2024-05-15T17:51:09.015 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-15T17:51:09.015 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} --archive /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331 --name cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi --verbose --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/orig.config.yaml 2024-05-15T17:51:09.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T17:51:09.127 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331 branch: wip-65996-squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7707331' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-65996-squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bbba46de2a13fb16c0e4bdf7e55e7284972cce5e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bbba46de2a13fb16c0e4bdf7e55e7284972cce5e rgw: ec-data-pool: false frontend: beast selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-65996-squid sha1: bbba46de2a13fb16c0e4bdf7e55e7284972cce5e owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 5575 sha1: bbba46de2a13fb16c0e4bdf7e55e7284972cce5e sleep_before_teardown: 0 suite: rgw suite_branch: wip-65996-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bbba46de2a13fb16c0e4bdf7e55e7284972cce5e targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYMn3SuJzZuNiTB7CRgxyRcR4h+aBOj2TzBe+sZPBD34qX7Mvmd0kC2hiY38nt7gXzuYpPpVX+goFuykWKeb8k= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPlEx610WxDZDU1EM7zvdsbMiu33EZCateP6pqehLeQ9KGtANaftcsvkv5lDOjdAo6CyodCH9bTTKKl+wPwXyYs= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-15_17:01:13 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-15T17:51:09.127 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/qa; will attempt to use it 2024-05-15T17:51:09.128 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/qa/tasks 2024-05-15T17:51:09.128 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-15T17:51:09.130 INFO:teuthology.task.internal:Checking packages... 2024-05-15T17:51:09.165 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e' 2024-05-15T17:51:09.165 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-15T17:51:09.166 INFO:teuthology.packaging:ref: None 2024-05-15T17:51:09.166 INFO:teuthology.packaging:tag: None 2024-05-15T17:51:09.166 INFO:teuthology.packaging:branch: wip-65996-squid 2024-05-15T17:51:09.166 INFO:teuthology.packaging:sha1: bbba46de2a13fb16c0e4bdf7e55e7284972cce5e 2024-05-15T17:51:09.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-65996-squid 2024-05-15T17:51:09.386 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2571.gbbba46de 2024-05-15T17:51:09.387 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-15T17:51:09.394 INFO:teuthology.task.internal:no buildpackages task found 2024-05-15T17:51:09.394 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-15T17:51:09.401 INFO:teuthology.task.internal:Saving configuration 2024-05-15T17:51:09.414 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-15T17:51:09.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T17:51:09.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 17:46:15.379657', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYMn3SuJzZuNiTB7CRgxyRcR4h+aBOj2TzBe+sZPBD34qX7Mvmd0kC2hiY38nt7gXzuYpPpVX+goFuykWKeb8k='} 2024-05-15T17:51:09.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 17:46:15.377767', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPlEx610WxDZDU1EM7zvdsbMiu33EZCateP6pqehLeQ9KGtANaftcsvkv5lDOjdAo6CyodCH9bTTKKl+wPwXyYs='} 2024-05-15T17:51:09.473 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-15T17:51:09.479 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-05-15T17:51:09.479 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-15T17:51:09.479 INFO:teuthology.run_tasks:Running task console_log... 2024-05-15T17:51:09.554 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2aa46370d0>, signals=[15]) 2024-05-15T17:51:09.554 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-15T17:51:09.561 INFO:teuthology.task.internal:Opening connections... 2024-05-15T17:51:09.561 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2024-05-15T17:51:09.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T17:51:09.645 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T17:51:09.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T17:51:09.735 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-15T17:51:09.742 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-05-15T17:51:09.761 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-05-15T17:51:09.761 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-05-15T17:51:09.819 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-05-15T17:51:09.819 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-05-15T17:51:09.819 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-05-15T17:51:09.821 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T17:51:09.822 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T17:51:09.822 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T17:51:09.822 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-05-15T17:51:09.846 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-05-15T17:51:09.864 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-05-15T17:51:09.864 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-05-15T17:51:09.921 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T17:51:09.922 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T17:51:09.923 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-05-15T17:51:09.947 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-15T17:51:09.956 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-15T17:51:09.961 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-15T17:51:09.962 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2024-05-15T17:51:09.964 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-05-15T17:51:09.980 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-15T17:51:09.986 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-15T17:51:09.986 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2024-05-15T17:51:10.022 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-05-15T17:51:10.214 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-15T17:51:10.272 INFO:teuthology.run_tasks:Running task kernel... 2024-05-15T17:51:10.287 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-15T17:51:10.287 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-15T17:51:10.287 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T17:51:10.288 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T17:51:10.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T17:51:10.304 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-05-15T17:51:10.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T17:51:10.305 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-05-15T17:51:10.361 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-437.el9.x86_64 2024-05-15T17:51:10.361 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.14.0-437.el9.x86_64 2024-05-15T17:51:10.362 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2024-05-15T17:51:10.364 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-437.el9.x86_64 2024-05-15T17:51:10.364 INFO:teuthology.task.kernel:Running kernel on smithi003: 5.14.0-437.el9.x86_64 2024-05-15T17:51:10.364 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2024-05-15T17:51:12.722 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.1 MB 00:00 2024-05-15T17:51:13.828 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.1 MB 00:01 2024-05-15T17:51:14.673 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-15T17:51:15.654 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-05-15T17:51:19.032 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-05-15T17:51:20.172 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.2 MB 00:00 2024-05-15T17:51:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-05-15T17:51:21.855 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-05-15T17:51:21.943 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-05-15T17:51:22.975 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-05-15T17:51:27.343 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-05-15T17:51:28.064 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-05-15T17:51:29.415 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-15T17:51:29.416 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-15T17:51:29.504 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T17:51:29.518 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T17:51:29.518 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-05-15T17:51:29.518 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T17:51:29.518 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T17:51:29.519 INFO:teuthology.orchestra.run.smithi003.stdout:Install 4 Packages 2024-05-15T17:51:29.520 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T17:51:29.521 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 78 M 2024-05-15T17:51:29.521 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 123 M 2024-05-15T17:51:29.521 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T17:51:29.977 INFO:teuthology.orchestra.run.smithi003.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 1.7 MB/s | 550 kB 00:00 2024-05-15T17:51:30.037 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-15T17:51:30.037 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-15T17:51:30.131 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T17:51:30.139 INFO:teuthology.orchestra.run.smithi173.stdout:Install 4 Packages 2024-05-15T17:51:30.140 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T17:51:30.140 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 78 M 2024-05-15T17:51:30.140 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 123 M 2024-05-15T17:51:30.140 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T17:51:30.516 INFO:teuthology.orchestra.run.smithi173.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 1.7 MB/s | 550 kB 00:00 2024-05-15T17:51:31.677 INFO:teuthology.orchestra.run.smithi003.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 7.7 MB/s | 15 MB 00:02 2024-05-15T17:51:32.252 INFO:teuthology.orchestra.run.smithi003.stdout:(3/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 13 MB/s | 34 MB 00:02 2024-05-15T17:51:32.553 INFO:teuthology.orchestra.run.smithi003.stdout:(4/4): kernel-modules-core-5.14.0-446.el9.x86_6 11 MB/s | 28 MB 00:02 2024-05-15T17:51:32.553 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T17:51:32.553 INFO:teuthology.orchestra.run.smithi003.stdout:Total 26 MB/s | 78 MB 00:03 2024-05-15T17:51:33.265 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T17:51:33.499 INFO:teuthology.orchestra.run.smithi173.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 4.7 MB/s | 15 MB 00:03 2024-05-15T17:51:33.672 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T17:51:33.672 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T17:51:34.627 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T17:51:34.627 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T17:51:35.274 INFO:teuthology.orchestra.run.smithi173.stdout:(3/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 6.7 MB/s | 34 MB 00:05 2024-05-15T17:51:36.958 INFO:teuthology.orchestra.run.smithi173.stdout:(4/4): kernel-modules-core-5.14.0-446.el9.x86_6 4.3 MB/s | 28 MB 00:06 2024-05-15T17:51:36.958 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T17:51:36.958 INFO:teuthology.orchestra.run.smithi173.stdout:Total 11 MB/s | 78 MB 00:06 2024-05-15T17:51:37.144 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T17:51:37.641 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T17:51:37.776 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-15T17:51:37.861 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T17:51:37.985 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T17:51:37.985 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T17:51:38.911 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T17:51:38.912 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T17:51:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T17:51:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T17:51:41.275 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T17:51:41.940 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-15T17:51:42.024 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T17:51:44.677 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T17:51:44.809 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T17:51:45.893 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T17:51:45.934 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:51:49.508 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T17:51:49.604 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:51:51.034 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:51:54.351 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:22.136 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:22.176 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-15T17:52:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T17:52:22.540 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T17:52:23.325 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T17:52:23.633 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T17:52:23.694 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:23.712 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T17:52:23.713 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T17:52:23.713 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-15T17:52:23.713 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-15T17:52:23.713 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-15T17:52:23.713 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-15T17:52:23.714 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2024-05-15T17:52:23.714 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T17:52:23.733 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:23.766 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T17:52:23.766 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T17:52:23.766 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2024-05-15T17:52:23.801 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2024-05-15T17:52:23.801 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2024-05-15T17:52:23.801 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.06 2024-05-15T17:52:23.801 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 68.el9 2024-05-15T17:52:23.801 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2024-05-15T17:52:23.801 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-15T17:52:23.801 INFO:teuthology.orchestra.run.smithi003.stdout:Group : Unspecified 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 8264254 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : builder@centos.org 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-15T17:52:23.802 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T17:52:23.803 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2024-05-15T17:52:23.804 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-15T17:52:23.805 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 5.14.0-446.el9.x86_64 2024-05-15T17:52:23.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-15T17:52:24.030 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:24.031 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-15T17:52:24.031 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T17:52:24.031 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T17:52:24.386 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2024-05-15T17:52:24.826 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T17:52:24.827 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T17:52:25.202 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T17:52:25.289 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T17:52:25.289 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T17:52:25.289 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-15T17:52:25.289 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-15T17:52:25.289 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-15T17:52:25.289 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-15T17:52:25.289 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-05-15T17:52:25.289 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T17:52:25.339 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T17:52:25.340 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T17:52:25.340 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.06 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 68.el9 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Group : Unspecified 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 8264254 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2024-05-15T17:52:25.370 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : builder@centos.org 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T17:52:25.371 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2024-05-15T17:52:25.372 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-15T17:52:25.372 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 5.14.0-446.el9.x86_64 2024-05-15T17:52:25.372 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-15T17:52:25.838 INFO:teuthology.orchestra.run.smithi003.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-15T17:52:25.855 INFO:teuthology.orchestra.run.smithi003.stderr:done 2024-05-15T17:52:25.857 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2024-05-15T17:52:25.873 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.7U8Z4mMCN2 2024-05-15T17:52:25.873 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7U8Z4mMCN2 2024-05-15T17:52:25.940 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.7U8Z4mMCN2 2024-05-15T17:52:25.963 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-05-15T17:52:26.083 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.7U8Z4mMCN2 is 6KB 2024-05-15T17:52:26.134 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.7U8Z4mMCN2 2024-05-15T17:52:26.149 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2024-05-15T17:52:26.210 INFO:teuthology.orchestra.run.smithi003.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-15T17:52:26.210 INFO:teuthology.orchestra.run.smithi003.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-15T17:52:26.211 INFO:teuthology.orchestra.run.smithi003.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-15T17:52:26.211 INFO:teuthology.orchestra.run.smithi003.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-15T17:52:26.212 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-15T17:52:26.353 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2024-05-15T17:52:27.318 INFO:teuthology.orchestra.run.smithi173.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-15T17:52:27.353 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-05-15T17:52:27.355 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-05-15T17:52:27.370 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.GwXTDMXTHN 2024-05-15T17:52:27.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GwXTDMXTHN 2024-05-15T17:52:27.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.GwXTDMXTHN 2024-05-15T17:52:27.573 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.GwXTDMXTHN is 6KB 2024-05-15T17:52:27.622 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.GwXTDMXTHN 2024-05-15T17:52:27.636 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2024-05-15T17:52:27.704 INFO:teuthology.orchestra.run.smithi173.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-15T17:52:27.704 INFO:teuthology.orchestra.run.smithi173.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-15T17:52:27.704 INFO:teuthology.orchestra.run.smithi173.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-15T17:52:27.704 INFO:teuthology.orchestra.run.smithi173.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-15T17:52:27.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-15T17:52:27.847 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-05-15T17:52:56.386 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-15T17:52:56.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-05-15T17:52:56.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T17:52:57.852 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-15T17:52:57.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-05-15T17:52:57.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T17:53:56.447 DEBUG:teuthology.orchestra.remote:timed out 2024-05-15T17:53:57.856 DEBUG:teuthology.orchestra.remote:timed out 2024-05-15T17:54:05.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-05-15T17:54:05.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T17:54:05.927 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-05-15T17:54:06.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-05-15T17:54:06.370 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-446.el9.x86_64"... 2024-05-15T17:54:06.370 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-05-15T17:54:06.385 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-446.el9.x86_64 2024-05-15T17:54:06.386 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-15T17:54:06.386 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-15T17:54:06.386 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-15T17:54:06.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-05-15T17:54:06.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T17:54:07.380 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-05-15T17:54:07.386 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-15T17:54:07.387 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-15T17:54:07.486 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2024-05-15T17:54:07.530 DEBUG:teuthology.parallel:result is None 2024-05-15T17:54:07.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-05-15T17:54:07.770 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-446.el9.x86_64"... 2024-05-15T17:54:07.770 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-05-15T17:54:07.784 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-446.el9.x86_64 2024-05-15T17:54:07.784 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-15T17:54:07.784 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-15T17:54:07.784 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-15T17:54:08.785 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-15T17:54:08.786 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-15T17:54:08.849 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-05-15T17:54:08.888 DEBUG:teuthology.parallel:result is None 2024-05-15T17:54:08.889 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-15T17:54:08.896 INFO:teuthology.task.internal:Creating test directory... 2024-05-15T17:54:08.897 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T17:54:08.899 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T17:54:08.913 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-15T17:54:08.920 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-15T17:54:08.931 INFO:teuthology.task.internal:Creating archive directory... 2024-05-15T17:54:08.931 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T17:54:08.959 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T17:54:09.001 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-15T17:54:09.007 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-15T17:54:09.007 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T17:54:09.034 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T17:54:09.074 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T17:54:09.085 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T17:54:09.095 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T17:54:09.105 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T17:54:09.107 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-15T17:54:09.114 INFO:teuthology.task.internal:Configuring sudo... 2024-05-15T17:54:09.115 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T17:54:09.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T17:54:09.158 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-15T17:54:09.167 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-15T17:54:09.168 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T17:54:09.203 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T17:54:09.217 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T17:54:09.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T17:54:09.347 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T17:54:09.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T17:54:09.479 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T17:54:09.480 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T17:54:09.550 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T17:54:09.592 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T17:54:09.630 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T17:54:09.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T17:54:09.746 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T17:54:09.746 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T17:54:09.808 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2024-05-15T17:54:09.811 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-05-15T17:54:09.856 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T17:54:09.940 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T17:54:10.409 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-15T17:54:10.417 INFO:teuthology.task.internal:Starting timer... 2024-05-15T17:54:10.417 INFO:teuthology.run_tasks:Running task pcp... 2024-05-15T17:54:10.427 INFO:teuthology.run_tasks:Running task selinux... 2024-05-15T17:54:10.435 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-15T17:54:10.435 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2024-05-15T17:54:10.506 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: 2024-05-15T17:54:10.508 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-05-15T17:54:10.598 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-05-15T17:54:10.600 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-15T17:54:10.600 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2024-05-15T17:54:10.625 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2024-05-15T17:54:10.625 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-05-15T17:54:10.657 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-05-15T17:54:10.657 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-05-15T17:54:10.657 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T17:54:10.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T17:54:10.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T17:54:10.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T17:54:10.721 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-15T17:54:10.721 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2024-05-15T17:54:10.768 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-05-15T17:54:10.793 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-15T17:54:10.803 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-15T17:54:10.808 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-15T17:54:10.933 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-15T17:54:10.949 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-15T17:54:10.950 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-15T18:05:18.123 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-05-15T18:05:18.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-05-15T18:05:18.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T18:05:18.207 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-05-15T18:05:18.287 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-05-15T18:05:18.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-05-15T18:05:18.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T18:05:18.363 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-05-15T18:05:18.442 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-05-15T18:05:18.442 INFO:teuthology.run_tasks:Running task clock... 2024-05-15T18:05:18.453 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-15T18:05:18.454 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T18:05:18.454 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T18:05:18.457 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T18:05:18.457 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T18:05:18.489 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T18:05:18.505 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T18:05:18.514 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T18:05:18.529 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T18:05:18.532 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2024-05-15T18:05:18.545 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2024-05-15T18:05:18.555 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-05-15T18:05:18.560 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T18:05:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-05-15T18:05:18.575 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T18:05:18.580 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T18:05:18.594 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T18:05:18.640 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-05-15T18:05:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T18:05:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-05-15T18:05:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.644 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.650 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-05-15T18:05:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T18:05:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-05-15T18:05:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:05:18.654 INFO:teuthology.run_tasks:Running task install... 2024-05-15T18:05:18.663 DEBUG:teuthology.task.install:project ceph 2024-05-15T18:05:18.663 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e'}} 2024-05-15T18:05:18.663 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e'} 2024-05-15T18:05:18.663 INFO:teuthology.task.install:Using flavor: default 2024-05-15T18:05:18.669 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-15T18:05:18.669 INFO:teuthology.task.install:extra packages: [] 2024-05-15T18:05:18.670 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e', 'tag': None, 'wait_for_package': False} 2024-05-15T18:05:18.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bbba46de2a13fb16c0e4bdf7e55e7284972cce5e 2024-05-15T18:05:18.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e', 'tag': None, 'wait_for_package': False} 2024-05-15T18:05:18.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bbba46de2a13fb16c0e4bdf7e55e7284972cce5e 2024-05-15T18:05:18.902 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/ 2024-05-15T18:05:18.903 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2571.gbbba46de 2024-05-15T18:05:18.907 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/ 2024-05-15T18:05:18.907 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2571.gbbba46de 2024-05-15T18:05:19.015 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T18:05:19.015 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:05:19.015 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T18:05:19.023 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-65996-squid/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T18:05:19.023 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:05:19.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T18:05:19.043 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-15T18:05:19.043 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T18:05:19.053 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-15T18:05:19.053 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T18:05:19.110 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T18:05:19.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T18:05:19.185 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T18:05:19.202 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T18:05:19.250 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-05-15T18:05:19.252 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-05-15T18:05:19.268 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2024-05-15T18:05:19.270 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2024-05-15T18:05:19.491 INFO:teuthology.orchestra.run.smithi173.stdout:57 files removed 2024-05-15T18:05:19.517 INFO:teuthology.orchestra.run.smithi003.stdout:57 files removed 2024-05-15T18:05:19.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw 2024-05-15T18:05:19.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw 2024-05-15T18:05:20.150 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 262 kB/s | 83 kB 00:00 2024-05-15T18:05:20.255 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 179 kB/s | 83 kB 00:00 2024-05-15T18:05:20.584 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-05-15T18:05:20.631 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-05-15T18:05:20.926 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 6.3 kB/s | 1.9 kB 00:00 2024-05-15T18:05:21.057 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-15T18:05:21.676 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-15T18:05:21.815 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-15T18:05:23.577 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-05-15T18:05:27.762 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-15T18:05:29.438 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-05-15T18:05:30.514 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-05-15T18:05:35.839 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-15T18:05:38.308 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:05:38.316 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:05:38.316 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:05:38.316 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:05:38.316 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:05:38.316 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 10 M 2024-05-15T18:05:38.316 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2024-05-15T18:05:38.316 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 3.4 M 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 3.1 M 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 5.4 M 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 21 M 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 25 k 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 746 k 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T18:05:38.317 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 501 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 5.3 M 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 45 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 135 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 161 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 320 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 300 k 2024-05-15T18:05:38.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 99 k 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout:Install 30 Packages 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 2 Packages 2024-05-15T18:05:38.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:05:38.320 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 60 M 2024-05-15T18:05:38.320 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:05:38.847 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-05-15T18:05:39.523 INFO:teuthology.orchestra.run.smithi003.stdout:(1/32): ceph-base-19.0.0-2571.gbbba46de.el9.x86 7.5 MB/s | 5.4 MB 00:00 2024-05-15T18:05:39.573 INFO:teuthology.orchestra.run.smithi003.stdout:(2/32): ceph-selinux-19.0.0-2571.gbbba46de.el9. 504 kB/s | 25 kB 00:00 2024-05-15T18:05:39.690 INFO:teuthology.orchestra.run.smithi003.stdout:(3/32): libcephfs2-19.0.0-2571.gbbba46de.el9.x8 6.2 MB/s | 746 kB 00:00 2024-05-15T18:05:39.799 INFO:teuthology.orchestra.run.smithi003.stdout:(4/32): ceph-radosgw-19.0.0-2571.gbbba46de.el9. 10 MB/s | 10 MB 00:00 2024-05-15T18:05:39.824 INFO:teuthology.orchestra.run.smithi003.stdout:(5/32): libradosstriper1-19.0.0-2571.gbbba46de. 3.7 MB/s | 501 kB 00:00 2024-05-15T18:05:39.883 INFO:teuthology.orchestra.run.smithi003.stdout:(6/32): python3-ceph-argparse-19.0.0-2571.gbbba 776 kB/s | 45 kB 00:00 2024-05-15T18:05:39.958 INFO:teuthology.orchestra.run.smithi003.stdout:(7/32): python3-ceph-common-19.0.0-2571.gbbba46 1.8 MB/s | 135 kB 00:00 2024-05-15T18:05:40.033 INFO:teuthology.orchestra.run.smithi003.stdout:(8/32): python3-cephfs-19.0.0-2571.gbbba46de.el 2.1 MB/s | 161 kB 00:00 2024-05-15T18:05:40.109 INFO:teuthology.orchestra.run.smithi003.stdout:(9/32): librgw2-19.0.0-2571.gbbba46de.el9.x86_6 17 MB/s | 5.3 MB 00:00 2024-05-15T18:05:40.134 INFO:teuthology.orchestra.run.smithi003.stdout:(10/32): python3-rados-19.0.0-2571.gbbba46de.el 3.1 MB/s | 320 kB 00:00 2024-05-15T18:05:40.168 INFO:teuthology.orchestra.run.smithi003.stdout:(11/32): python3-rbd-19.0.0-2571.gbbba46de.el9. 5.0 MB/s | 300 kB 00:00 2024-05-15T18:05:40.193 INFO:teuthology.orchestra.run.smithi003.stdout:(12/32): python3-rgw-19.0.0-2571.gbbba46de.el9. 1.7 MB/s | 99 kB 00:00 2024-05-15T18:05:40.260 INFO:teuthology.orchestra.run.smithi003.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 1.1 MB/s | 107 kB 00:00 2024-05-15T18:05:40.285 INFO:teuthology.orchestra.run.smithi003.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-05-15T18:05:40.336 INFO:teuthology.orchestra.run.smithi003.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-05-15T18:05:40.394 INFO:teuthology.orchestra.run.smithi003.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-15T18:05:40.428 INFO:teuthology.orchestra.run.smithi003.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-15T18:05:40.453 INFO:teuthology.orchestra.run.smithi003.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 719 kB/s | 42 kB 00:00 2024-05-15T18:05:40.504 INFO:teuthology.orchestra.run.smithi003.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 720 kB/s | 36 kB 00:00 2024-05-15T18:05:40.529 INFO:teuthology.orchestra.run.smithi003.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-05-15T18:05:40.579 INFO:teuthology.orchestra.run.smithi003.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-05-15T18:05:40.821 INFO:teuthology.orchestra.run.smithi003.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.0 MB/s | 309 kB 00:00 2024-05-15T18:05:40.880 INFO:teuthology.orchestra.run.smithi003.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 448 kB/s | 26 kB 00:00 2024-05-15T18:05:40.947 INFO:teuthology.orchestra.run.smithi003.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 728 kB/s | 49 kB 00:00 2024-05-15T18:05:41.005 INFO:teuthology.orchestra.run.smithi003.stdout:(25/32): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-05-15T18:05:41.031 INFO:teuthology.orchestra.run.smithi003.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2024-05-15T18:05:41.089 INFO:teuthology.orchestra.run.smithi003.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-05-15T18:05:41.114 INFO:teuthology.orchestra.run.smithi003.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-05-15T18:05:41.173 INFO:teuthology.orchestra.run.smithi003.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-05-15T18:05:41.466 INFO:teuthology.orchestra.run.smithi003.stdout:(30/32): librados2-19.0.0-2571.gbbba46de.el9.x8 9.7 MB/s | 3.4 MB 00:00 2024-05-15T18:05:41.524 INFO:teuthology.orchestra.run.smithi003.stdout:(31/32): librbd1-19.0.0-2571.gbbba46de.el9.x86_ 9.0 MB/s | 3.1 MB 00:00 2024-05-15T18:05:43.323 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.2 MB 00:00 2024-05-15T18:05:43.532 INFO:teuthology.orchestra.run.smithi003.stdout:(32/32): ceph-common-19.0.0-2571.gbbba46de.el9. 4.4 MB/s | 21 MB 00:04 2024-05-15T18:05:43.535 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:05:43.536 INFO:teuthology.orchestra.run.smithi003.stdout:Total 11 MB/s | 60 MB 00:05 2024-05-15T18:05:43.647 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:05:43.688 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:05:43.688 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:05:44.339 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:05:44.339 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:05:44.882 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 16 kB 00:00 2024-05-15T18:05:45.879 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:05:45.958 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-15T18:05:45.987 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-15T18:05:46.020 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-15T18:05:46.044 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T18:05:46.071 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T18:05:46.225 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-15T18:05:46.238 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T18:05:46.309 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T18:05:46.804 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-15T18:05:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 7/34 2024-05-15T18:05:46.948 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 7/34 2024-05-15T18:05:47.038 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 8/34 2024-05-15T18:05:47.074 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 9/34 2024-05-15T18:05:47.128 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 9/34 2024-05-15T18:05:47.157 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-15T18:05:47.201 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:19.0.0-2571.gbbba46de.el9. 11/34 2024-05-15T18:05:47.270 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 12/34 2024-05-15T18:05:47.292 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_6 13/34 2024-05-15T18:05:47.365 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_6 13/34 2024-05-15T18:05:47.400 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-15T18:05:47.519 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-15T18:05:47.551 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-15T18:05:47.593 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-15T18:05:47.624 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-15T18:05:47.653 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-15T18:05:47.686 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-15T18:05:48.015 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-15T18:05:48.124 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 22/34 2024-05-15T18:05:48.207 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 22/34 2024-05-15T18:05:48.237 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 23/34 2024-05-15T18:05:48.273 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-15T18:05:48.777 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-15T18:05:48.810 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 26/34 2024-05-15T18:05:48.873 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 26/34 2024-05-15T18:05:48.954 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 27/34 2024-05-15T18:05:48.996 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:19.0.0-2571.gbbba46de.el9.x8 28/34 2024-05-15T18:05:51.384 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-15T18:05:51.390 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 29/34 2024-05-15T18:05:51.470 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 29/34 2024-05-15T18:05:52.047 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 29/34 2024-05-15T18:05:52.113 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 30/34 2024-05-15T18:05:52.206 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 30/34 2024-05-15T18:05:52.206 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T18:05:52.206 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T18:05:52.206 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:05:52.239 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 31/34 2024-05-15T18:05:53.707 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 10 M 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 3.4 M 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 3.1 M 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 5.4 M 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 21 M 2024-05-15T18:05:53.720 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 25 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 746 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 501 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 5.3 M 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T18:05:53.721 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 45 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 135 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 161 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 320 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 300 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 99 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:05:53.722 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:05:53.723 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:05:53.723 INFO:teuthology.orchestra.run.smithi173.stdout:Install 30 Packages 2024-05-15T18:05:53.723 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 2 Packages 2024-05-15T18:05:53.723 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:05:53.723 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 60 M 2024-05-15T18:05:53.723 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:05:56.276 INFO:teuthology.orchestra.run.smithi173.stdout:(1/32): ceph-base-19.0.0-2571.gbbba46de.el9.x86 2.4 MB/s | 5.4 MB 00:02 2024-05-15T18:05:56.377 INFO:teuthology.orchestra.run.smithi173.stdout:(2/32): ceph-radosgw-19.0.0-2571.gbbba46de.el9. 4.4 MB/s | 10 MB 00:02 2024-05-15T18:05:56.393 INFO:teuthology.orchestra.run.smithi173.stdout:(3/32): ceph-selinux-19.0.0-2571.gbbba46de.el9. 216 kB/s | 25 kB 00:00 2024-05-15T18:05:56.535 INFO:teuthology.orchestra.run.smithi173.stdout:(4/32): libcephfs2-19.0.0-2571.gbbba46de.el9.x8 4.6 MB/s | 746 kB 00:00 2024-05-15T18:05:56.560 INFO:teuthology.orchestra.run.smithi173.stdout:(5/32): libradosstriper1-19.0.0-2571.gbbba46de. 2.9 MB/s | 501 kB 00:00 2024-05-15T18:05:56.644 INFO:teuthology.orchestra.run.smithi173.stdout:(6/32): python3-ceph-argparse-19.0.0-2571.gbbba 539 kB/s | 45 kB 00:00 2024-05-15T18:05:56.736 INFO:teuthology.orchestra.run.smithi173.stdout:(7/32): python3-ceph-common-19.0.0-2571.gbbba46 1.4 MB/s | 135 kB 00:00 2024-05-15T18:05:56.820 INFO:teuthology.orchestra.run.smithi173.stdout:(8/32): python3-cephfs-19.0.0-2571.gbbba46de.el 1.9 MB/s | 161 kB 00:00 2024-05-15T18:05:56.913 INFO:teuthology.orchestra.run.smithi173.stdout:(9/32): python3-rados-19.0.0-2571.gbbba46de.el9 3.4 MB/s | 320 kB 00:00 2024-05-15T18:05:57.012 INFO:teuthology.orchestra.run.smithi173.stdout:(10/32): python3-rbd-19.0.0-2571.gbbba46de.el9. 2.9 MB/s | 300 kB 00:00 2024-05-15T18:05:57.105 INFO:teuthology.orchestra.run.smithi173.stdout:(11/32): python3-rgw-19.0.0-2571.gbbba46de.el9. 1.1 MB/s | 99 kB 00:00 2024-05-15T18:05:57.380 INFO:teuthology.orchestra.run.smithi173.stdout:(12/32): librgw2-19.0.0-2571.gbbba46de.el9.x86_ 6.3 MB/s | 5.3 MB 00:00 2024-05-15T18:05:58.163 INFO:teuthology.orchestra.run.smithi173.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 101 kB/s | 107 kB 00:01 2024-05-15T18:05:58.430 INFO:teuthology.orchestra.run.smithi173.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 153 kB/s | 160 kB 00:01 2024-05-15T18:05:58.888 INFO:teuthology.orchestra.run.smithi173.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 62 kB/s | 45 kB 00:00 2024-05-15T18:05:59.389 INFO:teuthology.orchestra.run.smithi173.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 691 kB/s | 662 kB 00:00 2024-05-15T18:05:59.739 INFO:teuthology.orchestra.run.smithi173.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 344 kB/s | 292 kB 00:00 2024-05-15T18:06:00.039 INFO:teuthology.orchestra.run.smithi173.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 65 kB/s | 42 kB 00:00 2024-05-15T18:06:00.540 INFO:teuthology.orchestra.run.smithi173.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 276 kB/s | 221 kB 00:00 2024-05-15T18:06:00.640 INFO:teuthology.orchestra.run.smithi173.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 60 kB/s | 36 kB 00:00 2024-05-15T18:06:00.815 INFO:teuthology.orchestra.run.smithi173.stdout:(21/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.7 MB/s | 309 kB 00:00 2024-05-15T18:06:01.040 INFO:teuthology.orchestra.run.smithi173.stdout:(22/32): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-05-15T18:06:01.082 INFO:teuthology.orchestra.run.smithi173.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 630 kB/s | 26 kB 00:00 2024-05-15T18:06:01.124 INFO:teuthology.orchestra.run.smithi173.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-05-15T18:06:01.158 INFO:teuthology.orchestra.run.smithi173.stdout:(25/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-05-15T18:06:01.174 INFO:teuthology.orchestra.run.smithi173.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-15T18:06:01.217 INFO:teuthology.orchestra.run.smithi173.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-05-15T18:06:01.300 INFO:teuthology.orchestra.run.smithi173.stdout:(28/32): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-05-15T18:06:01.342 INFO:teuthology.orchestra.run.smithi173.stdout:(29/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-05-15T18:06:02.362 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 31/34 2024-05-15T18:06:02.362 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2024-05-15T18:06:02.362 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2024-05-15T18:06:02.362 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2024-05-15T18:06:02.363 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2024-05-15T18:06:02.363 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2024-05-15T18:06:02.363 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /root 2024-05-15T18:06:02.363 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2024-05-15T18:06:02.363 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:02.392 INFO:teuthology.orchestra.run.smithi173.stdout:(30/32): librados2-19.0.0-2571.gbbba46de.el9.x8 3.1 MB/s | 3.4 MB 00:01 2024-05-15T18:06:02.542 INFO:teuthology.orchestra.run.smithi173.stdout:(31/32): librbd1-19.0.0-2571.gbbba46de.el9.x86_ 2.6 MB/s | 3.1 MB 00:01 2024-05-15T18:06:03.341 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 32/34 2024-05-15T18:06:03.368 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 32/34 2024-05-15T18:06:03.368 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:03.368 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T18:06:03.369 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T18:06:03.369 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T18:06:03.369 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:03.370 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T18:06:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T18:06:03.452 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 1/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 2/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 3/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 4/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 5/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_6 6/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 7/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2571.gbbba46de.el9. 8/34 2024-05-15T18:06:04.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:19.0.0-2571.gbbba46de.el9.x8 9/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 10/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 11/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 12/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 13/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-15T18:06:04.612 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 31/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-15T18:06:04.613 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 33/34 2024-05-15T18:06:04.667 INFO:teuthology.orchestra.run.smithi173.stdout:(32/32): ceph-common-19.0.0-2571.gbbba46de.el9. 2.0 MB/s | 21 MB 00:10 2024-05-15T18:06:04.671 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:04.671 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.5 MB/s | 60 MB 00:10 2024-05-15T18:06:04.769 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:06:04.805 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:06:04.805 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:06:05.420 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:06:05.421 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:06:05.521 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T18:06:05.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:05.521 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2024-05-15T18:06:05.521 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.521 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.521 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.522 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T18:06:05.523 INFO:teuthology.orchestra.run.smithi003.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T18:06:05.524 INFO:teuthology.orchestra.run.smithi003.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T18:06:05.524 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:05.524 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:05.885 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-test 2024-05-15T18:06:06.487 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:31 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:06.613 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 48 M 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 163 k 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T18:06:06.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:06.615 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:06:06.615 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:06.615 INFO:teuthology.orchestra.run.smithi003.stdout:Install 4 Packages 2024-05-15T18:06:06.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:06.615 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 49 M 2024-05-15T18:06:06.615 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 207 M 2024-05-15T18:06:06.615 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:06:06.849 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:06:06.907 INFO:teuthology.orchestra.run.smithi003.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 305 kB 00:00 2024-05-15T18:06:06.930 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-15T18:06:06.948 INFO:teuthology.orchestra.run.smithi003.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-05-15T18:06:06.956 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-15T18:06:06.981 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-15T18:06:07.004 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T18:06:07.024 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-15T18:06:07.149 INFO:teuthology.orchestra.run.smithi003.stdout:(3/4): libcephsqlite-19.0.0-2571.gbbba46de.el9. 406 kB/s | 163 kB 00:00 2024-05-15T18:06:07.224 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T18:06:07.277 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-15T18:06:07.681 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-15T18:06:07.733 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 7/34 2024-05-15T18:06:07.825 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 7/34 2024-05-15T18:06:07.914 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 8/34 2024-05-15T18:06:07.943 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 9/34 2024-05-15T18:06:08.006 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 9/34 2024-05-15T18:06:08.035 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-15T18:06:08.079 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:19.0.0-2571.gbbba46de.el9. 11/34 2024-05-15T18:06:08.149 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 12/34 2024-05-15T18:06:08.171 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_6 13/34 2024-05-15T18:06:08.236 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_6 13/34 2024-05-15T18:06:08.271 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-15T18:06:08.382 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-15T18:06:08.414 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-15T18:06:08.455 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-15T18:06:08.487 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-15T18:06:08.516 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-15T18:06:08.549 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-15T18:06:08.861 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-15T18:06:08.903 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 22/34 2024-05-15T18:06:08.993 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 22/34 2024-05-15T18:06:09.025 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 23/34 2024-05-15T18:06:09.060 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-15T18:06:09.358 INFO:teuthology.orchestra.run.smithi003.stdout:(4/4): ceph-test-19.0.0-2571.gbbba46de.el9.x86_ 18 MB/s | 48 MB 00:02 2024-05-15T18:06:09.359 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:09.360 INFO:teuthology.orchestra.run.smithi003.stdout:Total 18 MB/s | 49 MB 00:02 2024-05-15T18:06:09.389 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:06:09.411 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:06:09.411 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:06:09.532 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-15T18:06:09.564 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 26/34 2024-05-15T18:06:09.642 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 26/34 2024-05-15T18:06:09.712 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 27/34 2024-05-15T18:06:09.741 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:19.0.0-2571.gbbba46de.el9.x8 28/34 2024-05-15T18:06:09.797 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:06:09.798 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:06:10.346 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:06:10.418 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-15T18:06:10.457 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-15T18:06:10.484 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 3/4 2024-05-15T18:06:11.987 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 29/34 2024-05-15T18:06:12.038 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 29/34 2024-05-15T18:06:12.647 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 29/34 2024-05-15T18:06:12.683 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 30/34 2024-05-15T18:06:12.771 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 30/34 2024-05-15T18:06:12.772 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T18:06:12.772 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T18:06:12.772 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:12.993 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 31/34 2024-05-15T18:06:15.329 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 3/4 2024-05-15T18:06:15.419 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 4/4 2024-05-15T18:06:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 4/4 2024-05-15T18:06:17.749 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 1/4 2024-05-15T18:06:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 2/4 2024-05-15T18:06:17.750 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:18.020 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:18.352 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph 2024-05-15T18:06:18.948 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:43 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:19.079 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:19.081 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:19.081 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:06:19.081 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 6.6 k 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 2.4 M 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 1.5 M 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 249 k 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 4.7 M 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 17 M 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T18:06:19.082 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T18:06:19.083 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:06:19.084 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:19.085 INFO:teuthology.orchestra.run.smithi003.stdout:Install 36 Packages 2024-05-15T18:06:19.085 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:19.085 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 30 M 2024-05-15T18:06:19.085 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 107 M 2024-05-15T18:06:19.085 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:06:19.969 INFO:teuthology.orchestra.run.smithi003.stdout:(1/36): ceph-19.0.0-2571.gbbba46de.el9.x86_64.r 36 kB/s | 6.6 kB 00:00 2024-05-15T18:06:20.236 INFO:teuthology.orchestra.run.smithi003.stdout:(2/36): ceph-mgr-19.0.0-2571.gbbba46de.el9.x86_ 3.3 MB/s | 1.5 MB 00:00 2024-05-15T18:06:20.503 INFO:teuthology.orchestra.run.smithi003.stdout:(3/36): ceph-mds-19.0.0-2571.gbbba46de.el9.x86_ 3.3 MB/s | 2.4 MB 00:00 2024-05-15T18:06:20.578 INFO:teuthology.orchestra.run.smithi003.stdout:(4/36): ceph-mon-19.0.0-2571.gbbba46de.el9.x86_ 7.7 MB/s | 4.7 MB 00:00 2024-05-15T18:06:20.603 INFO:teuthology.orchestra.run.smithi003.stdout:(5/36): ceph-mgr-modules-core-19.0.0-2571.gbbba 2.4 MB/s | 249 kB 00:00 2024-05-15T18:06:20.687 INFO:teuthology.orchestra.run.smithi003.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-05-15T18:06:20.737 INFO:teuthology.orchestra.run.smithi003.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 9.2 MB/s | 1.2 MB 00:00 2024-05-15T18:06:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:(8/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-05-15T18:06:20.830 INFO:teuthology.orchestra.run.smithi003.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.4 MB/s | 135 kB 00:00 2024-05-15T18:06:20.863 INFO:teuthology.orchestra.run.smithi003.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 125 kB 00:00 2024-05-15T18:06:20.913 INFO:teuthology.orchestra.run.smithi003.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-05-15T18:06:20.972 INFO:teuthology.orchestra.run.smithi003.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-15T18:06:21.014 INFO:teuthology.orchestra.run.smithi003.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 833 kB/s | 35 kB 00:00 2024-05-15T18:06:21.039 INFO:teuthology.orchestra.run.smithi003.stdout:(14/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-05-15T18:06:21.064 INFO:teuthology.orchestra.run.smithi003.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-15T18:06:21.090 INFO:teuthology.orchestra.run.smithi003.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-05-15T18:06:21.132 INFO:teuthology.orchestra.run.smithi003.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 332 kB/s | 22 kB 00:00 2024-05-15T18:06:21.307 INFO:teuthology.orchestra.run.smithi003.stdout:(18/36): ceph-osd-19.0.0-2571.gbbba46de.el9.x86 16 MB/s | 17 MB 00:01 2024-05-15T18:06:21.566 INFO:teuthology.orchestra.run.smithi003.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 100 kB/s | 43 kB 00:00 2024-05-15T18:06:21.649 INFO:teuthology.orchestra.run.smithi003.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 270 kB/s | 151 kB 00:00 2024-05-15T18:06:21.774 INFO:teuthology.orchestra.run.smithi003.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 368 kB/s | 172 kB 00:00 2024-05-15T18:06:21.800 INFO:teuthology.orchestra.run.smithi003.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 71 kB/s | 11 kB 00:00 2024-05-15T18:06:21.867 INFO:teuthology.orchestra.run.smithi003.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2024-05-15T18:06:21.900 INFO:teuthology.orchestra.run.smithi003.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2024-05-15T18:06:21.926 INFO:teuthology.orchestra.run.smithi003.stdout:(25/36): python3-cherrypy-18.6.1-2.el9.noarch.r 996 kB/s | 358 kB 00:00 2024-05-15T18:06:21.959 INFO:teuthology.orchestra.run.smithi003.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 210 kB/s | 19 kB 00:00 2024-05-15T18:06:21.993 INFO:teuthology.orchestra.run.smithi003.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 213 kB/s | 20 kB 00:00 2024-05-15T18:06:22.043 INFO:teuthology.orchestra.run.smithi003.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 394 kB/s | 46 kB 00:00 2024-05-15T18:06:22.068 INFO:teuthology.orchestra.run.smithi003.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 724 kB/s | 79 kB 00:00 2024-05-15T18:06:22.152 INFO:teuthology.orchestra.run.smithi003.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-05-15T18:06:22.211 INFO:teuthology.orchestra.run.smithi003.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 634 kB/s | 90 kB 00:00 2024-05-15T18:06:22.236 INFO:teuthology.orchestra.run.smithi003.stdout:(32/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-05-15T18:06:22.261 INFO:teuthology.orchestra.run.smithi003.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 329 kB/s | 36 kB 00:00 2024-05-15T18:06:22.353 INFO:teuthology.orchestra.run.smithi003.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 218 kB/s | 20 kB 00:00 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 31/34 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-05-15T18:06:22.424 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:22.437 INFO:teuthology.orchestra.run.smithi003.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-05-15T18:06:22.520 INFO:teuthology.orchestra.run.smithi003.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.5 MB/s | 427 kB 00:00 2024-05-15T18:06:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:22.523 INFO:teuthology.orchestra.run.smithi003.stdout:Total 8.8 MB/s | 30 MB 00:03 2024-05-15T18:06:22.670 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:06:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:06:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:06:23.166 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:06:23.167 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:06:23.378 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 32/34 2024-05-15T18:06:23.403 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 32/34 2024-05-15T18:06:23.403 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:23.403 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T18:06:23.403 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T18:06:23.403 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T18:06:23.403 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:23.405 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T18:06:23.490 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-15T18:06:23.490 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T18:06:24.456 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:06:24.515 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-15T18:06:24.555 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-15T18:06:24.584 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-15T18:06:24.624 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T18:06:24.624 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 1/34 2024-05-15T18:06:24.624 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 2/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 3/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 4/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 5/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_6 6/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 7/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2571.gbbba46de.el9. 8/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:19.0.0-2571.gbbba46de.el9.x8 9/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 10/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 11/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 12/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 13/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-15T18:06:24.625 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-15T18:06:24.626 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 31/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-15T18:06:24.628 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 33/34 2024-05-15T18:06:24.661 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-15T18:06:24.700 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-15T18:06:24.733 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-15T18:06:24.831 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-15T18:06:24.915 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-15T18:06:24.962 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-15T18:06:24.996 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-15T18:06:25.026 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-15T18:06:25.060 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-15T18:06:25.093 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-15T18:06:25.134 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-15T18:06:25.178 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-15T18:06:25.211 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-15T18:06:25.250 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-15T18:06:25.328 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-15T18:06:25.482 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-15T18:06:25.528 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T18:06:25.529 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.530 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:25.531 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:06:25.562 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-15T18:06:25.621 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-15T18:06:25.659 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-15T18:06:25.717 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-15T18:06:25.781 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-15T18:06:25.887 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test 2024-05-15T18:06:25.981 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-15T18:06:26.029 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-15T18:06:26.112 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-15T18:06:26.210 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-15T18:06:26.253 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-15T18:06:26.378 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-15T18:06:26.469 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:35 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:06:26.550 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2571.gbbba46de.el9. 31/36 2024-05-15T18:06:26.579 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 32/36 2024-05-15T18:06:26.589 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 48 M 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 163 k 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T18:06:26.590 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:26.591 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:06:26.591 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:26.591 INFO:teuthology.orchestra.run.smithi173.stdout:Install 4 Packages 2024-05-15T18:06:26.591 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:26.591 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 49 M 2024-05-15T18:06:26.591 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 207 M 2024-05-15T18:06:26.591 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:06:26.607 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 32/36 2024-05-15T18:06:26.608 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:26.608 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T18:06:26.608 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T18:06:26.608 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T18:06:26.608 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:27.027 INFO:teuthology.orchestra.run.smithi173.stdout:(1/4): libcephsqlite-19.0.0-2571.gbbba46de.el9. 446 kB/s | 163 kB 00:00 2024-05-15T18:06:27.252 INFO:teuthology.orchestra.run.smithi173.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 515 kB/s | 305 kB 00:00 2024-05-15T18:06:27.385 INFO:teuthology.orchestra.run.smithi173.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 178 kB/s | 64 kB 00:00 2024-05-15T18:06:28.130 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 33/36 2024-05-15T18:06:28.159 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 33/36 2024-05-15T18:06:28.159 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:28.159 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T18:06:28.159 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T18:06:28.159 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T18:06:28.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:28.631 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 34/36 2024-05-15T18:06:28.656 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 34/36 2024-05-15T18:06:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T18:06:28.656 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T18:06:28.657 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T18:06:28.657 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:28.898 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 35/36 2024-05-15T18:06:28.923 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 35/36 2024-05-15T18:06:28.923 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:28.923 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T18:06:28.923 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T18:06:28.924 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T18:06:28.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:28.990 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 36/36 2024-05-15T18:06:29.494 INFO:teuthology.orchestra.run.smithi173.stdout:(4/4): ceph-test-19.0.0-2571.gbbba46de.el9.x86_ 17 MB/s | 48 MB 00:02 2024-05-15T18:06:29.496 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:29.496 INFO:teuthology.orchestra.run.smithi173.stdout:Total 17 MB/s | 49 MB 00:02 2024-05-15T18:06:29.524 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:06:29.545 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:06:29.545 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:06:29.912 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:06:29.912 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:06:30.434 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:06:30.499 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 36/36 2024-05-15T18:06:30.499 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 1/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 2/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 3/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 4/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 5/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2571.gbbba46de.el9. 6/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-15T18:06:30.500 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-15T18:06:30.501 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-15T18:06:30.502 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-15T18:06:30.503 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-15T18:06:30.515 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-15T18:06:30.559 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-15T18:06:30.588 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 3/4 2024-05-15T18:06:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-15T18:06:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:31.442 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:06:31.442 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T18:06:31.443 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T18:06:31.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:31.445 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:31.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-base 2024-05-15T18:06:32.429 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:57 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:32.512 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:06:32.557 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:32.558 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:06:32.558 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:32.630 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install cephadm 2024-05-15T18:06:33.222 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:58 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:33.350 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 763 k 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 763 k 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 769 k 2024-05-15T18:06:33.351 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:06:33.798 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm-19.0.0-2571.gbbba46de.el9.noarch.rpm 1.7 MB/s | 763 kB 00:00 2024-05-15T18:06:33.799 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:33.799 INFO:teuthology.orchestra.run.smithi003.stdout:Total 1.7 MB/s | 763 kB 00:00 2024-05-15T18:06:33.799 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:06:33.804 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:06:33.804 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:06:33.810 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:06:33.811 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:06:33.886 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:06:34.362 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:34.471 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:34.885 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:35.135 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:35.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:35.135 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:06:35.135 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:35.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:35.135 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:35.170 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 3/4 2024-05-15T18:06:35.243 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 4/4 2024-05-15T18:06:35.337 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-immutable-object-cache 2024-05-15T18:06:35.938 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:00 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:36.065 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 145 k 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:36.066 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 145 k 2024-05-15T18:06:36.067 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 435 k 2024-05-15T18:06:36.067 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:06:36.388 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-immutable-object-cache-19.0.0-2571.gbbba46 451 kB/s | 145 kB 00:00 2024-05-15T18:06:36.388 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:36.388 INFO:teuthology.orchestra.run.smithi003.stdout:Total 449 kB/s | 145 kB 00:00 2024-05-15T18:06:36.389 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:06:36.397 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:06:36.397 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:06:36.457 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:06:36.457 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:06:36.608 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:06:36.689 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de. 1/1 2024-05-15T18:06:36.715 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de. 1/1 2024-05-15T18:06:36.715 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:36.715 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T18:06:36.716 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 4/4 2024-05-15T18:06:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 1/4 2024-05-15T18:06:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 2/4 2024-05-15T18:06:37.598 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-15T18:06:37.611 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de. 1/1 2024-05-15T18:06:37.611 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:37.611 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:06:37.611 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:37.612 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:37.612 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:37.833 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr 2024-05-15T18:06:37.882 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:37.883 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:06:38.201 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph 2024-05-15T18:06:38.434 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:03 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:06:38.562 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:06:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:38.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-dashboard 2024-05-15T18:06:38.778 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:47 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:06:38.904 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:06:38.906 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:38.906 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:06:38.906 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:38.906 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:06:38.906 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 6.6 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 2.4 M 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 1.5 M 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 249 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 4.7 M 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 17 M 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T18:06:38.907 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T18:06:38.908 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:06:38.909 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:38.910 INFO:teuthology.orchestra.run.smithi173.stdout:Install 36 Packages 2024-05-15T18:06:38.910 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:38.910 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 30 M 2024-05-15T18:06:38.910 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 107 M 2024-05-15T18:06:38.910 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:06:39.226 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:04 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:39.354 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:39.355 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:39.355 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:06:39.355 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:39.355 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:06:39.355 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 3.5 M 2024-05-15T18:06:39.356 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:06:39.356 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T18:06:39.356 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 32 k 2024-05-15T18:06:39.356 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 16 k 2024-05-15T18:06:39.356 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T18:06:39.356 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T18:06:39.357 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T18:06:39.357 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T18:06:39.357 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T18:06:39.357 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T18:06:39.357 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T18:06:39.358 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T18:06:39.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:39.358 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:06:39.358 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:39.358 INFO:teuthology.orchestra.run.smithi003.stdout:Install 12 Packages 2024-05-15T18:06:39.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:39.360 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 8.6 M 2024-05-15T18:06:39.360 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 103 M 2024-05-15T18:06:39.360 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:06:39.903 INFO:teuthology.orchestra.run.smithi173.stdout:(1/36): ceph-19.0.0-2571.gbbba46de.el9.x86_64.r 39 kB/s | 6.6 kB 00:00 2024-05-15T18:06:39.991 INFO:teuthology.orchestra.run.smithi003.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2571.gbb 156 kB/s | 32 kB 00:00 2024-05-15T18:06:40.017 INFO:teuthology.orchestra.run.smithi003.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2571.gbbb 72 kB/s | 16 kB 00:00 2024-05-15T18:06:40.103 INFO:teuthology.orchestra.run.smithi173.stdout:(2/36): ceph-mgr-19.0.0-2571.gbbba46de.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-05-15T18:06:40.267 INFO:teuthology.orchestra.run.smithi003.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-05-15T18:06:40.409 INFO:teuthology.orchestra.run.smithi003.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 6.0 MB/s | 863 kB 00:00 2024-05-15T18:06:40.495 INFO:teuthology.orchestra.run.smithi173.stdout:(3/36): ceph-mon-19.0.0-2571.gbbba46de.el9.x86_ 7.9 MB/s | 4.7 MB 00:00 2024-05-15T18:06:40.587 INFO:teuthology.orchestra.run.smithi173.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2571.gbbba 2.7 MB/s | 249 kB 00:00 2024-05-15T18:06:40.734 INFO:teuthology.orchestra.run.smithi003.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.4 MB/s | 1.0 MB 00:00 2024-05-15T18:06:40.746 INFO:teuthology.orchestra.run.smithi173.stdout:(5/36): ceph-mds-19.0.0-2571.gbbba46de.el9.x86_ 2.3 MB/s | 2.4 MB 00:01 2024-05-15T18:06:40.771 INFO:teuthology.orchestra.run.smithi173.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-15T18:06:40.821 INFO:teuthology.orchestra.run.smithi173.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-15T18:06:40.872 INFO:teuthology.orchestra.run.smithi173.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-05-15T18:06:40.922 INFO:teuthology.orchestra.run.smithi173.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.5 MB/s | 125 kB 00:00 2024-05-15T18:06:40.980 INFO:teuthology.orchestra.run.smithi173.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-05-15T18:06:41.093 INFO:teuthology.orchestra.run.smithi003.stdout:(6/12): ceph-mgr-dashboard-19.0.0-2571.gbbba46d 2.7 MB/s | 3.5 MB 00:01 2024-05-15T18:06:41.118 INFO:teuthology.orchestra.run.smithi003.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 773 kB/s | 548 kB 00:00 2024-05-15T18:06:41.143 INFO:teuthology.orchestra.run.smithi003.stdout:(8/12): grpc-data-1.46.7-10.el9.noarch.rpm 48 kB/s | 19 kB 00:00 2024-05-15T18:06:41.156 INFO:teuthology.orchestra.run.smithi173.stdout:(11/36): ceph-osd-19.0.0-2571.gbbba46de.el9.x86 16 MB/s | 17 MB 00:01 2024-05-15T18:06:41.189 INFO:teuthology.orchestra.run.smithi173.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2024-05-15T18:06:41.239 INFO:teuthology.orchestra.run.smithi003.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.2 MB/s | 144 kB 00:00 2024-05-15T18:06:41.269 INFO:teuthology.orchestra.run.smithi003.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 245 kB/s | 31 kB 00:00 2024-05-15T18:06:41.361 INFO:teuthology.orchestra.run.smithi003.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-05-15T18:06:41.781 INFO:teuthology.orchestra.run.smithi173.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 59 kB/s | 35 kB 00:00 2024-05-15T18:06:41.881 INFO:teuthology.orchestra.run.smithi173.stdout:(14/36): lua-5.4.4-4.el9.x86_64.rpm 209 kB/s | 188 kB 00:00 2024-05-15T18:06:41.923 INFO:teuthology.orchestra.run.smithi173.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 224 kB/s | 172 kB 00:00 2024-05-15T18:06:42.011 INFO:teuthology.orchestra.run.smithi003.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.2 MB/s | 2.0 MB 00:00 2024-05-15T18:06:42.017 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:42.017 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.2 MB/s | 8.6 MB 00:02 2024-05-15T18:06:42.072 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:06:42.092 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:06:42.092 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:06:42.157 INFO:teuthology.orchestra.run.smithi173.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 96 kB/s | 22 kB 00:00 2024-05-15T18:06:42.284 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:06:42.284 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:06:42.493 INFO:teuthology.orchestra.run.smithi173.stdout:(17/36): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-05-15T18:06:42.518 INFO:teuthology.orchestra.run.smithi173.stdout:(18/36): python3-pytz-2021.1-5.el9.noarch.rpm 69 kB/s | 51 kB 00:00 2024-05-15T18:06:42.710 INFO:teuthology.orchestra.run.smithi173.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 274 kB/s | 151 kB 00:00 2024-05-15T18:06:42.902 INFO:teuthology.orchestra.run.smithi173.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 106 kB/s | 43 kB 00:00 2024-05-15T18:06:42.930 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:06:42.960 INFO:teuthology.orchestra.run.smithi173.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-05-15T18:06:43.013 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-15T18:06:43.027 INFO:teuthology.orchestra.run.smithi173.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 85 kB/s | 11 kB 00:00 2024-05-15T18:06:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-15T18:06:43.061 INFO:teuthology.orchestra.run.smithi173.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-05-15T18:06:43.096 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-15T18:06:43.111 INFO:teuthology.orchestra.run.smithi173.stdout:(24/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 289 kB/s | 172 kB 00:00 2024-05-15T18:06:43.124 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-15T18:06:43.145 INFO:teuthology.orchestra.run.smithi173.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 197 kB/s | 23 kB 00:00 2024-05-15T18:06:43.162 INFO:teuthology.orchestra.run.smithi173.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 193 kB/s | 19 kB 00:00 2024-05-15T18:06:43.212 INFO:teuthology.orchestra.run.smithi173.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 195 kB/s | 20 kB 00:00 2024-05-15T18:06:43.233 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-15T18:06:43.271 INFO:teuthology.orchestra.run.smithi173.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 724 kB/s | 79 kB 00:00 2024-05-15T18:06:43.288 INFO:teuthology.orchestra.run.smithi173.stdout:(29/36): python3-logutils-0.3.5-21.el9.noarch.r 325 kB/s | 46 kB 00:00 2024-05-15T18:06:43.366 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-15T18:06:43.371 INFO:teuthology.orchestra.run.smithi173.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 163 kB/s | 16 kB 00:00 2024-05-15T18:06:43.430 INFO:teuthology.orchestra.run.smithi173.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-05-15T18:06:43.458 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-15T18:06:43.485 INFO:teuthology.orchestra.run.smithi173.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 314 kB/s | 36 kB 00:00 2024-05-15T18:06:43.514 INFO:teuthology.orchestra.run.smithi173.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 397 kB/s | 90 kB 00:00 2024-05-15T18:06:43.515 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-15T18:06:43.541 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-15T18:06:43.573 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2571.gbbba46de.el9 10/12 2024-05-15T18:06:43.589 INFO:teuthology.orchestra.run.smithi173.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-05-15T18:06:43.623 INFO:teuthology.orchestra.run.smithi173.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-05-15T18:06:43.698 INFO:teuthology.orchestra.run.smithi173.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.0 MB/s | 427 kB 00:00 2024-05-15T18:06:43.703 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:43.703 INFO:teuthology.orchestra.run.smithi173.stdout:Total 6.3 MB/s | 30 MB 00:04 2024-05-15T18:06:43.843 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:06:43.883 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:06:43.883 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:06:44.328 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:06:44.328 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:06:44.680 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2571.gbbba46de.el 11/12 2024-05-15T18:06:44.723 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noa 12/12 2024-05-15T18:06:45.600 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:06:45.659 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-15T18:06:45.701 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-15T18:06:45.728 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-15T18:06:45.810 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-15T18:06:45.861 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-15T18:06:45.894 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-15T18:06:45.987 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-15T18:06:46.012 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noa 12/12 2024-05-15T18:06:46.012 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2571.gbbba46de.el 1/12 2024-05-15T18:06:46.012 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noa 2/12 2024-05-15T18:06:46.012 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2571.gbbba46de.el9 3/12 2024-05-15T18:06:46.012 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-15T18:06:46.012 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-15T18:06:46.013 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-15T18:06:46.013 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-15T18:06:46.013 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-15T18:06:46.013 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-15T18:06:46.013 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-15T18:06:46.013 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-15T18:06:46.057 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-15T18:06:46.097 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-15T18:06:46.132 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-15T18:06:46.162 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-15T18:06:46.196 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-15T18:06:46.230 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-15T18:06:46.262 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-15T18:06:46.297 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-15T18:06:46.316 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T18:06:46.317 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T18:06:46.318 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T18:06:46.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T18:06:46.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T18:06:46.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T18:06:46.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T18:06:46.318 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T18:06:46.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:46.319 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:46.331 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-15T18:06:46.370 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-15T18:06:46.444 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-15T18:06:46.550 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-15T18:06:46.623 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-15T18:06:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-15T18:06:46.757 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-15T18:06:46.795 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-15T18:06:46.853 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-15T18:06:46.909 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-15T18:06:47.098 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-15T18:06:47.141 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-15T18:06:47.154 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:12 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:47.220 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-15T18:06:47.284 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 7.4 M 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T18:06:47.285 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout:======================================================================================= 2024-05-15T18:06:47.286 INFO:teuthology.orchestra.run.smithi003.stdout:Install 12 Packages 2024-05-15T18:06:47.287 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:47.287 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 38 M 2024-05-15T18:06:47.287 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 209 M 2024-05-15T18:06:47.287 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:06:47.316 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-15T18:06:47.357 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-15T18:06:47.475 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-15T18:06:47.639 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2571.gbbba46de.el9. 31/36 2024-05-15T18:06:47.668 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 32/36 2024-05-15T18:06:47.693 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 32/36 2024-05-15T18:06:47.693 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:47.693 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T18:06:47.693 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T18:06:47.693 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T18:06:47.693 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:47.744 INFO:teuthology.orchestra.run.smithi003.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-05-15T18:06:47.794 INFO:teuthology.orchestra.run.smithi003.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.2 MB/s | 803 kB 00:00 2024-05-15T18:06:47.812 INFO:teuthology.orchestra.run.smithi003.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-05-15T18:06:47.845 INFO:teuthology.orchestra.run.smithi003.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 544 kB/s | 18 kB 00:00 2024-05-15T18:06:47.879 INFO:teuthology.orchestra.run.smithi003.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-05-15T18:06:47.929 INFO:teuthology.orchestra.run.smithi003.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-05-15T18:06:47.980 INFO:teuthology.orchestra.run.smithi003.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-15T18:06:48.088 INFO:teuthology.orchestra.run.smithi003.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 23 MB/s | 4.7 MB 00:00 2024-05-15T18:06:48.138 INFO:teuthology.orchestra.run.smithi003.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-05-15T18:06:48.222 INFO:teuthology.orchestra.run.smithi003.stdout:(10/12): ceph-mgr-diskprediction-local-19.0.0-2 12 MB/s | 7.4 MB 00:00 2024-05-15T18:06:48.289 INFO:teuthology.orchestra.run.smithi003.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-05-15T18:06:48.672 INFO:teuthology.orchestra.run.smithi003.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-05-15T18:06:48.673 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:48.674 INFO:teuthology.orchestra.run.smithi003.stdout:Total 27 MB/s | 38 MB 00:01 2024-05-15T18:06:49.042 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:06:49.070 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:06:49.070 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:06:49.127 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 33/36 2024-05-15T18:06:49.154 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 33/36 2024-05-15T18:06:49.154 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:49.154 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T18:06:49.154 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T18:06:49.154 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T18:06:49.154 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:49.525 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:06:49.525 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:06:49.603 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 34/36 2024-05-15T18:06:49.626 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 34/36 2024-05-15T18:06:49.626 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:49.627 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T18:06:49.627 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T18:06:49.627 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T18:06:49.627 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:49.862 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 35/36 2024-05-15T18:06:49.885 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 35/36 2024-05-15T18:06:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T18:06:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T18:06:49.886 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T18:06:49.886 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:49.942 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 36/36 2024-05-15T18:06:50.456 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:06:50.530 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-15T18:06:50.580 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-15T18:06:50.688 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-15T18:06:50.739 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-15T18:06:50.924 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-15T18:06:50.955 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-15T18:06:51.034 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-15T18:06:51.664 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 36/36 2024-05-15T18:06:51.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 1/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 2/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 3/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 4/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 5/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2571.gbbba46de.el9. 6/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-15T18:06:51.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-15T18:06:51.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-15T18:06:51.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-15T18:06:51.738 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-15T18:06:51.865 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-15T18:06:52.747 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-15T18:06:52.747 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T18:06:52.748 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T18:06:52.749 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:52.750 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:06:53.104 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base 2024-05-15T18:06:53.220 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T18:06:53.684 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:02 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:06:53.766 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:06:53.807 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:06:53.808 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:06:53.808 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:06:53.876 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install cephadm 2024-05-15T18:06:54.336 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-15T18:06:54.362 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba4 12/12 2024-05-15T18:06:54.447 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:03 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:06:54.570 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 763 k 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:54.571 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 763 k 2024-05-15T18:06:54.572 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 769 k 2024-05-15T18:06:54.572 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:06:54.856 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm-19.0.0-2571.gbbba46de.el9.noarch.rpm 2.6 MB/s | 763 kB 00:00 2024-05-15T18:06:54.856 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:54.856 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.6 MB/s | 763 kB 00:00 2024-05-15T18:06:54.857 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:06:54.862 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:06:54.862 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:06:54.867 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:06:54.868 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:06:54.943 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:06:55.432 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:55.526 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:55.892 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:56.132 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/1 2024-05-15T18:06:56.132 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:56.132 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:06:56.132 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:56.132 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:56.132 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:06:56.352 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache 2024-05-15T18:06:56.847 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba4 12/12 2024-05-15T18:06:56.847 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba4 1/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T18:06:56.848 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-15T18:06:56.935 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:05 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:06:57.062 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 145 k 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-05-15T18:06:57.063 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:57.064 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 145 k 2024-05-15T18:06:57.064 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 435 k 2024-05-15T18:06:57.064 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:06:57.272 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-19.0.0-2571.gbbba46 698 kB/s | 145 kB 00:00 2024-05-15T18:06:57.272 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:57.273 INFO:teuthology.orchestra.run.smithi173.stdout:Total 693 kB/s | 145 kB 00:00 2024-05-15T18:06:57.273 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:06:57.280 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:06:57.280 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:06:57.336 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:06:57.336 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:06:57.412 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-15T18:06:57.412 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:57.412 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T18:06:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:57.414 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:06:57.487 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:06:57.581 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de. 1/1 2024-05-15T18:06:57.607 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de. 1/1 2024-05-15T18:06:57.607 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:06:57.607 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T18:06:57.607 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:57.766 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-rook 2024-05-15T18:06:58.373 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:23 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:06:58.503 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:06:58.504 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:58.504 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:06:58.504 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:58.504 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:06:58.504 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 49 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T18:06:58.505 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T18:06:58.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:58.506 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:06:58.506 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:06:58.506 INFO:teuthology.orchestra.run.smithi003.stdout:Install 13 Packages 2024-05-15T18:06:58.506 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:06:58.506 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 2.2 M 2024-05-15T18:06:58.506 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 26 M 2024-05-15T18:06:58.507 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:06:58.507 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de. 1/1 2024-05-15T18:06:58.507 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:58.507 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:06:58.507 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:06:58.507 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:06:58.507 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:06:58.769 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr 2024-05-15T18:06:59.110 INFO:teuthology.orchestra.run.smithi003.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 266 kB/s | 26 kB 00:00 2024-05-15T18:06:59.136 INFO:teuthology.orchestra.run.smithi003.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 158 kB/s | 19 kB 00:00 2024-05-15T18:06:59.252 INFO:teuthology.orchestra.run.smithi003.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.9 MB/s | 222 kB 00:00 2024-05-15T18:06:59.277 INFO:teuthology.orchestra.run.smithi003.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-05-15T18:06:59.303 INFO:teuthology.orchestra.run.smithi003.stdout:(5/13): ceph-mgr-rook-19.0.0-2571.gbbba46de.el9 171 kB/s | 49 kB 00:00 2024-05-15T18:06:59.328 INFO:teuthology.orchestra.run.smithi003.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-05-15T18:06:59.357 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:08 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:06:59.379 INFO:teuthology.orchestra.run.smithi003.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 279 kB 00:00 2024-05-15T18:06:59.437 INFO:teuthology.orchestra.run.smithi003.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 240 kB/s | 32 kB 00:00 2024-05-15T18:06:59.441 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-mgr-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:06:59.484 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:06:59.485 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:06:59.485 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:06:59.496 INFO:teuthology.orchestra.run.smithi003.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 106 kB/s | 15 kB 00:00 2024-05-15T18:06:59.554 INFO:teuthology.orchestra.run.smithi003.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-15T18:06:59.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-dashboard 2024-05-15T18:06:59.605 INFO:teuthology.orchestra.run.smithi003.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 7.3 MB/s | 1.0 MB 00:00 2024-05-15T18:06:59.630 INFO:teuthology.orchestra.run.smithi003.stdout:(12/13): python3-google-auth-2.29.0-1.el9.noarc 918 kB/s | 206 kB 00:00 2024-05-15T18:06:59.655 INFO:teuthology.orchestra.run.smithi003.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 893 kB/s | 90 kB 00:00 2024-05-15T18:06:59.657 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:06:59.657 INFO:teuthology.orchestra.run.smithi003.stdout:Total 1.9 MB/s | 2.2 MB 00:01 2024-05-15T18:06:59.726 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:06:59.743 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:06:59.743 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:06:59.835 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:06:59.835 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:00.136 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:09 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:00.258 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:00.259 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:00.259 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:07:00.259 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:00.259 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:00.259 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 3.5 M 2024-05-15T18:07:00.259 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:07:00.259 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 32 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 16 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout:Install 12 Packages 2024-05-15T18:07:00.260 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:00.261 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 8.6 M 2024-05-15T18:07:00.261 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 103 M 2024-05-15T18:07:00.261 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:00.343 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:00.519 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-15T18:07:00.669 INFO:teuthology.orchestra.run.smithi173.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2571.gbb 168 kB/s | 32 kB 00:00 2024-05-15T18:07:00.712 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-15T18:07:00.760 INFO:teuthology.orchestra.run.smithi173.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2571.gbbb 58 kB/s | 16 kB 00:00 2024-05-15T18:07:00.798 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-15T18:07:00.833 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-15T18:07:00.853 INFO:teuthology.orchestra.run.smithi173.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-05-15T18:07:00.875 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-15T18:07:00.936 INFO:teuthology.orchestra.run.smithi173.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-05-15T18:07:00.972 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-15T18:07:01.037 INFO:teuthology.orchestra.run.smithi173.stdout:(5/12): ceph-mgr-dashboard-19.0.0-2571.gbbba46d 6.3 MB/s | 3.5 MB 00:00 2024-05-15T18:07:01.084 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-15T18:07:01.086 INFO:teuthology.orchestra.run.smithi173.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.6 MB/s | 863 kB 00:00 2024-05-15T18:07:01.135 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-15T18:07:01.304 INFO:teuthology.orchestra.run.smithi173.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-05-15T18:07:01.446 INFO:teuthology.orchestra.run.smithi173.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-05-15T18:07:01.488 INFO:teuthology.orchestra.run.smithi173.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 787 kB/s | 144 kB 00:00 2024-05-15T18:07:01.529 INFO:teuthology.orchestra.run.smithi173.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 368 kB/s | 31 kB 00:00 2024-05-15T18:07:01.613 INFO:teuthology.orchestra.run.smithi173.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-05-15T18:07:01.663 INFO:teuthology.orchestra.run.smithi173.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.5 MB/s | 2.0 MB 00:00 2024-05-15T18:07:01.667 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:01.667 INFO:teuthology.orchestra.run.smithi173.stdout:Total 6.1 MB/s | 8.6 MB 00:01 2024-05-15T18:07:01.716 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:01.732 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:01.733 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:01.911 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-15T18:07:01.913 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:01.913 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:01.972 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-15T18:07:02.006 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-15T18:07:02.055 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-15T18:07:02.084 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 13/13 2024-05-15T18:07:02.521 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:02.615 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-15T18:07:02.658 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-15T18:07:02.704 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-15T18:07:02.743 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-15T18:07:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 13/13 2024-05-15T18:07:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 1/13 2024-05-15T18:07:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-15T18:07:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-15T18:07:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-15T18:07:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-15T18:07:02.805 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-15T18:07:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-15T18:07:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-15T18:07:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-15T18:07:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-15T18:07:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-15T18:07:02.806 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-15T18:07:02.861 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-15T18:07:03.004 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-15T18:07:03.097 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T18:07:03.131 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T18:07:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T18:07:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T18:07:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T18:07:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T18:07:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T18:07:03.132 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:03.132 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:03.140 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-15T18:07:03.169 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-15T18:07:03.200 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2571.gbbba46de.el9 10/12 2024-05-15T18:07:03.379 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-cephadm 2024-05-15T18:07:03.979 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:29 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:04.107 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 142 k 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T18:07:04.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:04.109 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:04.109 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:04.109 INFO:teuthology.orchestra.run.smithi003.stdout:Install 6 Packages 2024-05-15T18:07:04.109 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:04.109 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 7.0 M 2024-05-15T18:07:04.109 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 33 M 2024-05-15T18:07:04.109 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:04.258 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2571.gbbba46de.el 11/12 2024-05-15T18:07:04.294 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noa 12/12 2024-05-15T18:07:04.506 INFO:teuthology.orchestra.run.smithi003.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-05-15T18:07:04.640 INFO:teuthology.orchestra.run.smithi003.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-05-15T18:07:04.748 INFO:teuthology.orchestra.run.smithi003.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.2 MB/s | 548 kB 00:00 2024-05-15T18:07:04.782 INFO:teuthology.orchestra.run.smithi003.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 406 kB/s | 58 kB 00:00 2024-05-15T18:07:04.799 INFO:teuthology.orchestra.run.smithi003.stdout:(5/6): ceph-mgr-cephadm-19.0.0-2571.gbbba46de.e 309 kB/s | 142 kB 00:00 2024-05-15T18:07:04.824 INFO:teuthology.orchestra.run.smithi003.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 677 kB/s | 51 kB 00:00 2024-05-15T18:07:04.825 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:04.825 INFO:teuthology.orchestra.run.smithi003.stdout:Total 9.7 MB/s | 7.0 MB 00:00 2024-05-15T18:07:04.899 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:04.910 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:04.910 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:05.015 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:05.016 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:05.326 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noa 12/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2571.gbbba46de.el 1/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noa 2/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2571.gbbba46de.el9 3/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-15T18:07:05.367 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-15T18:07:05.368 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-15T18:07:05.368 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-15T18:07:05.497 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-15T18:07:05.560 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T18:07:05.673 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T18:07:05.674 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T18:07:05.674 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T18:07:05.674 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T18:07:05.674 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:05.674 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:05.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-15T18:07:06.114 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-15T18:07:06.208 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-15T18:07:06.277 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-15T18:07:06.305 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 6/6 2024-05-15T18:07:06.492 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:15 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:06.614 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:06.615 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-05-15T18:07:06.615 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:07:06.615 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-05-15T18:07:06.615 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:06.615 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 7.4 M 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:06.616 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:06.617 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-05-15T18:07:06.617 INFO:teuthology.orchestra.run.smithi173.stdout:Install 12 Packages 2024-05-15T18:07:06.617 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:06.617 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 38 M 2024-05-15T18:07:06.617 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 209 M 2024-05-15T18:07:06.617 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:07.065 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 6/6 2024-05-15T18:07:07.065 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/6 2024-05-15T18:07:07.065 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-15T18:07:07.065 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-15T18:07:07.065 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-15T18:07:07.066 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-15T18:07:07.338 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-15T18:07:07.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:07.338 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:07.339 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:07.573 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-fuse 2024-05-15T18:07:07.690 INFO:teuthology.orchestra.run.smithi173.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 303 kB/s | 195 kB 00:00 2024-05-15T18:07:07.915 INFO:teuthology.orchestra.run.smithi173.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 922 kB/s | 803 kB 00:00 2024-05-15T18:07:08.172 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:33 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:08.291 INFO:teuthology.orchestra.run.smithi173.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-05-15T18:07:08.301 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:08.301 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:08.301 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:07:08.301 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:08.301 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:08.301 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 890 k 2024-05-15T18:07:08.301 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:07:08.302 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T18:07:08.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:08.302 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:08.302 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:08.302 INFO:teuthology.orchestra.run.smithi003.stdout:Install 2 Packages 2024-05-15T18:07:08.302 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:08.303 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 970 k 2024-05-15T18:07:08.303 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 2.8 M 2024-05-15T18:07:08.303 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:08.576 INFO:teuthology.orchestra.run.smithi003.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 681 kB/s | 80 kB 00:00 2024-05-15T18:07:08.768 INFO:teuthology.orchestra.run.smithi003.stdout:(2/2): ceph-fuse-19.0.0-2571.gbbba46de.el9.x86_ 2.8 MB/s | 890 kB 00:00 2024-05-15T18:07:08.768 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:08.768 INFO:teuthology.orchestra.run.smithi003.stdout:Total 2.0 MB/s | 970 kB 00:00 2024-05-15T18:07:08.781 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:08.804 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:08.804 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:08.833 INFO:teuthology.orchestra.run.smithi173.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 34 kB/s | 18 kB 00:00 2024-05-15T18:07:08.887 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:08.887 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:09.066 INFO:teuthology.orchestra.run.smithi173.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-05-15T18:07:09.209 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:09.349 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-15T18:07:09.408 INFO:teuthology.orchestra.run.smithi173.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-25 3.1 MB/s | 7.4 MB 00:02 2024-05-15T18:07:09.419 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 2/2 2024-05-15T18:07:09.459 INFO:teuthology.orchestra.run.smithi173.stdout:(7/12): openblas-0.3.21-2.el9.x86_64.rpm 56 kB/s | 35 kB 00:00 2024-05-15T18:07:10.204 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 2/2 2024-05-15T18:07:10.204 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/2 2024-05-15T18:07:10.225 INFO:teuthology.orchestra.run.smithi173.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 299 kB/s | 244 kB 00:00 2024-05-15T18:07:10.292 INFO:teuthology.orchestra.run.smithi173.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 3.9 MB/s | 4.7 MB 00:01 2024-05-15T18:07:10.465 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-15T18:07:10.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:10.465 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:10.465 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-15T18:07:10.465 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:10.465 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:10.685 INFO:teuthology.orchestra.run.smithi173.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-15T18:07:10.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-volume 2024-05-15T18:07:11.118 INFO:teuthology.orchestra.run.smithi173.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 281 kB/s | 250 kB 00:00 2024-05-15T18:07:11.319 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:36 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:11.448 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 264 k 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout:Install 2 Packages 2024-05-15T18:07:11.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:11.450 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 341 k 2024-05-15T18:07:11.450 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 1.5 M 2024-05-15T18:07:11.450 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:11.755 INFO:teuthology.orchestra.run.smithi003.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 291 kB/s | 77 kB 00:00 2024-05-15T18:07:11.852 INFO:teuthology.orchestra.run.smithi173.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-15T18:07:11.853 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:11.853 INFO:teuthology.orchestra.run.smithi173.stdout:Total 7.3 MB/s | 38 MB 00:05 2024-05-15T18:07:11.997 INFO:teuthology.orchestra.run.smithi003.stdout:(2/2): ceph-volume-19.0.0-2571.gbbba46de.el9.no 520 kB/s | 264 kB 00:00 2024-05-15T18:07:11.998 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:11.998 INFO:teuthology.orchestra.run.smithi003.stdout:Total 621 kB/s | 341 kB 00:00 2024-05-15T18:07:12.010 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:12.021 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:12.021 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:12.055 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:12.056 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:12.203 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:12.206 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:12.234 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:12.234 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:12.405 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-15T18:07:12.433 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 2/2 2024-05-15T18:07:12.450 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 2/2 2024-05-15T18:07:12.450 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:07:12.450 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T18:07:12.450 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:12.660 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:12.660 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:13.087 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 1/2 2024-05-15T18:07:13.398 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-15T18:07:13.401 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:13.401 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:13.402 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:13.402 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T18:07:13.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:13.402 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:13.426 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:13.500 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-15T18:07:13.549 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-15T18:07:13.652 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-15T18:07:13.663 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados-devel 2024-05-15T18:07:13.693 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-15T18:07:13.871 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-15T18:07:13.900 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-15T18:07:13.981 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-15T18:07:14.269 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:39 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:14.397 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-05-15T18:07:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:14.398 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 127 k 2024-05-15T18:07:14.398 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-05-15T18:07:14.399 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 127 k 2024-05-15T18:07:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 456 k 2024-05-15T18:07:14.399 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:14.629 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-15T18:07:14.752 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-15T18:07:14.753 INFO:teuthology.orchestra.run.smithi003.stdout:librados-devel-19.0.0-2571.gbbba46de.el9.x86_64 358 kB/s | 127 kB 00:00 2024-05-15T18:07:14.753 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:14.754 INFO:teuthology.orchestra.run.smithi003.stdout:Total 356 kB/s | 127 kB 00:00 2024-05-15T18:07:14.754 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:14.760 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:14.760 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:14.828 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:14.986 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:15.097 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:15.509 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:15.772 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:15.772 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:16.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs2 2024-05-15T18:07:16.174 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T18:07:16.624 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:41 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:16.708 INFO:teuthology.orchestra.run.smithi003.stdout:Package libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:16.753 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:16.754 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:07:16.754 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:16.818 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs-devel 2024-05-15T18:07:17.210 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-15T18:07:17.243 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba4 12/12 2024-05-15T18:07:17.422 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:42 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:17.550 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:17.551 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:17.551 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 32 k 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 32 k 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 142 k 2024-05-15T18:07:17.552 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:17.806 INFO:teuthology.orchestra.run.smithi003.stdout:libcephfs-devel-19.0.0-2571.gbbba46de.el9.x86_6 125 kB/s | 32 kB 00:00 2024-05-15T18:07:17.806 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:17.807 INFO:teuthology.orchestra.run.smithi003.stdout:Total 124 kB/s | 32 kB 00:00 2024-05-15T18:07:17.807 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:17.810 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:17.810 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:17.824 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:17.911 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:18.446 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:18.661 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:18.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:18.661 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:18.822 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados2 2024-05-15T18:07:19.423 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:44 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:19.507 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:19.551 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:19.552 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:07:19.553 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:19.613 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librbd1 2024-05-15T18:07:19.686 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba4 12/12 2024-05-15T18:07:19.686 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba4 1/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-15T18:07:19.687 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-15T18:07:20.066 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-15T18:07:20.066 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T18:07:20.067 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T18:07:20.068 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T18:07:20.068 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T18:07:20.068 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T18:07:20.068 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:20.068 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:20.210 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:45 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:20.294 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:20.338 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:07:20.339 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:20.404 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rados 2024-05-15T18:07:20.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-rook 2024-05-15T18:07:21.004 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:46 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:21.054 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:30 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:21.087 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:21.132 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:21.133 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:07:21.133 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:21.176 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:21.177 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:21.177 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:07:21.177 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 49 k 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T18:07:21.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout:Install 13 Packages 2024-05-15T18:07:21.179 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:21.180 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.2 M 2024-05-15T18:07:21.180 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 26 M 2024-05-15T18:07:21.180 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:21.196 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rgw 2024-05-15T18:07:21.601 INFO:teuthology.orchestra.run.smithi173.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 221 kB/s | 26 kB 00:00 2024-05-15T18:07:21.626 INFO:teuthology.orchestra.run.smithi173.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 136 kB/s | 19 kB 00:00 2024-05-15T18:07:21.685 INFO:teuthology.orchestra.run.smithi173.stdout:(3/13): ceph-mgr-rook-19.0.0-2571.gbbba46de.el9 247 kB/s | 49 kB 00:00 2024-05-15T18:07:21.710 INFO:teuthology.orchestra.run.smithi173.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-05-15T18:07:21.760 INFO:teuthology.orchestra.run.smithi173.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-05-15T18:07:21.785 INFO:teuthology.orchestra.run.smithi173.stdout:(6/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 996 kB/s | 159 kB 00:00 2024-05-15T18:07:21.799 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:46 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:21.884 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:21.902 INFO:teuthology.orchestra.run.smithi173.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 129 kB/s | 15 kB 00:00 2024-05-15T18:07:21.928 INFO:teuthology.orchestra.run.smithi173.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 192 kB/s | 32 kB 00:00 2024-05-15T18:07:21.930 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:21.931 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:07:21.932 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:21.953 INFO:teuthology.orchestra.run.smithi173.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.0 MB/s | 279 kB 00:00 2024-05-15T18:07:21.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-cephfs 2024-05-15T18:07:22.053 INFO:teuthology.orchestra.run.smithi173.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.3 MB/s | 206 kB 00:00 2024-05-15T18:07:22.078 INFO:teuthology.orchestra.run.smithi173.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 472 kB/s | 59 kB 00:00 2024-05-15T18:07:22.103 INFO:teuthology.orchestra.run.smithi173.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-05-15T18:07:22.154 INFO:teuthology.orchestra.run.smithi173.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.5 MB/s | 1.0 MB 00:00 2024-05-15T18:07:22.155 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:22.155 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-05-15T18:07:22.220 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:22.234 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:22.234 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:22.318 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:22.319 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:22.603 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:47 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:22.687 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:22.731 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:07:22.732 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:22.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rbd 2024-05-15T18:07:22.825 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:22.995 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-15T18:07:23.064 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-15T18:07:23.119 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-15T18:07:23.156 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-15T18:07:23.198 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-15T18:07:23.291 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-15T18:07:23.401 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-15T18:07:23.403 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:48 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:23.457 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-15T18:07:23.489 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:23.534 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:23.535 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-05-15T18:07:23.535 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:23.595 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-fuse 2024-05-15T18:07:24.180 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-15T18:07:24.196 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:49 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:24.230 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-15T18:07:24.263 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-15T18:07:24.311 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-15T18:07:24.324 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:24.324 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 85 k 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-05-15T18:07:24.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:24.326 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 85 k 2024-05-15T18:07:24.326 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 231 k 2024-05-15T18:07:24.326 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:24.333 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 13/13 2024-05-15T18:07:24.533 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-fuse-19.0.0-2571.gbbba46de.el9.x86_64.rpm 413 kB/s | 85 kB 00:00 2024-05-15T18:07:24.533 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:24.534 INFO:teuthology.orchestra.run.smithi003.stdout:Total 410 kB/s | 85 kB 00:00 2024-05-15T18:07:24.534 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:24.542 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:24.542 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:24.608 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:24.608 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:24.760 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:24.866 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:25.113 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 13/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 1/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-15T18:07:25.114 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-15T18:07:25.115 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-15T18:07:25.115 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-15T18:07:25.115 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-15T18:07:25.115 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-15T18:07:25.233 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:25.445 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-15T18:07:25.445 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:25.445 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:25.445 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:25.445 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T18:07:25.445 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:25.446 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:25.495 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:25.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:25.496 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:25.496 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:25.496 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:25.496 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:25.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-cephadm 2024-05-15T18:07:25.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-mirror 2024-05-15T18:07:26.272 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:35 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:26.386 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:51 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:26.395 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 142 k 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T18:07:26.396 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T18:07:26.397 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T18:07:26.397 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:26.397 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:26.397 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:26.397 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-05-15T18:07:26.397 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:26.397 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 7.0 M 2024-05-15T18:07:26.398 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 33 M 2024-05-15T18:07:26.398 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:26.516 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:26.516 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:26.516 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-05-15T18:07:26.516 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 3.1 M 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 3.1 M 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 13 M 2024-05-15T18:07:26.517 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:26.848 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-05-15T18:07:26.884 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-mirror-19.0.0-2571.gbbba46de.el9.x86_64.rpm 8.4 MB/s | 3.1 MB 00:00 2024-05-15T18:07:26.885 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:26.885 INFO:teuthology.orchestra.run.smithi003.stdout:Total 8.4 MB/s | 3.1 MB 00:00 2024-05-15T18:07:26.885 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:26.895 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:26.895 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:26.981 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:26.981 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:27.056 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-05-15T18:07:27.081 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2571.gbbba46de.e 348 kB/s | 142 kB 00:00 2024-05-15T18:07:27.223 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.4 MB/s | 548 kB 00:00 2024-05-15T18:07:27.248 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 301 kB/s | 58 kB 00:00 2024-05-15T18:07:27.273 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 266 kB/s | 51 kB 00:00 2024-05-15T18:07:27.274 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:27.275 INFO:teuthology.orchestra.run.smithi173.stdout:Total 8.0 MB/s | 7.0 MB 00:00 2024-05-15T18:07:27.346 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:27.357 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:27.357 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:27.426 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:27.454 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:27.455 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:27.493 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:27.521 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:27.521 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:07:27.521 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T18:07:27.521 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T18:07:27.521 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T18:07:27.521 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:27.766 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:27.929 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-15T18:07:27.984 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-15T18:07:28.508 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-15T18:07:28.602 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:28.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:28.602 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:28.602 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:28.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:28.603 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:28.603 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-15T18:07:28.674 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-15T18:07:28.705 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 6/6 2024-05-15T18:07:28.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-nbd 2024-05-15T18:07:29.441 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:54 ago on Wed 15 May 2024 06:05:35 PM UTC. 2024-05-15T18:07:29.507 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 6/6 2024-05-15T18:07:29.507 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 1/6 2024-05-15T18:07:29.507 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-15T18:07:29.507 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-15T18:07:29.507 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-15T18:07:29.507 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-15T18:07:29.570 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-05-15T18:07:29.570 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:29.570 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 171 k 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 171 k 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 494 k 2024-05-15T18:07:29.571 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T18:07:29.770 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T18:07:29.771 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:29.771 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:30.030 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse 2024-05-15T18:07:30.240 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-nbd-19.0.0-2571.gbbba46de.el9.x86_64.rpm 255 kB/s | 171 kB 00:00 2024-05-15T18:07:30.240 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:30.240 INFO:teuthology.orchestra.run.smithi003.stdout:Total 255 kB/s | 171 kB 00:00 2024-05-15T18:07:30.240 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-05-15T18:07:30.249 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-05-15T18:07:30.249 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-05-15T18:07:30.318 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-05-15T18:07:30.318 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-05-15T18:07:30.487 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-05-15T18:07:30.591 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:30.608 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:39 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:30.732 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:30.732 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:30.732 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:07:30.732 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:30.732 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:30.732 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 890 k 2024-05-15T18:07:30.733 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:07:30.733 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T18:07:30.733 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:30.733 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:30.733 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:30.733 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-05-15T18:07:30.733 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:30.734 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 970 k 2024-05-15T18:07:30.734 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.8 M 2024-05-15T18:07:30.734 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:30.976 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 460 kB/s | 80 kB 00:00 2024-05-15T18:07:31.030 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:31.276 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-fuse-19.0.0-2571.gbbba46de.el9.x86_ 1.8 MB/s | 890 kB 00:00 2024-05-15T18:07:31.277 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:31.277 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.7 MB/s | 970 kB 00:00 2024-05-15T18:07:31.283 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-05-15T18:07:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:31.284 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:31.284 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-05-15T18:07:31.290 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:31.312 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:31.312 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:31.391 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:31.392 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:31.513 DEBUG:teuthology.parallel:result is None 2024-05-15T18:07:31.586 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:31.719 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-15T18:07:31.792 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 2/2 2024-05-15T18:07:32.469 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 2/2 2024-05-15T18:07:32.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/2 2024-05-15T18:07:32.753 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-15T18:07:32.753 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:32.753 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:32.753 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-15T18:07:32.753 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:32.753 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:33.051 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-volume 2024-05-15T18:07:33.655 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:42 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:33.783 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:33.783 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:33.783 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-05-15T18:07:33.783 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:19.0.0-2571.gbbba46de.el9 ceph-noarch 264 k 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-05-15T18:07:33.784 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:33.785 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 341 k 2024-05-15T18:07:33.785 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.5 M 2024-05-15T18:07:33.785 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:34.272 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 254 kB/s | 77 kB 00:00 2024-05-15T18:07:34.597 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-volume-19.0.0-2571.gbbba46de.el9.no 419 kB/s | 264 kB 00:00 2024-05-15T18:07:34.598 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:34.598 INFO:teuthology.orchestra.run.smithi173.stdout:Total 419 kB/s | 341 kB 00:00 2024-05-15T18:07:34.611 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:34.622 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:34.622 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:34.655 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:34.655 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:34.808 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:34.979 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-15T18:07:35.016 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 2/2 2024-05-15T18:07:35.032 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 2/2 2024-05-15T18:07:35.032 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:07:35.032 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T18:07:35.032 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:35.724 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 1/2 2024-05-15T18:07:36.011 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-15T18:07:36.011 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:36.011 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:36.011 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:19.0.0-2571.gbbba46de.el9.noarch 2024-05-15T18:07:36.011 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T18:07:36.011 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:36.011 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:36.346 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel 2024-05-15T18:07:36.938 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:45 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:37.063 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 127 k 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:37.064 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 127 k 2024-05-15T18:07:37.065 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 456 k 2024-05-15T18:07:37.065 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:37.469 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-19.0.0-2571.gbbba46de.el9.x86_64 313 kB/s | 127 kB 00:00 2024-05-15T18:07:37.470 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:37.470 INFO:teuthology.orchestra.run.smithi173.stdout:Total 312 kB/s | 127 kB 00:00 2024-05-15T18:07:37.470 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:37.476 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:37.476 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:37.539 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:37.687 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:37.805 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:38.246 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:38.492 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:38.492 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:38.493 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:38.493 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:38.493 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:38.493 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:38.763 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2 2024-05-15T18:07:39.354 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:48 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:39.436 INFO:teuthology.orchestra.run.smithi173.stdout:Package libcephfs2-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:39.479 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:39.480 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:07:39.480 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:39.555 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs-devel 2024-05-15T18:07:40.138 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:49 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:40.261 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 32 k 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:40.262 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:40.263 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-05-15T18:07:40.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:40.263 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 32 k 2024-05-15T18:07:40.263 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 142 k 2024-05-15T18:07:40.263 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:40.456 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs-devel-19.0.0-2571.gbbba46de.el9.x86_6 164 kB/s | 32 kB 00:00 2024-05-15T18:07:40.456 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:40.456 INFO:teuthology.orchestra.run.smithi173.stdout:Total 163 kB/s | 32 kB 00:00 2024-05-15T18:07:40.456 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:40.460 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:40.460 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:40.483 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:40.483 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:40.558 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:40.661 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:41.033 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:41.257 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:41.257 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:41.257 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:41.257 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:41.257 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:41.257 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:41.450 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2 2024-05-15T18:07:42.028 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:51 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:42.109 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:42.151 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:42.152 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:07:42.152 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:42.214 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1 2024-05-15T18:07:42.792 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:51 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:42.874 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:42.915 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:42.916 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:07:42.916 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:42.981 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados 2024-05-15T18:07:43.561 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:52 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:43.642 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rados-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:43.683 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:43.684 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:07:43.685 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:43.748 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw 2024-05-15T18:07:44.329 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:53 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:44.410 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rgw-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:44.453 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:44.454 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:07:44.454 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:44.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs 2024-05-15T18:07:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:54 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:45.186 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-cephfs-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:45.227 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:45.228 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:07:45.228 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:45.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd 2024-05-15T18:07:45.877 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:54 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:45.959 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rbd-2:19.0.0-2571.gbbba46de.el9.x86_64 is already installed. 2024-05-15T18:07:46.001 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:46.002 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-05-15T18:07:46.002 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:46.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse 2024-05-15T18:07:46.654 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:55 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:46.779 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:46.779 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:46.779 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-05-15T18:07:46.779 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:46.779 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:46.779 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 85 k 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 85 k 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 231 k 2024-05-15T18:07:46.780 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:47.000 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-19.0.0-2571.gbbba46de.el9.x86_64.rpm 388 kB/s | 85 kB 00:00 2024-05-15T18:07:47.001 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:47.001 INFO:teuthology.orchestra.run.smithi173.stdout:Total 386 kB/s | 85 kB 00:00 2024-05-15T18:07:47.001 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:47.008 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:47.008 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:47.070 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:47.070 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:47.222 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:47.331 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:47.696 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:47.942 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:47.942 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:47.943 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:47.943 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:47.943 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:47.943 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:48.177 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror 2024-05-15T18:07:48.780 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:57 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:48.910 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 3.1 M 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:48.911 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:48.912 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-05-15T18:07:48.912 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:48.912 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 3.1 M 2024-05-15T18:07:48.912 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 13 M 2024-05-15T18:07:48.912 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:49.460 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-19.0.0-2571.gbbba46de.el9.x86_64.rpm 5.6 MB/s | 3.1 MB 00:00 2024-05-15T18:07:49.461 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:49.461 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.6 MB/s | 3.1 MB 00:00 2024-05-15T18:07:49.461 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:49.470 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:49.470 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:49.551 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:49.551 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:49.980 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:50.044 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:50.070 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T18:07:50.070 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T18:07:50.070 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T18:07:50.070 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T18:07:50.070 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:51.212 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:51.212 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:51.212 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:51.212 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:51.212 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:51.212 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:51.448 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd 2024-05-15T18:07:52.039 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:01 ago on Wed 15 May 2024 06:05:51 PM UTC. 2024-05-15T18:07:52.164 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-05-15T18:07:52.164 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:19.0.0-2571.gbbba46de.el9 ceph 171 k 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-05-15T18:07:52.165 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:52.166 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 171 k 2024-05-15T18:07:52.166 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 494 k 2024-05-15T18:07:52.166 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-05-15T18:07:52.782 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-19.0.0-2571.gbbba46de.el9.x86_64.rpm 277 kB/s | 171 kB 00:00 2024-05-15T18:07:52.783 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-05-15T18:07:52.783 INFO:teuthology.orchestra.run.smithi173.stdout:Total 277 kB/s | 171 kB 00:00 2024-05-15T18:07:52.783 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-05-15T18:07:52.791 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-05-15T18:07:52.791 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-05-15T18:07:52.856 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-05-15T18:07:52.857 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-05-15T18:07:53.015 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-05-15T18:07:53.114 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:53.510 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:53.758 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 1/1 2024-05-15T18:07:53.758 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:53.758 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-05-15T18:07:53.758 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:19.0.0-2571.gbbba46de.el9.x86_64 2024-05-15T18:07:53.758 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:53.759 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-05-15T18:07:53.997 DEBUG:teuthology.parallel:result is None 2024-05-15T18:07:53.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bbba46de2a13fb16c0e4bdf7e55e7284972cce5e 2024-05-15T18:07:54.140 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T18:07:54.167 INFO:teuthology.orchestra.run.smithi003.stdout:19.0.0-2571.gbbba46de.el9 2024-05-15T18:07:54.167 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2571.gbbba46de.el9 2024-05-15T18:07:54.167 INFO:teuthology.task.install:The correct ceph version 19.0.0-2571.gbbba46de is installed. 2024-05-15T18:07:54.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bbba46de2a13fb16c0e4bdf7e55e7284972cce5e 2024-05-15T18:07:54.385 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T18:07:54.407 INFO:teuthology.orchestra.run.smithi173.stdout:19.0.0-2571.gbbba46de.el9 2024-05-15T18:07:54.407 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2571.gbbba46de.el9 2024-05-15T18:07:54.408 INFO:teuthology.task.install:The correct ceph version 19.0.0-2571.gbbba46de is installed. 2024-05-15T18:07:54.409 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-15T18:07:54.410 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:54.410 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T18:07:54.441 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:07:54.441 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T18:07:54.475 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-15T18:07:54.475 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:54.475 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T18:07:54.511 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T18:07:54.581 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:07:54.581 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T18:07:54.607 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T18:07:54.674 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-15T18:07:54.674 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:54.674 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T18:07:54.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T18:07:54.775 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:07:54.775 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T18:07:54.801 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T18:07:54.867 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-15T18:07:54.867 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:54.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T18:07:54.898 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T18:07:54.968 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:07:54.968 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T18:07:54.993 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T18:07:55.058 INFO:teuthology.run_tasks:Running task ceph... 2024-05-15T18:07:55.153 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-15T18:07:55.153 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /var/log/ceph 2024-05-15T18:07:55.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2024-05-15T18:07:55.183 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-15T18:07:55.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T18:07:55.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T18:07:55.254 INFO:tasks.ceph:Creating extra log directories... 2024-05-15T18:07:55.254 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T18:07:55.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T18:07:55.330 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-15T18:07:55.331 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-15T18:07:55.331 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331', 'branch': 'wip-65996-squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7707331', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-65996-squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-65996-squid', 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 5575, 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-65996-squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bbba46de2a13fb16c0e4bdf7e55e7284972cce5e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e', 'targets': {'smithi003.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYMn3SuJzZuNiTB7CRgxyRcR4h+aBOj2TzBe+sZPBD34qX7Mvmd0kC2hiY38nt7gXzuYpPpVX+goFuykWKeb8k=', 'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPlEx610WxDZDU1EM7zvdsbMiu33EZCateP6pqehLeQ9KGtANaftcsvkv5lDOjdAo6CyodCH9bTTKKl+wPwXyYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bbba46de2a13fb16c0e4bdf7e55e7284972cce5e', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-15_17:01:13', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-15T18:07:55.331 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T18:07:55.364 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T18:07:55.380 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T18:07:55.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T18:07:55.445 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:55.445 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T18:07:55.500 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T18:07:55.501 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-05-15 18:07:27.802325835 +0000 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-05-15 18:00:05.240169302 +0000 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-05-15 18:00:05.240169302 +0000 2024-05-15T18:07:55.557 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-05-15 18:00:05.240169302 +0000 2024-05-15T18:07:55.558 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T18:07:55.621 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-05-15T18:07:55.622 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-05-15T18:07:55.622 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000203643 s, 2.5 MB/s 2024-05-15T18:07:55.623 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T18:07:55.679 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2024-05-15T18:07:55.740 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T18:07:55.740 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:55.740 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-15T18:07:55.740 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:55.740 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:55.741 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-05-15 18:07:27.802325835 +0000 2024-05-15T18:07:55.741 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-05-15 18:00:05.591164950 +0000 2024-05-15T18:07:55.741 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-05-15 18:00:05.591164950 +0000 2024-05-15T18:07:55.741 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-05-15 18:00:05.591164950 +0000 2024-05-15T18:07:55.741 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T18:07:55.811 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-05-15T18:07:55.812 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-05-15T18:07:55.812 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000206077 s, 2.5 MB/s 2024-05-15T18:07:55.813 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T18:07:55.871 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2024-05-15T18:07:55.933 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T18:07:55.933 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:55.933 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-15T18:07:55.934 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:55.935 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:55.935 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-05-15 18:07:27.803325823 +0000 2024-05-15T18:07:55.935 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-05-15 18:00:05.935160685 +0000 2024-05-15T18:07:55.935 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-05-15 18:00:05.935160685 +0000 2024-05-15T18:07:55.935 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-05-15 18:00:05.935160685 +0000 2024-05-15T18:07:55.935 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T18:07:56.001 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-05-15T18:07:56.001 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-05-15T18:07:56.001 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000218118 s, 2.3 MB/s 2024-05-15T18:07:56.003 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T18:07:56.064 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2024-05-15T18:07:56.122 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T18:07:56.122 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:56.123 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-15T18:07:56.123 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:56.123 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:56.123 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-05-15 18:07:27.803325823 +0000 2024-05-15T18:07:56.123 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-05-15 18:00:06.296156209 +0000 2024-05-15T18:07:56.123 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-05-15 18:00:06.296156209 +0000 2024-05-15T18:07:56.123 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-05-15 18:00:06.296156209 +0000 2024-05-15T18:07:56.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T18:07:56.188 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-05-15T18:07:56.188 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-05-15T18:07:56.189 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000193869 s, 2.6 MB/s 2024-05-15T18:07:56.190 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T18:07:56.248 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-15T18:07:56.248 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:07:56.248 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T18:07:56.268 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T18:07:56.268 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-05-15T18:07:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T18:07:56.327 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:56.327 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-15T18:07:56.327 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:56.328 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:56.328 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-05-15 18:07:50.364968678 +0000 2024-05-15T18:07:56.328 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-05-15 18:02:15.091432855 +0000 2024-05-15T18:07:56.328 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-05-15 18:02:15.091432855 +0000 2024-05-15T18:07:56.328 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-05-15 18:02:15.091432855 +0000 2024-05-15T18:07:56.328 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T18:07:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-05-15T18:07:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-05-15T18:07:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000345994 s, 1.5 MB/s 2024-05-15T18:07:56.395 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T18:07:56.455 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-05-15T18:07:56.512 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-05-15 18:07:50.365968656 +0000 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-05-15 18:02:15.443424949 +0000 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-05-15 18:02:15.443424949 +0000 2024-05-15T18:07:56.513 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-05-15 18:02:15.443424949 +0000 2024-05-15T18:07:56.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T18:07:56.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-05-15T18:07:56.578 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-05-15T18:07:56.578 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000233773 s, 2.2 MB/s 2024-05-15T18:07:56.579 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T18:07:56.638 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-05-15T18:07:56.695 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T18:07:56.695 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:56.696 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-15T18:07:56.696 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:56.696 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:56.696 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-05-15 18:07:50.365968656 +0000 2024-05-15T18:07:56.696 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-05-15 18:02:15.778417424 +0000 2024-05-15T18:07:56.696 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-05-15 18:02:15.778417424 +0000 2024-05-15T18:07:56.696 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-05-15 18:02:15.778417424 +0000 2024-05-15T18:07:56.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T18:07:56.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-05-15T18:07:56.760 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-05-15T18:07:56.760 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000211401 s, 2.4 MB/s 2024-05-15T18:07:56.761 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T18:07:56.820 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-05-15T18:07:56.877 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T18:07:56.877 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T18:07:56.877 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-15T18:07:56.877 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T18:07:56.877 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T18:07:56.877 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-05-15 18:07:50.366968634 +0000 2024-05-15T18:07:56.878 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-05-15 18:02:16.137409361 +0000 2024-05-15T18:07:56.878 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-05-15 18:02:16.137409361 +0000 2024-05-15T18:07:56.878 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-05-15 18:02:16.137409361 +0000 2024-05-15T18:07:56.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T18:07:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-05-15T18:07:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-05-15T18:07:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000192099 s, 2.7 MB/s 2024-05-15T18:07:56.943 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T18:07:57.002 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-15T18:07:57.002 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-15T18:07:57.002 INFO:tasks.ceph:Generating config... 2024-05-15T18:07:57.004 INFO:tasks.ceph:[client] debug ms = 1 2024-05-15T18:07:57.004 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-05-15T18:07:57.004 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-15T18:07:57.004 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-15T18:07:57.004 INFO:tasks.ceph:[client] setuser = ceph 2024-05-15T18:07:57.004 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-15T18:07:57.004 INFO:tasks.ceph:[osd] debug objclass = 20 2024-05-15T18:07:57.004 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-15T18:07:57.004 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-15T18:07:57.005 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-15T18:07:57.006 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-15T18:07:57.006 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-15T18:07:57.006 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-15T18:07:57.006 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-15T18:07:57.006 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-15T18:07:57.006 INFO:tasks.ceph:Setting up mon.a... 2024-05-15T18:07:57.006 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-15T18:07:57.059 INFO:teuthology.orchestra.run.smithi003.stdout:creating /etc/ceph/ceph.keyring 2024-05-15T18:07:57.062 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-15T18:07:57.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T18:07:57.133 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.3')] 2024-05-15T18:07:57.133 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.3'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-05-15T18:07:57.134 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:57.134 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T18:07:57.189 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.3 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:07:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:07:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: generated fsid b091c162-becd-4424-b394-ddcc165a450a 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = quincy 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 0 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:fsid b091c162-becd-4424-b394-ddcc165a450a 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:last_changed 2024-05-15T18:07:57.294567+0000 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-05-15T18:07:57.294567+0000 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:min_mon_release 17 (quincy) 2024-05-15T18:07:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:election_strategy: 1 2024-05-15T18:07:57.272 INFO:teuthology.orchestra.run.smithi003.stdout:0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-05-15T18:07:57.272 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-15T18:07:57.273 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T18:07:57.329 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b091c162-becd-4424-b394-ddcc165a450a... 2024-05-15T18:07:57.330 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T18:07:57.372 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T18:07:57.413 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2024-05-15T18:07:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: chdir = "" 2024-05-15T18:07:57.413 INFO:teuthology.orchestra.run.smithi003.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: auth supported = cephx 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: filestore xattr use omap = true 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: mon clock drift allowed = 1.000 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: osd crush chooseleaf type = 0 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: auth debug = true 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on old message = true 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: ms die on bug = true 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.414 INFO:teuthology.orchestra.run.smithi003.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: mon pg warn max object skew = 0 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default size = 2 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow primary affinity = true 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd allow pg remap = true 2024-05-15T18:07:57.415 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on legacy crush tunables = false 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on crush straw calc version zero = false 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on no sortbitwise = false 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on osd down out interval zero = false 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: mon warn on too few osds = false 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: mon_allow_pool_size_one = true 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: osd default data pool replay window = 5 2024-05-15T18:07:57.416 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: mon allow pool delete = true 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: mon cluster log file level = debug 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: debug asserts on shutdown = true 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: mon health detail to clog = false 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: mon host = 172.21.15.3 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = b091c162-becd-4424-b394-ddcc165a450a 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout:[osd] 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: osd journal size = 100 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub load threshold = 5.0 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: osd scrub max interval = 600 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: osd mclock profile = high_recovery_ops 2024-05-15T18:07:57.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd recover clone overlap = true 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd recovery max chunk = 1048576 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug shutdown = true 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug op order = true 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug verify stray on activate = true 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug trim objects = true 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd open classes on start = true 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug pg log writeout = true 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd deep scrub update digest min age = 30 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.418 INFO:teuthology.orchestra.run.smithi003.stdout: osd map max advance = 10 2024-05-15T18:07:57.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.419 INFO:teuthology.orchestra.run.smithi003.stdout: journal zero on create = true 2024-05-15T18:07:57.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.419 INFO:teuthology.orchestra.run.smithi003.stdout: filestore ondisk finisher threads = 3 2024-05-15T18:07:57.419 INFO:teuthology.orchestra.run.smithi003.stdout: filestore apply finisher threads = 3 2024-05-15T18:07:57.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.419 INFO:teuthology.orchestra.run.smithi003.stdout: bdev debug aio = true 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: osd debug misdirected ops = true 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: debug objclass = 20 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: bdev async discard = True 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: bdev enable discard = True 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore allocator = bitmap 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore block size = 96636764160 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: bluestore fsck on mount = True 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluefs = 1/20 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: debug bluestore = 1/20 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: debug osd = 20 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: debug rocksdb = 4/10 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd full ratio = 0.9 2024-05-15T18:07:57.420 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd nearfull ratio = 0.8 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: osd failsafe full ratio = 0.95 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: osd objectstore = bluestore 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr] 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: debug mgr = 20 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: mgr/telemetry/nag = false 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.421 INFO:teuthology.orchestra.run.smithi003.stdout:[mon] 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: debug mon = 20 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: debug paxos = 20 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: debug auth = 20 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon data avail warn = 5 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon mgr mkfs grace = 240 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min pgs per osd = 4 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd reporter subtree level = osd 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon osd prime pg temp = true 2024-05-15T18:07:57.422 INFO:teuthology.orchestra.run.smithi003.stdout: mon reweight min bytes per osd = 10 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.423 INFO:teuthology.orchestra.run.smithi003.stdout: # 1m isn't quite enough 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: mon_down_mkfs_grace = 2m 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: mon_warn_on_filestore_osds = false 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout:[client] 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: rgw cache enabled = true 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable ops log = true 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: rgw enable usage log = true 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: debug ms = 1 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: rgw gc obj min wait = 15 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: debug rgw = 20 2024-05-15T18:07:57.424 INFO:teuthology.orchestra.run.smithi003.stdout: setgroup = ceph 2024-05-15T18:07:57.425 INFO:teuthology.orchestra.run.smithi003.stdout: setuser = ceph 2024-05-15T18:07:57.425 INFO:teuthology.orchestra.run.smithi003.stdout:[mon.a] 2024-05-15T18:07:57.425 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-05-15T18:07:57.425 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2024-05-15T18:07:57.425 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T18:07:57.425 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2024-05-15T18:07:57.426 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2024-05-15T18:07:57.427 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2024-05-15T18:07:57.428 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = 172.21.15.3 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = b091c162-becd-4424-b394-ddcc165a450a 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2024-05-15T18:07:57.429 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug trim objects = true 2024-05-15T18:07:57.430 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2024-05-15T18:07:57.431 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: debug objclass = 20 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1/20 2024-05-15T18:07:57.432 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1/20 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 4/10 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-05-15T18:07:57.433 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-05-15T18:07:57.434 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2024-05-15T18:07:57.434 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.434 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2024-05-15T18:07:57.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-05-15T18:07:57.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-05-15T18:07:57.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2024-05-15T18:07:57.434 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.435 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T18:07:57.436 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-05-15T18:07:57.437 INFO:teuthology.orchestra.run.smithi173.stdout: rgw gc obj min wait = 15 2024-05-15T18:07:57.437 INFO:teuthology.orchestra.run.smithi173.stdout: debug rgw = 20 2024-05-15T18:07:57.437 INFO:teuthology.orchestra.run.smithi173.stdout: setgroup = ceph 2024-05-15T18:07:57.437 INFO:teuthology.orchestra.run.smithi173.stdout: setuser = ceph 2024-05-15T18:07:57.437 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2024-05-15T18:07:57.439 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-15T18:07:57.439 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-15T18:07:57.534 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-15T18:07:57.534 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:57.534 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-15T18:07:57.550 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:57.550 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-15T18:07:57.606 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi003.front.sepia.ceph.com 2024-05-15T18:07:57.607 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:57.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T18:07:57.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T18:07:57.682 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:07:57.683 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:07:57.739 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:07:57.739 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:07:57.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T18:07:57.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T18:07:57.774 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:07:57.774 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:07:57.830 INFO:tasks.ceph:Setting up mon nodes... 2024-05-15T18:07:57.830 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-15T18:07:57.830 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T18:07:57.929 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T18:07:57.931 INFO:tasks.ceph:Setting up mds nodes... 2024-05-15T18:07:57.932 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-15T18:07:57.932 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-15T18:07:57.972 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-15T18:07:57.984 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-15T18:07:57.984 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi003.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-15T18:07:57.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-15T18:07:58.011 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-15T18:07:58.011 INFO:tasks.ceph:role: osd.0 2024-05-15T18:07:58.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com 2024-05-15T18:07:58.011 DEBUG:teuthology.orchestra.run.smithi003:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T18:07:58.084 INFO:teuthology.orchestra.run.smithi003.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout: = sunit=0 swidth=0 blks 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T18:07:58.085 INFO:teuthology.orchestra.run.smithi003.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T18:07:58.552 INFO:teuthology.orchestra.run.smithi003.stdout:Discarding blocks...Done. 2024-05-15T18:07:58.554 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi003.front.sepia.ceph.com -o noatime 2024-05-15T18:07:58.554 DEBUG:teuthology.orchestra.run.smithi003:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-15T18:07:58.659 DEBUG:teuthology.orchestra.run.smithi003:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-15T18:07:58.696 DEBUG:teuthology.orchestra.run.smithi003:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:07:58.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:07:58.811+0000 7fb808e14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-15T18:07:58.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:07:58.814+0000 7fb808e14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-15T18:07:58.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:07:58.814+0000 7fb808e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T18:07:58.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:07:58.814+0000 7fb808e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T18:07:58.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:07:58.814+0000 7fb808e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T18:07:58.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:07:58.822+0000 7fb808e14640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-15T18:08:01.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-15T18:08:01.685 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-15T18:08:01.715 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-15T18:08:01.715 INFO:tasks.ceph:role: osd.1 2024-05-15T18:08:01.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:08:01.715 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T18:08:01.793 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T18:08:02.327 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-05-15T18:08:02.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-05-15T18:08:02.329 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-15T18:08:02.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-15T18:08:02.515 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-15T18:08:02.583 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-15T18:08:02.583 INFO:tasks.ceph:role: osd.2 2024-05-15T18:08:02.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:08:02.583 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-15T18:08:02.657 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T18:08:02.657 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T18:08:02.657 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T18:08:02.657 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T18:08:02.658 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T18:08:02.658 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-05-15T18:08:02.658 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T18:08:02.658 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T18:08:02.658 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T18:08:02.658 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T18:08:03.099 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-05-15T18:08:03.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-05-15T18:08:03.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-05-15T18:08:03.189 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-15T18:08:03.218 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-15T18:08:03.282 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-15T18:08:03.283 INFO:tasks.ceph:role: osd.3 2024-05-15T18:08:03.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:08:03.283 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T18:08:03.356 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T18:08:03.839 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-05-15T18:08:03.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-05-15T18:08:03.841 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-05-15T18:08:03.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-15T18:08:04.008 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:08:04.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:04.121+0000 7f0dfa414640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-15T18:08:04.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:04.123+0000 7f0dfa414640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-15T18:08:04.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:04.123+0000 7f0dfa414640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T18:08:04.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:04.123+0000 7f0dfa414640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T18:08:04.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:04.123+0000 7f0dfa414640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T18:08:04.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:04.130+0000 7f0dfa414640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-15T18:08:06.951 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-15T18:08:06.981 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:08:07.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:07.093+0000 7fe018411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-15T18:08:07.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:07.093+0000 7fe018411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-15T18:08:07.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:07.093+0000 7fe018411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T18:08:07.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:07.093+0000 7fe018411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T18:08:07.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:07.093+0000 7fe018411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T18:08:07.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:07.094+0000 7fe018411640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-15T18:08:09.919 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-15T18:08:09.948 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:08:10.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:10.061+0000 7fae7f621640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-15T18:08:10.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:10.061+0000 7fae7f621640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-15T18:08:10.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:10.061+0000 7fae7f621640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T18:08:10.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:10.061+0000 7fae7f621640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T18:08:10.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:10.061+0000 7fae7f621640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T18:08:10.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:10.062+0000 7fae7f621640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-15T18:08:12.882 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-15T18:08:12.909 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-15T18:08:12.910 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:08:12.910 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-15T18:08:12.941 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:12.941 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-15T18:08:12.975 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:12.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-15T18:08:13.041 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:13.041 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-15T18:08:13.107 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:13.107 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-15T18:08:13.173 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:13.173 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-15T18:08:13.228 INFO:tasks.ceph:Adding keys to all mons... 2024-05-15T18:08:13.228 DEBUG:teuthology.orchestra.run.smithi003:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-15T18:08:13.257 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.0] 2024-05-15T18:08:13.257 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD++URmILV8MBAANl5wsLPTkRgaslQeNBRO8Q== 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout:[mgr.x] 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD9+URmHWvPOBAAEzkFAbk/PbF2a3PpzaZTcA== 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.1] 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAE+kRm9wBSBxAAsqV92tKhXZsfrL/b5m9kgw== 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.2] 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAH+kRmjUCrBRAA47NiMxvqUZOuybzEc6aEqA== 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout:[osd.3] 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQAK+kRmnf68AxAA7o44puxp4CRhbOSLYH4iTA== 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2024-05-15T18:08:13.258 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQD9+URmDkxfOxAA7oG9AO9MwEguzY8xR23Ckg== 2024-05-15T18:08:13.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T18:08:13.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T18:08:13.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T18:08:13.469 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T18:08:13.521 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T18:08:13.573 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T18:08:13.628 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-15T18:08:13.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-15T18:08:13.654 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T18:08:13.752 DEBUG:teuthology.orchestra.run.smithi003:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-15T18:08:13.778 DEBUG:teuthology.orchestra.run.smithi003:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-15T18:08:13.835 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-15T18:08:13.835 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-15T18:08:13.835 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-15T18:08:13.877 INFO:tasks.ceph.mon.a:Started 2024-05-15T18:08:13.877 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-15T18:08:13.878 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-15T18:08:13.878 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-15T18:08:13.880 INFO:tasks.ceph.mgr.x:Started 2024-05-15T18:08:13.880 INFO:tasks.ceph:Setting crush tunables to default 2024-05-15T18:08:13.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd crush tunables default 2024-05-15T18:08:13.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.004+0000 7f8198b00640 1 Processor -- start 2024-05-15T18:08:13.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.004+0000 7f8198b00640 1 -- start start 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8198b00640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 0x7f81941337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8198b00640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81940720b0 con 0x7f819406d4f0 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8198b00640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f819406f6b0 con 0x7f819406dfe0 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8191d9b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 0x7f81941337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f819259c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f819406d4f0 0x7f819406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54504/0 (socket says 172.21.15.3:54504) 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f819259c640 1 -- 172.21.15.3:0/1233126438 learned_addr learned my addr 172.21.15.3:0/1233126438 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8191d9b640 1 -- 172.21.15.3:0/1233126438 >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 msgr2=0x7f81941337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8191d9b640 1 -- 172.21.15.3:0/1233126438 >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 msgr2=0x7f81941337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-15T18:08:13.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8191d9b640 1 --2- 172.21.15.3:0/1233126438 >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 0x7f81941337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-15T18:08:13.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.005+0000 7f8191d9b640 1 --2- 172.21.15.3:0/1233126438 >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 0x7f81941337c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423153760 0 0) 0x7f81940720b0 con 0x7f819406d4f0 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8180003520 con 0x7f819406d4f0 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2976266632 0 0) 0x7f8180003520 con 0x7f819406d4f0 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 msgr2=0x7f81941337c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 --2- 172.21.15.3:0/1233126438 >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 0x7f81941337c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819406e710 con 0x7f819406d4f0 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3553069955 0 0) 0x7f8184001920 con 0x7f819406d4f0 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 >> v1:172.21.15.3:6789/0 conn(0x7f819406d4f0 legacy=0x7f819406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 --2- 172.21.15.3:0/1233126438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f8180003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8180004520 con 0x7f81800039b0 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819259c640 1 --2- 172.21.15.3:0/1233126438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f8180003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:13.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.010+0000 7f819259c640 1 -- 172.21.15.3:0/1233126438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8180003520 con 0x7f81800039b0 2024-05-15T18:08:13.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.012+0000 7f819259c640 1 --2- 172.21.15.3:0/1233126438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f8180003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f818400a770 tx=0x7f8180005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6617a7f81dcc26a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:13.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.012+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f818400a410 con 0x7f81800039b0 2024-05-15T18:08:13.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.012+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8184007070 con 0x7f81800039b0 2024-05-15T18:08:13.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.012+0000 7f819159a640 1 -- 172.21.15.3:0/1233126438 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8184007370 con 0x7f81800039b0 2024-05-15T18:08:13.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 -- 172.21.15.3:0/1233126438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 msgr2=0x7f8180003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:13.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 --2- 172.21.15.3:0/1233126438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f8180003db0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f818400a770 tx=0x7f8180005830 comp rx=0 tx=0).stop 2024-05-15T18:08:13.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 -- 172.21.15.3:0/1233126438 shutdown_connections 2024-05-15T18:08:13.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 --2- 172.21.15.3:0/1233126438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f8180003db0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 --2- 172.21.15.3:0/1233126438 >> v2:172.21.15.3:3300/0 conn(0x7f819406dfe0 0x7f81941337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 -- 172.21.15.3:0/1233126438 >> 172.21.15.3:0/1233126438 conn(0x7f819409d750 msgr2=0x7f819409db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 -- 172.21.15.3:0/1233126438 shutdown_connections 2024-05-15T18:08:13.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.013+0000 7f8198b00640 1 -- 172.21.15.3:0/1233126438 wait complete. 2024-05-15T18:08:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.014+0000 7f8198b00640 1 Processor -- start 2024-05-15T18:08:13.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.014+0000 7f8198b00640 1 -- start start 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.014+0000 7f8198b00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f81941c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.014+0000 7f8198b00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f819409fe30 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.014+0000 7f819259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f81941c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.014+0000 7f819259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f81941c2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47188/0 (socket says 172.21.15.3:47188) 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.014+0000 7f819259c640 1 -- 172.21.15.3:0/2058517124 learned_addr learned my addr 172.21.15.3:0/2058517124 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f819259c640 1 -- 172.21.15.3:0/2058517124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8194129040 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f819259c640 1 --2- 172.21.15.3:0/2058517124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f81941c2f30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f818400a890 tx=0x7f81940a0590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f818affd640 1 -- 172.21.15.3:0/2058517124 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f818403a040 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f818affd640 1 -- 172.21.15.3:0/2058517124 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8184044070 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819412b030 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f818affd640 1 -- 172.21.15.3:0/2058517124 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8184004b60 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8194129720 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f818affd640 1 -- 172.21.15.3:0/2058517124 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8184004d00 con 0x7f81800039b0 2024-05-15T18:08:13.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.015+0000 7f818affd640 1 -- 172.21.15.3:0/2058517124 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8184049820 con 0x7f81800039b0 2024-05-15T18:08:13.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.016+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8194129c90 con 0x7f81800039b0 2024-05-15T18:08:13.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.018+0000 7f818affd640 1 -- 172.21.15.3:0/2058517124 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8184007560 con 0x7f81800039b0 2024-05-15T18:08:14.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.084+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8194062e90 con 0x7f81800039b0 2024-05-15T18:08:14.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.085+0000 7f818affd640 1 -- 172.21.15.3:0/2058517124 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8184007740 con 0x7f81800039b0 2024-05-15T18:08:14.062 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2024-05-15T18:08:14.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.086+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 msgr2=0x7f81941c2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.086+0000 7f8198b00640 1 --2- 172.21.15.3:0/2058517124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f81941c2f30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f818400a890 tx=0x7f81940a0590 comp rx=0 tx=0).stop 2024-05-15T18:08:14.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.086+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 shutdown_connections 2024-05-15T18:08:14.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.086+0000 7f8198b00640 1 --2- 172.21.15.3:0/2058517124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f81800039b0 0x7f81941c2f30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.086+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 >> 172.21.15.3:0/2058517124 conn(0x7f819409d750 msgr2=0x7f8194133550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.086+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 shutdown_connections 2024-05-15T18:08:14.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:14.086+0000 7f8198b00640 1 -- 172.21.15.3:0/2058517124 wait complete. 2024-05-15T18:08:14.074 INFO:tasks.ceph:check_enable_crimson: False 2024-05-15T18:08:14.074 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-15T18:08:14.074 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-05-15T18:08:14.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-15T18:08:14.099 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:14.100 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-15T18:08:14.124 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:14.124 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-15T18:08:14.189 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-05-15T18:08:14.189 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-15T18:08:14.253 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 5f954d51-bfea-4d84-8489-befad33377e1 0 2024-05-15T18:08:14.269 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:14.293+0000 7fe680751040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-15T18:08:14.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.390+0000 7f06dea74640 1 Processor -- start 2024-05-15T18:08:14.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.390+0000 7f06dea74640 1 -- start start 2024-05-15T18:08:14.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06dea74640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f06d811ab90 0x7f06d811cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06dea74640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d811d550 con 0x7f06d8117f10 2024-05-15T18:08:14.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06dea74640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f06d811e750 con 0x7f06d811ab90 2024-05-15T18:08:14.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06d7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f06d811ab90 0x7f06d811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06d7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f06d811ab90 0x7f06d811cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49932/0 (socket says 172.21.15.173:49932) 2024-05-15T18:08:14.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06d7fff640 1 -- 172.21.15.173:0/2927521023 learned_addr learned my addr 172.21.15.173:0/2927521023 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:14.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06dc810640 1 --1- 172.21.15.173:0/2927521023 >> v1:172.21.15.3:6789/0 conn(0x7f06d8117f10 0x7f06d81182f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:39786/0 (socket says 172.21.15.173:39786) 2024-05-15T18:08:14.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06d7fff640 1 -- 172.21.15.173:0/2927521023 >> v1:172.21.15.3:6789/0 conn(0x7f06d8117f10 legacy=0x7f06d81182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.391+0000 7f06d7fff640 1 -- 172.21.15.173:0/2927521023 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d811e900 con 0x7f06d811ab90 2024-05-15T18:08:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.392+0000 7f06d7fff640 1 --2- 172.21.15.173:0/2927521023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d811ab90 0x7f06d811cf80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f06c40097f0 tx=0x7f06c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7b927881acc2b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.392+0000 7f06d77fe640 1 -- 172.21.15.173:0/2927521023 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c4035020 con 0x7f06d811ab90 2024-05-15T18:08:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.392+0000 7f06d77fe640 1 -- 172.21.15.173:0/2927521023 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c40317a0 con 0x7f06d811ab90 2024-05-15T18:08:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.392+0000 7f06d77fe640 1 -- 172.21.15.173:0/2927521023 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c4031aa0 con 0x7f06d811ab90 2024-05-15T18:08:14.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.393+0000 7f06dea74640 1 -- 172.21.15.173:0/2927521023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d811ab90 msgr2=0x7f06d811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.393+0000 7f06dea74640 1 --2- 172.21.15.173:0/2927521023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d811ab90 0x7f06d811cf80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f06c40097f0 tx=0x7f06c402b910 comp rx=0 tx=0).stop 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.393+0000 7f06dea74640 1 -- 172.21.15.173:0/2927521023 shutdown_connections 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.393+0000 7f06dea74640 1 --2- 172.21.15.173:0/2927521023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d811ab90 0x7f06d811cf80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.393+0000 7f06dea74640 1 -- 172.21.15.173:0/2927521023 >> 172.21.15.173:0/2927521023 conn(0x7f06d806e840 msgr2=0x7f06d810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.393+0000 7f06dea74640 1 -- 172.21.15.173:0/2927521023 shutdown_connections 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.393+0000 7f06dea74640 1 -- 172.21.15.173:0/2927521023 wait complete. 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.394+0000 7f06dea74640 1 Processor -- start 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.394+0000 7f06dea74640 1 -- start start 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.394+0000 7f06dea74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d8117f10 0x7f06d81a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.394+0000 7f06dea74640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f06d811dc40 con 0x7f06d8117f10 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.394+0000 7f06dc810640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d8117f10 0x7f06d81a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.394+0000 7f06dc810640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d8117f10 0x7f06d81a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49942/0 (socket says 172.21.15.173:49942) 2024-05-15T18:08:14.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.394+0000 7f06dc810640 1 -- 172.21.15.173:0/2707107285 learned_addr learned my addr 172.21.15.173:0/2707107285 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06dc810640 1 -- 172.21.15.173:0/2707107285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d81a6f30 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06dc810640 1 --2- 172.21.15.173:0/2707107285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d8117f10 0x7f06d81a69f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c450 tx=0x7f06cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06d57fa640 1 -- 172.21.15.173:0/2707107285 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06cc007410 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06d57fa640 1 -- 172.21.15.173:0/2707107285 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0075b0 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06d57fa640 1 -- 172.21.15.173:0/2707107285 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06cc004910 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d81a7220 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d81ab2d0 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06d57fa640 1 -- 172.21.15.173:0/2707107285 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f06cc01a020 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.395+0000 7f06d57fa640 1 -- 172.21.15.173:0/2707107285 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f06cc01c5c0 con 0x7f06d8117f10 2024-05-15T18:08:14.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.396+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d804fe40 con 0x7f06d8117f10 2024-05-15T18:08:14.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.398+0000 7f06d57fa640 1 -- 172.21.15.173:0/2707107285 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f06cc021070 con 0x7f06d8117f10 2024-05-15T18:08:14.426 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:14.449+0000 7fe680751040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-15T18:08:14.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.470+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5f954d51-bfea-4d84-8489-befad33377e1", "id": 0} v 0) -- 0x7f06d81a7450 con 0x7f06d8117f10 2024-05-15T18:08:14.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.472+0000 7f06d57fa640 1 -- 172.21.15.173:0/2707107285 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f954d51-bfea-4d84-8489-befad33377e1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f06cc01c9a0 con 0x7f06d8117f10 2024-05-15T18:08:14.449 INFO:teuthology.orchestra.run.smithi173.stdout:0 2024-05-15T18:08:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.473+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d8117f10 msgr2=0x7f06d81a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.473+0000 7f06dea74640 1 --2- 172.21.15.173:0/2707107285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d8117f10 0x7f06d81a69f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c450 tx=0x7f06cc00c910 comp rx=0 tx=0).stop 2024-05-15T18:08:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.473+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 shutdown_connections 2024-05-15T18:08:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.473+0000 7f06dea74640 1 --2- 172.21.15.173:0/2707107285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d8117f10 0x7f06d81a69f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.473+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 >> 172.21.15.173:0/2707107285 conn(0x7f06d806e840 msgr2=0x7f06d811af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.473+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 shutdown_connections 2024-05-15T18:08:14.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.473+0000 7f06dea74640 1 -- 172.21.15.173:0/2707107285 wait complete. 2024-05-15T18:08:14.460 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 1d016dab-93aa-42f0-a59a-63c894431afe 1 2024-05-15T18:08:14.483 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:14.506+0000 7fe680751040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-15T18:08:14.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe1a14ba640 1 Processor -- start 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe1a14ba640 1 -- start start 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe1a14ba640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe19c10f9a0 0x7fe19c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe1a14ba640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19c114fc0 con 0x7fe19c1103a0 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe1a14ba640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fe19c1151b0 con 0x7fe19c10f9a0 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe19affd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe19c10f9a0 0x7fe19c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe19affd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe19c10f9a0 0x7fe19c10fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49952/0 (socket says 172.21.15.173:49952) 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe19affd640 1 -- 172.21.15.173:0/1255307877 learned_addr learned my addr 172.21.15.173:0/1255307877 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.583+0000 7fe19a7fc640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe19c1103a0 0x7fe19c1147f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:39792/0 (socket says 172.21.15.173:39792) 2024-05-15T18:08:14.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.584+0000 7fe19affd640 1 -- 172.21.15.173:0/1255307877 >> v1:172.21.15.3:6789/0 conn(0x7fe19c1103a0 legacy=0x7fe19c1147f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.584+0000 7fe19affd640 1 -- 172.21.15.173:0/1255307877 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c115360 con 0x7fe19c10f9a0 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.584+0000 7fe19affd640 1 --2- 172.21.15.173:0/1255307877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c10fda0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4841aa0e7d3b15 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.584+0000 7fe199ffb640 1 -- 172.21.15.173:0/1255307877 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c035020 con 0x7fe19c10f9a0 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.584+0000 7fe199ffb640 1 -- 172.21.15.173:0/1255307877 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c0317a0 con 0x7fe19c10f9a0 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe199ffb640 1 -- 172.21.15.173:0/1255307877 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c031aa0 con 0x7fe19c10f9a0 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe1a14ba640 1 -- 172.21.15.173:0/1255307877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 msgr2=0x7fe19c10fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe1a14ba640 1 --2- 172.21.15.173:0/1255307877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c10fda0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c02b910 comp rx=0 tx=0).stop 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe1a14ba640 1 -- 172.21.15.173:0/1255307877 shutdown_connections 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe1a14ba640 1 --2- 172.21.15.173:0/1255307877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c10fda0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe1a14ba640 1 -- 172.21.15.173:0/1255307877 >> 172.21.15.173:0/1255307877 conn(0x7fe19c06f690 msgr2=0x7fe19c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe1a14ba640 1 -- 172.21.15.173:0/1255307877 shutdown_connections 2024-05-15T18:08:14.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.585+0000 7fe1a14ba640 1 -- 172.21.15.173:0/1255307877 wait complete. 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.586+0000 7fe1a14ba640 1 Processor -- start 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.586+0000 7fe1a14ba640 1 -- start start 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.586+0000 7fe1a14ba640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c1a3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.586+0000 7fe1a14ba640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c11ac30 con 0x7fe19c10f9a0 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.586+0000 7fe19affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c1a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.586+0000 7fe19affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c1a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49958/0 (socket says 172.21.15.173:49958) 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.586+0000 7fe19affd640 1 -- 172.21.15.173:0/2215513680 learned_addr learned my addr 172.21.15.173:0/2215513680 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe19affd640 1 -- 172.21.15.173:0/2215513680 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c10f530 con 0x7fe19c10f9a0 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe19affd640 1 --2- 172.21.15.173:0/2215513680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c1a3190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe1837fe640 1 -- 172.21.15.173:0/2215513680 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c03ad00 con 0x7fe19c10f9a0 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe1837fe640 1 -- 172.21.15.173:0/2215513680 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c0443f0 con 0x7fe19c10f9a0 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c1a36d0 con 0x7fe19c10f9a0 2024-05-15T18:08:14.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe1837fe640 1 -- 172.21.15.173:0/2215513680 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe18c0446d0 con 0x7fe19c10f9a0 2024-05-15T18:08:14.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c1a3bc0 con 0x7fe19c10f9a0 2024-05-15T18:08:14.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe1837fe640 1 -- 172.21.15.173:0/2215513680 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe18c04b060 con 0x7fe19c10f9a0 2024-05-15T18:08:14.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.587+0000 7fe1837fe640 1 -- 172.21.15.173:0/2215513680 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe18c04dd80 con 0x7fe19c10f9a0 2024-05-15T18:08:14.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.588+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c04fe40 con 0x7fe19c10f9a0 2024-05-15T18:08:14.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.590+0000 7fe1837fe640 1 -- 172.21.15.173:0/2215513680 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe18c052020 con 0x7fe19c10f9a0 2024-05-15T18:08:14.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.662+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d016dab-93aa-42f0-a59a-63c894431afe", "id": 1} v 0) -- 0x7fe19c117f20 con 0x7fe19c10f9a0 2024-05-15T18:08:14.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.664+0000 7fe1837fe640 1 -- 172.21.15.173:0/2215513680 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d016dab-93aa-42f0-a59a-63c894431afe", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe18c03f070 con 0x7fe19c10f9a0 2024-05-15T18:08:14.640 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-05-15T18:08:14.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.664+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 msgr2=0x7fe19c1a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.664+0000 7fe1a14ba640 1 --2- 172.21.15.173:0/2215513680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c1a3190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0097f0 tx=0x7fe18c0046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.664+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 shutdown_connections 2024-05-15T18:08:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.665+0000 7fe1a14ba640 1 --2- 172.21.15.173:0/2215513680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe19c10f9a0 0x7fe19c1a3190 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.665+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 >> 172.21.15.173:0/2215513680 conn(0x7fe19c06f690 msgr2=0x7fe19c113f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.665+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 shutdown_connections 2024-05-15T18:08:14.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.665+0000 7fe1a14ba640 1 -- 172.21.15.173:0/2215513680 wait complete. 2024-05-15T18:08:14.652 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 81eea92a-95c4-47aa-b7fd-60c53281e661 2 2024-05-15T18:08:14.770 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:14.790+0000 7fe680751040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.815+0000 7fad3d996640 1 Processor -- start 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.815+0000 7fad3d996640 1 -- start start 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.815+0000 7fad3d996640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad3811ab90 0x7fad3811cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.815+0000 7fad3d996640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3811d550 con 0x7fad38117f10 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.815+0000 7fad3d996640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fad3811e750 con 0x7fad3811ab90 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.816+0000 7fad367fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad3811ab90 0x7fad3811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.816+0000 7fad367fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fad3811ab90 0x7fad3811cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49962/0 (socket says 172.21.15.173:49962) 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.816+0000 7fad36ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fad38117f10 0x7fad381182f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:39796/0 (socket says 172.21.15.173:39796) 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.816+0000 7fad367fc640 1 -- 172.21.15.173:0/76315154 learned_addr learned my addr 172.21.15.173:0/76315154 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.816+0000 7fad367fc640 1 -- 172.21.15.173:0/76315154 >> v1:172.21.15.3:6789/0 conn(0x7fad38117f10 legacy=0x7fad381182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.816+0000 7fad367fc640 1 -- 172.21.15.173:0/76315154 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3811e900 con 0x7fad3811ab90 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.817+0000 7fad367fc640 1 --2- 172.21.15.173:0/76315154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad3811ab90 0x7fad3811cf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0097f0 tx=0x7fad2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd650efb75e3d6a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.817+0000 7fad35ffb640 1 -- 172.21.15.173:0/76315154 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c035020 con 0x7fad3811ab90 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.817+0000 7fad35ffb640 1 -- 172.21.15.173:0/76315154 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c0317a0 con 0x7fad3811ab90 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.817+0000 7fad35ffb640 1 -- 172.21.15.173:0/76315154 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c031aa0 con 0x7fad3811ab90 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 -- 172.21.15.173:0/76315154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad3811ab90 msgr2=0x7fad3811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 --2- 172.21.15.173:0/76315154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad3811ab90 0x7fad3811cf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0097f0 tx=0x7fad2c02b910 comp rx=0 tx=0).stop 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 -- 172.21.15.173:0/76315154 shutdown_connections 2024-05-15T18:08:14.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 --2- 172.21.15.173:0/76315154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad3811ab90 0x7fad3811cf80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 -- 172.21.15.173:0/76315154 >> 172.21.15.173:0/76315154 conn(0x7fad3806e840 msgr2=0x7fad3810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 -- 172.21.15.173:0/76315154 shutdown_connections 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 -- 172.21.15.173:0/76315154 wait complete. 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 Processor -- start 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.818+0000 7fad3d996640 1 -- start start 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.819+0000 7fad3d996640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad38117f10 0x7fad381a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.819+0000 7fad3d996640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fad3811dc40 con 0x7fad38117f10 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.819+0000 7fad36ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad38117f10 0x7fad381a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.819+0000 7fad36ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad38117f10 0x7fad381a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49976/0 (socket says 172.21.15.173:49976) 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.819+0000 7fad36ffd640 1 -- 172.21.15.173:0/2655357133 learned_addr learned my addr 172.21.15.173:0/2655357133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:14.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.819+0000 7fad36ffd640 1 -- 172.21.15.173:0/2655357133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad381a6f30 con 0x7fad38117f10 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad36ffd640 1 --2- 172.21.15.173:0/2655357133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad38117f10 0x7fad381a69f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad2800c450 tx=0x7fad2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad1ffff640 1 -- 172.21.15.173:0/2655357133 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad28007410 con 0x7fad38117f10 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad381a7220 con 0x7fad38117f10 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad1ffff640 1 -- 172.21.15.173:0/2655357133 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad280075b0 con 0x7fad38117f10 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad1ffff640 1 -- 172.21.15.173:0/2655357133 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad28004910 con 0x7fad38117f10 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad381ab2d0 con 0x7fad38117f10 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad1ffff640 1 -- 172.21.15.173:0/2655357133 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fad2801a020 con 0x7fad38117f10 2024-05-15T18:08:14.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.820+0000 7fad1ffff640 1 -- 172.21.15.173:0/2655357133 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fad28012810 con 0x7fad38117f10 2024-05-15T18:08:14.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.821+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3804fe40 con 0x7fad38117f10 2024-05-15T18:08:14.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.823+0000 7fad1ffff640 1 -- 172.21.15.173:0/2655357133 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fad28021070 con 0x7fad38117f10 2024-05-15T18:08:14.815 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:14.838+0000 7fe680751040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-15T18:08:14.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.895+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd new", "uuid": "81eea92a-95c4-47aa-b7fd-60c53281e661", "id": 2} v 0) -- 0x7fad381a73f0 con 0x7fad38117f10 2024-05-15T18:08:14.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.897+0000 7fad1ffff640 1 -- 172.21.15.173:0/2655357133 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "81eea92a-95c4-47aa-b7fd-60c53281e661", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fad28012610 con 0x7fad38117f10 2024-05-15T18:08:14.874 INFO:teuthology.orchestra.run.smithi173.stdout:2 2024-05-15T18:08:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.898+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad38117f10 msgr2=0x7fad381a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.898+0000 7fad3d996640 1 --2- 172.21.15.173:0/2655357133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad38117f10 0x7fad381a69f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad2800c450 tx=0x7fad2800c910 comp rx=0 tx=0).stop 2024-05-15T18:08:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.898+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 shutdown_connections 2024-05-15T18:08:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.898+0000 7fad3d996640 1 --2- 172.21.15.173:0/2655357133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad38117f10 0x7fad381a69f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.898+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 >> 172.21.15.173:0/2655357133 conn(0x7fad3806e840 msgr2=0x7fad3811af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.898+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 shutdown_connections 2024-05-15T18:08:14.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:14.898+0000 7fad3d996640 1 -- 172.21.15.173:0/2655357133 wait complete. 2024-05-15T18:08:14.885 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 4499dec7-c48d-42fb-95a6-9f5e346fb4da 3 2024-05-15T18:08:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.007+0000 7fe6161e6640 1 Processor -- start 2024-05-15T18:08:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.007+0000 7fe6161e6640 1 -- start start 2024-05-15T18:08:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe6161e6640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe610117f10 0x7fe6101182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe6161e6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe610118980 con 0x7fe610111bf0 2024-05-15T18:08:14.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe6161e6640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fe6101127b0 con 0x7fe610117f10 2024-05-15T18:08:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe60f7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe610117f10 0x7fe6101182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe60effd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe610111bf0 0x7fe6101120a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:39806/0 (socket says 172.21.15.173:39806) 2024-05-15T18:08:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe60effd640 1 -- 172.21.15.173:0/2838364438 learned_addr learned my addr 172.21.15.173:0/2838364438 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe60f7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe610117f10 0x7fe6101182f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49980/0 (socket says 172.21.15.173:49980) 2024-05-15T18:08:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe60f7fe640 1 -- 172.21.15.173:0/2838364438 >> v1:172.21.15.3:6789/0 conn(0x7fe610111bf0 legacy=0x7fe6101120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.008+0000 7fe60f7fe640 1 -- 172.21.15.173:0/2838364438 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe610112960 con 0x7fe610117f10 2024-05-15T18:08:14.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.009+0000 7fe60f7fe640 1 --2- 172.21.15.173:0/2838364438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610117f10 0x7fe6101182f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe60002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda4f90f3d25bcb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.013+0000 7fe60e7fc640 1 -- 172.21.15.173:0/2838364438 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe600039070 con 0x7fe610117f10 2024-05-15T18:08:14.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.013+0000 7fe60e7fc640 1 -- 172.21.15.173:0/2838364438 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60002cb10 con 0x7fe610117f10 2024-05-15T18:08:14.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.013+0000 7fe60e7fc640 1 -- 172.21.15.173:0/2838364438 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe60002ce10 con 0x7fe610117f10 2024-05-15T18:08:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.014+0000 7fe6161e6640 1 -- 172.21.15.173:0/2838364438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610117f10 msgr2=0x7fe6101182f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.014+0000 7fe6161e6640 1 --2- 172.21.15.173:0/2838364438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610117f10 0x7fe6101182f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe60002beb0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.014+0000 7fe6161e6640 1 -- 172.21.15.173:0/2838364438 shutdown_connections 2024-05-15T18:08:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.014+0000 7fe6161e6640 1 --2- 172.21.15.173:0/2838364438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610117f10 0x7fe6101182f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.014+0000 7fe6161e6640 1 -- 172.21.15.173:0/2838364438 >> 172.21.15.173:0/2838364438 conn(0x7fe61006e840 msgr2=0x7fe61010fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.014+0000 7fe6161e6640 1 -- 172.21.15.173:0/2838364438 shutdown_connections 2024-05-15T18:08:14.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.014+0000 7fe6161e6640 1 -- 172.21.15.173:0/2838364438 wait complete. 2024-05-15T18:08:14.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.015+0000 7fe6161e6640 1 Processor -- start 2024-05-15T18:08:14.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.015+0000 7fe6161e6640 1 -- start start 2024-05-15T18:08:14.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.015+0000 7fe6161e6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610111bf0 0x7fe6101a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:14.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.015+0000 7fe6161e6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe61011e090 con 0x7fe610111bf0 2024-05-15T18:08:14.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.015+0000 7fe60f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610111bf0 0x7fe6101a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:14.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.015+0000 7fe60f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610111bf0 0x7fe6101a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49996/0 (socket says 172.21.15.173:49996) 2024-05-15T18:08:14.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.015+0000 7fe60f7fe640 1 -- 172.21.15.173:0/2514067199 learned_addr learned my addr 172.21.15.173:0/2514067199 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:14.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe60f7fe640 1 -- 172.21.15.173:0/2514067199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6101a6f70 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe60f7fe640 1 --2- 172.21.15.173:0/2514067199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610111bf0 0x7fe6101a6a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe607fff640 1 -- 172.21.15.173:0/2514067199 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe600044020 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6101a7260 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe607fff640 1 -- 172.21.15.173:0/2514067199 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60003a040 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe607fff640 1 -- 172.21.15.173:0/2514067199 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe600039070 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6101ab310 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe607fff640 1 -- 172.21.15.173:0/2514067199 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe600047020 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.016+0000 7fe607fff640 1 -- 172.21.15.173:0/2514067199 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fe600049cb0 con 0x7fe610111bf0 2024-05-15T18:08:14.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.017+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61004fe40 con 0x7fe610111bf0 2024-05-15T18:08:14.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.019+0000 7fe607fff640 1 -- 172.21.15.173:0/2514067199 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe60004e030 con 0x7fe610111bf0 2024-05-15T18:08:15.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.092+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4499dec7-c48d-42fb-95a6-9f5e346fb4da", "id": 3} v 0) -- 0x7fe6101a7430 con 0x7fe610111bf0 2024-05-15T18:08:15.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.096+0000 7fe607fff640 1 -- 172.21.15.173:0/2514067199 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4499dec7-c48d-42fb-95a6-9f5e346fb4da", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fe600049400 con 0x7fe610111bf0 2024-05-15T18:08:15.072 INFO:teuthology.orchestra.run.smithi173.stdout:3 2024-05-15T18:08:15.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.097+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610111bf0 msgr2=0x7fe6101a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:15.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.097+0000 7fe6161e6640 1 --2- 172.21.15.173:0/2514067199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610111bf0 0x7fe6101a6a30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe600009d90 tx=0x7fe600004a40 comp rx=0 tx=0).stop 2024-05-15T18:08:15.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.097+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 shutdown_connections 2024-05-15T18:08:15.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.097+0000 7fe6161e6640 1 --2- 172.21.15.173:0/2514067199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe610111bf0 0x7fe6101a6a30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:15.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.097+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 >> 172.21.15.173:0/2514067199 conn(0x7fe61006e840 msgr2=0x7fe610113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:15.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.097+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 shutdown_connections 2024-05-15T18:08:15.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:15.097+0000 7fe6161e6640 1 -- 172.21.15.173:0/2514067199 wait complete. 2024-05-15T18:08:15.084 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-15T18:08:15.084 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-15T18:08:15.087 INFO:tasks.ceph.osd.0:Started 2024-05-15T18:08:15.087 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-15T18:08:15.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-15T18:08:15.089 INFO:tasks.ceph.osd.1:Started 2024-05-15T18:08:15.089 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-15T18:08:15.090 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-15T18:08:15.091 INFO:tasks.ceph.osd.2:Started 2024-05-15T18:08:15.092 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-15T18:08:15.092 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-15T18:08:15.094 INFO:tasks.ceph.osd.3:Started 2024-05-15T18:08:15.094 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T18:08:15.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.232+0000 7f5253d67640 1 Processor -- start 2024-05-15T18:08:15.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.232+0000 7f5253d67640 1 -- start start 2024-05-15T18:08:15.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5253d67640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f524c12c5b0 0x7f524c12c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:15.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5253d67640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524c113dd0 con 0x7f524c12ced0 2024-05-15T18:08:15.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5253d67640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f524c072290 con 0x7f524c12c5b0 2024-05-15T18:08:15.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5251b03640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f524c12c5b0 0x7f524c12c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:15.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5251302640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f524c12ced0 0x7f524c06e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54514/0 (socket says 172.21.15.3:54514) 2024-05-15T18:08:15.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5251302640 1 -- 172.21.15.3:0/2051672272 learned_addr learned my addr 172.21.15.3:0/2051672272 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:15.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5251b03640 1 -- 172.21.15.3:0/2051672272 >> v1:172.21.15.3:6789/0 conn(0x7f524c12ced0 legacy=0x7f524c06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:15.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5250b01640 1 -- 172.21.15.3:0/2051672272 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740930491 0 0) 0x7f524c113dd0 con 0x7f524c12ced0 2024-05-15T18:08:15.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.233+0000 7f5251b03640 1 -- 172.21.15.3:0/2051672272 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c12c390 con 0x7f524c12c5b0 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.234+0000 7f5251b03640 1 --2- 172.21.15.3:0/2051672272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c12c990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5248009720 tx=0x7f524802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398e8d339576e9b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.234+0000 7f5250b01640 1 -- 172.21.15.3:0/2051672272 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52480316d0 con 0x7f524c12c5b0 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.234+0000 7f5250b01640 1 -- 172.21.15.3:0/2051672272 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5248037070 con 0x7f524c12c5b0 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.234+0000 7f5250b01640 1 -- 172.21.15.3:0/2051672272 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52480319c0 con 0x7f524c12c5b0 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.234+0000 7f5253d67640 1 -- 172.21.15.3:0/2051672272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 msgr2=0x7f524c12c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.234+0000 7f5253d67640 1 --2- 172.21.15.3:0/2051672272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c12c990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5248009720 tx=0x7f524802b840 comp rx=0 tx=0).stop 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.235+0000 7f5253d67640 1 -- 172.21.15.3:0/2051672272 shutdown_connections 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.235+0000 7f5253d67640 1 --2- 172.21.15.3:0/2051672272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c12c990 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.235+0000 7f5253d67640 1 -- 172.21.15.3:0/2051672272 >> 172.21.15.3:0/2051672272 conn(0x7f524c099380 msgr2=0x7f524c099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:15.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.235+0000 7f5253d67640 1 -- 172.21.15.3:0/2051672272 shutdown_connections 2024-05-15T18:08:15.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.235+0000 7f5253d67640 1 -- 172.21.15.3:0/2051672272 wait complete. 2024-05-15T18:08:15.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5253d67640 1 Processor -- start 2024-05-15T18:08:15.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5253d67640 1 -- start start 2024-05-15T18:08:15.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5253d67640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:15.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5253d67640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f524c113b10 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5251b03640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5251b03640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c122140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47212/0 (socket says 172.21.15.3:47212) 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5251b03640 1 -- 172.21.15.3:0/1742720142 learned_addr learned my addr 172.21.15.3:0/1742720142 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.236+0000 7f5251b03640 1 -- 172.21.15.3:0/1742720142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524c071c40 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f5251b03640 1 --2- 172.21.15.3:0/1742720142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c122140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5248009720 tx=0x7f52480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f52427fc640 1 -- 172.21.15.3:0/1742720142 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5248032770 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f52427fc640 1 -- 172.21.15.3:0/1742720142 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5248032910 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524c1290f0 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f52427fc640 1 -- 172.21.15.3:0/1742720142 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5248032bf0 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524c118c10 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f52427fc640 1 -- 172.21.15.3:0/1742720142 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5248045780 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.237+0000 7f52427fc640 1 -- 172.21.15.3:0/1742720142 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f524802f050 con 0x7f524c12c5b0 2024-05-15T18:08:15.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.238+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f524c062e90 con 0x7f524c12c5b0 2024-05-15T18:08:15.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.240+0000 7f52427fc640 1 -- 172.21.15.3:0/1742720142 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5248063dd0 con 0x7f524c12c5b0 2024-05-15T18:08:15.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.301+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f524c073fd0 con 0x7f524c12c5b0 2024-05-15T18:08:15.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.301+0000 7f52427fc640 1 -- 172.21.15.3:0/1742720142 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f5248052020 con 0x7f524c12c5b0 2024-05-15T18:08:15.279 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:08:15.279 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":6,"fsid":"b091c162-becd-4424-b394-ddcc165a450a","created":"2024-05-15T18:08:14.002961+0000","modified":"2024-05-15T18:08:15.093157+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T18:08:15.093157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f954d51-bfea-4d84-8489-befad33377e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d016dab-93aa-42f0-a59a-63c894431afe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"81eea92a-95c4-47aa-b7fd-60c53281e661","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4499dec7-c48d-42fb-95a6-9f5e346fb4da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T18:08:15.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.302+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 msgr2=0x7f524c122140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:15.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.302+0000 7f5253d67640 1 --2- 172.21.15.3:0/1742720142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c122140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5248009720 tx=0x7f52480046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:15.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.302+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 shutdown_connections 2024-05-15T18:08:15.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.302+0000 7f5253d67640 1 --2- 172.21.15.3:0/1742720142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f524c12c5b0 0x7f524c122140 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:15.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.302+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 >> 172.21.15.3:0/1742720142 conn(0x7f524c099380 msgr2=0x7f524c1b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:15.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.302+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 shutdown_connections 2024-05-15T18:08:15.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:15.302+0000 7f5253d67640 1 -- 172.21.15.3:0/1742720142 wait complete. 2024-05-15T18:08:15.290 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-15T18:08:15.291 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-15T18:08:15.592 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:15.615+0000 7fe680751040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-15T18:08:15.678 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:15.701+0000 7fe680751040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-15T18:08:15.683 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-05-15T18:08:15.706+0000 7efc08225640 -1 Falling back to public interface 2024-05-15T18:08:15.686 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-05-15T18:08:15.709+0000 7fb01e80d640 -1 Falling back to public interface 2024-05-15T18:08:15.687 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-05-15T18:08:15.710+0000 7fd50d42c640 -1 Falling back to public interface 2024-05-15T18:08:15.690 INFO:tasks.ceph.osd.0.smithi003.stderr:2024-05-15T18:08:15.713+0000 7f4ea1ddc640 -1 Falling back to public interface 2024-05-15T18:08:15.694 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T18:08:15.723 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:15.746+0000 7fe680751040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.815+0000 7f838346b640 1 Processor -- start 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f838346b640 1 -- start start 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f838346b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f837c095110 0x7f837c0954f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f838346b640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837c06b290 con 0x7f837c095a30 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f838346b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f837c06b4d0 con 0x7f837c095110 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f8381207640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f837c095110 0x7f837c0954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f8380a06640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f837c095a30 0x7f837c12b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:54528/0 (socket says 172.21.15.3:54528) 2024-05-15T18:08:15.794 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f8380a06640 1 -- 172.21.15.3:0/195067656 learned_addr learned my addr 172.21.15.3:0/195067656 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:15.795 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f8381207640 1 -- 172.21.15.3:0/195067656 >> v1:172.21.15.3:6789/0 conn(0x7f837c095a30 legacy=0x7f837c12b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:15.795 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.816+0000 7f8381207640 1 -- 172.21.15.3:0/195067656 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c091170 con 0x7f837c095110 2024-05-15T18:08:15.797 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.817+0000 7f8381207640 1 --2- 172.21.15.3:0/195067656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c0954f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8378009720 tx=0x7f837802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a19fa98b6bfcc30 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.817+0000 7f8373fff640 1 -- 172.21.15.3:0/195067656 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83780316d0 con 0x7f837c095110 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.817+0000 7f8373fff640 1 -- 172.21.15.3:0/195067656 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8378037070 con 0x7f837c095110 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.817+0000 7f8373fff640 1 -- 172.21.15.3:0/195067656 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83780319c0 con 0x7f837c095110 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.818+0000 7f838346b640 1 -- 172.21.15.3:0/195067656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 msgr2=0x7f837c0954f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.818+0000 7f838346b640 1 --2- 172.21.15.3:0/195067656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c0954f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8378009720 tx=0x7f837802b840 comp rx=0 tx=0).stop 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.818+0000 7f838346b640 1 -- 172.21.15.3:0/195067656 shutdown_connections 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.818+0000 7f838346b640 1 --2- 172.21.15.3:0/195067656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c0954f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:15.798 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.818+0000 7f838346b640 1 -- 172.21.15.3:0/195067656 >> 172.21.15.3:0/195067656 conn(0x7f837c09a170 msgr2=0x7f837c09a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.818+0000 7f838346b640 1 -- 172.21.15.3:0/195067656 shutdown_connections 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.818+0000 7f838346b640 1 -- 172.21.15.3:0/195067656 wait complete. 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.819+0000 7f838346b640 1 Processor -- start 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.819+0000 7f838346b640 1 -- start start 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.819+0000 7f838346b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c06f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.819+0000 7f838346b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f837c095e40 con 0x7f837c095110 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.819+0000 7f8381207640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c06f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.819+0000 7f8381207640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c06f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47224/0 (socket says 172.21.15.3:47224) 2024-05-15T18:08:15.799 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.819+0000 7f8381207640 1 -- 172.21.15.3:0/2660390186 learned_addr learned my addr 172.21.15.3:0/2660390186 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f8381207640 1 -- 172.21.15.3:0/2660390186 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c08f300 con 0x7f837c095110 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f8381207640 1 --2- 172.21.15.3:0/2660390186 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c06f560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8378009840 tx=0x7f83780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f8371ffb640 1 -- 172.21.15.3:0/2660390186 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8378032770 con 0x7f837c095110 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f8371ffb640 1 -- 172.21.15.3:0/2660390186 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8378032910 con 0x7f837c095110 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f8371ffb640 1 -- 172.21.15.3:0/2660390186 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8378032c30 con 0x7f837c095110 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837c070e70 con 0x7f837c095110 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837c072710 con 0x7f837c095110 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f8371ffb640 1 -- 172.21.15.3:0/2660390186 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f837804c060 con 0x7f837c095110 2024-05-15T18:08:15.800 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.820+0000 7f8371ffb640 1 -- 172.21.15.3:0/2660390186 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f837802f050 con 0x7f837c095110 2024-05-15T18:08:15.801 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.821+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837c062e90 con 0x7f837c095110 2024-05-15T18:08:15.801 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.823+0000 7f8371ffb640 1 -- 172.21.15.3:0/2660390186 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8378040070 con 0x7f837c095110 2024-05-15T18:08:15.862 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.885+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f837c071f00 con 0x7f837c095110 2024-05-15T18:08:15.863 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.885+0000 7f8371ffb640 1 -- 172.21.15.3:0/2660390186 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f8378032dd0 con 0x7f837c095110 2024-05-15T18:08:15.863 INFO:teuthology.misc.health.smithi003.stdout: 2024-05-15T18:08:15.863 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":6,"fsid":"b091c162-becd-4424-b394-ddcc165a450a","created":"2024-05-15T18:08:14.002961+0000","modified":"2024-05-15T18:08:15.093157+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T18:08:15.093157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f954d51-bfea-4d84-8489-befad33377e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d016dab-93aa-42f0-a59a-63c894431afe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"81eea92a-95c4-47aa-b7fd-60c53281e661","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4499dec7-c48d-42fb-95a6-9f5e346fb4da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T18:08:15.864 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.886+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 msgr2=0x7f837c06f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:15.864 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.886+0000 7f838346b640 1 --2- 172.21.15.3:0/2660390186 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c06f560 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8378009840 tx=0x7f83780046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:15.864 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.886+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 shutdown_connections 2024-05-15T18:08:15.864 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.886+0000 7f838346b640 1 --2- 172.21.15.3:0/2660390186 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f837c095110 0x7f837c06f560 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:15.864 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.886+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 >> 172.21.15.3:0/2660390186 conn(0x7f837c09a170 msgr2=0x7f837c094000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:15.864 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.886+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 shutdown_connections 2024-05-15T18:08:15.864 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:15.886+0000 7f838346b640 1 -- 172.21.15.3:0/2660390186 wait complete. 2024-05-15T18:08:15.873 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-15T18:08:15.885 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:15.908+0000 7fe680751040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-15T18:08:15.931 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:15.955+0000 7fe680751040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-15T18:08:15.985 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:16.009+0000 7fe680751040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-15T18:08:16.095 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:16.118+0000 7fe680751040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-15T18:08:16.471 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:16.494+0000 7fe680751040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-15T18:08:16.728 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:16.751+0000 7fe680751040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-15T18:08:16.781 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:16.804+0000 7fe680751040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-15T18:08:16.898 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:16.921+0000 7fe680751040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-15T18:08:17.192 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:17.216+0000 7fe680751040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-15T18:08:17.239 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:17.262+0000 7fe680751040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-15T18:08:17.395 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:17.418+0000 7fe680751040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-15T18:08:17.528 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:17.552+0000 7fe680751040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-15T18:08:17.577 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:17.601+0000 7fe680751040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-15T18:08:17.649 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:17.673+0000 7fe680751040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-15T18:08:17.694 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:17.717+0000 7fe680751040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-15T18:08:18.163 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:18.186+0000 7fe680751040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-15T18:08:18.284 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:18.307+0000 7fe680751040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-15T18:08:19.119 INFO:tasks.ceph.osd.0.smithi003.stderr:2024-05-15T18:08:19.142+0000 7f4ea1ddc640 -1 osd.0 0 log_to_monitors true 2024-05-15T18:08:19.214 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-05-15T18:08:19.237+0000 7efc08225640 -1 osd.1 0 log_to_monitors true 2024-05-15T18:08:19.237 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-05-15T18:08:19.260+0000 7fb01e80d640 -1 osd.2 0 log_to_monitors true 2024-05-15T18:08:19.252 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-05-15T18:08:19.276+0000 7fd50d42c640 -1 osd.3 0 log_to_monitors true 2024-05-15T18:08:19.293 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-05-15T18:08:19.316+0000 7fe621b37640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-15T18:08:22.001 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-05-15T18:08:22.024+0000 7efc04ca0640 -1 osd.1 0 waiting for initial osdmap 2024-05-15T18:08:22.005 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-05-15T18:08:22.028+0000 7fd5081f2640 -1 osd.3 0 waiting for initial osdmap 2024-05-15T18:08:22.011 INFO:tasks.ceph.osd.1.smithi173.stderr:2024-05-15T18:08:22.035+0000 7efbfba9a640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T18:08:22.015 INFO:tasks.ceph.osd.3.smithi173.stderr:2024-05-15T18:08:22.039+0000 7fd500824640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T18:08:22.047 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-05-15T18:08:22.070+0000 7fb01b237640 -1 osd.2 0 waiting for initial osdmap 2024-05-15T18:08:22.056 INFO:tasks.ceph.osd.2.smithi173.stderr:2024-05-15T18:08:22.080+0000 7fb012031640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T18:08:22.276 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T18:08:22.370 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.392+0000 7f324f94f640 1 Processor -- start 2024-05-15T18:08:22.370 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.393+0000 7f324f94f640 1 -- start start 2024-05-15T18:08:22.371 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.393+0000 7f324f94f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f324812e210 0x7f324812e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:22.371 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.393+0000 7f324f94f640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324809a510 con 0x7f324812eb30 2024-05-15T18:08:22.371 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.393+0000 7f324f94f640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f324809a940 con 0x7f324812e210 2024-05-15T18:08:22.371 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.393+0000 7f324d6eb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f324812e210 0x7f324812e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:22.371 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.393+0000 7f324ceea640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f324812eb30 0x7f324812af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:59408/0 (socket says 172.21.15.3:59408) 2024-05-15T18:08:22.371 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.393+0000 7f324ceea640 1 -- 172.21.15.3:0/2625960417 learned_addr learned my addr 172.21.15.3:0/2625960417 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:22.372 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.394+0000 7f324d6eb640 1 -- 172.21.15.3:0/2625960417 >> v1:172.21.15.3:6789/0 conn(0x7f324812eb30 legacy=0x7f324812af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:22.372 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.394+0000 7f324d6eb640 1 -- 172.21.15.3:0/2625960417 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324806d890 con 0x7f324812e210 2024-05-15T18:08:22.373 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.395+0000 7f324d6eb640 1 --2- 172.21.15.3:0/2625960417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f324812e5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3244009750 tx=0x7f324402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282ac9ea81b209c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:22.373 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.395+0000 7f323bfff640 1 -- 172.21.15.3:0/2625960417 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32440316d0 con 0x7f324812e210 2024-05-15T18:08:22.373 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.395+0000 7f323bfff640 1 -- 172.21.15.3:0/2625960417 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3244037070 con 0x7f324812e210 2024-05-15T18:08:22.373 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.395+0000 7f323bfff640 1 -- 172.21.15.3:0/2625960417 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32440319c0 con 0x7f324812e210 2024-05-15T18:08:22.373 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.396+0000 7f324f94f640 1 -- 172.21.15.3:0/2625960417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 msgr2=0x7f324812e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:22.373 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.396+0000 7f324f94f640 1 --2- 172.21.15.3:0/2625960417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f324812e5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3244009750 tx=0x7f324402b840 comp rx=0 tx=0).stop 2024-05-15T18:08:22.373 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.396+0000 7f324f94f640 1 -- 172.21.15.3:0/2625960417 shutdown_connections 2024-05-15T18:08:22.374 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.396+0000 7f324f94f640 1 --2- 172.21.15.3:0/2625960417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f324812e5f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:22.374 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.396+0000 7f324f94f640 1 -- 172.21.15.3:0/2625960417 >> 172.21.15.3:0/2625960417 conn(0x7f324809d8e0 msgr2=0x7f324806cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:22.374 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.396+0000 7f324f94f640 1 -- 172.21.15.3:0/2625960417 shutdown_connections 2024-05-15T18:08:22.374 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.396+0000 7f324f94f640 1 -- 172.21.15.3:0/2625960417 wait complete. 2024-05-15T18:08:22.375 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.397+0000 7f324f94f640 1 Processor -- start 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.397+0000 7f324f94f640 1 -- start start 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.397+0000 7f324f94f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f32481c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.397+0000 7f324f94f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f324812b650 con 0x7f324812e210 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.397+0000 7f324d6eb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f32481c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.397+0000 7f324d6eb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f32481c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34412/0 (socket says 172.21.15.3:34412) 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.397+0000 7f324d6eb640 1 -- 172.21.15.3:0/1341337572 learned_addr learned my addr 172.21.15.3:0/1341337572 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.398+0000 7f324d6eb640 1 -- 172.21.15.3:0/1341337572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3248121540 con 0x7f324812e210 2024-05-15T18:08:22.376 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.398+0000 7f324d6eb640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f32481c33d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3244034040 tx=0x7f32440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:22.377 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.398+0000 7f3239ffb640 1 -- 172.21.15.3:0/1341337572 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3244032830 con 0x7f324812e210 2024-05-15T18:08:22.377 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.398+0000 7f3239ffb640 1 -- 172.21.15.3:0/1341337572 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32440329d0 con 0x7f324812e210 2024-05-15T18:08:22.377 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.398+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32481217d0 con 0x7f324812e210 2024-05-15T18:08:22.377 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.398+0000 7f3239ffb640 1 -- 172.21.15.3:0/1341337572 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3244032cf0 con 0x7f324812e210 2024-05-15T18:08:22.377 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.398+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32481c3af0 con 0x7f324812e210 2024-05-15T18:08:22.379 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.399+0000 7f3239ffb640 1 -- 172.21.15.3:0/1341337572 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f324404c060 con 0x7f324812e210 2024-05-15T18:08:22.379 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.399+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f324804fe40 con 0x7f324812e210 2024-05-15T18:08:22.379 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.400+0000 7f3239ffb640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f322c037fd0 0x7f322c03a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:22.380 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.400+0000 7f3239ffb640 1 -- 172.21.15.3:0/1341337572 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1623+0+0 (secure 0 0 0) 0x7f324402f050 con 0x7f324812e210 2024-05-15T18:08:22.380 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.400+0000 7f324ceea640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f322c037fd0 0x7f322c03a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:22.380 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.401+0000 7f324ceea640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f322c037fd0 0x7f322c03a490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f323c000f60 tx=0x7f323c007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:22.382 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.405+0000 7f3239ffb640 1 -- 172.21.15.3:0/1341337572 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f324804fe40 con 0x7f324812e210 2024-05-15T18:08:22.604 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.626+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3248062e90 con 0x7f324812e210 2024-05-15T18:08:22.604 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.627+0000 7f3239ffb640 1 -- 172.21.15.3:0/1341337572 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f3244040070 con 0x7f324812e210 2024-05-15T18:08:22.604 INFO:teuthology.misc.health.smithi003.stdout: 2024-05-15T18:08:22.605 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":8,"fsid":"b091c162-becd-4424-b394-ddcc165a450a","created":"2024-05-15T18:08:14.002961+0000","modified":"2024-05-15T18:08:20.363751+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T18:08:15.093157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5f954d51-bfea-4d84-8489-befad33377e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d016dab-93aa-42f0-a59a-63c894431afe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"81eea92a-95c4-47aa-b7fd-60c53281e661","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4499dec7-c48d-42fb-95a6-9f5e346fb4da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f322c037fd0 msgr2=0x7f322c03a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f322c037fd0 0x7f322c03a490 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f323c000f60 tx=0x7f323c007a80 comp rx=0 tx=0).stop 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 msgr2=0x7f32481c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f32481c33d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3244034040 tx=0x7f32440046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 shutdown_connections 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f322c037fd0 0x7f322c03a490 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 --2- 172.21.15.3:0/1341337572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f324812e210 0x7f32481c33d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.629+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 >> 172.21.15.3:0/1341337572 conn(0x7f324809d8e0 msgr2=0x7f324809ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:22.607 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.630+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 shutdown_connections 2024-05-15T18:08:22.608 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:22.630+0000 7f324f94f640 1 -- 172.21.15.3:0/1341337572 wait complete. 2024-05-15T18:08:22.617 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-15T18:08:23.099 INFO:tasks.ceph.osd.0.smithi003.stderr:2024-05-15T18:08:23.122+0000 7f4e9ed87640 -1 osd.0 0 waiting for initial osdmap 2024-05-15T18:08:23.109 INFO:tasks.ceph.osd.0.smithi003.stderr:2024-05-15T18:08:23.132+0000 7f4e95b81640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T18:08:29.021 DEBUG:teuthology.orchestra.run.smithi003:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T18:08:29.128 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.150+0000 7fa792f02640 1 Processor -- start 2024-05-15T18:08:29.128 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.150+0000 7fa792f02640 1 -- start start 2024-05-15T18:08:29.128 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa792f02640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa78c12b2b0 0x7fa78c094710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:29.128 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa792f02640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c12b700 con 0x7fa78c12aed0 2024-05-15T18:08:29.128 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa792f02640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c0906e0 con 0x7fa78c12b2b0 2024-05-15T18:08:29.129 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa78bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa78c12b2b0 0x7fa78c094710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:29.129 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa790c9e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fa78c12aed0 0x7fa78c094000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50424/0 (socket says 172.21.15.3:50424) 2024-05-15T18:08:29.129 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa790c9e640 1 -- 172.21.15.3:0/4284785195 learned_addr learned my addr 172.21.15.3:0/4284785195 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:29.129 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa78bfff640 1 -- 172.21.15.3:0/4284785195 >> v1:172.21.15.3:6789/0 conn(0x7fa78c12aed0 legacy=0x7fa78c094000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:29.129 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa78bfff640 1 -- 172.21.15.3:0/4284785195 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c095390 con 0x7fa78c12b2b0 2024-05-15T18:08:29.129 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.151+0000 7fa78b7fe640 1 -- 172.21.15.3:0/4284785195 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734217403 0 0) 0x7fa78c12b700 con 0x7fa78c12aed0 2024-05-15T18:08:29.130 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.152+0000 7fa78bfff640 1 --2- 172.21.15.3:0/4284785195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12b2b0 0x7fa78c094710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa780009720 tx=0x7fa78002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce85d7c430427fb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.152+0000 7fa78b7fe640 1 -- 172.21.15.3:0/4284785195 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa780035020 con 0x7fa78c12b2b0 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.152+0000 7fa78b7fe640 1 -- 172.21.15.3:0/4284785195 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa780031760 con 0x7fa78c12b2b0 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.152+0000 7fa78b7fe640 1 -- 172.21.15.3:0/4284785195 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa780031a60 con 0x7fa78c12b2b0 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.153+0000 7fa792f02640 1 -- 172.21.15.3:0/4284785195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12b2b0 msgr2=0x7fa78c094710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.153+0000 7fa792f02640 1 --2- 172.21.15.3:0/4284785195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12b2b0 0x7fa78c094710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa780009720 tx=0x7fa78002b8d0 comp rx=0 tx=0).stop 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.153+0000 7fa792f02640 1 -- 172.21.15.3:0/4284785195 shutdown_connections 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.153+0000 7fa792f02640 1 --2- 172.21.15.3:0/4284785195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12b2b0 0x7fa78c094710 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.153+0000 7fa792f02640 1 -- 172.21.15.3:0/4284785195 >> 172.21.15.3:0/4284785195 conn(0x7fa78c09a170 msgr2=0x7fa78c09a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.153+0000 7fa792f02640 1 -- 172.21.15.3:0/4284785195 shutdown_connections 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.153+0000 7fa792f02640 1 -- 172.21.15.3:0/4284785195 wait complete. 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.154+0000 7fa792f02640 1 Processor -- start 2024-05-15T18:08:29.131 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.154+0000 7fa792f02640 1 -- start start 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.154+0000 7fa792f02640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12aed0 0x7fa78c133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.154+0000 7fa792f02640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c094c50 con 0x7fa78c12aed0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.154+0000 7fa790c9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12aed0 0x7fa78c133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.154+0000 7fa790c9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12aed0 0x7fa78c133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41170/0 (socket says 172.21.15.3:41170) 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.154+0000 7fa790c9e640 1 -- 172.21.15.3:0/3778799631 learned_addr learned my addr 172.21.15.3:0/3778799631 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.155+0000 7fa790c9e640 1 -- 172.21.15.3:0/3778799631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c131cd0 con 0x7fa78c12aed0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.155+0000 7fa790c9e640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12aed0 0x7fa78c133dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c420 tx=0x7fa77c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.155+0000 7fa7897fa640 1 -- 172.21.15.3:0/3778799631 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c018070 con 0x7fa78c12aed0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.155+0000 7fa7897fa640 1 -- 172.21.15.3:0/3778799631 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c0074d0 con 0x7fa78c12aed0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.155+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c133400 con 0x7fa78c12aed0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.155+0000 7fa7897fa640 1 -- 172.21.15.3:0/3778799631 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa77c004950 con 0x7fa78c12aed0 2024-05-15T18:08:29.133 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.155+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c132e70 con 0x7fa78c12aed0 2024-05-15T18:08:29.134 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.156+0000 7fa7897fa640 1 -- 172.21.15.3:0/3778799631 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa77c01b070 con 0x7fa78c12aed0 2024-05-15T18:08:29.134 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.156+0000 7fa7897fa640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa778038060 0x7fa77803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:29.134 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.156+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c062e90 con 0x7fa78c12aed0 2024-05-15T18:08:29.135 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.156+0000 7fa7897fa640 1 -- 172.21.15.3:0/3778799631 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fa77c04a200 con 0x7fa78c12aed0 2024-05-15T18:08:29.135 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.156+0000 7fa78bfff640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa778038060 0x7fa77803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:29.135 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.157+0000 7fa78bfff640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa778038060 0x7fa77803a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa780009720 tx=0x7fa780008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:29.138 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.161+0000 7fa7897fa640 1 -- 172.21.15.3:0/3778799631 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa77c011980 con 0x7fa78c12aed0 2024-05-15T18:08:29.322 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.344+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa78c0985a0 con 0x7fa78c12aed0 2024-05-15T18:08:29.322 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.345+0000 7fa7897fa640 1 -- 172.21.15.3:0/3778799631 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7964 (secure 0 0 0) 0x7fa77c011be0 con 0x7fa78c12aed0 2024-05-15T18:08:29.322 INFO:teuthology.misc.health.smithi003.stdout: 2024-05-15T18:08:29.322 INFO:teuthology.misc.health.smithi003.stdout:{"epoch":13,"fsid":"b091c162-becd-4424-b394-ddcc165a450a","created":"2024-05-15T18:08:14.002961+0000","modified":"2024-05-15T18:08:27.130378+0000","last_up_change":"2024-05-15T18:08:24.124486+0000","last_in_change":"2024-05-15T18:08:15.093157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T18:08:24.359980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f954d51-bfea-4d84-8489-befad33377e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6801","nonce":774076599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6803","nonce":774076599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6807","nonce":774076599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6805","nonce":774076599}]},"public_addr":"172.21.15.3:6801/774076599","cluster_addr":"172.21.15.3:6803/774076599","heartbeat_back_addr":"172.21.15.3:6807/774076599","heartbeat_front_addr":"172.21.15.3:6805/774076599","state":["exists","up"]},{"osd":1,"uuid":"1d016dab-93aa-42f0-a59a-63c894431afe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6801","nonce":3225970667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6803","nonce":3225970667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6807","nonce":3225970667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6805","nonce":3225970667}]},"public_addr":"172.21.15.173:6801/3225970667","cluster_addr":"172.21.15.173:6803/3225970667","heartbeat_back_addr":"172.21.15.173:6807/3225970667","heartbeat_front_addr":"172.21.15.173:6805/3225970667","state":["exists","up"]},{"osd":2,"uuid":"81eea92a-95c4-47aa-b7fd-60c53281e661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6809","nonce":3098545592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6811","nonce":3098545592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6817","nonce":3098545592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6813","nonce":3098545592}]},"public_addr":"172.21.15.173:6809/3098545592","cluster_addr":"172.21.15.173:6811/3098545592","heartbeat_back_addr":"172.21.15.173:6817/3098545592","heartbeat_front_addr":"172.21.15.173:6813/3098545592","state":["exists","up"]},{"osd":3,"uuid":"4499dec7-c48d-42fb-95a6-9f5e346fb4da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6816","nonce":3793320597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6819","nonce":3793320597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6823","nonce":3793320597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6821","nonce":3793320597}]},"public_addr":"172.21.15.173:6816/3793320597","cluster_addr":"172.21.15.173:6819/3793320597","heartbeat_back_addr":"172.21.15.173:6823/3793320597","heartbeat_front_addr":"172.21.15.173:6821/3793320597","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.180046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.270013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.222912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.265860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T18:08:29.324 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa778038060 msgr2=0x7fa77803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa778038060 0x7fa77803a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa780009720 tx=0x7fa780008030 comp rx=0 tx=0).stop 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12aed0 msgr2=0x7fa78c133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12aed0 0x7fa78c133dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c420 tx=0x7fa77c00c8e0 comp rx=0 tx=0).stop 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 shutdown_connections 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa778038060 0x7fa77803a520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 --2- 172.21.15.3:0/3778799631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa78c12aed0 0x7fa78c133dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 >> 172.21.15.3:0/3778799631 conn(0x7fa78c09a170 msgr2=0x7fa78c091630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 shutdown_connections 2024-05-15T18:08:29.325 INFO:teuthology.misc.health.smithi003.stderr:2024-05-15T18:08:29.347+0000 7fa792f02640 1 -- 172.21.15.3:0/3778799631 wait complete. 2024-05-15T18:08:29.334 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-15T18:08:29.334 INFO:tasks.ceph:Creating RBD pool 2024-05-15T18:08:29.335 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-15T18:08:29.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.459+0000 7f795506d640 1 Processor -- start 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.459+0000 7f795506d640 1 -- start start 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f795506d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f795006e300 0x7f7950133610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f795506d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795006f380 con 0x7f795006d810 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f795506d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f795006edd0 con 0x7f795006e300 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f794e59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f795006e300 0x7f7950133610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f794ed9d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f795006d810 0x7f795006dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50436/0 (socket says 172.21.15.3:50436) 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f794ed9d640 1 -- 172.21.15.3:0/3380382110 learned_addr learned my addr 172.21.15.3:0/3380382110 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f794e59c640 1 -- 172.21.15.3:0/3380382110 >> v1:172.21.15.3:6789/0 conn(0x7f795006d810 legacy=0x7f795006dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f794dd9b640 1 -- 172.21.15.3:0/3380382110 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522742693 0 0) 0x7f795006f380 con 0x7f795006d810 2024-05-15T18:08:29.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.460+0000 7f794e59c640 1 -- 172.21.15.3:0/3380382110 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795006fde0 con 0x7f795006e300 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.461+0000 7f794e59c640 1 --2- 172.21.15.3:0/3380382110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006e300 0x7f7950133610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7938009720 tx=0x7f793802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfa5ceee7f0f054 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.461+0000 7f794dd9b640 1 -- 172.21.15.3:0/3380382110 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79380316d0 con 0x7f795006e300 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.461+0000 7f794dd9b640 1 -- 172.21.15.3:0/3380382110 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7938037070 con 0x7f795006e300 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.461+0000 7f794dd9b640 1 -- 172.21.15.3:0/3380382110 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79380319c0 con 0x7f795006e300 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.462+0000 7f795506d640 1 -- 172.21.15.3:0/3380382110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006e300 msgr2=0x7f7950133610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.462+0000 7f795506d640 1 --2- 172.21.15.3:0/3380382110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006e300 0x7f7950133610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7938009720 tx=0x7f793802b840 comp rx=0 tx=0).stop 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.462+0000 7f795506d640 1 -- 172.21.15.3:0/3380382110 shutdown_connections 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.462+0000 7f795506d640 1 --2- 172.21.15.3:0/3380382110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006e300 0x7f7950133610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.462+0000 7f795506d640 1 -- 172.21.15.3:0/3380382110 >> 172.21.15.3:0/3380382110 conn(0x7f79500a0d20 msgr2=0x7f79500a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.462+0000 7f795506d640 1 -- 172.21.15.3:0/3380382110 shutdown_connections 2024-05-15T18:08:29.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.462+0000 7f795506d640 1 -- 172.21.15.3:0/3380382110 wait complete. 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.463+0000 7f795506d640 1 Processor -- start 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.463+0000 7f795506d640 1 -- start start 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.463+0000 7f795506d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006d810 0x7f795012f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.463+0000 7f795506d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7950133cd0 con 0x7f795006d810 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f794ed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006d810 0x7f795012f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f794ed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006d810 0x7f795012f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41200/0 (socket says 172.21.15.3:41200) 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f794ed9d640 1 -- 172.21.15.3:0/2222208395 learned_addr learned my addr 172.21.15.3:0/2222208395 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f794ed9d640 1 -- 172.21.15.3:0/2222208395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7950132a00 con 0x7f795006d810 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f794ed9d640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006d810 0x7f795012f3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f794000c420 tx=0x7f794000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f79477fe640 1 -- 172.21.15.3:0/2222208395 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7940018070 con 0x7f795006d810 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f79477fe640 1 -- 172.21.15.3:0/2222208395 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79400074d0 con 0x7f795006d810 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7950131b40 con 0x7f795006d810 2024-05-15T18:08:29.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f79477fe640 1 -- 172.21.15.3:0/2222208395 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7940004950 con 0x7f795006d810 2024-05-15T18:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.464+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795012fae0 con 0x7f795006d810 2024-05-15T18:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.465+0000 7f79477fe640 1 -- 172.21.15.3:0/2222208395 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f794001b070 con 0x7f795006d810 2024-05-15T18:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.465+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7950131e20 con 0x7f795006d810 2024-05-15T18:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.465+0000 7f79477fe640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7930038060 0x7f793003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.465+0000 7f79477fe640 1 -- 172.21.15.3:0/2222208395 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f794004a140 con 0x7f795006d810 2024-05-15T18:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.466+0000 7f794e59c640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7930038060 0x7f793003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:29.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.466+0000 7f794e59c640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7930038060 0x7f793003a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7938036000 tx=0x7f7938008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.470+0000 7f79477fe640 1 -- 172.21.15.3:0/2222208395 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7940011980 con 0x7f795006d810 2024-05-15T18:08:29.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:29.654+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f79501274c0 con 0x7f795006d810 2024-05-15T18:08:30.119 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.140+0000 7f79477fe640 1 -- 172.21.15.3:0/2222208395 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7f7940011be0 con 0x7f795006d810 2024-05-15T18:08:30.119 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'rbd' created 2024-05-15T18:08:30.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7930038060 msgr2=0x7f793003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:30.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7930038060 0x7f793003a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7938036000 tx=0x7f7938008030 comp rx=0 tx=0).stop 2024-05-15T18:08:30.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006d810 msgr2=0x7f795012f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:30.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006d810 0x7f795012f3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f794000c420 tx=0x7f794000c8e0 comp rx=0 tx=0).stop 2024-05-15T18:08:30.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 shutdown_connections 2024-05-15T18:08:30.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7930038060 0x7f793003a520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:30.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 --2- 172.21.15.3:0/2222208395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f795006d810 0x7f795012f3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:30.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.142+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 >> 172.21.15.3:0/2222208395 conn(0x7f79500a0d20 msgr2=0x7f795009d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:30.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.143+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 shutdown_connections 2024-05-15T18:08:30.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.143+0000 7f795506d640 1 -- 172.21.15.3:0/2222208395 wait complete. 2024-05-15T18:08:30.133 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-15T18:08:30.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.265+0000 7fe63bf38640 1 Processor -- start 2024-05-15T18:08:30.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.265+0000 7fe63bf38640 1 -- start start 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe63bf38640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe634127ee0 0x7fe6341282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe63bf38640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe63406e6e0 con 0x7fe63412af70 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe63bf38640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fe634127a90 con 0x7fe634127ee0 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe639cd4640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe634127ee0 0x7fe6341282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe6394d3640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe63412af70 0x7fe63412b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50442/0 (socket says 172.21.15.3:50442) 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe6394d3640 1 -- 172.21.15.3:0/4023287897 learned_addr learned my addr 172.21.15.3:0/4023287897 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe639cd4640 1 -- 172.21.15.3:0/4023287897 >> v1:172.21.15.3:6789/0 conn(0x7fe63412af70 legacy=0x7fe63412b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:30.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.266+0000 7fe639cd4640 1 -- 172.21.15.3:0/4023287897 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe634128800 con 0x7fe634127ee0 2024-05-15T18:08:30.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.267+0000 7fe639cd4640 1 --2- 172.21.15.3:0/4023287897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341282c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b9c0 tx=0x7fe63002e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a855b65485166a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:30.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.267+0000 7fe638cd2640 1 -- 172.21.15.3:0/4023287897 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63003b070 con 0x7fe634127ee0 2024-05-15T18:08:30.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.267+0000 7fe638cd2640 1 -- 172.21.15.3:0/4023287897 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63002ecf0 con 0x7fe634127ee0 2024-05-15T18:08:30.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.267+0000 7fe638cd2640 1 -- 172.21.15.3:0/4023287897 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe630036440 con 0x7fe634127ee0 2024-05-15T18:08:30.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.268+0000 7fe63bf38640 1 -- 172.21.15.3:0/4023287897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 msgr2=0x7fe6341282c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.268+0000 7fe63bf38640 1 --2- 172.21.15.3:0/4023287897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341282c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe63000b9c0 tx=0x7fe63002e010 comp rx=0 tx=0).stop 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.268+0000 7fe63bf38640 1 -- 172.21.15.3:0/4023287897 shutdown_connections 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.268+0000 7fe63bf38640 1 --2- 172.21.15.3:0/4023287897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341282c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.268+0000 7fe63bf38640 1 -- 172.21.15.3:0/4023287897 >> 172.21.15.3:0/4023287897 conn(0x7fe6340991a0 msgr2=0x7fe6340995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.268+0000 7fe63bf38640 1 -- 172.21.15.3:0/4023287897 shutdown_connections 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.268+0000 7fe63bf38640 1 -- 172.21.15.3:0/4023287897 wait complete. 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.269+0000 7fe63bf38640 1 Processor -- start 2024-05-15T18:08:30.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.269+0000 7fe63bf38640 1 -- start start 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.269+0000 7fe63bf38640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341bf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.269+0000 7fe63bf38640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe634071e90 con 0x7fe634127ee0 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.269+0000 7fe639cd4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341bf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.269+0000 7fe639cd4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341bf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41218/0 (socket says 172.21.15.3:41218) 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.269+0000 7fe639cd4640 1 -- 172.21.15.3:0/1398484484 learned_addr learned my addr 172.21.15.3:0/1398484484 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.270+0000 7fe639cd4640 1 -- 172.21.15.3:0/1398484484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6341157d0 con 0x7fe634127ee0 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.270+0000 7fe639cd4640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341bf120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe630039040 tx=0x7fe6300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.270+0000 7fe62a7fc640 1 -- 172.21.15.3:0/1398484484 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe630047070 con 0x7fe634127ee0 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.270+0000 7fe62a7fc640 1 -- 172.21.15.3:0/1398484484 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63003c040 con 0x7fe634127ee0 2024-05-15T18:08:30.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.270+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe634115330 con 0x7fe634127ee0 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.270+0000 7fe62a7fc640 1 -- 172.21.15.3:0/1398484484 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe63003b050 con 0x7fe634127ee0 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.270+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6341bf660 con 0x7fe634127ee0 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.271+0000 7fe62a7fc640 1 -- 172.21.15.3:0/1398484484 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe63004a070 con 0x7fe634127ee0 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.271+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe634062e90 con 0x7fe634127ee0 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.271+0000 7fe62a7fc640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe618038060 0x7fe61803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.271+0000 7fe62a7fc640 1 -- 172.21.15.3:0/1398484484 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7fe63006f210 con 0x7fe634127ee0 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.272+0000 7fe6394d3640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe618038060 0x7fe61803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:30.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.272+0000 7fe6394d3640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe618038060 0x7fe61803a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe624000f60 tx=0x7fe624007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:30.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.276+0000 7fe62a7fc640 1 -- 172.21.15.3:0/1398484484 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe630040dd0 con 0x7fe634127ee0 2024-05-15T18:08:30.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:30.462+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7fe634073fd0 con 0x7fe634127ee0 2024-05-15T18:08:31.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.143+0000 7fe62a7fc640 1 -- 172.21.15.3:0/1398484484 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 173+0+0 (secure 0 0 0) 0x7fe630041570 con 0x7fe634127ee0 2024-05-15T18:08:31.120 INFO:teuthology.orchestra.run.smithi003.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-15T18:08:31.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.145+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe618038060 msgr2=0x7fe61803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.145+0000 7fe63bf38640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe618038060 0x7fe61803a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe624000f60 tx=0x7fe624007a80 comp rx=0 tx=0).stop 2024-05-15T18:08:31.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.145+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 msgr2=0x7fe6341bf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.145+0000 7fe63bf38640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341bf120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe630039040 tx=0x7fe6300046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.146+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 shutdown_connections 2024-05-15T18:08:31.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.146+0000 7fe63bf38640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe618038060 0x7fe61803a520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.146+0000 7fe63bf38640 1 --2- 172.21.15.3:0/1398484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe634127ee0 0x7fe6341bf120 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.146+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 >> 172.21.15.3:0/1398484484 conn(0x7fe6340991a0 msgr2=0x7fe6341217b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:31.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.146+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 shutdown_connections 2024-05-15T18:08:31.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.146+0000 7fe63bf38640 1 -- 172.21.15.3:0/1398484484 wait complete. 2024-05-15T18:08:31.138 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-15T18:08:31.138 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-15T18:08:31.138 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-15T18:08:31.138 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-15T18:08:31.139 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.270+0000 7f8c12b60640 1 Processor -- start 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.270+0000 7f8c12b60640 1 -- start start 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.270+0000 7f8c12b60640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8c0c127ea0 0x7f8c0c128280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.270+0000 7f8c12b60640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0c071020 con 0x7f8c0c1287c0 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.270+0000 7f8c12b60640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0c071780 con 0x7f8c0c127ea0 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.271+0000 7f8c108fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8c0c127ea0 0x7f8c0c128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.271+0000 7f8c0bfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8c0c1287c0 0x7f8c0c12b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50452/0 (socket says 172.21.15.3:50452) 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.271+0000 7f8c0bfff640 1 -- 172.21.15.3:0/3402121080 learned_addr learned my addr 172.21.15.3:0/3402121080 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.271+0000 7f8c108fc640 1 -- 172.21.15.3:0/3402121080 >> v1:172.21.15.3:6789/0 conn(0x7f8c0c1287c0 legacy=0x7f8c0c12b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.271+0000 7f8c108fc640 1 -- 172.21.15.3:0/3402121080 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c06e6e0 con 0x7f8c0c127ea0 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c108fc640 1 --2- 172.21.15.3:0/3402121080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c128280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009720 tx=0x7f8c0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03cb5f1c2aad40b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c0b7fe640 1 -- 172.21.15.3:0/3402121080 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c00035020 con 0x7f8c0c127ea0 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c0b7fe640 1 -- 172.21.15.3:0/3402121080 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00031760 con 0x7f8c0c127ea0 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c0b7fe640 1 -- 172.21.15.3:0/3402121080 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c00031a60 con 0x7f8c0c127ea0 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c12b60640 1 -- 172.21.15.3:0/3402121080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 msgr2=0x7f8c0c128280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c12b60640 1 --2- 172.21.15.3:0/3402121080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c128280 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009720 tx=0x7f8c0002b8d0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c12b60640 1 -- 172.21.15.3:0/3402121080 shutdown_connections 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c12b60640 1 --2- 172.21.15.3:0/3402121080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c128280 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c12b60640 1 -- 172.21.15.3:0/3402121080 >> 172.21.15.3:0/3402121080 conn(0x7f8c0c099380 msgr2=0x7f8c0c099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c12b60640 1 -- 172.21.15.3:0/3402121080 shutdown_connections 2024-05-15T18:08:31.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.272+0000 7f8c12b60640 1 -- 172.21.15.3:0/3402121080 wait complete. 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.273+0000 7f8c12b60640 1 Processor -- start 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.273+0000 7f8c12b60640 1 -- start start 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.274+0000 7f8c12b60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c114bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.274+0000 7f8c12b60640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c12b800 con 0x7f8c0c127ea0 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.274+0000 7f8c108fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c114bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.274+0000 7f8c108fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c114bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41240/0 (socket says 172.21.15.3:41240) 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.274+0000 7f8c108fc640 1 -- 172.21.15.3:0/1573355074 learned_addr learned my addr 172.21.15.3:0/1573355074 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.274+0000 7f8c108fc640 1 -- 172.21.15.3:0/1573355074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c117b70 con 0x7f8c0c127ea0 2024-05-15T18:08:31.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.274+0000 7f8c108fc640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c114bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009720 tx=0x7f8c000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.275+0000 7f8c097fa640 1 -- 172.21.15.3:0/1573355074 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0003b980 con 0x7f8c0c127ea0 2024-05-15T18:08:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.275+0000 7f8c097fa640 1 -- 172.21.15.3:0/1573355074 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0003bb40 con 0x7f8c0c127ea0 2024-05-15T18:08:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.275+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c1166f0 con 0x7f8c0c127ea0 2024-05-15T18:08:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.275+0000 7f8c097fa640 1 -- 172.21.15.3:0/1573355074 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0003be60 con 0x7f8c0c127ea0 2024-05-15T18:08:31.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.275+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0c1183d0 con 0x7f8c0c127ea0 2024-05-15T18:08:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.275+0000 7f8c097fa640 1 -- 172.21.15.3:0/1573355074 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8c0004c060 con 0x7f8c0c127ea0 2024-05-15T18:08:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.276+0000 7f8c097fa640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8bf0038060 0x7f8bf003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.276+0000 7f8c097fa640 1 -- 172.21.15.3:0/1573355074 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f8c0006ccf0 con 0x7f8c0c127ea0 2024-05-15T18:08:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.276+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0c117ee0 con 0x7f8c0c127ea0 2024-05-15T18:08:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.276+0000 7f8c0bfff640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8bf0038060 0x7f8bf003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.276+0000 7f8c0bfff640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8bf0038060 0x7f8bf003a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8007fd0 tx=0x7f8bf8007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.281+0000 7f8c097fa640 1 -- 172.21.15.3:0/1573355074 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8c00040070 con 0x7f8c0c127ea0 2024-05-15T18:08:31.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.515+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8c0c062e90 con 0x7f8c0c127ea0 2024-05-15T18:08:31.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.517+0000 7f8c097fa640 1 -- 172.21.15.3:0/1573355074 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87207 (secure 0 0 0) 0x7f8c00030380 con 0x7f8c0c127ea0 2024-05-15T18:08:31.495 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:08:31.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8bf0038060 msgr2=0x7f8bf003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8bf0038060 0x7f8bf003a520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8007fd0 tx=0x7f8bf8007ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 msgr2=0x7f8c0c114bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c114bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009720 tx=0x7f8c000046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 shutdown_connections 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8bf0038060 0x7f8bf003a520 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 --2- 172.21.15.3:0/1573355074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8c0c127ea0 0x7f8c0c114bc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 >> 172.21.15.3:0/1573355074 conn(0x7f8c0c099380 msgr2=0x7f8c0c06ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 shutdown_connections 2024-05-15T18:08:31.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.519+0000 7f8c12b60640 1 -- 172.21.15.3:0/1573355074 wait complete. 2024-05-15T18:08:31.507 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":3800909313},{"type":"v1","addr":"172.21.15.173:6825","nonce":3800909313}]},"active_addr":"172.21.15.173:6825/3800909313","active_change":"2024-05-15T18:08:18.309657+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1239528162}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":4184643710}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":3504454474}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.173:0","nonce":1327491832}]}]} 2024-05-15T18:08:31.509 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-15T18:08:31.509 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-15T18:08:31.509 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.635+0000 7eff196f8640 1 Processor -- start 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.635+0000 7eff196f8640 1 -- start start 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.635+0000 7eff196f8640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7eff1412f580 0x7eff14131970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.635+0000 7eff196f8640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff14113dd0 con 0x7eff1412c5b0 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.635+0000 7eff196f8640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7eff14072290 con 0x7eff1412f580 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.636+0000 7eff127fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7eff1412f580 0x7eff14131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.636+0000 7eff12ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7eff1412c5b0 0x7eff1412c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50460/0 (socket says 172.21.15.3:50460) 2024-05-15T18:08:31.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.636+0000 7eff12ffd640 1 -- 172.21.15.3:0/2013279536 learned_addr learned my addr 172.21.15.3:0/2013279536 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:31.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.636+0000 7eff127fc640 1 -- 172.21.15.3:0/2013279536 >> v1:172.21.15.3:6789/0 conn(0x7eff1412c5b0 legacy=0x7eff1412c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.636+0000 7eff127fc640 1 -- 172.21.15.3:0/2013279536 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1412c390 con 0x7eff1412f580 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff127fc640 1 --2- 172.21.15.3:0/2013279536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412f580 0x7eff14131970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff08009720 tx=0x7eff0802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4290e9e56904ad server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff11ffb640 1 -- 172.21.15.3:0/2013279536 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff080316d0 con 0x7eff1412f580 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff11ffb640 1 -- 172.21.15.3:0/2013279536 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08037070 con 0x7eff1412f580 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff11ffb640 1 -- 172.21.15.3:0/2013279536 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff080319c0 con 0x7eff1412f580 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff196f8640 1 -- 172.21.15.3:0/2013279536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412f580 msgr2=0x7eff14131970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff196f8640 1 --2- 172.21.15.3:0/2013279536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412f580 0x7eff14131970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff08009720 tx=0x7eff0802b840 comp rx=0 tx=0).stop 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff196f8640 1 -- 172.21.15.3:0/2013279536 shutdown_connections 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff196f8640 1 --2- 172.21.15.3:0/2013279536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412f580 0x7eff14131970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff196f8640 1 -- 172.21.15.3:0/2013279536 >> 172.21.15.3:0/2013279536 conn(0x7eff14099380 msgr2=0x7eff14099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:31.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff196f8640 1 -- 172.21.15.3:0/2013279536 shutdown_connections 2024-05-15T18:08:31.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.637+0000 7eff196f8640 1 -- 172.21.15.3:0/2013279536 wait complete. 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.638+0000 7eff196f8640 1 Processor -- start 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.638+0000 7eff196f8640 1 -- start start 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.639+0000 7eff196f8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412c5b0 0x7eff14128110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.639+0000 7eff196f8640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7eff14113990 con 0x7eff1412c5b0 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.639+0000 7eff12ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412c5b0 0x7eff14128110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.639+0000 7eff12ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412c5b0 0x7eff14128110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41260/0 (socket says 172.21.15.3:41260) 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.639+0000 7eff12ffd640 1 -- 172.21.15.3:0/431925612 learned_addr learned my addr 172.21.15.3:0/431925612 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.639+0000 7eff12ffd640 1 -- 172.21.15.3:0/431925612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff141145d0 con 0x7eff1412c5b0 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.639+0000 7eff12ffd640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412c5b0 0x7eff14128110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c4a0 tx=0x7eff0400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.640+0000 7efefb7fe640 1 -- 172.21.15.3:0/431925612 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff04017070 con 0x7eff1412c5b0 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.640+0000 7efefb7fe640 1 -- 172.21.15.3:0/431925612 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff04005c10 con 0x7eff1412c5b0 2024-05-15T18:08:31.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.640+0000 7efefb7fe640 1 -- 172.21.15.3:0/431925612 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff04007070 con 0x7eff1412c5b0 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.640+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff14128650 con 0x7eff1412c5b0 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.640+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff14128b20 con 0x7eff1412c5b0 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.640+0000 7efefb7fe640 1 -- 172.21.15.3:0/431925612 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff0401a070 con 0x7eff1412c5b0 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.641+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1406ef60 con 0x7eff1412c5b0 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.641+0000 7efefb7fe640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7eff00038010 0x7eff0003a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.641+0000 7efefb7fe640 1 -- 172.21.15.3:0/431925612 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7eff0404a1e0 con 0x7eff1412c5b0 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.641+0000 7eff127fc640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7eff00038010 0x7eff0003a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.641+0000 7eff127fc640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7eff00038010 0x7eff0003a4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff08036000 tx=0x7eff08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.646+0000 7efefb7fe640 1 -- 172.21.15.3:0/431925612 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7eff1406ef60 con 0x7eff1412c5b0 2024-05-15T18:08:31.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.828+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff14113360 con 0x7eff1412c5b0 2024-05-15T18:08:31.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.829+0000 7efefb7fe640 1 -- 172.21.15.3:0/431925612 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9745 (secure 0 0 0) 0x7eff0401b410 con 0x7eff1412c5b0 2024-05-15T18:08:31.806 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:08:31.806 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"b091c162-becd-4424-b394-ddcc165a450a","created":"2024-05-15T18:08:14.002961+0000","modified":"2024-05-15T18:08:31.141308+0000","last_up_change":"2024-05-15T18:08:24.124486+0000","last_in_change":"2024-05-15T18:08:15.093157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T18:08:24.359980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-15T18:08:29.685679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f954d51-bfea-4d84-8489-befad33377e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6801","nonce":774076599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6803","nonce":774076599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6807","nonce":774076599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6805","nonce":774076599}]},"public_addr":"172.21.15.3:6801/774076599","cluster_addr":"172.21.15.3:6803/774076599","heartbeat_back_addr":"172.21.15.3:6807/774076599","heartbeat_front_addr":"172.21.15.3:6805/774076599","state":["exists","up"]},{"osd":1,"uuid":"1d016dab-93aa-42f0-a59a-63c894431afe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6801","nonce":3225970667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6803","nonce":3225970667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6807","nonce":3225970667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6805","nonce":3225970667}]},"public_addr":"172.21.15.173:6801/3225970667","cluster_addr":"172.21.15.173:6803/3225970667","heartbeat_back_addr":"172.21.15.173:6807/3225970667","heartbeat_front_addr":"172.21.15.173:6805/3225970667","state":["exists","up"]},{"osd":2,"uuid":"81eea92a-95c4-47aa-b7fd-60c53281e661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6809","nonce":3098545592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6811","nonce":3098545592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6817","nonce":3098545592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6813","nonce":3098545592}]},"public_addr":"172.21.15.173:6809/3098545592","cluster_addr":"172.21.15.173:6811/3098545592","heartbeat_back_addr":"172.21.15.173:6817/3098545592","heartbeat_front_addr":"172.21.15.173:6813/3098545592","state":["exists","up"]},{"osd":3,"uuid":"4499dec7-c48d-42fb-95a6-9f5e346fb4da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6816","nonce":3793320597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6819","nonce":3793320597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6823","nonce":3793320597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6821","nonce":3793320597}]},"public_addr":"172.21.15.173:6816/3793320597","cluster_addr":"172.21.15.173:6819/3793320597","heartbeat_back_addr":"172.21.15.173:6823/3793320597","heartbeat_front_addr":"172.21.15.173:6821/3793320597","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.180046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.270013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.222912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.265860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T18:08:31.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7eff00038010 msgr2=0x7eff0003a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7eff00038010 0x7eff0003a4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7eff08036000 tx=0x7eff08008030 comp rx=0 tx=0).stop 2024-05-15T18:08:31.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412c5b0 msgr2=0x7eff14128110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412c5b0 0x7eff14128110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c4a0 tx=0x7eff0400c960 comp rx=0 tx=0).stop 2024-05-15T18:08:31.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 shutdown_connections 2024-05-15T18:08:31.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7eff00038010 0x7eff0003a4d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 --2- 172.21.15.3:0/431925612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff1412c5b0 0x7eff14128110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 >> 172.21.15.3:0/431925612 conn(0x7eff14099380 msgr2=0x7eff1412ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:31.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 shutdown_connections 2024-05-15T18:08:31.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.831+0000 7eff196f8640 1 -- 172.21.15.3:0/431925612 wait complete. 2024-05-15T18:08:31.819 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-15T18:08:31.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T18:08:31.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.944+0000 7f0890ec8640 1 Processor -- start 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.944+0000 7f0890ec8640 1 -- start start 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f0890ec8640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f088c12b590 0x7f088c12b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f0890ec8640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088c070f50 con 0x7f088c12e3e0 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f0890ec8640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f088c0706e0 con 0x7f088c12b590 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f088a59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f088c12b590 0x7f088c12b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f088a59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f088c12b590 0x7f088c12b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41268/0 (socket says 172.21.15.3:41268) 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f0889d9b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f088c12e3e0 0x7f088c12e890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50476/0 (socket says 172.21.15.3:50476) 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f088a59c640 1 -- 172.21.15.3:0/4225264214 learned_addr learned my addr 172.21.15.3:0/4225264214 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f088a59c640 1 -- 172.21.15.3:0/4225264214 >> v1:172.21.15.3:6789/0 conn(0x7f088c12e3e0 legacy=0x7f088c12e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f088a59c640 1 -- 172.21.15.3:0/4225264214 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c09dd00 con 0x7f088c12b590 2024-05-15T18:08:31.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.945+0000 7f088959a640 1 -- 172.21.15.3:0/4225264214 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 205610375 0 0) 0x7f088c070f50 con 0x7f088c12e3e0 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.946+0000 7f088a59c640 1 --2- 172.21.15.3:0/4225264214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c12b970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f087c0097f0 tx=0x7f087c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a799575cea0a90fd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.946+0000 7f088959a640 1 -- 172.21.15.3:0/4225264214 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087c035020 con 0x7f088c12b590 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.946+0000 7f088959a640 1 -- 172.21.15.3:0/4225264214 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0317a0 con 0x7f088c12b590 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.946+0000 7f088959a640 1 -- 172.21.15.3:0/4225264214 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087c031aa0 con 0x7f088c12b590 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.947+0000 7f0890ec8640 1 -- 172.21.15.3:0/4225264214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 msgr2=0x7f088c12b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.947+0000 7f0890ec8640 1 --2- 172.21.15.3:0/4225264214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c12b970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f087c0097f0 tx=0x7f087c02b910 comp rx=0 tx=0).stop 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.947+0000 7f0890ec8640 1 -- 172.21.15.3:0/4225264214 shutdown_connections 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.947+0000 7f0890ec8640 1 --2- 172.21.15.3:0/4225264214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c12b970 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:31.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.947+0000 7f0890ec8640 1 -- 172.21.15.3:0/4225264214 >> 172.21.15.3:0/4225264214 conn(0x7f088c09ed60 msgr2=0x7f088c09f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:31.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.947+0000 7f0890ec8640 1 -- 172.21.15.3:0/4225264214 shutdown_connections 2024-05-15T18:08:31.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.947+0000 7f0890ec8640 1 -- 172.21.15.3:0/4225264214 wait complete. 2024-05-15T18:08:31.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.948+0000 7f0890ec8640 1 Processor -- start 2024-05-15T18:08:31.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.948+0000 7f0890ec8640 1 -- start start 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.948+0000 7f0890ec8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c11a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.948+0000 7f0890ec8640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f088c12beb0 con 0x7f088c12b590 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.948+0000 7f088a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c11a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.948+0000 7f088a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c11a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41272/0 (socket says 172.21.15.3:41272) 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.948+0000 7f088a59c640 1 -- 172.21.15.3:0/1388913263 learned_addr learned my addr 172.21.15.3:0/1388913263 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.949+0000 7f088a59c640 1 -- 172.21.15.3:0/1388913263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c11c5a0 con 0x7f088c12b590 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.949+0000 7f088a59c640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c11a890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f087c034040 tx=0x7f087c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.949+0000 7f087affd640 1 -- 172.21.15.3:0/1388913263 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087c03ad00 con 0x7f088c12b590 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.949+0000 7f087affd640 1 -- 172.21.15.3:0/1388913263 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0443f0 con 0x7f088c12b590 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.949+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088c128ed0 con 0x7f088c12b590 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.949+0000 7f087affd640 1 -- 172.21.15.3:0/1388913263 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087c044710 con 0x7f088c12b590 2024-05-15T18:08:31.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.949+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088c11add0 con 0x7f088c12b590 2024-05-15T18:08:31.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.950+0000 7f087affd640 1 -- 172.21.15.3:0/1388913263 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f087c04b060 con 0x7f088c12b590 2024-05-15T18:08:31.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.950+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088c062e90 con 0x7f088c12b590 2024-05-15T18:08:31.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.950+0000 7f087affd640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f086c038060 0x7f086c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:31.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.950+0000 7f087affd640 1 -- 172.21.15.3:0/1388913263 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f087c06d0d0 con 0x7f088c12b590 2024-05-15T18:08:31.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.950+0000 7f0889d9b640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f086c038060 0x7f086c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:31.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.951+0000 7f0889d9b640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f086c038060 0x7f086c03a520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0880000c00 tx=0x7f0880007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:31.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:31.955+0000 7f087affd640 1 -- 172.21.15.3:0/1388913263 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f087c03f070 con 0x7f088c12b590 2024-05-15T18:08:32.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.137+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f088c073fd0 con 0x7f088c12b590 2024-05-15T18:08:32.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.138+0000 7f087affd640 1 -- 172.21.15.3:0/1388913263 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9745 (secure 0 0 0) 0x7f087c02f320 con 0x7f088c12b590 2024-05-15T18:08:32.115 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:08:32.115 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"fsid":"b091c162-becd-4424-b394-ddcc165a450a","created":"2024-05-15T18:08:14.002961+0000","modified":"2024-05-15T18:08:31.141308+0000","last_up_change":"2024-05-15T18:08:24.124486+0000","last_in_change":"2024-05-15T18:08:15.093157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T18:08:24.359980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-15T18:08:29.685679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f954d51-bfea-4d84-8489-befad33377e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6801","nonce":774076599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6803","nonce":774076599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6807","nonce":774076599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6805","nonce":774076599}]},"public_addr":"172.21.15.3:6801/774076599","cluster_addr":"172.21.15.3:6803/774076599","heartbeat_back_addr":"172.21.15.3:6807/774076599","heartbeat_front_addr":"172.21.15.3:6805/774076599","state":["exists","up"]},{"osd":1,"uuid":"1d016dab-93aa-42f0-a59a-63c894431afe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6801","nonce":3225970667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6803","nonce":3225970667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6807","nonce":3225970667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6805","nonce":3225970667}]},"public_addr":"172.21.15.173:6801/3225970667","cluster_addr":"172.21.15.173:6803/3225970667","heartbeat_back_addr":"172.21.15.173:6807/3225970667","heartbeat_front_addr":"172.21.15.173:6805/3225970667","state":["exists","up"]},{"osd":2,"uuid":"81eea92a-95c4-47aa-b7fd-60c53281e661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6809","nonce":3098545592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6811","nonce":3098545592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6817","nonce":3098545592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6813","nonce":3098545592}]},"public_addr":"172.21.15.173:6809/3098545592","cluster_addr":"172.21.15.173:6811/3098545592","heartbeat_back_addr":"172.21.15.173:6817/3098545592","heartbeat_front_addr":"172.21.15.173:6813/3098545592","state":["exists","up"]},{"osd":3,"uuid":"4499dec7-c48d-42fb-95a6-9f5e346fb4da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6816","nonce":3793320597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6819","nonce":3793320597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6823","nonce":3793320597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6821","nonce":3793320597}]},"public_addr":"172.21.15.173:6816/3793320597","cluster_addr":"172.21.15.173:6819/3793320597","heartbeat_back_addr":"172.21.15.173:6823/3793320597","heartbeat_front_addr":"172.21.15.173:6821/3793320597","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.180046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.270013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.222912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.265860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T18:08:32.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f086c038060 msgr2=0x7f086c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f086c038060 0x7f086c03a520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0880000c00 tx=0x7f0880007930 comp rx=0 tx=0).stop 2024-05-15T18:08:32.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 msgr2=0x7f088c11a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c11a890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f087c034040 tx=0x7f087c0046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 shutdown_connections 2024-05-15T18:08:32.118 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f086c038060 0x7f086c03a520 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.118 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 --2- 172.21.15.3:0/1388913263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f088c12b590 0x7f088c11a890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.118 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 >> 172.21.15.3:0/1388913263 conn(0x7f088c09ed60 msgr2=0x7f088c12a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.118 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 shutdown_connections 2024-05-15T18:08:32.118 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.140+0000 7f0890ec8640 1 -- 172.21.15.3:0/1388913263 wait complete. 2024-05-15T18:08:32.129 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-15T18:08:32.129 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-15T18:08:32.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-15T18:08:32.130 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-15T18:08:32.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7ff2d69ce640 1 Processor -- start 2024-05-15T18:08:32.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7fa5ee984640 1 Processor -- start 2024-05-15T18:08:32.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7f8dcd53b640 1 Processor -- start 2024-05-15T18:08:32.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7fa5ee984640 1 -- start start 2024-05-15T18:08:32.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7f8dcd53b640 1 -- start start 2024-05-15T18:08:32.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7ff2d69ce640 1 -- start start 2024-05-15T18:08:32.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7fc7ce263640 1 Processor -- start 2024-05-15T18:08:32.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.265+0000 7fc7ce263640 1 -- start start 2024-05-15T18:08:32.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7f8dcd53b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8dc806ef90 0x7f8dc8133960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7f8dcd53b640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc8072330 con 0x7f8dc806cd30 2024-05-15T18:08:32.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7f8dcd53b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc8099930 con 0x7f8dc806ef90 2024-05-15T18:08:32.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7ff2d69ce640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff2d006d480 0x7ff2d006d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fa5ee984640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5e812b6b0 0x7fa5e812ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7ff2d69ce640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d00722a0 con 0x7ff2d006dda0 2024-05-15T18:08:32.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7ff2d69ce640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d006f7a0 con 0x7ff2d006d480 2024-05-15T18:08:32.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7ff2cffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff2d006d480 0x7ff2d006d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7f8dc67fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8dc806ef90 0x7f8dc8133960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7f8dc6ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8dc806cd30 0x7f8dc806d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50482/0 (socket says 172.21.15.3:50482) 2024-05-15T18:08:32.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7f8dc6ffd640 1 -- 172.21.15.3:0/186769823 learned_addr learned my addr 172.21.15.3:0/186769823 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:32.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fa5ee984640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e8072390 con 0x7fa5e8071200 2024-05-15T18:08:32.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fc7ce263640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc7c812e340 0x7fc7c8130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fc7ce263640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c8098840 con 0x7fc7c812b2e0 2024-05-15T18:08:32.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fc7ce263640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c806f9a0 con 0x7fc7c812e340 2024-05-15T18:08:32.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fa5ee984640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e806fa90 con 0x7fa5e812b6b0 2024-05-15T18:08:32.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7ff2cffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7ff2d006d480 0x7ff2d006d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41284/0 (socket says 172.21.15.3:41284) 2024-05-15T18:08:32.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fa5e7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5e812b6b0 0x7fa5e812ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7ff2cffff640 1 -- 172.21.15.3:0/2451726279 learned_addr learned my addr 172.21.15.3:0/2451726279 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fa5e7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fa5e812b6b0 0x7fa5e812ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41292/0 (socket says 172.21.15.3:41292) 2024-05-15T18:08:32.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fc7c77fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc7c812e340 0x7fc7c8130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fa5e7fff640 1 -- 172.21.15.3:0/2772940779 learned_addr learned my addr 172.21.15.3:0/2772940779 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fa5e77fe640 1 --1- 172.21.15.3:0/2772940779 >> v1:172.21.15.3:6789/0 conn(0x7fa5e8071200 0x7fa5e8071650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50504/0 (socket says 172.21.15.3:50504) 2024-05-15T18:08:32.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fc7c77fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fc7c812e340 0x7fc7c8130730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41300/0 (socket says 172.21.15.3:41300) 2024-05-15T18:08:32.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7fc7c77fe640 1 -- 172.21.15.3:0/623234904 learned_addr learned my addr 172.21.15.3:0/623234904 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.266+0000 7f8dc67fc640 1 -- 172.21.15.3:0/186769823 >> v1:172.21.15.3:6789/0 conn(0x7f8dc806cd30 legacy=0x7f8dc806d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7f8dc67fc640 1 -- 172.21.15.3:0/186769823 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc8097e90 con 0x7f8dc806ef90 2024-05-15T18:08:32.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7ff2ceffd640 1 -- 172.21.15.3:0/2451726279 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423843003 0 0) 0x7ff2d00722a0 con 0x7ff2d006dda0 2024-05-15T18:08:32.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7ff2cffff640 1 -- 172.21.15.3:0/2451726279 >> v1:172.21.15.3:6789/0 conn(0x7ff2d006dda0 legacy=0x7ff2d0132950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7ff2cffff640 1 -- 172.21.15.3:0/2451726279 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d006f050 con 0x7ff2d006d480 2024-05-15T18:08:32.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7fc7c77fe640 1 -- 172.21.15.3:0/623234904 >> v1:172.21.15.3:6789/0 conn(0x7fc7c812b2e0 legacy=0x7fc7c812b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7fc7c77fe640 1 -- 172.21.15.3:0/623234904 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c812bdd0 con 0x7fc7c812e340 2024-05-15T18:08:32.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7fa5e7fff640 1 -- 172.21.15.3:0/2772940779 >> v1:172.21.15.3:6789/0 conn(0x7fa5e8071200 legacy=0x7fa5e8071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7fa5e7fff640 1 -- 172.21.15.3:0/2772940779 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e812b270 con 0x7fa5e812b6b0 2024-05-15T18:08:32.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.267+0000 7f8dc67fc640 1 --2- 172.21.15.3:0/186769823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806ef90 0x7f8dc8133960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009720 tx=0x7f8dbc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ac55f8ebcfa92b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7ff2cffff640 1 --2- 172.21.15.3:0/2451726279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d006d860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097f0 tx=0x7ff2c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d10dd40081a2127 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7f8dc5ffb640 1 -- 172.21.15.3:0/186769823 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc0316d0 con 0x7f8dc806ef90 2024-05-15T18:08:32.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7ff2ceffd640 1 -- 172.21.15.3:0/2451726279 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c0035020 con 0x7ff2d006d480 2024-05-15T18:08:32.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7f8dc5ffb640 1 -- 172.21.15.3:0/186769823 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc037070 con 0x7f8dc806ef90 2024-05-15T18:08:32.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7f8dc5ffb640 1 -- 172.21.15.3:0/186769823 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc0319c0 con 0x7f8dc806ef90 2024-05-15T18:08:32.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7ff2ceffd640 1 -- 172.21.15.3:0/2451726279 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c00317a0 con 0x7ff2d006d480 2024-05-15T18:08:32.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7ff2ceffd640 1 -- 172.21.15.3:0/2451726279 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c0031aa0 con 0x7ff2d006d480 2024-05-15T18:08:32.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fc7c77fe640 1 --2- 172.21.15.3:0/623234904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812e340 0x7fc7c8130730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009820 tx=0x7fc7bc02b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeb0801750be5f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fa5e7fff640 1 --2- 172.21.15.3:0/2772940779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e812b6b0 0x7fa5e812ba90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800ba90 tx=0x7fa5d802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e258ade9cea47c4e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fc7c6ffd640 1 -- 172.21.15.3:0/623234904 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc037070 con 0x7fc7c812e340 2024-05-15T18:08:32.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fc7c6ffd640 1 -- 172.21.15.3:0/623234904 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc030640 con 0x7fc7c812e340 2024-05-15T18:08:32.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fc7c6ffd640 1 -- 172.21.15.3:0/623234904 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7bc030940 con 0x7fc7c812e340 2024-05-15T18:08:32.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fa5e6ffd640 1 -- 172.21.15.3:0/2772940779 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5d803b070 con 0x7fa5e812b6b0 2024-05-15T18:08:32.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fa5e6ffd640 1 -- 172.21.15.3:0/2772940779 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d802edc0 con 0x7fa5e812b6b0 2024-05-15T18:08:32.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.268+0000 7fa5e6ffd640 1 -- 172.21.15.3:0/2772940779 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5d8036590 con 0x7fa5e812b6b0 2024-05-15T18:08:32.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7ff2d69ce640 1 -- 172.21.15.3:0/2451726279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 msgr2=0x7ff2d006d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7f8dcd53b640 1 -- 172.21.15.3:0/186769823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806ef90 msgr2=0x7f8dc8133960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/186769823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806ef90 0x7f8dc8133960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009720 tx=0x7f8dbc02b840 comp rx=0 tx=0).stop 2024-05-15T18:08:32.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7f8dcd53b640 1 -- 172.21.15.3:0/186769823 shutdown_connections 2024-05-15T18:08:32.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/186769823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806ef90 0x7f8dc8133960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7f8dcd53b640 1 -- 172.21.15.3:0/186769823 >> 172.21.15.3:0/186769823 conn(0x7f8dc809a6d0 msgr2=0x7f8dc809aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/2451726279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d006d860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097f0 tx=0x7ff2c002b910 comp rx=0 tx=0).stop 2024-05-15T18:08:32.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7f8dcd53b640 1 -- 172.21.15.3:0/186769823 shutdown_connections 2024-05-15T18:08:32.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7f8dcd53b640 1 -- 172.21.15.3:0/186769823 wait complete. 2024-05-15T18:08:32.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7ff2d69ce640 1 -- 172.21.15.3:0/2451726279 shutdown_connections 2024-05-15T18:08:32.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/2451726279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d006d860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fc7ce263640 1 -- 172.21.15.3:0/623234904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812e340 msgr2=0x7fc7c8130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7ff2d69ce640 1 -- 172.21.15.3:0/2451726279 >> 172.21.15.3:0/2451726279 conn(0x7ff2d00996c0 msgr2=0x7ff2d0099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7ff2d69ce640 1 -- 172.21.15.3:0/2451726279 shutdown_connections 2024-05-15T18:08:32.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7ff2d69ce640 1 -- 172.21.15.3:0/2451726279 wait complete. 2024-05-15T18:08:32.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fc7ce263640 1 --2- 172.21.15.3:0/623234904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812e340 0x7fc7c8130730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009820 tx=0x7fc7bc02b760 comp rx=0 tx=0).stop 2024-05-15T18:08:32.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fa5ee984640 1 -- 172.21.15.3:0/2772940779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e812b6b0 msgr2=0x7fa5e812ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fa5ee984640 1 --2- 172.21.15.3:0/2772940779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e812b6b0 0x7fa5e812ba90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800ba90 tx=0x7fa5d802e0e0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fc7ce263640 1 -- 172.21.15.3:0/623234904 shutdown_connections 2024-05-15T18:08:32.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fc7ce263640 1 --2- 172.21.15.3:0/623234904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812e340 0x7fc7c8130730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fc7ce263640 1 -- 172.21.15.3:0/623234904 >> 172.21.15.3:0/623234904 conn(0x7fc7c80996c0 msgr2=0x7fc7c8099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fa5ee984640 1 -- 172.21.15.3:0/2772940779 shutdown_connections 2024-05-15T18:08:32.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fa5ee984640 1 --2- 172.21.15.3:0/2772940779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e812b6b0 0x7fa5e812ba90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fa5ee984640 1 -- 172.21.15.3:0/2772940779 >> 172.21.15.3:0/2772940779 conn(0x7fa5e809da30 msgr2=0x7fa5e809de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fc7ce263640 1 -- 172.21.15.3:0/623234904 shutdown_connections 2024-05-15T18:08:32.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fa5ee984640 1 -- 172.21.15.3:0/2772940779 shutdown_connections 2024-05-15T18:08:32.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fa5ee984640 1 -- 172.21.15.3:0/2772940779 wait complete. 2024-05-15T18:08:32.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.269+0000 7fc7ce263640 1 -- 172.21.15.3:0/623234904 wait complete. 2024-05-15T18:08:32.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.270+0000 7f8dcd53b640 1 Processor -- start 2024-05-15T18:08:32.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.270+0000 7f8dcd53b640 1 -- start start 2024-05-15T18:08:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.270+0000 7fa5ee984640 1 Processor -- start 2024-05-15T18:08:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.270+0000 7ff2d69ce640 1 Processor -- start 2024-05-15T18:08:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fa5ee984640 1 -- start start 2024-05-15T18:08:32.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fc7ce263640 1 Processor -- start 2024-05-15T18:08:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7f8dcd53b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806cd30 0x7f8dc8131150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7f8dcd53b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8133ea0 con 0x7f8dc806cd30 2024-05-15T18:08:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7f8dc6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806cd30 0x7f8dc8131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7f8dc6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806cd30 0x7f8dc8131150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41304/0 (socket says 172.21.15.3:41304) 2024-05-15T18:08:32.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7f8dc6ffd640 1 -- 172.21.15.3:0/1515586201 learned_addr learned my addr 172.21.15.3:0/1515586201 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7ff2d69ce640 1 -- start start 2024-05-15T18:08:32.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fc7ce263640 1 -- start start 2024-05-15T18:08:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fa5ee984640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e8071200 0x7fa5e808adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fa5ee984640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e8070c30 con 0x7fa5e8071200 2024-05-15T18:08:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fa5e7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e8071200 0x7fa5e808adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7f8dc6ffd640 1 -- 172.21.15.3:0/1515586201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc8124aa0 con 0x7f8dc806cd30 2024-05-15T18:08:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fa5e7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e8071200 0x7fa5e808adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41320/0 (socket says 172.21.15.3:41320) 2024-05-15T18:08:32.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7fa5e7fff640 1 -- 172.21.15.3:0/3027869473 learned_addr learned my addr 172.21.15.3:0/3027869473 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.271+0000 7f8dc6ffd640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806cd30 0x7f8dc8131150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8db800c380 tx=0x7f8db800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fc7ce263640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812b2e0 0x7fc7c8131c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fc7ce263640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c8070190 con 0x7fc7c812b2e0 2024-05-15T18:08:32.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fa5e7fff640 1 -- 172.21.15.3:0/3027869473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e808c840 con 0x7fa5e8071200 2024-05-15T18:08:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812b2e0 0x7fc7c8131c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812b2e0 0x7fc7c8131c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41326/0 (socket says 172.21.15.3:41326) 2024-05-15T18:08:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db8005c10 con 0x7f8dc806cd30 2024-05-15T18:08:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fc7c7fff640 1 -- 172.21.15.3:0/3004506376 learned_addr learned my addr 172.21.15.3:0/3004506376 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7ff2d69ce640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d01bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db8005db0 con 0x7f8dc806cd30 2024-05-15T18:08:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc8123ef0 con 0x7f8dc806cd30 2024-05-15T18:08:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db8004930 con 0x7f8dc806cd30 2024-05-15T18:08:32.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fa5e7fff640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e8071200 0x7fa5e808adc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800ba90 tx=0x7fa5d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc8131870 con 0x7f8dc806cd30 2024-05-15T18:08:32.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7ff2cffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d01bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7ff2cffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d01bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41336/0 (socket says 172.21.15.3:41336) 2024-05-15T18:08:32.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7ff2cffff640 1 -- 172.21.15.3:0/1526880124 learned_addr learned my addr 172.21.15.3:0/1526880124 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fc7c7fff640 1 -- 172.21.15.3:0/3004506376 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c8092880 con 0x7fc7c812b2e0 2024-05-15T18:08:32.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0096dc0 con 0x7ff2d006d480 2024-05-15T18:08:32.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.272+0000 7fc7c7fff640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812b2e0 0x7fc7c8131c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c700 tx=0x7fc7b800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8017070 con 0x7fc7c812b2e0 2024-05-15T18:08:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7ff2cffff640 1 -- 172.21.15.3:0/1526880124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d01a8fb0 con 0x7ff2d006d480 2024-05-15T18:08:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5d8045070 con 0x7fa5e8071200 2024-05-15T18:08:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d8040670 con 0x7fa5e8071200 2024-05-15T18:08:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5d803b040 con 0x7fa5e8071200 2024-05-15T18:08:32.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b80051a0 con 0x7fc7c812b2e0 2024-05-15T18:08:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e808d470 con 0x7fa5e8071200 2024-05-15T18:08:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b800a660 con 0x7fc7c812b2e0 2024-05-15T18:08:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8db801a020 con 0x7f8dc806cd30 2024-05-15T18:08:32.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e808e0a0 con 0x7fa5e8071200 2024-05-15T18:08:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8dc8062e90 con 0x7f8dc806cd30 2024-05-15T18:08:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c8096df0 con 0x7fc7c812b2e0 2024-05-15T18:08:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c8093c10 con 0x7fc7c812b2e0 2024-05-15T18:08:32.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7ff2cffff640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d01bf760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00090b0 tx=0x7ff2c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7f8daf7fe640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8db4038010 0x7f8db403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.273+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f8db804a760 con 0x7f8dc806cd30 2024-05-15T18:08:32.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c0031950 con 0x7ff2d006d480 2024-05-15T18:08:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7f8daf7fe640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8db403d790 0x7f8db403fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8db8015e50 con 0x7f8db403d790 2024-05-15T18:08:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f8db804f2a0 con 0x7f8dc806cd30 2024-05-15T18:08:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c0004030 con 0x7ff2d006d480 2024-05-15T18:08:32.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d01aac90 con 0x7ff2d006d480 2024-05-15T18:08:32.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7f8dc67fc640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8db4038010 0x7f8db403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc7c8062e90 con 0x7fc7c812b2e0 2024-05-15T18:08:32.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7f8dc77fe640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8db403d790 0x7f8db403fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa5d8048070 con 0x7fa5e8071200 2024-05-15T18:08:32.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5e81252d0 con 0x7fa5e8071200 2024-05-15T18:08:32.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7fa5e4ff9640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa5d403c510 0x7fa5d403e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fa5d806d750 con 0x7fa5e8071200 2024-05-15T18:08:32.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7f8dc67fc640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8db4038010 0x7f8db403a4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc036000 tx=0x7f8dbc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5e4ff9640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7fa5d4041c90 0x7fa5d40440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5d8035ec0 con 0x7fa5d4041c90 2024-05-15T18:08:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5e77fe640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa5d403c510 0x7fa5d403e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.274+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d01bfca0 con 0x7ff2d006d480 2024-05-15T18:08:32.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5ecf21640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7fa5d4041c90 0x7fa5d40440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c0004310 con 0x7ff2d006d480 2024-05-15T18:08:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7f8dc77fe640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8db403d790 0x7f8db403fbd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fa5d80413f0 con 0x7fa5e8071200 2024-05-15T18:08:32.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5e77fe640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa5d403c510 0x7fa5d403e9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0015f0 tx=0x7fa5dc007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2b0000f80 con 0x7ff2d006d480 2024-05-15T18:08:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7b801a070 con 0x7fc7c812b2e0 2024-05-15T18:08:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.275+0000 7fa5ecf21640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7fa5d4041c90 0x7fa5d40440d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff2c004c060 con 0x7ff2d006d480 2024-05-15T18:08:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7c4ff9640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc7b4038060 0x7fc7b403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fc7b804ac40 con 0x7fc7c812b2e0 2024-05-15T18:08:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7c4ff9640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7b403d7e0 0x7fc7b403fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7b8014ec0 con 0x7fc7b403d7e0 2024-05-15T18:08:32.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fc7b804b000 con 0x7fc7c812b2e0 2024-05-15T18:08:32.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2ccff9640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff2bc038060 0x7ff2bc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7c77fe640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc7b4038060 0x7fc7b403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7ff2c006d380 con 0x7ff2d006d480 2024-05-15T18:08:32.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7cc800640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7b403d7e0 0x7fc7b403fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8db8015e50 con 0x7f8db403d790 2024-05-15T18:08:32.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2ccff9640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7ff2bc03d7e0 0x7ff2bc03fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2cf7fe640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff2bc038060 0x7ff2bc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2c0030e50 con 0x7ff2bc03d7e0 2024-05-15T18:08:32.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7ff2c0074050 con 0x7ff2d006d480 2024-05-15T18:08:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5d8035ec0 con 0x7fa5d4041c90 2024-05-15T18:08:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7ff2d4f6b640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7ff2bc03d7e0 0x7ff2bc03fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.276+0000 7fc7cc800640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7b403d7e0 0x7fc7b403fc20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.277+0000 7ff2cf7fe640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff2bc038060 0x7ff2bc03a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4007fd0 tx=0x7ff2c40078c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.277+0000 7ff2d4f6b640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7ff2bc03d7e0 0x7ff2bc03fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.277+0000 7fc7c77fe640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc7b4038060 0x7fc7b403a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009820 tx=0x7fc7bc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.277+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7b8014ec0 con 0x7fc7b403d7e0 2024-05-15T18:08:32.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.278+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2c0030e50 con 0x7ff2bc03d7e0 2024-05-15T18:08:32.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.291+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc7c8093260 con 0x7fc7b403d7e0 2024-05-15T18:08:32.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7c4ff9640 1 -- 172.21.15.3:0/3004506376 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc7c8093260 con 0x7fc7b403d7e0 2024-05-15T18:08:32.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7b403d7e0 msgr2=0x7fc7b403fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7b403d7e0 0x7fc7b403fc20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc7b4038060 msgr2=0x7fc7b403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc7b4038060 0x7fc7b403a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009820 tx=0x7fc7bc008030 comp rx=0 tx=0).stop 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812b2e0 msgr2=0x7fc7c8131c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812b2e0 0x7fc7c8131c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c700 tx=0x7fc7b800cbc0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 shutdown_connections 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7b403d7e0 0x7fc7b403fc20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc7b4038060 0x7fc7b403a520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 --2- 172.21.15.3:0/3004506376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7c812b2e0 0x7fc7c8131c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 >> 172.21.15.3:0/3004506376 conn(0x7fc7c80996c0 msgr2=0x7fc7c806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.292+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 shutdown_connections 2024-05-15T18:08:32.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.293+0000 7fc7ce263640 1 -- 172.21.15.3:0/3004506376 wait complete. 2024-05-15T18:08:32.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.293+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2b0002c70 con 0x7ff2bc03d7e0 2024-05-15T18:08:32.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.293+0000 7ff2ccff9640 1 -- 172.21.15.3:0/1526880124 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff2b0002c70 con 0x7ff2bc03d7e0 2024-05-15T18:08:32.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.293+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7ff2bc03d7e0 msgr2=0x7ff2bc03fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.293+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7ff2bc03d7e0 0x7ff2bc03fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff2bc038060 msgr2=0x7ff2bc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff2bc038060 0x7ff2bc03a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4007fd0 tx=0x7ff2c40078c0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 msgr2=0x7ff2d01bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d01bf760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00090b0 tx=0x7ff2c00046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 shutdown_connections 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7ff2bc03d7e0 0x7ff2bc03fc20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff2bc038060 0x7ff2bc03a520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 --2- 172.21.15.3:0/1526880124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2d006d480 0x7ff2d01bf760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 >> 172.21.15.3:0/1526880124 conn(0x7ff2d00996c0 msgr2=0x7ff2d00903f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 shutdown_connections 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.294+0000 7ff2d69ce640 1 -- 172.21.15.3:0/1526880124 wait complete. 2024-05-15T18:08:32.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.301+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5e8062e90 con 0x7fa5d4041c90 2024-05-15T18:08:32.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.301+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8dc806ef90 con 0x7f8db403d790 2024-05-15T18:08:32.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.301+0000 7fa5e4ff9640 1 -- 172.21.15.3:0/3027869473 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa5e8062e90 con 0x7fa5d4041c90 2024-05-15T18:08:32.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.301+0000 7f8daf7fe640 1 -- 172.21.15.3:0/1515586201 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8dc806ef90 con 0x7f8db403d790 2024-05-15T18:08:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7fa5d4041c90 msgr2=0x7fa5d40440d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7fa5d4041c90 0x7fa5d40440d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa5d403c510 msgr2=0x7fa5d403e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa5d403c510 0x7fa5d403e9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0015f0 tx=0x7fa5dc007a40 comp rx=0 tx=0).stop 2024-05-15T18:08:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e8071200 msgr2=0x7fa5e808adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e8071200 0x7fa5e808adc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800ba90 tx=0x7fa5d80046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8db403d790 msgr2=0x7f8db403fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 shutdown_connections 2024-05-15T18:08:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7fa5d4041c90 0x7fa5d40440d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa5d403c510 0x7fa5d403e9d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 --2- 172.21.15.3:0/3027869473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa5e8071200 0x7fa5e808adc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 >> 172.21.15.3:0/3027869473 conn(0x7fa5e809da30 msgr2=0x7fa5e80982c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8db403d790 0x7f8db403fbd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8db4038010 msgr2=0x7f8db403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8db4038010 0x7f8db403a4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc036000 tx=0x7f8dbc008030 comp rx=0 tx=0).stop 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806cd30 msgr2=0x7f8dc8131150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806cd30 0x7f8dc8131150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8db800c380 tx=0x7f8db800c840 comp rx=0 tx=0).stop 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 shutdown_connections 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8db403d790 0x7f8db403fbd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8db4038010 0x7f8db403a4d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 --2- 172.21.15.3:0/1515586201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8dc806cd30 0x7f8dc8131150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 >> 172.21.15.3:0/1515586201 conn(0x7f8dc809a6d0 msgr2=0x7f8dc8132b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 shutdown_connections 2024-05-15T18:08:32.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7fa5ee984640 1 -- 172.21.15.3:0/3027869473 wait complete. 2024-05-15T18:08:32.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 shutdown_connections 2024-05-15T18:08:32.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.302+0000 7f8dcd53b640 1 -- 172.21.15.3:0/1515586201 wait complete. 2024-05-15T18:08:32.297 INFO:teuthology.orchestra.run.smithi003.stdout:42949672967 2024-05-15T18:08:32.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T18:08:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:38654705670 2024-05-15T18:08:32.299 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T18:08:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:38654705669 2024-05-15T18:08:32.300 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T18:08:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:38654705669 2024-05-15T18:08:32.301 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T18:08:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f95685a4640 1 Processor -- start 2024-05-15T18:08:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f8eaf6d2640 1 Processor -- start 2024-05-15T18:08:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f95685a4640 1 -- start start 2024-05-15T18:08:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f9f67159640 1 Processor -- start 2024-05-15T18:08:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f0aeae93640 1 Processor -- start 2024-05-15T18:08:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f9f67159640 1 -- start start 2024-05-15T18:08:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f0aeae93640 1 -- start start 2024-05-15T18:08:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.470+0000 7f8eaf6d2640 1 -- start start 2024-05-15T18:08:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f95685a4640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f956012e340 0x7f9560130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f0aeae93640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0ae412e340 0x7f0ae4130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f95685a4640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9560098840 con 0x7f956012b2e0 2024-05-15T18:08:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f0aeae93640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae4098840 con 0x7f0ae412b2e0 2024-05-15T18:08:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f0aeae93640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae406f9a0 con 0x7f0ae412e340 2024-05-15T18:08:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f95685a4640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f956006f9a0 con 0x7f956012e340 2024-05-15T18:08:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9f67159640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9f6006d810 0x7f9f6006dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9565b3f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f956012e340 0x7f9560130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f8eaf6d2640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8ea812e340 0x7f8ea8130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f8eaf6d2640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea8098840 con 0x7f8ea812b2e0 2024-05-15T18:08:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f8eaf6d2640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea806f9a0 con 0x7f8ea812e340 2024-05-15T18:08:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f8ead46e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f8ea812b2e0 0x7f8ea812b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50540/0 (socket says 172.21.15.3:50540) 2024-05-15T18:08:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f8ead46e640 1 -- 172.21.15.3:0/2819149677 learned_addr learned my addr 172.21.15.3:0/2819149677 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9f67159640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6006f380 con 0x7f9f6006e130 2024-05-15T18:08:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f0adbfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0ae412e340 0x7f0ae4130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f0adbfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0ae412e340 0x7f0ae4130730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41346/0 (socket says 172.21.15.3:41346) 2024-05-15T18:08:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f0adbfff640 1 -- 172.21.15.3:0/677522801 learned_addr learned my addr 172.21.15.3:0/677522801 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9565b3f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f956012e340 0x7f9560130730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41360/0 (socket says 172.21.15.3:41360) 2024-05-15T18:08:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9565b3f640 1 -- 172.21.15.3:0/2448032539 learned_addr learned my addr 172.21.15.3:0/2448032539 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9f67159640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6006edd0 con 0x7f9f6006d810 2024-05-15T18:08:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9f64ef5640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9f6006d810 0x7f9f6006dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9f64ef5640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9f6006d810 0x7f9f6006dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41362/0 (socket says 172.21.15.3:41362) 2024-05-15T18:08:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f9f64ef5640 1 -- 172.21.15.3:0/2231042976 learned_addr learned my addr 172.21.15.3:0/2231042976 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.471+0000 7f8eacc6d640 1 --2- 172.21.15.3:0/2819149677 >> v2:172.21.15.3:3300/0 conn(0x7f8ea812e340 0x7f8ea8130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f9565b3f640 1 -- 172.21.15.3:0/2448032539 >> v1:172.21.15.3:6789/0 conn(0x7f956012b2e0 legacy=0x7f956012b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f9565b3f640 1 -- 172.21.15.3:0/2448032539 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956012bdd0 con 0x7f956012e340 2024-05-15T18:08:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f0adbfff640 1 -- 172.21.15.3:0/677522801 >> v1:172.21.15.3:6789/0 conn(0x7f0ae412b2e0 legacy=0x7f0ae412b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960266038 0 0) 0x7f8ea8098840 con 0x7f8ea812b2e0 2024-05-15T18:08:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f0adbfff640 1 -- 172.21.15.3:0/677522801 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae412bdd0 con 0x7f0ae412e340 2024-05-15T18:08:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e94003520 con 0x7f8ea812b2e0 2024-05-15T18:08:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f9f64ef5640 1 -- 172.21.15.3:0/2231042976 >> v1:172.21.15.3:6789/0 conn(0x7f9f6006e130 legacy=0x7f9f6012e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f9f64ef5640 1 -- 172.21.15.3:0/2231042976 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6006e580 con 0x7f9f6006d810 2024-05-15T18:08:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f9f5f7fe640 1 -- 172.21.15.3:0/2231042976 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724905055 0 0) 0x7f9f6006f380 con 0x7f9f6006e130 2024-05-15T18:08:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 <== mon.0 v1:172.21.15.3:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1874495571 0 0) 0x7f8e94003520 con 0x7f8ea812b2e0 2024-05-15T18:08:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 >> v2:172.21.15.3:3300/0 conn(0x7f8ea812e340 msgr2=0x7f8ea8130730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 --2- 172.21.15.3:0/2819149677 >> v2:172.21.15.3:3300/0 conn(0x7f8ea812e340 0x7f8ea8130730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 --> v1:172.21.15.3:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea812bdd0 con 0x7f8ea812b2e0 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 <== mon.0 v1:172.21.15.3:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3553069955 0 0) 0x7f8ea40015a0 con 0x7f8ea812b2e0 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 >> v1:172.21.15.3:6789/0 conn(0x7f8ea812b2e0 legacy=0x7f8ea812b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 --2- 172.21.15.3:0/2819149677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8e94003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e940044f0 con 0x7f8e94003a30 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.472+0000 7f8ead46e640 1 --2- 172.21.15.3:0/2819149677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8e94003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f8ead46e640 1 -- 172.21.15.3:0/2819149677 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e94003520 con 0x7f8e94003a30 2024-05-15T18:08:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f9565b3f640 1 --2- 172.21.15.3:0/2448032539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012e340 0x7f9560130730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9550009820 tx=0x7f955002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925f0beb72955642 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f0adbfff640 1 --2- 172.21.15.3:0/677522801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412e340 0x7f0ae4130730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009820 tx=0x7f0ad402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a2132950a82ec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f956533e640 1 -- 172.21.15.3:0/2448032539 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9550035020 con 0x7f956012e340 2024-05-15T18:08:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f956533e640 1 -- 172.21.15.3:0/2448032539 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95500317a0 con 0x7f956012e340 2024-05-15T18:08:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f956533e640 1 -- 172.21.15.3:0/2448032539 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9550035020 con 0x7f956012e340 2024-05-15T18:08:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f9f64ef5640 1 --2- 172.21.15.3:0/2231042976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6006dbf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f540097f0 tx=0x7f9f5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68be267814a83a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f0adb7fe640 1 -- 172.21.15.3:0/677522801 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4035020 con 0x7f0ae412e340 2024-05-15T18:08:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f0adb7fe640 1 -- 172.21.15.3:0/677522801 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad40317a0 con 0x7f0ae412e340 2024-05-15T18:08:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f0adb7fe640 1 -- 172.21.15.3:0/677522801 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4031aa0 con 0x7f0ae412e340 2024-05-15T18:08:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f8ead46e640 1 --2- 172.21.15.3:0/2819149677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8e94003e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4007f00 tx=0x7f8e94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187d14fb95e51df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f9f5f7fe640 1 -- 172.21.15.3:0/2231042976 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f54035020 con 0x7f9f6006d810 2024-05-15T18:08:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f9f5f7fe640 1 -- 172.21.15.3:0/2231042976 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f540317a0 con 0x7f9f6006d810 2024-05-15T18:08:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.473+0000 7f9f5f7fe640 1 -- 172.21.15.3:0/2231042976 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f54031aa0 con 0x7f9f6006d810 2024-05-15T18:08:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f95685a4640 1 -- 172.21.15.3:0/2448032539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012e340 msgr2=0x7f9560130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f95685a4640 1 --2- 172.21.15.3:0/2448032539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012e340 0x7f9560130730 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9550009820 tx=0x7f955002b910 comp rx=0 tx=0).stop 2024-05-15T18:08:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f0aeae93640 1 -- 172.21.15.3:0/677522801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412e340 msgr2=0x7f0ae4130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f0aeae93640 1 --2- 172.21.15.3:0/677522801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412e340 0x7f0ae4130730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009820 tx=0x7f0ad402b910 comp rx=0 tx=0).stop 2024-05-15T18:08:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f95685a4640 1 -- 172.21.15.3:0/2448032539 shutdown_connections 2024-05-15T18:08:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4007ba0 con 0x7f8e94003a30 2024-05-15T18:08:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f0aeae93640 1 -- 172.21.15.3:0/677522801 shutdown_connections 2024-05-15T18:08:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f0aeae93640 1 --2- 172.21.15.3:0/677522801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412e340 0x7f0ae4130730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f0aeae93640 1 -- 172.21.15.3:0/677522801 >> 172.21.15.3:0/677522801 conn(0x7f0ae40996c0 msgr2=0x7f0ae4099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f95685a4640 1 --2- 172.21.15.3:0/2448032539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012e340 0x7f9560130730 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f95685a4640 1 -- 172.21.15.3:0/2448032539 >> 172.21.15.3:0/2448032539 conn(0x7f95600996c0 msgr2=0x7f9560099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4030070 con 0x7f8e94003a30 2024-05-15T18:08:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f8e9ffff640 1 -- 172.21.15.3:0/2819149677 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea402cc70 con 0x7f8e94003a30 2024-05-15T18:08:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f0aeae93640 1 -- 172.21.15.3:0/677522801 shutdown_connections 2024-05-15T18:08:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f0aeae93640 1 -- 172.21.15.3:0/677522801 wait complete. 2024-05-15T18:08:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f9f67159640 1 -- 172.21.15.3:0/2231042976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 msgr2=0x7f9f6006dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f9f67159640 1 --2- 172.21.15.3:0/2231042976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6006dbf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9f540097f0 tx=0x7f9f5402b910 comp rx=0 tx=0).stop 2024-05-15T18:08:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f9f67159640 1 -- 172.21.15.3:0/2231042976 shutdown_connections 2024-05-15T18:08:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f9f67159640 1 --2- 172.21.15.3:0/2231042976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6006dbf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f9f67159640 1 -- 172.21.15.3:0/2231042976 >> 172.21.15.3:0/2231042976 conn(0x7f9f600a0d20 msgr2=0x7f9f600a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f95685a4640 1 -- 172.21.15.3:0/2448032539 shutdown_connections 2024-05-15T18:08:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f9f67159640 1 -- 172.21.15.3:0/2231042976 shutdown_connections 2024-05-15T18:08:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f95685a4640 1 -- 172.21.15.3:0/2448032539 wait complete. 2024-05-15T18:08:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.474+0000 7f9f67159640 1 -- 172.21.15.3:0/2231042976 wait complete. 2024-05-15T18:08:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/2819149677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 msgr2=0x7f8e94003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f8eaf6d2640 1 --2- 172.21.15.3:0/2819149677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8e94003e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4007f00 tx=0x7f8e94005830 comp rx=0 tx=0).stop 2024-05-15T18:08:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/2819149677 shutdown_connections 2024-05-15T18:08:32.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f8eaf6d2640 1 --2- 172.21.15.3:0/2819149677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8e94003e30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f0aeae93640 1 Processor -- start 2024-05-15T18:08:32.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f8eaf6d2640 1 --2- 172.21.15.3:0/2819149677 >> v2:172.21.15.3:3300/0 conn(0x7f8ea812e340 0x7f8ea8130730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/2819149677 >> 172.21.15.3:0/2819149677 conn(0x7f8ea80996c0 msgr2=0x7f8ea8099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f9f67159640 1 Processor -- start 2024-05-15T18:08:32.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f0aeae93640 1 -- start start 2024-05-15T18:08:32.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.475+0000 7f9f67159640 1 -- start start 2024-05-15T18:08:32.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/2819149677 shutdown_connections 2024-05-15T18:08:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/2819149677 wait complete. 2024-05-15T18:08:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f95685a4640 1 Processor -- start 2024-05-15T18:08:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f95685a4640 1 -- start start 2024-05-15T18:08:32.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f0aeae93640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412b2e0 0x7f0ae4126d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f9f67159640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6009bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f9f67159640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6012ea00 con 0x7f9f6006d810 2024-05-15T18:08:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f0aeae93640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4070190 con 0x7f0ae412b2e0 2024-05-15T18:08:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f0ae8c2f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412b2e0 0x7f0ae4126d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f9f64ef5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6009bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f9f64ef5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6009bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41408/0 (socket says 172.21.15.3:41408) 2024-05-15T18:08:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f9f64ef5640 1 -- 172.21.15.3:0/174958362 learned_addr learned my addr 172.21.15.3:0/174958362 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f0ae8c2f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412b2e0 0x7f0ae4126d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41396/0 (socket says 172.21.15.3:41396) 2024-05-15T18:08:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.476+0000 7f0ae8c2f640 1 -- 172.21.15.3:0/3936070686 learned_addr learned my addr 172.21.15.3:0/3936070686 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f0ae8c2f640 1 -- 172.21.15.3:0/3936070686 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae4133410 con 0x7f0ae412b2e0 2024-05-15T18:08:32.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9f64ef5640 1 -- 172.21.15.3:0/174958362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f60125f70 con 0x7f9f6006d810 2024-05-15T18:08:32.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f95685a4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012b2e0 0x7f95601228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f0ae8c2f640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412b2e0 0x7f0ae4126d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c450 tx=0x7f0ae000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f95685a4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9560070190 con 0x7f956012b2e0 2024-05-15T18:08:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9f64ef5640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6009bd00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9f540097f0 tx=0x7f9f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9566340640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012b2e0 0x7f95601228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f0ad97fa640 1 -- 172.21.15.3:0/3936070686 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae0017070 con 0x7f0ae412b2e0 2024-05-15T18:08:32.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9566340640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012b2e0 0x7f95601228a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41410/0 (socket says 172.21.15.3:41410) 2024-05-15T18:08:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9566340640 1 -- 172.21.15.3:0/2235402514 learned_addr learned my addr 172.21.15.3:0/2235402514 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae4132360 con 0x7f0ae412b2e0 2024-05-15T18:08:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f8eaf6d2640 1 Processor -- start 2024-05-15T18:08:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae41285b0 con 0x7f0ae412b2e0 2024-05-15T18:08:32.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f8eaf6d2640 1 -- start start 2024-05-15T18:08:32.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f0ad97fa640 1 -- 172.21.15.3:0/3936070686 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae0005200 con 0x7f0ae412b2e0 2024-05-15T18:08:32.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f0ad97fa640 1 -- 172.21.15.3:0/3936070686 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00035f0 con 0x7f0ae412b2e0 2024-05-15T18:08:32.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9f5d7fa640 1 -- 172.21.15.3:0/174958362 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f5403ad00 con 0x7f9f6006d810 2024-05-15T18:08:32.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9f5d7fa640 1 -- 172.21.15.3:0/174958362 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f540443f0 con 0x7f9f6006d810 2024-05-15T18:08:32.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9f5d7fa640 1 -- 172.21.15.3:0/174958362 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f540446d0 con 0x7f9f6006d810 2024-05-15T18:08:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6009c240 con 0x7f9f6006d810 2024-05-15T18:08:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.477+0000 7f9566340640 1 -- 172.21.15.3:0/2235402514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95601257a0 con 0x7f956012b2e0 2024-05-15T18:08:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f8eaf6d2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8ea8096300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f9566340640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012b2e0 0x7f95601228a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f955c00c380 tx=0x7f955c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f8eaf6d2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8070190 con 0x7f8e94003a30 2024-05-15T18:08:32.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f9556ffd640 1 -- 172.21.15.3:0/2235402514 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f955c005200 con 0x7f956012b2e0 2024-05-15T18:08:32.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9560125000 con 0x7f956012b2e0 2024-05-15T18:08:32.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6009c710 con 0x7f9f6006d810 2024-05-15T18:08:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f9556ffd640 1 -- 172.21.15.3:0/2235402514 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c0053a0 con 0x7f956012b2e0 2024-05-15T18:08:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f9556ffd640 1 -- 172.21.15.3:0/2235402514 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f955c005200 con 0x7f956012b2e0 2024-05-15T18:08:32.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9560122de0 con 0x7f956012b2e0 2024-05-15T18:08:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f8ead46e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8ea8096300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f8ead46e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8ea8096300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41422/0 (socket says 172.21.15.3:41422) 2024-05-15T18:08:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f8ead46e640 1 -- 172.21.15.3:0/590967343 learned_addr learned my addr 172.21.15.3:0/590967343 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:32.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f0ad97fa640 1 -- 172.21.15.3:0/3936070686 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ae001a070 con 0x7f0ae412b2e0 2024-05-15T18:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.478+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae4130bf0 con 0x7f0ae412b2e0 2024-05-15T18:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f0ad97fa640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0ad0038060 0x7f0ad003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f0ad97fa640 1 -- 172.21.15.3:0/3936070686 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f0ae004a330 con 0x7f0ae412b2e0 2024-05-15T18:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f9f5d7fa640 1 -- 172.21.15.3:0/174958362 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9f5404b060 con 0x7f9f6006d810 2024-05-15T18:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f8ead46e640 1 -- 172.21.15.3:0/590967343 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea809ad10 con 0x7f8e94003a30 2024-05-15T18:08:32.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f0adbfff640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0ad0038060 0x7f0ad003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f9556ffd640 1 -- 172.21.15.3:0/2235402514 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f955c007020 con 0x7f956012b2e0 2024-05-15T18:08:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.479+0000 7f9f5d7fa640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f440380b0 0x7f9f4403a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9560062e90 con 0x7f956012b2e0 2024-05-15T18:08:32.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9556ffd640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f95440381f0 0x7f954403a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9f5d7fa640 1 -- 172.21.15.3:0/174958362 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f9f54072060 con 0x7f9f6006d810 2024-05-15T18:08:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9f5ffff640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f440380b0 0x7f9f4403a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9556ffd640 1 -- 172.21.15.3:0/2235402514 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f955c04a1b0 con 0x7f956012b2e0 2024-05-15T18:08:32.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f8ead46e640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8ea8096300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4007f00 tx=0x7f8ea402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9565b3f640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f95440381f0 0x7f954403a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f0adbfff640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0ad0038060 0x7f0ad003a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009820 tx=0x7f0ad4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f60062e90 con 0x7f9f6006d810 2024-05-15T18:08:32.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9f5ffff640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f440380b0 0x7f9f4403a570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c001620 tx=0x7f9f4c007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.480+0000 7f9565b3f640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f95440381f0 0x7f954403a6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9550009820 tx=0x7f9550008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.484+0000 7f0ad97fa640 1 -- 172.21.15.3:0/3936070686 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0ae001b9f0 con 0x7f0ae412b2e0 2024-05-15T18:08:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.489+0000 7f8e9dffb640 1 -- 172.21.15.3:0/590967343 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4004b20 con 0x7f8e94003a30 2024-05-15T18:08:32.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.489+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea81251c0 con 0x7f8e94003a30 2024-05-15T18:08:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.489+0000 7f9556ffd640 1 -- 172.21.15.3:0/2235402514 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f955c0125e0 con 0x7f956012b2e0 2024-05-15T18:08:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.489+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea8096840 con 0x7f8e94003a30 2024-05-15T18:08:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.490+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea8062e90 con 0x7f8e94003a30 2024-05-15T18:08:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.494+0000 7f8e9dffb640 1 -- 172.21.15.3:0/590967343 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4030020 con 0x7f8e94003a30 2024-05-15T18:08:32.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.494+0000 7f8e9dffb640 1 -- 172.21.15.3:0/590967343 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4004df0 con 0x7f8e94003a30 2024-05-15T18:08:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.494+0000 7f9f5d7fa640 1 -- 172.21.15.3:0/174958362 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9f5403f070 con 0x7f9f6006d810 2024-05-15T18:08:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.494+0000 7f8e9dffb640 1 -- 172.21.15.3:0/590967343 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ea4007070 con 0x7f8e94003a30 2024-05-15T18:08:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.495+0000 7f8e9dffb640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e8c038010 0x7f8e8c03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.495+0000 7f8e9dffb640 1 -- 172.21.15.3:0/590967343 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f8ea406cf70 con 0x7f8e94003a30 2024-05-15T18:08:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.495+0000 7f8eacc6d640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e8c038010 0x7f8e8c03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:32.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.496+0000 7f8eacc6d640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e8c038010 0x7f8e8c03a4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea812b080 tx=0x7f8e98009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:32.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.499+0000 7f8e9dffb640 1 -- 172.21.15.3:0/590967343 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8ea404f070 con 0x7f8e94003a30 2024-05-15T18:08:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.675+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9560124390 con 0x7f956012b2e0 2024-05-15T18:08:32.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.675+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0ae4062e90 con 0x7f0ae412b2e0 2024-05-15T18:08:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.675+0000 7f9556ffd640 1 -- 172.21.15.3:0/2235402514 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f955c012840 con 0x7f956012b2e0 2024-05-15T18:08:32.653 INFO:teuthology.orchestra.run.smithi003.stdout:38654705669 2024-05-15T18:08:32.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.676+0000 7f0ad97fa640 1 -- 172.21.15.3:0/3936070686 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ae0011590 con 0x7f0ae412b2e0 2024-05-15T18:08:32.654 INFO:teuthology.orchestra.run.smithi003.stdout:42949672966 2024-05-15T18:08:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f95440381f0 msgr2=0x7f954403a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f95440381f0 0x7f954403a6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9550009820 tx=0x7f9550008030 comp rx=0 tx=0).stop 2024-05-15T18:08:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012b2e0 msgr2=0x7f95601228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012b2e0 0x7f95601228a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f955c00c380 tx=0x7f955c00c840 comp rx=0 tx=0).stop 2024-05-15T18:08:32.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0ad0038060 msgr2=0x7f0ad003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0ad0038060 0x7f0ad003a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009820 tx=0x7f0ad4008030 comp rx=0 tx=0).stop 2024-05-15T18:08:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412b2e0 msgr2=0x7f0ae4126d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412b2e0 0x7f0ae4126d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c450 tx=0x7f0ae000c910 comp rx=0 tx=0).stop 2024-05-15T18:08:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 shutdown_connections 2024-05-15T18:08:32.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f95440381f0 0x7f954403a6b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 --2- 172.21.15.3:0/2235402514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f956012b2e0 0x7f95601228a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 >> 172.21.15.3:0/2235402514 conn(0x7f95600996c0 msgr2=0x7f95600971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 shutdown_connections 2024-05-15T18:08:32.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f95685a4640 1 -- 172.21.15.3:0/2235402514 wait complete. 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 shutdown_connections 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0ad0038060 0x7f0ad003a520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 --2- 172.21.15.3:0/3936070686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ae412b2e0 0x7f0ae4126d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 >> 172.21.15.3:0/3936070686 conn(0x7f0ae40996c0 msgr2=0x7f0ae40971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 shutdown_connections 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.678+0000 7f0aeae93640 1 -- 172.21.15.3:0/3936070686 wait complete. 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.681+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9f6009d830 con 0x7f9f6006d810 2024-05-15T18:08:32.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.681+0000 7f9f5d7fa640 1 -- 172.21.15.3:0/174958362 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f5402f320 con 0x7f9f6006d810 2024-05-15T18:08:32.659 INFO:teuthology.orchestra.run.smithi003.stdout:38654705668 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f440380b0 msgr2=0x7f9f4403a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f440380b0 0x7f9f4403a570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c001620 tx=0x7f9f4c007930 comp rx=0 tx=0).stop 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 msgr2=0x7f9f6009bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6009bd00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9f540097f0 tx=0x7f9f540046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 shutdown_connections 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f440380b0 0x7f9f4403a570 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 --2- 172.21.15.3:0/174958362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9f6006d810 0x7f9f6009bd00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 >> 172.21.15.3:0/174958362 conn(0x7f9f600a0d20 msgr2=0x7f9f60096550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.683+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 shutdown_connections 2024-05-15T18:08:32.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.684+0000 7f9f67159640 1 -- 172.21.15.3:0/174958362 wait complete. 2024-05-15T18:08:32.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.685+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8ea8124d00 con 0x7f8e94003a30 2024-05-15T18:08:32.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.686+0000 7f8e9dffb640 1 -- 172.21.15.3:0/590967343 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ea4049360 con 0x7f8e94003a30 2024-05-15T18:08:32.663 INFO:teuthology.orchestra.run.smithi003.stdout:38654705668 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e8c038010 msgr2=0x7f8e8c03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e8c038010 0x7f8e8c03a4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea812b080 tx=0x7f8e98009190 comp rx=0 tx=0).stop 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 msgr2=0x7f8ea8096300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8ea8096300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4007f00 tx=0x7f8ea402e070 comp rx=0 tx=0).stop 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 shutdown_connections 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e8c038010 0x7f8e8c03a4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 --2- 172.21.15.3:0/590967343 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e94003a30 0x7f8ea8096300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 >> 172.21.15.3:0/590967343 conn(0x7f8ea80996c0 msgr2=0x7f8ea812d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 shutdown_connections 2024-05-15T18:08:32.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:32.688+0000 7f8eaf6d2640 1 -- 172.21.15.3:0/590967343 wait complete. 2024-05-15T18:08:32.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.3 2024-05-15T18:08:32.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672966 for osd.0 2024-05-15T18:08:32.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-05-15T18:08:32.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-05-15T18:08:33.669 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T18:08:33.670 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T18:08:33.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T18:08:33.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T18:08:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.814+0000 7f1e78bad640 1 Processor -- start 2024-05-15T18:08:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.814+0000 7f1e78bad640 1 -- start start 2024-05-15T18:08:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.814+0000 7fb80da43640 1 Processor -- start 2024-05-15T18:08:33.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.814+0000 7fb80da43640 1 -- start start 2024-05-15T18:08:33.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.814+0000 7f1e78bad640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1e7406d4f0 0x7f1e7406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.814+0000 7fb80da43640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb80812b440 0x7fb80812b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7f1e78bad640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e740720b0 con 0x7f1e7406de10 2024-05-15T18:08:33.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7fb80da43640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8080723d0 con 0x7fb80812c170 2024-05-15T18:08:33.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7f1e78bad640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f1e7406f6b0 con 0x7f1e7406d4f0 2024-05-15T18:08:33.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7fb80da43640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fb808072920 con 0x7fb80812b440 2024-05-15T18:08:33.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7f1e7259c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1e7406d4f0 0x7f1e7406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7f1e71d9b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1e7406de10 0x7f1e7409a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50556/0 (socket says 172.21.15.3:50556) 2024-05-15T18:08:33.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7f1e71d9b640 1 -- 172.21.15.3:0/2586753140 learned_addr learned my addr 172.21.15.3:0/2586753140 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:33.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7fb806ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb80812b440 0x7fb80812b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7fb806ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb80812b440 0x7fb80812b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41426/0 (socket says 172.21.15.3:41426) 2024-05-15T18:08:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7fb806ffd640 1 -- 172.21.15.3:0/464955375 learned_addr learned my addr 172.21.15.3:0/464955375 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7fb806ffd640 1 -- 172.21.15.3:0/464955375 >> v1:172.21.15.3:6789/0 conn(0x7fb80812c170 legacy=0x7fb80812c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7fb806ffd640 1 -- 172.21.15.3:0/464955375 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb808071510 con 0x7fb80812b440 2024-05-15T18:08:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7f1e7259c640 1 -- 172.21.15.3:0/2586753140 >> v1:172.21.15.3:6789/0 conn(0x7f1e7406de10 legacy=0x7f1e7409a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.815+0000 7f1e7259c640 1 -- 172.21.15.3:0/2586753140 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7406e710 con 0x7f1e7406d4f0 2024-05-15T18:08:33.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7fb806ffd640 1 --2- 172.21.15.3:0/464955375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb80812b820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80097f0 tx=0x7fb7f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be9fdf3ee97f4e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7f1e7259c640 1 --2- 172.21.15.3:0/2586753140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e7406d8d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009720 tx=0x7f1e6402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fdfc8e15a8523d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7fb805ffb640 1 -- 172.21.15.3:0/464955375 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f8035020 con 0x7fb80812b440 2024-05-15T18:08:33.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7f1e7159a640 1 -- 172.21.15.3:0/2586753140 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e640316d0 con 0x7f1e7406d4f0 2024-05-15T18:08:33.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7f1e7159a640 1 -- 172.21.15.3:0/2586753140 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e64037070 con 0x7f1e7406d4f0 2024-05-15T18:08:33.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7f1e7159a640 1 -- 172.21.15.3:0/2586753140 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e640319c0 con 0x7f1e7406d4f0 2024-05-15T18:08:33.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7fb805ffb640 1 -- 172.21.15.3:0/464955375 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f80317a0 con 0x7fb80812b440 2024-05-15T18:08:33.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.816+0000 7fb805ffb640 1 -- 172.21.15.3:0/464955375 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f8031aa0 con 0x7fb80812b440 2024-05-15T18:08:33.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7fb80da43640 1 -- 172.21.15.3:0/464955375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 msgr2=0x7fb80812b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7fb80da43640 1 --2- 172.21.15.3:0/464955375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb80812b820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80097f0 tx=0x7fb7f802b910 comp rx=0 tx=0).stop 2024-05-15T18:08:33.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7fb80da43640 1 -- 172.21.15.3:0/464955375 shutdown_connections 2024-05-15T18:08:33.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7fb80da43640 1 --2- 172.21.15.3:0/464955375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb80812b820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:33.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7fb80da43640 1 -- 172.21.15.3:0/464955375 >> 172.21.15.3:0/464955375 conn(0x7fb80809b7f0 msgr2=0x7fb80809bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:33.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7f1e78bad640 1 -- 172.21.15.3:0/2586753140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 msgr2=0x7f1e7406d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7f1e78bad640 1 --2- 172.21.15.3:0/2586753140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e7406d8d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009720 tx=0x7f1e6402b840 comp rx=0 tx=0).stop 2024-05-15T18:08:33.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7fb80da43640 1 -- 172.21.15.3:0/464955375 shutdown_connections 2024-05-15T18:08:33.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7fb80da43640 1 -- 172.21.15.3:0/464955375 wait complete. 2024-05-15T18:08:33.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7f1e78bad640 1 -- 172.21.15.3:0/2586753140 shutdown_connections 2024-05-15T18:08:33.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7f1e78bad640 1 --2- 172.21.15.3:0/2586753140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e7406d8d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:33.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7f1e78bad640 1 -- 172.21.15.3:0/2586753140 >> 172.21.15.3:0/2586753140 conn(0x7f1e7409d750 msgr2=0x7f1e7409db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:33.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7f1e78bad640 1 -- 172.21.15.3:0/2586753140 shutdown_connections 2024-05-15T18:08:33.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.817+0000 7f1e78bad640 1 -- 172.21.15.3:0/2586753140 wait complete. 2024-05-15T18:08:33.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.818+0000 7fb80da43640 1 Processor -- start 2024-05-15T18:08:33.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7fb80da43640 1 -- start start 2024-05-15T18:08:33.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7f1e78bad640 1 Processor -- start 2024-05-15T18:08:33.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7f1e78bad640 1 -- start start 2024-05-15T18:08:33.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7fb80da43640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb8081bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7fb80da43640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb80812bd60 con 0x7fb80812b440 2024-05-15T18:08:33.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7f1e78bad640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e741bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7f1e78bad640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7406ed30 con 0x7f1e7406d4f0 2024-05-15T18:08:33.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7fb806ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb8081bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7f1e7259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e741bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7fb806ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb8081bf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41434/0 (socket says 172.21.15.3:41434) 2024-05-15T18:08:33.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7f1e7259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e741bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41436/0 (socket says 172.21.15.3:41436) 2024-05-15T18:08:33.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7f1e7259c640 1 -- 172.21.15.3:0/3297855309 learned_addr learned my addr 172.21.15.3:0/3297855309 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:33.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.819+0000 7fb806ffd640 1 -- 172.21.15.3:0/2909223999 learned_addr learned my addr 172.21.15.3:0/2909223999 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:33.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7fb806ffd640 1 -- 172.21.15.3:0/2909223999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8081196f0 con 0x7fb80812b440 2024-05-15T18:08:33.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7f1e7259c640 1 -- 172.21.15.3:0/3297855309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7412a2e0 con 0x7f1e7406d4f0 2024-05-15T18:08:33.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7fb806ffd640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb8081bf2d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8034040 tx=0x7fb7f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7fb7effff640 1 -- 172.21.15.3:0/2909223999 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f8040070 con 0x7fb80812b440 2024-05-15T18:08:33.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7fb7effff640 1 -- 172.21.15.3:0/2909223999 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8030c50 con 0x7fb80812b440 2024-05-15T18:08:33.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80811a660 con 0x7fb80812b440 2024-05-15T18:08:33.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7fb7effff640 1 -- 172.21.15.3:0/2909223999 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f8035040 con 0x7fb80812b440 2024-05-15T18:08:33.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7f1e7259c640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e741bf900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009840 tx=0x7f1e640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.820+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8081bf810 con 0x7fb80812b440 2024-05-15T18:08:33.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.821+0000 7f1e62ffd640 1 -- 172.21.15.3:0/3297855309 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e64032770 con 0x7f1e7406d4f0 2024-05-15T18:08:33.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.821+0000 7f1e62ffd640 1 -- 172.21.15.3:0/3297855309 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e64032910 con 0x7f1e7406d4f0 2024-05-15T18:08:33.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.821+0000 7f1e62ffd640 1 -- 172.21.15.3:0/3297855309 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e64032c30 con 0x7f1e7406d4f0 2024-05-15T18:08:33.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.821+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7412aa60 con 0x7f1e7406d4f0 2024-05-15T18:08:33.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.821+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e7408e910 con 0x7f1e7406d4f0 2024-05-15T18:08:33.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.821+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb808062e90 con 0x7fb80812b440 2024-05-15T18:08:33.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.822+0000 7fb7effff640 1 -- 172.21.15.3:0/2909223999 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb7f804b060 con 0x7fb80812b440 2024-05-15T18:08:33.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.822+0000 7fb7effff640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb7f4038100 0x7fb7f403a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.822+0000 7fb7effff640 1 -- 172.21.15.3:0/2909223999 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fb7f806ce30 con 0x7fb80812b440 2024-05-15T18:08:33.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.822+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e74062e90 con 0x7f1e7406d4f0 2024-05-15T18:08:33.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.823+0000 7fb8067fc640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb7f4038100 0x7fb7f403a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.823+0000 7f1e62ffd640 1 -- 172.21.15.3:0/3297855309 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1e6404c060 con 0x7f1e7406d4f0 2024-05-15T18:08:33.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.823+0000 7fb8067fc640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb7f4038100 0x7fb7f403a5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc000f60 tx=0x7fb7fc007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.823+0000 7f1e62ffd640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1e54038060 0x7f1e5403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.823+0000 7f1e62ffd640 1 -- 172.21.15.3:0/3297855309 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f1e6402f050 con 0x7f1e7406d4f0 2024-05-15T18:08:33.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.824+0000 7f1e71d9b640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1e54038060 0x7f1e5403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.824+0000 7f1e71d9b640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1e54038060 0x7f1e5403a520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e68007fd0 tx=0x7f1e68007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.831+0000 7fb7effff640 1 -- 172.21.15.3:0/2909223999 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb7f804ddf0 con 0x7fb80812b440 2024-05-15T18:08:33.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.840+0000 7f1e62ffd640 1 -- 172.21.15.3:0/3297855309 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1e64040070 con 0x7f1e7406d4f0 2024-05-15T18:08:33.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.854+0000 7f77a2175640 1 Processor -- start 2024-05-15T18:08:33.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.854+0000 7f77a2175640 1 -- start start 2024-05-15T18:08:33.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f77a2175640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f779c06e300 0x7f779c133610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f77a2175640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c06f380 con 0x7f779c06d810 2024-05-15T18:08:33.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f77a2175640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f779c06edd0 con 0x7f779c06e300 2024-05-15T18:08:33.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f779affd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f779c06e300 0x7f779c133610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f779affd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f779c06e300 0x7f779c133610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41452/0 (socket says 172.21.15.3:41452) 2024-05-15T18:08:33.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f779affd640 1 -- 172.21.15.3:0/3309489292 learned_addr learned my addr 172.21.15.3:0/3309489292 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:33.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f779affd640 1 -- 172.21.15.3:0/3309489292 >> v1:172.21.15.3:6789/0 conn(0x7f779c06d810 legacy=0x7f779c06dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.855+0000 7f779affd640 1 -- 172.21.15.3:0/3309489292 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c06fde0 con 0x7f779c06e300 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.856+0000 7f779affd640 1 --2- 172.21.15.3:0/3309489292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06e300 0x7f779c133610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77900097f0 tx=0x7f779002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2decac4ae294e116 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.856+0000 7f779a7fc640 1 -- 172.21.15.3:0/3309489292 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7790035020 con 0x7f779c06e300 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.856+0000 7f779a7fc640 1 -- 172.21.15.3:0/3309489292 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77900317a0 con 0x7f779c06e300 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.857+0000 7f779a7fc640 1 -- 172.21.15.3:0/3309489292 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7790031aa0 con 0x7f779c06e300 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.857+0000 7f77a2175640 1 -- 172.21.15.3:0/3309489292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06e300 msgr2=0x7f779c133610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.857+0000 7f77a2175640 1 --2- 172.21.15.3:0/3309489292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06e300 0x7f779c133610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77900097f0 tx=0x7f779002b910 comp rx=0 tx=0).stop 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.857+0000 7f77a2175640 1 -- 172.21.15.3:0/3309489292 shutdown_connections 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.857+0000 7f77a2175640 1 --2- 172.21.15.3:0/3309489292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06e300 0x7f779c133610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.857+0000 7f77a2175640 1 -- 172.21.15.3:0/3309489292 >> 172.21.15.3:0/3309489292 conn(0x7f779c0a0d20 msgr2=0x7f779c0a1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.858+0000 7f77a2175640 1 -- 172.21.15.3:0/3309489292 shutdown_connections 2024-05-15T18:08:33.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.858+0000 7f77a2175640 1 -- 172.21.15.3:0/3309489292 wait complete. 2024-05-15T18:08:33.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.859+0000 7f77a2175640 1 Processor -- start 2024-05-15T18:08:33.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.859+0000 7f77a2175640 1 -- start start 2024-05-15T18:08:33.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.860+0000 7f77a2175640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06d810 0x7f779c09a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.860+0000 7f29e5a6d640 1 Processor -- start 2024-05-15T18:08:33.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.860+0000 7f29e5a6d640 1 -- start start 2024-05-15T18:08:33.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.860+0000 7f77a2175640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f779c133cd0 con 0x7f779c06d810 2024-05-15T18:08:33.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.860+0000 7f779b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06d810 0x7f779c09a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f779b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06d810 0x7f779c09a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41460/0 (socket says 172.21.15.3:41460) 2024-05-15T18:08:33.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f779b7fe640 1 -- 172.21.15.3:0/3255276919 learned_addr learned my addr 172.21.15.3:0/3255276919 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:33.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29e5a6d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f29e006d4f0 0x7f29e006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29e5a6d640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e00720b0 con 0x7f29e006de10 2024-05-15T18:08:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29e5a6d640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f29e006f6b0 con 0x7f29e006d4f0 2024-05-15T18:08:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29df7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f29e006d4f0 0x7f29e006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29deffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f29e006de10 0x7f29e009a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50582/0 (socket says 172.21.15.3:50582) 2024-05-15T18:08:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29deffd640 1 -- 172.21.15.3:0/2748711348 learned_addr learned my addr 172.21.15.3:0/2748711348 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29de7fc640 1 -- 172.21.15.3:0/2748711348 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981896747 0 0) 0x7f29e00720b0 con 0x7f29e006de10 2024-05-15T18:08:33.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f779b7fe640 1 -- 172.21.15.3:0/3255276919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c130ec0 con 0x7f779c06d810 2024-05-15T18:08:33.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29de7fc640 1 -- 172.21.15.3:0/2748711348 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c8003520 con 0x7f29e006de10 2024-05-15T18:08:33.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29df7fe640 1 -- 172.21.15.3:0/2748711348 >> v1:172.21.15.3:6789/0 conn(0x7f29e006de10 legacy=0x7f29e009a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.861+0000 7f29df7fe640 1 -- 172.21.15.3:0/2748711348 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e006e710 con 0x7f29e006d4f0 2024-05-15T18:08:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.862+0000 7f779b7fe640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06d810 0x7f779c09a710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f778c00c380 tx=0x7f778c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.862+0000 7f7783fff640 1 -- 172.21.15.3:0/3255276919 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f778c005200 con 0x7f779c06d810 2024-05-15T18:08:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.862+0000 7f7783fff640 1 -- 172.21.15.3:0/3255276919 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c0053c0 con 0x7f779c06d810 2024-05-15T18:08:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.862+0000 7f7783fff640 1 -- 172.21.15.3:0/3255276919 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f778c007190 con 0x7f779c06d810 2024-05-15T18:08:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.862+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779c1329e0 con 0x7f779c06d810 2024-05-15T18:08:33.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.862+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f779c09ac50 con 0x7f779c06d810 2024-05-15T18:08:33.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.862+0000 7f29df7fe640 1 --2- 172.21.15.3:0/2748711348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e006d8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009720 tx=0x7f29d002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21275eea3af3d2f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.863+0000 7f29de7fc640 1 -- 172.21.15.3:0/2748711348 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d00316d0 con 0x7f29e006d4f0 2024-05-15T18:08:33.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.863+0000 7f29de7fc640 1 -- 172.21.15.3:0/2748711348 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0037070 con 0x7f29e006d4f0 2024-05-15T18:08:33.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.863+0000 7f29de7fc640 1 -- 172.21.15.3:0/2748711348 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d00319c0 con 0x7f29e006d4f0 2024-05-15T18:08:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.863+0000 7f7783fff640 1 -- 172.21.15.3:0/3255276919 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f778c007330 con 0x7f779c06d810 2024-05-15T18:08:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.863+0000 7f7783fff640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7788038060 0x7f778803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.863+0000 7f7783fff640 1 -- 172.21.15.3:0/3255276919 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f778c04a3e0 con 0x7f779c06d810 2024-05-15T18:08:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779c062e90 con 0x7f779c06d810 2024-05-15T18:08:33.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f779affd640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7788038060 0x7f778803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2748711348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 msgr2=0x7f29e006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f29e5a6d640 1 --2- 172.21.15.3:0/2748711348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e006d8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009720 tx=0x7f29d002b840 comp rx=0 tx=0).stop 2024-05-15T18:08:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2748711348 shutdown_connections 2024-05-15T18:08:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f29e5a6d640 1 --2- 172.21.15.3:0/2748711348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e006d8d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2748711348 >> 172.21.15.3:0/2748711348 conn(0x7f29e009d750 msgr2=0x7f29e009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2748711348 shutdown_connections 2024-05-15T18:08:33.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.864+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2748711348 wait complete. 2024-05-15T18:08:33.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.865+0000 7f779affd640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7788038060 0x7f778803a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7790036000 tx=0x7f7790008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.865+0000 7f29e5a6d640 1 Processor -- start 2024-05-15T18:08:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.866+0000 7f29e5a6d640 1 -- start start 2024-05-15T18:08:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.866+0000 7f29e5a6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e01bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.866+0000 7f29e5a6d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f29e006ed30 con 0x7f29e006d4f0 2024-05-15T18:08:33.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.866+0000 7f29df7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e01bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.866+0000 7f29df7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e01bfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41472/0 (socket says 172.21.15.3:41472) 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.866+0000 7f29df7fe640 1 -- 172.21.15.3:0/2688445980 learned_addr learned my addr 172.21.15.3:0/2688445980 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.867+0000 7f29df7fe640 1 -- 172.21.15.3:0/2688445980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e008e910 con 0x7f29e006d4f0 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.867+0000 7f29df7fe640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e01bfae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.868+0000 7f29c7fff640 1 -- 172.21.15.3:0/2688445980 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d0032560 con 0x7f29e006d4f0 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.868+0000 7f29c7fff640 1 -- 172.21.15.3:0/2688445980 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0032700 con 0x7f29e006d4f0 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.868+0000 7f29c7fff640 1 -- 172.21.15.3:0/2688445980 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d0032a00 con 0x7f29e006d4f0 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.868+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e008ed50 con 0x7f29e006d4f0 2024-05-15T18:08:33.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.869+0000 7f7783fff640 1 -- 172.21.15.3:0/3255276919 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f778c007620 con 0x7f779c06d810 2024-05-15T18:08:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.869+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e01c0200 con 0x7f29e006d4f0 2024-05-15T18:08:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.870+0000 7f29c7fff640 1 -- 172.21.15.3:0/2688445980 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f29d0032ba0 con 0x7f29e006d4f0 2024-05-15T18:08:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.870+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e008e4f0 con 0x7f29e006d4f0 2024-05-15T18:08:33.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.870+0000 7f29c7fff640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f29cc038060 0x7f29cc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.870+0000 7f29c7fff640 1 -- 172.21.15.3:0/2688445980 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f29d002f050 con 0x7f29e006d4f0 2024-05-15T18:08:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.870+0000 7f29deffd640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f29cc038060 0x7f29cc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:33.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.871+0000 7f29deffd640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f29cc038060 0x7f29cc03a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001610 tx=0x7f29d4007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:33.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:33.879+0000 7f29c7fff640 1 -- 172.21.15.3:0/2688445980 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f29d0040070 con 0x7f29e006d4f0 2024-05-15T18:08:34.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.026+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb808125e10 con 0x7fb80812b440 2024-05-15T18:08:34.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.026+0000 7fb7effff640 1 -- 172.21.15.3:0/2909223999 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7f80393b0 con 0x7fb80812b440 2024-05-15T18:08:34.003 INFO:teuthology.orchestra.run.smithi003.stdout:42949672967 2024-05-15T18:08:34.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb7f4038100 msgr2=0x7fb7f403a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb7f4038100 0x7fb7f403a5c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc000f60 tx=0x7fb7fc007a30 comp rx=0 tx=0).stop 2024-05-15T18:08:34.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 msgr2=0x7fb8081bf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb8081bf2d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8034040 tx=0x7fb7f80046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 shutdown_connections 2024-05-15T18:08:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb7f4038100 0x7fb7f403a5c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 --2- 172.21.15.3:0/2909223999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb80812b440 0x7fb8081bf2d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 >> 172.21.15.3:0/2909223999 conn(0x7fb80809b7f0 msgr2=0x7fb808126360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 shutdown_connections 2024-05-15T18:08:34.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.028+0000 7fb80da43640 1 -- 172.21.15.3:0/2909223999 wait complete. 2024-05-15T18:08:34.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672967 for osd.0 2024-05-15T18:08:34.017 DEBUG:teuthology.parallel:result is None 2024-05-15T18:08:34.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.048+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1e74073fd0 con 0x7f1e7406d4f0 2024-05-15T18:08:34.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.048+0000 7f1e62ffd640 1 -- 172.21.15.3:0/3297855309 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e64039310 con 0x7f1e7406d4f0 2024-05-15T18:08:34.026 INFO:teuthology.orchestra.run.smithi003.stdout:38654705670 2024-05-15T18:08:34.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.050+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1e54038060 msgr2=0x7f1e5403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.050+0000 7f1e78bad640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1e54038060 0x7f1e5403a520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e68007fd0 tx=0x7f1e68007ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.050+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 msgr2=0x7f1e741bf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.050+0000 7f1e78bad640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e741bf900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009840 tx=0x7f1e640046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.050+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 shutdown_connections 2024-05-15T18:08:34.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.050+0000 7f1e78bad640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1e54038060 0x7f1e5403a520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.051+0000 7f1e78bad640 1 --2- 172.21.15.3:0/3297855309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1e7406d4f0 0x7f1e741bf900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.051+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 >> 172.21.15.3:0/3297855309 conn(0x7f1e7409d750 msgr2=0x7f1e7409b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.051+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 shutdown_connections 2024-05-15T18:08:34.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.051+0000 7f1e78bad640 1 -- 172.21.15.3:0/3297855309 wait complete. 2024-05-15T18:08:34.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-05-15T18:08:34.039 DEBUG:teuthology.parallel:result is None 2024-05-15T18:08:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.065+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f29e0062e90 con 0x7f29e006d4f0 2024-05-15T18:08:34.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.065+0000 7f29c7fff640 1 -- 172.21.15.3:0/2688445980 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29d00447a0 con 0x7f29e006d4f0 2024-05-15T18:08:34.042 INFO:teuthology.orchestra.run.smithi003.stdout:38654705669 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f29cc038060 msgr2=0x7f29cc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f29cc038060 0x7f29cc03a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29d4001610 tx=0x7f29d4007970 comp rx=0 tx=0).stop 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 msgr2=0x7f29e01bfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e01bfae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000c00 tx=0x7f29d00046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 shutdown_connections 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f29cc038060 0x7f29cc03a520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 --2- 172.21.15.3:0/2688445980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29e006d4f0 0x7f29e01bfae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 >> 172.21.15.3:0/2688445980 conn(0x7f29e009d750 msgr2=0x7f29e009b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 shutdown_connections 2024-05-15T18:08:34.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.067+0000 7f29e5a6d640 1 -- 172.21.15.3:0/2688445980 wait complete. 2024-05-15T18:08:34.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.074+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f779c131a80 con 0x7f779c06d810 2024-05-15T18:08:34.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.074+0000 7f7783fff640 1 -- 172.21.15.3:0/3255276919 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f778c012820 con 0x7f779c06d810 2024-05-15T18:08:34.052 INFO:teuthology.orchestra.run.smithi003.stdout:38654705669 2024-05-15T18:08:34.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7788038060 msgr2=0x7f778803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7788038060 0x7f778803a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7790036000 tx=0x7f7790008030 comp rx=0 tx=0).stop 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06d810 msgr2=0x7f779c09a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06d810 0x7f779c09a710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f778c00c380 tx=0x7f778c00c840 comp rx=0 tx=0).stop 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 shutdown_connections 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7788038060 0x7f778803a520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 --2- 172.21.15.3:0/3255276919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f779c06d810 0x7f779c09a710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 >> 172.21.15.3:0/3255276919 conn(0x7f779c0a0d20 msgr2=0x7f779c09d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 shutdown_connections 2024-05-15T18:08:34.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.077+0000 7f77a2175640 1 -- 172.21.15.3:0/3255276919 wait complete. 2024-05-15T18:08:34.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-05-15T18:08:34.056 DEBUG:teuthology.parallel:result is None 2024-05-15T18:08:34.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-05-15T18:08:34.065 DEBUG:teuthology.parallel:result is None 2024-05-15T18:08:34.065 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T18:08:34.065 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:08:34.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.230+0000 7fdb25dab640 1 Processor -- start 2024-05-15T18:08:34.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.230+0000 7fdb25dab640 1 -- start start 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb25dab640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb20127ea0 0x7fdb20128280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb25dab640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb20071020 con 0x7fdb201287c0 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb25dab640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fdb20071780 con 0x7fdb20127ea0 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb1f7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb20127ea0 0x7fdb20128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb1effd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fdb201287c0 0x7fdb2012b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50584/0 (socket says 172.21.15.3:50584) 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb1f7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fdb20127ea0 0x7fdb20128280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41482/0 (socket says 172.21.15.3:41482) 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb1effd640 1 -- 172.21.15.3:0/1621080211 learned_addr learned my addr 172.21.15.3:0/1621080211 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb1f7fe640 1 -- 172.21.15.3:0/1621080211 >> v1:172.21.15.3:6789/0 conn(0x7fdb201287c0 legacy=0x7fdb2012b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.231+0000 7fdb1f7fe640 1 -- 172.21.15.3:0/1621080211 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2006e6e0 con 0x7fdb20127ea0 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.232+0000 7fdb1f7fe640 1 --2- 172.21.15.3:0/1621080211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20128280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009720 tx=0x7fdb1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42d06bc1f79f2f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.232+0000 7fdb1e7fc640 1 -- 172.21.15.3:0/1621080211 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb10035020 con 0x7fdb20127ea0 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.232+0000 7fdb1e7fc640 1 -- 172.21.15.3:0/1621080211 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb10031760 con 0x7fdb20127ea0 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.232+0000 7fdb1e7fc640 1 -- 172.21.15.3:0/1621080211 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb10031a60 con 0x7fdb20127ea0 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.232+0000 7fdb25dab640 1 -- 172.21.15.3:0/1621080211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 msgr2=0x7fdb20128280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.232+0000 7fdb25dab640 1 --2- 172.21.15.3:0/1621080211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20128280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009720 tx=0x7fdb1002b8d0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.233+0000 7fdb25dab640 1 -- 172.21.15.3:0/1621080211 shutdown_connections 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.233+0000 7fdb25dab640 1 --2- 172.21.15.3:0/1621080211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20128280 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.233+0000 7fdb25dab640 1 -- 172.21.15.3:0/1621080211 >> 172.21.15.3:0/1621080211 conn(0x7fdb20099380 msgr2=0x7fdb20099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.233+0000 7fdb25dab640 1 -- 172.21.15.3:0/1621080211 shutdown_connections 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.233+0000 7fdb25dab640 1 -- 172.21.15.3:0/1621080211 wait complete. 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.233+0000 7fdb25dab640 1 Processor -- start 2024-05-15T18:08:34.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.234+0000 7fdb25dab640 1 -- start start 2024-05-15T18:08:34.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.234+0000 7fdb25dab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20114bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.234+0000 7fdb25dab640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2012b800 con 0x7fdb20127ea0 2024-05-15T18:08:34.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.234+0000 7fdb1f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20114bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.234+0000 7fdb1f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20114bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41494/0 (socket says 172.21.15.3:41494) 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.234+0000 7fdb1f7fe640 1 -- 172.21.15.3:0/3967283180 learned_addr learned my addr 172.21.15.3:0/3967283180 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.234+0000 7fdb1f7fe640 1 -- 172.21.15.3:0/3967283180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb20117b70 con 0x7fdb20127ea0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.235+0000 7fdb1f7fe640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20114bc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb1002b910 tx=0x7fdb100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.235+0000 7fdb07fff640 1 -- 172.21.15.3:0/3967283180 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1003bcd0 con 0x7fdb20127ea0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.235+0000 7fdb07fff640 1 -- 172.21.15.3:0/3967283180 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb100453f0 con 0x7fdb20127ea0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.235+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb201166f0 con 0x7fdb20127ea0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.235+0000 7fdb07fff640 1 -- 172.21.15.3:0/3967283180 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb10045710 con 0x7fdb20127ea0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.235+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb201183d0 con 0x7fdb20127ea0 2024-05-15T18:08:34.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.236+0000 7fdb07fff640 1 -- 172.21.15.3:0/3967283180 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb1004c060 con 0x7fdb20127ea0 2024-05-15T18:08:34.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.236+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb20117ee0 con 0x7fdb20127ea0 2024-05-15T18:08:34.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.236+0000 7fdb07fff640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdb0c038060 0x7fdb0c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.236+0000 7fdb07fff640 1 -- 172.21.15.3:0/3967283180 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fdb1006d0c0 con 0x7fdb20127ea0 2024-05-15T18:08:34.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.236+0000 7fdb1effd640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdb0c038060 0x7fdb0c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.237+0000 7fdb1effd640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdb0c038060 0x7fdb0c03a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000f60 tx=0x7fdb14007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.241+0000 7fdb07fff640 1 -- 172.21.15.3:0/3967283180 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdb10040070 con 0x7fdb20127ea0 2024-05-15T18:08:34.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.420+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb20062e90 con 0x7fdb0c038060 2024-05-15T18:08:34.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.422+0000 7fdb07fff640 1 -- 172.21.15.3:0/3967283180 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31869 (secure 0 0 0) 0x7fdb20062e90 con 0x7fdb0c038060 2024-05-15T18:08:34.400 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:08:34.400 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:08:34.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdb0c038060 msgr2=0x7fdb0c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdb0c038060 0x7fdb0c03a520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000f60 tx=0x7fdb14007a80 comp rx=0 tx=0).stop 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 msgr2=0x7fdb20114bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20114bc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb1002b910 tx=0x7fdb100046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 shutdown_connections 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdb0c038060 0x7fdb0c03a520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 --2- 172.21.15.3:0/3967283180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb20127ea0 0x7fdb20114bc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 >> 172.21.15.3:0/3967283180 conn(0x7fdb20099380 msgr2=0x7fdb2006ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 shutdown_connections 2024-05-15T18:08:34.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.424+0000 7fdb25dab640 1 -- 172.21.15.3:0/3967283180 wait complete. 2024-05-15T18:08:34.412 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-15T18:08:34.316475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109800,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377560,"statfs":{"total":386547056640,"available":386434621440,"internally_reserved":0,"allocated":1744896,"data_stored":1355540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":110618386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.174497"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547722+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:08:32.547722+0000","last_peered":"2024-05-15T18:08:32.547722+0000","last_clean":"2024-05-15T18:08:32.547722+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:08:32.547722+0000","last_undegraded":"2024-05-15T18:08:32.547722+0000","last_fullsized":"2024-05-15T18:08:32.547722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:33:34.798074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.146130+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:08:32.146130+0000","last_peered":"2024-05-15T18:08:32.146130+0000","last_clean":"2024-05-15T18:08:32.146130+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:08:32.146130+0000","last_undegraded":"2024-05-15T18:08:32.146130+0000","last_fullsized":"2024-05-15T18:08:32.146130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:14.064562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547766+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:08:32.547766+0000","last_peered":"2024-05-15T18:08:32.547766+0000","last_clean":"2024-05-15T18:08:32.547766+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:08:32.547766+0000","last_undegraded":"2024-05-15T18:08:32.547766+0000","last_fullsized":"2024-05-15T18:08:32.547766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:13.458538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.146043+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:08:32.146043+0000","last_peered":"2024-05-15T18:08:32.146043+0000","last_clean":"2024-05-15T18:08:32.146043+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:08:32.146043+0000","last_undegraded":"2024-05-15T18:08:32.146043+0000","last_fullsized":"2024-05-15T18:08:32.146043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547655+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:08:32.547655+0000","last_peered":"2024-05-15T18:08:32.547655+0000","last_clean":"2024-05-15T18:08:32.547655+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:08:32.547655+0000","last_undegraded":"2024-05-15T18:08:32.547655+0000","last_fullsized":"2024-05-15T18:08:32.547655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:36:43.128557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547657+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:08:32.547657+0000","last_peered":"2024-05-15T18:08:32.547657+0000","last_clean":"2024-05-15T18:08:32.547657+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:08:32.547657+0000","last_undegraded":"2024-05-15T18:08:32.547657+0000","last_fullsized":"2024-05-15T18:08:32.547657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547652+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:08:32.547652+0000","last_peered":"2024-05-15T18:08:32.547652+0000","last_clean":"2024-05-15T18:08:32.547652+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:08:32.547652+0000","last_undegraded":"2024-05-15T18:08:32.547652+0000","last_fullsized":"2024-05-15T18:08:32.547652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:44:53.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547742+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:08:32.547742+0000","last_peered":"2024-05-15T18:08:32.547742+0000","last_clean":"2024-05-15T18:08:32.547742+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:08:32.547742+0000","last_undegraded":"2024-05-15T18:08:32.547742+0000","last_fullsized":"2024-05-15T18:08:32.547742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:51:30.696652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547402+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:08:32.547402+0000","last_peered":"2024-05-15T18:08:32.547402+0000","last_clean":"2024-05-15T18:08:32.547402+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:08:32.547402+0000","last_undegraded":"2024-05-15T18:08:32.547402+0000","last_fullsized":"2024-05-15T18:08:32.547402+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:38:29.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":733184,"data_stored":634069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":733184,"data_stored":634069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:08:34.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:08:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.538+0000 7fe97dea5640 1 Processor -- start 2024-05-15T18:08:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.538+0000 7fe97dea5640 1 -- start start 2024-05-15T18:08:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.538+0000 7fe97dea5640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe97812e460 0x7fe978130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.538+0000 7fe97dea5640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe978071020 con 0x7fe978127ea0 2024-05-15T18:08:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.538+0000 7fe97dea5640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fe978071780 con 0x7fe97812e460 2024-05-15T18:08:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.539+0000 7fe976ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fe97812e460 0x7fe978130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.539+0000 7fe9777fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fe978127ea0 0x7fe978128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50598/0 (socket says 172.21.15.3:50598) 2024-05-15T18:08:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.539+0000 7fe9777fe640 1 -- 172.21.15.3:0/2505501806 learned_addr learned my addr 172.21.15.3:0/2505501806 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.539+0000 7fe976ffd640 1 --2- 172.21.15.3:0/2505501806 >> v2:172.21.15.3:3300/0 conn(0x7fe97812e460 0x7fe978130850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41508/0 (socket says 172.21.15.3:41508) 2024-05-15T18:08:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.539+0000 7fe976ffd640 1 -- 172.21.15.3:0/2505501806 >> v1:172.21.15.3:6789/0 conn(0x7fe978127ea0 legacy=0x7fe978128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.539+0000 7fe976ffd640 1 -- 172.21.15.3:0/2505501806 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97806e6e0 con 0x7fe97812e460 2024-05-15T18:08:34.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe976ffd640 1 --2- 172.21.15.3:0/2505501806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe97812e460 0x7fe978130850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009720 tx=0x7fe96c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71bb5197bb22511 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe9767fc640 1 -- 172.21.15.3:0/2505501806 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c035020 con 0x7fe97812e460 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe9767fc640 1 -- 172.21.15.3:0/2505501806 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c031760 con 0x7fe97812e460 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe9767fc640 1 -- 172.21.15.3:0/2505501806 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c031a60 con 0x7fe97812e460 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe97dea5640 1 -- 172.21.15.3:0/2505501806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe97812e460 msgr2=0x7fe978130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe97dea5640 1 --2- 172.21.15.3:0/2505501806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe97812e460 0x7fe978130850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009720 tx=0x7fe96c02b8d0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe97dea5640 1 -- 172.21.15.3:0/2505501806 shutdown_connections 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe97dea5640 1 --2- 172.21.15.3:0/2505501806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe97812e460 0x7fe978130850 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe97dea5640 1 -- 172.21.15.3:0/2505501806 >> 172.21.15.3:0/2505501806 conn(0x7fe978099380 msgr2=0x7fe978099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe97dea5640 1 -- 172.21.15.3:0/2505501806 shutdown_connections 2024-05-15T18:08:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.540+0000 7fe97dea5640 1 -- 172.21.15.3:0/2505501806 wait complete. 2024-05-15T18:08:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.541+0000 7fe97dea5640 1 Processor -- start 2024-05-15T18:08:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.541+0000 7fe97dea5640 1 -- start start 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe97dea5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe978127ea0 0x7fe97812c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe97dea5640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780725d0 con 0x7fe978127ea0 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe9777fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe978127ea0 0x7fe97812c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe9777fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe978127ea0 0x7fe97812c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41518/0 (socket says 172.21.15.3:41518) 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe9777fe640 1 -- 172.21.15.3:0/104771008 learned_addr learned my addr 172.21.15.3:0/104771008 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe9777fe640 1 -- 172.21.15.3:0/104771008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe978121f80 con 0x7fe978127ea0 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe9777fe640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe978127ea0 0x7fe97812c200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c4a0 tx=0x7fe96800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe95ffff640 1 -- 172.21.15.3:0/104771008 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe968017070 con 0x7fe978127ea0 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.542+0000 7fe95ffff640 1 -- 172.21.15.3:0/104771008 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe968005c10 con 0x7fe978127ea0 2024-05-15T18:08:34.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.543+0000 7fe95ffff640 1 -- 172.21.15.3:0/104771008 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe968007070 con 0x7fe978127ea0 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.543+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe978125110 con 0x7fe978127ea0 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.543+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97812d4c0 con 0x7fe978127ea0 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.544+0000 7fe95ffff640 1 -- 172.21.15.3:0/104771008 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe96801a070 con 0x7fe978127ea0 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.544+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe978062e90 con 0x7fe978127ea0 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.544+0000 7fe95ffff640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe964038010 0x7fe96403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.544+0000 7fe95ffff640 1 -- 172.21.15.3:0/104771008 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fe96804a250 con 0x7fe978127ea0 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.544+0000 7fe976ffd640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe964038010 0x7fe96403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.545+0000 7fe976ffd640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe964038010 0x7fe96403a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe96c036000 tx=0x7fe96c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.549+0000 7fe95ffff640 1 -- 172.21.15.3:0/104771008 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe96801b400 con 0x7fe978127ea0 2024-05-15T18:08:34.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.727+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe978117990 con 0x7fe964038010 2024-05-15T18:08:34.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.729+0000 7fe95ffff640 1 -- 172.21.15.3:0/104771008 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31869 (secure 0 0 0) 0x7fe978117990 con 0x7fe964038010 2024-05-15T18:08:34.706 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:08:34.707 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe964038010 msgr2=0x7fe96403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe964038010 0x7fe96403a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe96c036000 tx=0x7fe96c008030 comp rx=0 tx=0).stop 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe978127ea0 msgr2=0x7fe97812c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe978127ea0 0x7fe97812c200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe96800c4a0 tx=0x7fe96800c960 comp rx=0 tx=0).stop 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 shutdown_connections 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe964038010 0x7fe96403a4d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 --2- 172.21.15.3:0/104771008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe978127ea0 0x7fe97812c200 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.730+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 >> 172.21.15.3:0/104771008 conn(0x7fe978099380 msgr2=0x7fe97809a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.731+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 shutdown_connections 2024-05-15T18:08:34.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.731+0000 7fe97dea5640 1 -- 172.21.15.3:0/104771008 wait complete. 2024-05-15T18:08:34.719 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-15T18:08:34.316475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109800,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377560,"statfs":{"total":386547056640,"available":386434621440,"internally_reserved":0,"allocated":1744896,"data_stored":1355540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":110618386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.174497"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547722+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:08:32.547722+0000","last_peered":"2024-05-15T18:08:32.547722+0000","last_clean":"2024-05-15T18:08:32.547722+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:08:32.547722+0000","last_undegraded":"2024-05-15T18:08:32.547722+0000","last_fullsized":"2024-05-15T18:08:32.547722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:33:34.798074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.146130+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:08:32.146130+0000","last_peered":"2024-05-15T18:08:32.146130+0000","last_clean":"2024-05-15T18:08:32.146130+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:08:32.146130+0000","last_undegraded":"2024-05-15T18:08:32.146130+0000","last_fullsized":"2024-05-15T18:08:32.146130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:14.064562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547766+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:08:32.547766+0000","last_peered":"2024-05-15T18:08:32.547766+0000","last_clean":"2024-05-15T18:08:32.547766+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:08:32.547766+0000","last_undegraded":"2024-05-15T18:08:32.547766+0000","last_fullsized":"2024-05-15T18:08:32.547766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:13.458538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.146043+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:08:32.146043+0000","last_peered":"2024-05-15T18:08:32.146043+0000","last_clean":"2024-05-15T18:08:32.146043+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:08:32.146043+0000","last_undegraded":"2024-05-15T18:08:32.146043+0000","last_fullsized":"2024-05-15T18:08:32.146043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547655+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:08:32.547655+0000","last_peered":"2024-05-15T18:08:32.547655+0000","last_clean":"2024-05-15T18:08:32.547655+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:08:32.547655+0000","last_undegraded":"2024-05-15T18:08:32.547655+0000","last_fullsized":"2024-05-15T18:08:32.547655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:36:43.128557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547657+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:08:32.547657+0000","last_peered":"2024-05-15T18:08:32.547657+0000","last_clean":"2024-05-15T18:08:32.547657+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:08:32.547657+0000","last_undegraded":"2024-05-15T18:08:32.547657+0000","last_fullsized":"2024-05-15T18:08:32.547657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547652+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:08:32.547652+0000","last_peered":"2024-05-15T18:08:32.547652+0000","last_clean":"2024-05-15T18:08:32.547652+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:08:32.547652+0000","last_undegraded":"2024-05-15T18:08:32.547652+0000","last_fullsized":"2024-05-15T18:08:32.547652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:44:53.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547742+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:08:32.547742+0000","last_peered":"2024-05-15T18:08:32.547742+0000","last_clean":"2024-05-15T18:08:32.547742+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:08:32.547742+0000","last_undegraded":"2024-05-15T18:08:32.547742+0000","last_fullsized":"2024-05-15T18:08:32.547742+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:51:30.696652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":168,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-05-15T18:08:32.547402+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:08:32.547402+0000","last_peered":"2024-05-15T18:08:32.547402+0000","last_clean":"2024-05-15T18:08:32.547402+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:08:32.547402+0000","last_undegraded":"2024-05-15T18:08:32.547402+0000","last_fullsized":"2024-05-15T18:08:32.547402+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:38:29.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":733184,"data_stored":634069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":733184,"data_stored":634069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:08:34.720 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T18:08:34.720 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-15T18:08:34.720 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-15T18:08:34.720 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-15T18:08:34.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.844+0000 7fbc5a831640 1 Processor -- start 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc5a831640 1 -- start start 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc5a831640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbc54127ed0 0x7fbc541282b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc5a831640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5406eb00 con 0x7fbc5412b000 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc5a831640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fbc54127a80 con 0x7fbc54127ed0 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc53fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fbc54127ed0 0x7fbc541282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc537fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fbc5412b000 0x7fbc5412b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:50608/0 (socket says 172.21.15.3:50608) 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc537fe640 1 -- 172.21.15.3:0/3719647524 learned_addr learned my addr 172.21.15.3:0/3719647524 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc53fff640 1 -- 172.21.15.3:0/3719647524 >> v1:172.21.15.3:6789/0 conn(0x7fbc5412b000 legacy=0x7fbc5412b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc53fff640 1 -- 172.21.15.3:0/3719647524 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc54127cb0 con 0x7fbc54127ed0 2024-05-15T18:08:34.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.845+0000 7fbc52ffd640 1 -- 172.21.15.3:0/3719647524 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043445333 0 0) 0x7fbc5406eb00 con 0x7fbc5412b000 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.846+0000 7fbc53fff640 1 --2- 172.21.15.3:0/3719647524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc541282b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009720 tx=0x7fbc4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5609ed8df51d7f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.846+0000 7fbc52ffd640 1 -- 172.21.15.3:0/3719647524 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44035020 con 0x7fbc54127ed0 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.846+0000 7fbc52ffd640 1 -- 172.21.15.3:0/3719647524 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44031760 con 0x7fbc54127ed0 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.846+0000 7fbc52ffd640 1 -- 172.21.15.3:0/3719647524 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44031a60 con 0x7fbc54127ed0 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.847+0000 7fbc5a831640 1 -- 172.21.15.3:0/3719647524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 msgr2=0x7fbc541282b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.847+0000 7fbc5a831640 1 --2- 172.21.15.3:0/3719647524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc541282b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009720 tx=0x7fbc4402b8d0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.847+0000 7fbc5a831640 1 -- 172.21.15.3:0/3719647524 shutdown_connections 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.847+0000 7fbc5a831640 1 --2- 172.21.15.3:0/3719647524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc541282b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.847+0000 7fbc5a831640 1 -- 172.21.15.3:0/3719647524 >> 172.21.15.3:0/3719647524 conn(0x7fbc540995c0 msgr2=0x7fbc540999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:34.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.847+0000 7fbc5a831640 1 -- 172.21.15.3:0/3719647524 shutdown_connections 2024-05-15T18:08:34.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.847+0000 7fbc5a831640 1 -- 172.21.15.3:0/3719647524 wait complete. 2024-05-15T18:08:34.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.848+0000 7fbc5a831640 1 Processor -- start 2024-05-15T18:08:34.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.848+0000 7fbc5a831640 1 -- start start 2024-05-15T18:08:34.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.848+0000 7fbc5a831640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc54128de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.848+0000 7fbc5a831640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540724c0 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.848+0000 7fbc53fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc54128de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.848+0000 7fbc53fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc54128de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41538/0 (socket says 172.21.15.3:41538) 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.848+0000 7fbc53fff640 1 -- 172.21.15.3:0/1673157668 learned_addr learned my addr 172.21.15.3:0/1673157668 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.849+0000 7fbc53fff640 1 -- 172.21.15.3:0/1673157668 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc54124e60 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.849+0000 7fbc53fff640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc54128de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009840 tx=0x7fbc440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.849+0000 7fbc50ff9640 1 -- 172.21.15.3:0/1673157668 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4403b930 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.849+0000 7fbc50ff9640 1 -- 172.21.15.3:0/1673157668 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4403baf0 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.849+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc54117920 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.849+0000 7fbc50ff9640 1 -- 172.21.15.3:0/1673157668 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4403be10 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.849+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5412a120 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.850+0000 7fbc50ff9640 1 -- 172.21.15.3:0/1673157668 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbc4404c060 con 0x7fbc54127ed0 2024-05-15T18:08:34.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.850+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc54062e90 con 0x7fbc54127ed0 2024-05-15T18:08:34.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.850+0000 7fbc50ff9640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbc40038090 0x7fbc4003a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:34.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.850+0000 7fbc50ff9640 1 -- 172.21.15.3:0/1673157668 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fbc4406cd10 con 0x7fbc54127ed0 2024-05-15T18:08:34.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.850+0000 7fbc537fe640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbc40038090 0x7fbc4003a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:34.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.851+0000 7fbc537fe640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbc40038090 0x7fbc4003a550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc48001230 tx=0x7fbc480078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:34.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:34.855+0000 7fbc50ff9640 1 -- 172.21.15.3:0/1673157668 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbc44040070 con 0x7fbc54127ed0 2024-05-15T18:08:35.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.075+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbc5412b910 con 0x7fbc54127ed0 2024-05-15T18:08:35.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.075+0000 7fbc50ff9640 1 -- 172.21.15.3:0/1673157668 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbc44030380 con 0x7fbc54127ed0 2024-05-15T18:08:35.053 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:08:35.053 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-15T18:08:35.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbc40038090 msgr2=0x7fbc4003a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbc40038090 0x7fbc4003a550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbc48001230 tx=0x7fbc480078f0 comp rx=0 tx=0).stop 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 msgr2=0x7fbc54128de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc54128de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009840 tx=0x7fbc440046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 shutdown_connections 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbc40038090 0x7fbc4003a550 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 --2- 172.21.15.3:0/1673157668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc54127ed0 0x7fbc54128de0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 >> 172.21.15.3:0/1673157668 conn(0x7fbc540995c0 msgr2=0x7fbc5406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 shutdown_connections 2024-05-15T18:08:35.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:08:35.077+0000 7fbc5a831640 1 -- 172.21.15.3:0/1673157668 wait complete. 2024-05-15T18:08:35.065 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-15T18:08:35.066 INFO:teuthology.run_tasks:Running task rgw... 2024-05-15T18:08:35.080 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-15T18:08:35.080 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-15T18:08:35.081 INFO:tasks.rgw:Creating data pools 2024-05-15T18:08:35.081 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-15T18:08:35.081 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.215+0000 7f18c6500640 1 Processor -- start 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.215+0000 7f18c6500640 1 -- start start 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18c6500640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18c010e000 0x7f18c010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18c6500640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c010eb30 con 0x7f18c0117990 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18c6500640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f18c011c4b0 con 0x7f18c010e000 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18bffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f18c010e000 0x7f18c010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18b7fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f18c0117990 0x7f18c0119d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43388/0 (socket says 172.21.15.173:43388) 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18b7fff640 1 -- 172.21.15.173:0/1939203128 learned_addr learned my addr 172.21.15.173:0/1939203128 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:35.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18bffff640 1 -- 172.21.15.173:0/1939203128 >> v1:172.21.15.3:6789/0 conn(0x7f18c0117990 legacy=0x7f18c0119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:35.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.216+0000 7f18bffff640 1 -- 172.21.15.173:0/1939203128 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c011c630 con 0x7f18c010e000 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.217+0000 7f18bffff640 1 --2- 172.21.15.173:0/1939203128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010e3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009720 tx=0x7f18b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b707161c885fc2ab server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.217+0000 7f18bf7fe640 1 -- 172.21.15.173:0/1939203128 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b00316d0 con 0x7f18c010e000 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.217+0000 7f18bf7fe640 1 -- 172.21.15.173:0/1939203128 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0037070 con 0x7f18c010e000 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.217+0000 7f18bf7fe640 1 -- 172.21.15.173:0/1939203128 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b00319c0 con 0x7f18c010e000 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.218+0000 7f18c6500640 1 -- 172.21.15.173:0/1939203128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 msgr2=0x7f18c010e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.218+0000 7f18c6500640 1 --2- 172.21.15.173:0/1939203128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010e3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009720 tx=0x7f18b002b840 comp rx=0 tx=0).stop 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.218+0000 7f18c6500640 1 -- 172.21.15.173:0/1939203128 shutdown_connections 2024-05-15T18:08:35.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.218+0000 7f18c6500640 1 --2- 172.21.15.173:0/1939203128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010e3e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:35.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.218+0000 7f18c6500640 1 -- 172.21.15.173:0/1939203128 >> 172.21.15.173:0/1939203128 conn(0x7f18c006f430 msgr2=0x7f18c0071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:35.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.218+0000 7f18c6500640 1 -- 172.21.15.173:0/1939203128 shutdown_connections 2024-05-15T18:08:35.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.218+0000 7f18c6500640 1 -- 172.21.15.173:0/1939203128 wait complete. 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.219+0000 7f18c6500640 1 Processor -- start 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.219+0000 7f18c6500640 1 -- start start 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.219+0000 7f18c6500640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.219+0000 7f18c6500640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f18c011b9c0 con 0x7f18c010e000 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.219+0000 7f18bffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.219+0000 7f18bffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:47650/0 (socket says 172.21.15.173:47650) 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.219+0000 7f18bffff640 1 -- 172.21.15.173:0/2620064719 learned_addr learned my addr 172.21.15.173:0/2620064719 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:35.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.220+0000 7f18bffff640 1 -- 172.21.15.173:0/2620064719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c010fd40 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.220+0000 7f18bffff640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010f800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18b0034040 tx=0x7f18b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.220+0000 7f18bd7fa640 1 -- 172.21.15.173:0/2620064719 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b0032770 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.220+0000 7f18bd7fa640 1 -- 172.21.15.173:0/2620064719 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0032910 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.220+0000 7f18bd7fa640 1 -- 172.21.15.173:0/2620064719 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b0032c30 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.220+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c010ff70 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.220+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c0110460 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.221+0000 7f18bd7fa640 1 -- 172.21.15.173:0/2620064719 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f18b004c060 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.221+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c004fe40 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.221+0000 7f18bd7fa640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f18a0038060 0x7f18a003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.221+0000 7f18bd7fa640 1 -- 172.21.15.173:0/2620064719 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f18b002f050 con 0x7f18c010e000 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.221+0000 7f18b7fff640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f18a0038060 0x7f18a003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:35.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.221+0000 7f18b7fff640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f18a0038060 0x7f18a003a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007fd0 tx=0x7f18a8007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:35.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.226+0000 7f18bd7fa640 1 -- 172.21.15.173:0/2620064719 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f18b0040070 con 0x7f18c010e000 2024-05-15T18:08:35.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:35.402+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f18c0117990 con 0x7f18c010e000 2024-05-15T18:08:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.154+0000 7f18bd7fa640 1 -- 172.21.15.173:0/2620064719 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v17) ==== 167+0+0 (secure 0 0 0) 0x7f18b003a380 con 0x7f18c010e000 2024-05-15T18:08:36.132 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'default.rgw.buckets.data' created 2024-05-15T18:08:36.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f18a0038060 msgr2=0x7f18a003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:36.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f18a0038060 0x7f18a003a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007fd0 tx=0x7f18a8007ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 msgr2=0x7f18c010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010f800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18b0034040 tx=0x7f18b00046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 shutdown_connections 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f18a0038060 0x7f18a003a520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 --2- 172.21.15.173:0/2620064719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f18c010e000 0x7f18c010f800 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 >> 172.21.15.173:0/2620064719 conn(0x7f18c006f430 msgr2=0x7f18c006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 shutdown_connections 2024-05-15T18:08:36.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.157+0000 7f18c6500640 1 -- 172.21.15.173:0/2620064719 wait complete. 2024-05-15T18:08:36.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-15T18:08:36.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.281+0000 7f7271532640 1 Processor -- start 2024-05-15T18:08:36.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.281+0000 7f7271532640 1 -- start start 2024-05-15T18:08:36.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.281+0000 7f7271532640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f726c06ca90 0x7f726c06ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:36.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.281+0000 7f7271532640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f726c11d610 con 0x7f726c06d3b0 2024-05-15T18:08:36.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.281+0000 7f7271532640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f726c06d8f0 con 0x7f726c06ca90 2024-05-15T18:08:36.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.282+0000 7f726affd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f726c06ca90 0x7f726c06ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:36.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.282+0000 7f7263fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f726c06d3b0 0x7f726c11bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43396/0 (socket says 172.21.15.173:43396) 2024-05-15T18:08:36.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.282+0000 7f7263fff640 1 -- 172.21.15.173:0/1355764287 learned_addr learned my addr 172.21.15.173:0/1355764287 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.282+0000 7f726affd640 1 -- 172.21.15.173:0/1355764287 >> v1:172.21.15.3:6789/0 conn(0x7f726c06d3b0 legacy=0x7f726c11bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.282+0000 7f726affd640 1 -- 172.21.15.173:0/1355764287 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c11e7f0 con 0x7f726c06ca90 2024-05-15T18:08:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.283+0000 7f726affd640 1 --2- 172.21.15.173:0/1355764287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c06ce70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f725c009720 tx=0x7f725c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc447a1cb666414 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.283+0000 7f726a7fc640 1 -- 172.21.15.173:0/1355764287 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c0316d0 con 0x7f726c06ca90 2024-05-15T18:08:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.283+0000 7f726a7fc640 1 -- 172.21.15.173:0/1355764287 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c037070 con 0x7f726c06ca90 2024-05-15T18:08:36.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.283+0000 7f726a7fc640 1 -- 172.21.15.173:0/1355764287 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c0319c0 con 0x7f726c06ca90 2024-05-15T18:08:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 -- 172.21.15.173:0/1355764287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 msgr2=0x7f726c06ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 --2- 172.21.15.173:0/1355764287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c06ce70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f725c009720 tx=0x7f725c02b840 comp rx=0 tx=0).stop 2024-05-15T18:08:36.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 -- 172.21.15.173:0/1355764287 shutdown_connections 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 --2- 172.21.15.173:0/1355764287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c06ce70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 -- 172.21.15.173:0/1355764287 >> 172.21.15.173:0/1355764287 conn(0x7f726c071570 msgr2=0x7f726c10dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 -- 172.21.15.173:0/1355764287 shutdown_connections 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 -- 172.21.15.173:0/1355764287 wait complete. 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 Processor -- start 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.284+0000 7f7271532640 1 -- start start 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.285+0000 7f7271532640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c1ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.285+0000 7f7271532640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f726c11dcc0 con 0x7f726c06ca90 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.285+0000 7f726affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c1ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.285+0000 7f726affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c1ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:47664/0 (socket says 172.21.15.173:47664) 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.285+0000 7f726affd640 1 -- 172.21.15.173:0/784953734 learned_addr learned my addr 172.21.15.173:0/784953734 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.285+0000 7f726affd640 1 -- 172.21.15.173:0/784953734 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c1ac9e0 con 0x7f726c06ca90 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.285+0000 7f726affd640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c1ac410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f725c02b880 tx=0x7f725c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:36.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.286+0000 7f72637fe640 1 -- 172.21.15.173:0/784953734 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c032770 con 0x7f726c06ca90 2024-05-15T18:08:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.286+0000 7f72637fe640 1 -- 172.21.15.173:0/784953734 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c032910 con 0x7f726c06ca90 2024-05-15T18:08:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.286+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c1acc10 con 0x7f726c06ca90 2024-05-15T18:08:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.286+0000 7f72637fe640 1 -- 172.21.15.173:0/784953734 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c032bf0 con 0x7f726c06ca90 2024-05-15T18:08:36.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.286+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c1a6520 con 0x7f726c06ca90 2024-05-15T18:08:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.287+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c04fe40 con 0x7f726c06ca90 2024-05-15T18:08:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.287+0000 7f72637fe640 1 -- 172.21.15.173:0/784953734 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f725c04c060 con 0x7f726c06ca90 2024-05-15T18:08:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.287+0000 7f72637fe640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f724c038060 0x7f724c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.287+0000 7f72637fe640 1 -- 172.21.15.173:0/784953734 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3845+0+0 (secure 0 0 0) 0x7f725c02f050 con 0x7f726c06ca90 2024-05-15T18:08:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.287+0000 7f7263fff640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f724c038060 0x7f724c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:36.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.287+0000 7f7263fff640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f724c038060 0x7f724c03a520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7254000f60 tx=0x7f7254007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:36.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.292+0000 7f72637fe640 1 -- 172.21.15.173:0/784953734 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f725c040070 con 0x7f726c06ca90 2024-05-15T18:08:36.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:36.466+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f726c06d3b0 con 0x7f726c06ca90 2024-05-15T18:08:37.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.158+0000 7f72637fe640 1 -- 172.21.15.173:0/784953734 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v18) ==== 185+0+0 (secure 0 0 0) 0x7f725c03a380 con 0x7f726c06ca90 2024-05-15T18:08:37.136 INFO:teuthology.orchestra.run.smithi173.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-15T18:08:37.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f724c038060 msgr2=0x7f724c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:37.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f724c038060 0x7f724c03a520 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7254000f60 tx=0x7f7254007a80 comp rx=0 tx=0).stop 2024-05-15T18:08:37.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 msgr2=0x7f726c1ac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:37.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c1ac410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f725c02b880 tx=0x7f725c0046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:37.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 shutdown_connections 2024-05-15T18:08:37.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f724c038060 0x7f724c03a520 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7254000f60 tx=0x7f7254007a80 comp rx=0 tx=0).stop 2024-05-15T18:08:37.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 --2- 172.21.15.173:0/784953734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726c06ca90 0x7f726c1ac410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:37.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.162+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 >> 172.21.15.173:0/784953734 conn(0x7f726c071570 msgr2=0x7f726c11a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:37.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.167+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 shutdown_connections 2024-05-15T18:08:37.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.169+0000 7f7271532640 1 -- 172.21.15.173:0/784953734 wait complete. 2024-05-15T18:08:37.171 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-15T18:08:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.297+0000 7fb28df8a640 1 Processor -- start 2024-05-15T18:08:37.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.297+0000 7fb28df8a640 1 -- start start 2024-05-15T18:08:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.297+0000 7fb28df8a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb28811aa40 0x7fb28811ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.297+0000 7fb28df8a640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28811d400 con 0x7fb288117d50 2024-05-15T18:08:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.297+0000 7fb28df8a640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fb28811e5e0 con 0x7fb28811aa40 2024-05-15T18:08:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.298+0000 7fb286ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb28811aa40 0x7fb28811ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.298+0000 7fb2877fe640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb288117d50 0x7fb288118130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43398/0 (socket says 172.21.15.173:43398) 2024-05-15T18:08:37.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.298+0000 7fb2877fe640 1 -- 172.21.15.173:0/3309577744 learned_addr learned my addr 172.21.15.173:0/3309577744 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.298+0000 7fb286ffd640 1 -- 172.21.15.173:0/3309577744 >> v1:172.21.15.3:6789/0 conn(0x7fb288117d50 legacy=0x7fb288118130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.298+0000 7fb286ffd640 1 -- 172.21.15.173:0/3309577744 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28811e760 con 0x7fb28811aa40 2024-05-15T18:08:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.299+0000 7fb286ffd640 1 --2- 172.21.15.173:0/3309577744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb28811aa40 0x7fb28811ce30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009720 tx=0x7fb27c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915b8473593dc488 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.299+0000 7fb2867fc640 1 -- 172.21.15.173:0/3309577744 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb27c0316d0 con 0x7fb28811aa40 2024-05-15T18:08:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.299+0000 7fb2867fc640 1 -- 172.21.15.173:0/3309577744 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c037070 con 0x7fb28811aa40 2024-05-15T18:08:37.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.299+0000 7fb2867fc640 1 -- 172.21.15.173:0/3309577744 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb27c0319c0 con 0x7fb28811aa40 2024-05-15T18:08:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 -- 172.21.15.173:0/3309577744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb28811aa40 msgr2=0x7fb28811ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:37.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 --2- 172.21.15.173:0/3309577744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb28811aa40 0x7fb28811ce30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009720 tx=0x7fb27c02b840 comp rx=0 tx=0).stop 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 -- 172.21.15.173:0/3309577744 shutdown_connections 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 --2- 172.21.15.173:0/3309577744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb28811aa40 0x7fb28811ce30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 -- 172.21.15.173:0/3309577744 >> 172.21.15.173:0/3309577744 conn(0x7fb28806e900 msgr2=0x7fb28810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 -- 172.21.15.173:0/3309577744 shutdown_connections 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 -- 172.21.15.173:0/3309577744 wait complete. 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.300+0000 7fb28df8a640 1 Processor -- start 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.301+0000 7fb28df8a640 1 -- start start 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.301+0000 7fb28df8a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb288117d50 0x7fb2881ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.301+0000 7fb28df8a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb28811dac0 con 0x7fb288117d50 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.301+0000 7fb2877fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb288117d50 0x7fb2881ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.301+0000 7fb2877fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb288117d50 0x7fb2881ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:47686/0 (socket says 172.21.15.173:47686) 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.301+0000 7fb2877fe640 1 -- 172.21.15.173:0/4171076280 learned_addr learned my addr 172.21.15.173:0/4171076280 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.301+0000 7fb2877fe640 1 -- 172.21.15.173:0/4171076280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2881aca10 con 0x7fb288117d50 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.302+0000 7fb2877fe640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb288117d50 0x7fb2881ac440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb27800ca90 tx=0x7fb27800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:37.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.302+0000 7fb26ffff640 1 -- 172.21.15.173:0/4171076280 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb278018070 con 0x7fb288117d50 2024-05-15T18:08:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.302+0000 7fb26ffff640 1 -- 172.21.15.173:0/4171076280 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb278004c90 con 0x7fb288117d50 2024-05-15T18:08:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.302+0000 7fb26ffff640 1 -- 172.21.15.173:0/4171076280 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb27800aa50 con 0x7fb288117d50 2024-05-15T18:08:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.302+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2881acca0 con 0x7fb288117d50 2024-05-15T18:08:37.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.302+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2881a6730 con 0x7fb288117d50 2024-05-15T18:08:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.303+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28804fe40 con 0x7fb288117d50 2024-05-15T18:08:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.303+0000 7fb26ffff640 1 -- 172.21.15.173:0/4171076280 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb27801b070 con 0x7fb288117d50 2024-05-15T18:08:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.303+0000 7fb26ffff640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb274038010 0x7fb27403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.303+0000 7fb26ffff640 1 -- 172.21.15.173:0/4171076280 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3856+0+0 (secure 0 0 0) 0x7fb27804aeb0 con 0x7fb288117d50 2024-05-15T18:08:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.303+0000 7fb286ffd640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb274038010 0x7fb27403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:37.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.303+0000 7fb286ffd640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb274038010 0x7fb27403a4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb27c036000 tx=0x7fb27c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:37.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.308+0000 7fb26ffff640 1 -- 172.21.15.173:0/4171076280 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb278007a30 con 0x7fb288117d50 2024-05-15T18:08:37.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:37.481+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fb2881aced0 con 0x7fb288117d50 2024-05-15T18:08:38.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.162+0000 7fb26ffff640 1 -- 172.21.15.173:0/4171076280 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v19) ==== 169+0+0 (secure 0 0 0) 0x7fb27801b360 con 0x7fb288117d50 2024-05-15T18:08:38.140 INFO:teuthology.orchestra.run.smithi173.stderr:pool 'default.rgw.buckets.index' created 2024-05-15T18:08:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb274038010 msgr2=0x7fb27403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb274038010 0x7fb27403a4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb27c036000 tx=0x7fb27c008030 comp rx=0 tx=0).stop 2024-05-15T18:08:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb288117d50 msgr2=0x7fb2881ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb288117d50 0x7fb2881ac440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb27800ca90 tx=0x7fb27800cf50 comp rx=0 tx=0).stop 2024-05-15T18:08:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 shutdown_connections 2024-05-15T18:08:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb274038010 0x7fb27403a4d0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb27c036000 tx=0x7fb27c008030 comp rx=0 tx=0).stop 2024-05-15T18:08:38.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 --2- 172.21.15.173:0/4171076280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb288117d50 0x7fb2881ac440 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb27800ca90 tx=0x7fb27800cf50 comp rx=0 tx=0).stop 2024-05-15T18:08:38.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.166+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 >> 172.21.15.173:0/4171076280 conn(0x7fb28806e900 msgr2=0x7fb28811ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:38.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.168+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 shutdown_connections 2024-05-15T18:08:38.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.169+0000 7fb28df8a640 1 -- 172.21.15.173:0/4171076280 wait complete. 2024-05-15T18:08:38.165 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.290+0000 7fb33a585640 1 Processor -- start 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.290+0000 7fb33a585640 1 -- start start 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.290+0000 7fb33a585640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb33410f9a0 0x7fb33410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.290+0000 7fb33a585640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb334110440 con 0x7fb334114830 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.290+0000 7fb33a585640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fb3341153f0 con 0x7fb33410f9a0 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.291+0000 7fb333fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb33410f9a0 0x7fb33410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.291+0000 7fb333fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb33410f9a0 0x7fb33410fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:47688/0 (socket says 172.21.15.173:47688) 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.291+0000 7fb32bfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb334114830 0x7fb334114ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43402/0 (socket says 172.21.15.173:43402) 2024-05-15T18:08:38.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.291+0000 7fb333fff640 1 -- 172.21.15.173:0/1221394164 learned_addr learned my addr 172.21.15.173:0/1221394164 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.291+0000 7fb333fff640 1 -- 172.21.15.173:0/1221394164 >> v1:172.21.15.3:6789/0 conn(0x7fb334114830 legacy=0x7fb334114ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:38.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.291+0000 7fb333fff640 1 -- 172.21.15.173:0/1221394164 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3341155a0 con 0x7fb33410f9a0 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.292+0000 7fb333fff640 1 --2- 172.21.15.173:0/1221394164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb33410fd80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3240097f0 tx=0x7fb32402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e268fa272cf982 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.292+0000 7fb3337fe640 1 -- 172.21.15.173:0/1221394164 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb324035020 con 0x7fb33410f9a0 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.292+0000 7fb3337fe640 1 -- 172.21.15.173:0/1221394164 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3240317a0 con 0x7fb33410f9a0 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.292+0000 7fb3337fe640 1 -- 172.21.15.173:0/1221394164 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb324031aa0 con 0x7fb33410f9a0 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.293+0000 7fb33a585640 1 -- 172.21.15.173:0/1221394164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 msgr2=0x7fb33410fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.293+0000 7fb33a585640 1 --2- 172.21.15.173:0/1221394164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb33410fd80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3240097f0 tx=0x7fb32402b910 comp rx=0 tx=0).stop 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.293+0000 7fb33a585640 1 -- 172.21.15.173:0/1221394164 shutdown_connections 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.293+0000 7fb33a585640 1 --2- 172.21.15.173:0/1221394164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb33410fd80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.293+0000 7fb33a585640 1 -- 172.21.15.173:0/1221394164 >> 172.21.15.173:0/1221394164 conn(0x7fb33406f430 msgr2=0x7fb334071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.293+0000 7fb33a585640 1 -- 172.21.15.173:0/1221394164 shutdown_connections 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.293+0000 7fb33a585640 1 -- 172.21.15.173:0/1221394164 wait complete. 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb33a585640 1 Processor -- start 2024-05-15T18:08:38.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb33a585640 1 -- start start 2024-05-15T18:08:38.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb33a585640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb3341a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:38.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb33a585640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb33411aca0 con 0x7fb33410f9a0 2024-05-15T18:08:38.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb333fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb3341a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:38.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb333fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb3341a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:47704/0 (socket says 172.21.15.173:47704) 2024-05-15T18:08:38.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb333fff640 1 -- 172.21.15.173:0/4280974441 learned_addr learned my addr 172.21.15.173:0/4280974441 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:38.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.294+0000 7fb333fff640 1 -- 172.21.15.173:0/4280974441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3341a6ec0 con 0x7fb33410f9a0 2024-05-15T18:08:38.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.295+0000 7fb333fff640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb3341a6980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3240090b0 tx=0x7fb3240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.295+0000 7fb3317fa640 1 -- 172.21.15.173:0/4280974441 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb324049070 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.295+0000 7fb3317fa640 1 -- 172.21.15.173:0/4280974441 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb324031a80 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.295+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3341a71b0 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.295+0000 7fb3317fa640 1 -- 172.21.15.173:0/4280974441 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb324044550 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.295+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3341ab260 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.296+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33404fe40 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.296+0000 7fb3317fa640 1 -- 172.21.15.173:0/4280974441 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb32404c070 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.296+0000 7fb3317fa640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb314038040 0x7fb31403a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.296+0000 7fb3317fa640 1 -- 172.21.15.173:0/4280974441 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4220+0+0 (secure 0 0 0) 0x7fb32406d630 con 0x7fb33410f9a0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.296+0000 7fb32bfff640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb314038040 0x7fb31403a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:38.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.296+0000 7fb32bfff640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb314038040 0x7fb31403a500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb31c000f60 tx=0x7fb31c007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:38.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.301+0000 7fb3317fa640 1 -- 172.21.15.173:0/4280974441 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb32403f070 con 0x7fb33410f9a0 2024-05-15T18:08:38.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:38.478+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fb3341a7380 con 0x7fb33410f9a0 2024-05-15T18:08:39.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.165+0000 7fb3317fa640 1 -- 172.21.15.173:0/4280974441 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v20) ==== 187+0+0 (secure 0 0 0) 0x7fb324031710 con 0x7fb33410f9a0 2024-05-15T18:08:39.143 INFO:teuthology.orchestra.run.smithi173.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-15T18:08:39.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.176+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb314038040 msgr2=0x7fb31403a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:39.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.176+0000 7fb33a585640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb314038040 0x7fb31403a500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb31c000f60 tx=0x7fb31c007a80 comp rx=0 tx=0).stop 2024-05-15T18:08:39.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.176+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 msgr2=0x7fb3341a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:39.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.176+0000 7fb33a585640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb3341a6980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3240090b0 tx=0x7fb3240046c0 comp rx=0 tx=0).stop 2024-05-15T18:08:39.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.177+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 shutdown_connections 2024-05-15T18:08:39.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.177+0000 7fb33a585640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb314038040 0x7fb31403a500 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:39.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.177+0000 7fb33a585640 1 --2- 172.21.15.173:0/4280974441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb33410f9a0 0x7fb3341a6980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:39.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.177+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 >> 172.21.15.173:0/4280974441 conn(0x7fb33406f430 msgr2=0x7fb33410ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:39.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.178+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 shutdown_connections 2024-05-15T18:08:39.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:39.178+0000 7fb33a585640 1 -- 172.21.15.173:0/4280974441 wait complete. 2024-05-15T18:08:39.176 DEBUG:tasks.rgw:Pools created 2024-05-15T18:08:39.177 INFO:tasks.rgw:Starting rgw... 2024-05-15T18:08:39.177 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-15T18:08:39.177 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-15T18:08:39.177 DEBUG:teuthology.orchestra.run.smithi173:> sudo echo -n http://smithi173.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-15T18:08:39.204 INFO:teuthology.orchestra.run.smithi173.stdout:http://smithi173.front.sepia.ceph.com:80 2024-05-15T18:08:39.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-15T18:08:39.270 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-15T18:08:39.270 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-15T18:08:39.313 INFO:tasks.rgw.client.0:Started 2024-05-15T18:08:39.313 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi173.front.sepia.ceph.com:80/ 2024-05-15T18:08:39.313 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-05-15T18:08:39.347 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T18:08:39.347 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-05-15T18:08:39.348 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-15T18:08:39.349 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-15T18:08:39.349 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-05-15T18:08:40.350 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-05-15T18:08:40.374 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-15T18:08:40.375 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T18:08:40.375 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-05-15T18:08:40.375 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-15T18:08:40.375 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-05-15T18:08:42.376 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-05-15T18:08:42.399 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T18:08:42.401 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-15T18:08:42.401 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-05-15T18:08:42.401 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-15T18:08:42.402 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-05-15T18:08:46.402 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-05-15T18:08:46.425 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T18:08:46.426 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-05-15T18:08:46.427 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-15T18:08:46.427 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-15T18:08:46.428 INFO:teuthology.orchestra.run.smithi173.stderr:curl: (7) Failed to connect to smithi173.front.sepia.ceph.com port 80: Connection refused 2024-05-15T18:08:48.349 INFO:tasks.rgw.client.0.smithi173.stdout:2024-05-15T18:08:48.371+0000 7f2a11520880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-15T18:08:54.428 DEBUG:teuthology.orchestra.run.smithi173:> curl http://smithi173.front.sepia.ceph.com:80/ 2024-05-15T18:08:54.452 INFO:teuthology.orchestra.run.smithi173.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-15T18:08:54.452 INFO:teuthology.orchestra.run.smithi173.stderr: Dload Upload Total Spent Left Speed 2024-05-15T18:08:54.453 INFO:teuthology.orchestra.run.smithi173.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-05-15T18:08:54.454 INFO:teuthology.orchestra.run.smithi173.stdout:anonymous 2024-05-15T18:08:54.455 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-05-15T18:08:54.535 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-05-15T18:08:54.535 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-15T18:08:54.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-15T18:08:54.536 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-15T18:08:54.584 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:54.584 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f135bb28800 1 Processor -- start 2024-05-15T18:08:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f135bb28800 1 -- start start 2024-05-15T18:08:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f135bb28800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x564b3dbda130 0x564b3dbda550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f135bb28800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b3dbdabd0 con 0x564b3dbdb340 2024-05-15T18:08:54.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f135bb28800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x564b3da6b050 con 0x564b3dbda130 2024-05-15T18:08:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f1357860640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x564b3dbda130 0x564b3dbda550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f1357860640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x564b3dbda130 0x564b3dbda550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42788/0 (socket says 172.21.15.173:42788) 2024-05-15T18:08:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f1357860640 1 -- 172.21.15.173:0/2686689985 learned_addr learned my addr 172.21.15.173:0/2686689985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.607+0000 7f135705f640 1 --1- 172.21.15.173:0/2686689985 >> v1:172.21.15.3:6789/0 conn(0x564b3dbdb340 0x564b3dbdb7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35108/0 (socket says 172.21.15.173:35108) 2024-05-15T18:08:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.608+0000 7f1357860640 1 -- 172.21.15.173:0/2686689985 >> v1:172.21.15.3:6789/0 conn(0x564b3dbdb340 legacy=0x564b3dbdb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.608+0000 7f1357860640 1 -- 172.21.15.173:0/2686689985 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3dbdbf00 con 0x564b3dbda130 2024-05-15T18:08:54.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.610+0000 7f1357860640 1 --2- 172.21.15.173:0/2686689985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dbda550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f134800a520 tx=0x7f134801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc4128d6431fd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.610+0000 7f135685e640 1 -- 172.21.15.173:0/2686689985 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348057070 con 0x564b3dbda130 2024-05-15T18:08:54.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.610+0000 7f135685e640 1 -- 172.21.15.173:0/2686689985 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1348052570 con 0x564b3dbda130 2024-05-15T18:08:54.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.610+0000 7f135685e640 1 -- 172.21.15.173:0/2686689985 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348052870 con 0x564b3dbda130 2024-05-15T18:08:54.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.611+0000 7f135bb28800 1 -- 172.21.15.173:0/2686689985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 msgr2=0x564b3dbda550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.611+0000 7f135bb28800 1 --2- 172.21.15.173:0/2686689985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dbda550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f134800a520 tx=0x7f134801d010 comp rx=0 tx=0).stop 2024-05-15T18:08:54.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.611+0000 7f135bb28800 1 -- 172.21.15.173:0/2686689985 shutdown_connections 2024-05-15T18:08:54.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.611+0000 7f135bb28800 1 --2- 172.21.15.173:0/2686689985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dbda550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.611+0000 7f135bb28800 1 -- 172.21.15.173:0/2686689985 >> 172.21.15.173:0/2686689985 conn(0x564b3dbd5770 msgr2=0x564b3dbd7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.611+0000 7f135bb28800 1 -- 172.21.15.173:0/2686689985 shutdown_connections 2024-05-15T18:08:54.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.611+0000 7f135bb28800 1 -- 172.21.15.173:0/2686689985 wait complete. 2024-05-15T18:08:54.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.626+0000 7f135bb28800 1 Processor -- start 2024-05-15T18:08:54.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.626+0000 7f135bb28800 1 -- start start 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.626+0000 7f135bb28800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dccb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.626+0000 7f135bb28800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564b3db251c0 con 0x564b3dbda130 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.626+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dccb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.626+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dccb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42794/0 (socket says 172.21.15.173:42794) 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.626+0000 7f1357860640 1 -- 172.21.15.173:0/473438664 learned_addr learned my addr 172.21.15.173:0/473438664 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.627+0000 7f1357860640 1 -- 172.21.15.173:0/473438664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3dccbd20 con 0x564b3dbda130 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.627+0000 7f1357860640 1 --2- 172.21.15.173:0/473438664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dccb750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f134801d050 tx=0x7f134804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8611fab9f4b481a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.627+0000 7f1245e0b640 1 -- 172.21.15.173:0/473438664 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348057040 con 0x564b3dbda130 2024-05-15T18:08:54.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.627+0000 7f1245e0b640 1 -- 172.21.15.173:0/473438664 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1348052850 con 0x564b3dbda130 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.627+0000 7f1245e0b640 1 -- 172.21.15.173:0/473438664 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348052b70 con 0x564b3dbda130 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 -- 172.21.15.173:0/473438664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 msgr2=0x564b3dccb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 --2- 172.21.15.173:0/473438664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dccb750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f134801d050 tx=0x7f134804c000 comp rx=0 tx=0).stop 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 -- 172.21.15.173:0/473438664 shutdown_connections 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 --2- 172.21.15.173:0/473438664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dccb750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 -- 172.21.15.173:0/473438664 >> 172.21.15.173:0/473438664 conn(0x564b3dbd5770 msgr2=0x564b3dcc7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 -- 172.21.15.173:0/473438664 shutdown_connections 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 -- 172.21.15.173:0/473438664 wait complete. 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 Processor -- start 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 -- start start 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dcd3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.628+0000 7f135bb28800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564b3dbe3810 con 0x564b3dbda130 2024-05-15T18:08:54.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dcd3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dcd3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42796/0 (socket says 172.21.15.173:42796) 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f1357860640 1 -- 172.21.15.173:0/4094789156 learned_addr learned my addr 172.21.15.173:0/4094789156 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f1357860640 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3dcd3680 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f1357860640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dcd3140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f134801d050 tx=0x7f1348003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f123ffff640 1 -- 172.21.15.173:0/4094789156 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348073070 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f123ffff640 1 -- 172.21.15.173:0/4094789156 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134805d650 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b3dcd3910 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f123ffff640 1 -- 172.21.15.173:0/4094789156 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348057070 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.629+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b3dcd65c0 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.630+0000 7f123ffff640 1 -- 172.21.15.173:0/4094789156 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1348076070 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f123ffff640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1240036950 0x7f1240038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f123ffff640 1 -- 172.21.15.173:0/4094789156 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f134808ddc0 con 0x564b3dbda130 2024-05-15T18:08:54.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f135705f640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1240036950 0x7f1240038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dbdb340 0x564b3dcda380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dcda9a0 con 0x564b3dbdb340 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f1358061640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dbdb340 0x564b3dcda380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f135705f640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1240036950 0x7f1240038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1340000f60 tx=0x7f1340001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.631+0000 7f1358061640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dbdb340 0x564b3dcda380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.632+0000 7f1358061640 1 -- 172.21.15.173:0/4094789156 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dbdb340 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.632+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dcd7930 con 0x564b3dbdb340 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.632+0000 7f1358061640 1 -- 172.21.15.173:0/4094789156 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dbdb340 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.632+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dcdccb0 0x564b3dcdf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.632+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dcdf740 con 0x564b3dcdccb0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.632+0000 7f1357860640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dcdccb0 0x564b3dcdf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.632+0000 7f1357860640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dcdccb0 0x564b3dcdf0a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.633+0000 7f1357860640 1 -- 172.21.15.173:0/4094789156 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1348075030 con 0x564b3dcdccb0 2024-05-15T18:08:54.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.633+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dcdbc60 con 0x564b3dbdb340 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.633+0000 7f1358061640 1 -- 172.21.15.173:0/4094789156 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dbdb340 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.633+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x564b3dce0bf0 0x564b3dce3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.633+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dce37c0 con 0x564b3dce0bf0 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.633+0000 7f135705f640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x564b3dce0bf0 0x564b3dce3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.634+0000 7f135705f640 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x564b3dce0bf0 0x564b3dce3060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.634+0000 7f135705f640 1 -- 172.21.15.173:0/4094789156 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f134000f690 con 0x564b3dce0bf0 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f135bb28800 1 Processor -- start 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f135bb28800 1 -- start start 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f135bb28800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3db4fa40 0x564b3db4deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f135bb28800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564b3dacbcf0 con 0x564b3db4fa40 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3db4fa40 0x564b3db4deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3db4fa40 0x564b3db4deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42806/0 (socket says 172.21.15.173:42806) 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f1357860640 1 -- 172.21.15.173:0/3259207773 learned_addr learned my addr 172.21.15.173:0/3259207773 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.635+0000 7f1357860640 1 -- 172.21.15.173:0/3259207773 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3db4e3f0 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.636+0000 7f1357860640 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3db4fa40 0x564b3db4deb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f134808c300 tx=0x7f1348076f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.636+0000 7f123d7fa640 1 -- 172.21.15.173:0/3259207773 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13480777b0 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.636+0000 7f123d7fa640 1 -- 172.21.15.173:0/3259207773 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1348091070 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.636+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b3db4e620 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.636+0000 7f123d7fa640 1 -- 172.21.15.173:0/3259207773 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f134805dac0 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.636+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b3db4eb20 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f123d7fa640 1 -- 172.21.15.173:0/3259207773 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f134805dc60 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f123d7fa640 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12300368b0 0x7f1230038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f123d7fa640 1 -- 172.21.15.173:0/3259207773 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1348002000 con 0x564b3db4fa40 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f135705f640 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12300368b0 0x7f1230038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f135bb28800 1 Processor -- start 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f135bb28800 1 -- start start 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f135705f640 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12300368b0 0x7f1230038d70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x564b3dcd7870 tx=0x7f134000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f135bb28800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.637+0000 7f135bb28800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564b3dccbfe0 con 0x564b3dd00fa0 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd013c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42816/0 (socket says 172.21.15.173:42816) 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1357860640 1 -- 172.21.15.173:0/4095275102 learned_addr learned my addr 172.21.15.173:0/4095275102 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1357860640 1 -- 172.21.15.173:0/4095275102 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3dd01990 con 0x564b3dd00fa0 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1357860640 1 --2- 172.21.15.173:0/4095275102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd013c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1348098030 tx=0x7f134806e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3f747516f2ecde server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1236ffd640 1 -- 172.21.15.173:0/4095275102 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13480a6070 con 0x564b3dd00fa0 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1236ffd640 1 -- 172.21.15.173:0/4095275102 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1348083400 con 0x564b3dd00fa0 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.638+0000 7f1236ffd640 1 -- 172.21.15.173:0/4095275102 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348078cf0 con 0x564b3dd00fa0 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 -- 172.21.15.173:0/4095275102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 msgr2=0x564b3dd013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 --2- 172.21.15.173:0/4095275102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd013c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1348098030 tx=0x7f134806e760 comp rx=0 tx=0).stop 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 -- 172.21.15.173:0/4095275102 shutdown_connections 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 --2- 172.21.15.173:0/4095275102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd013c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 -- 172.21.15.173:0/4095275102 >> 172.21.15.173:0/4095275102 conn(0x564b3dcfd2b0 msgr2=0x564b3dcfb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 -- 172.21.15.173:0/4095275102 shutdown_connections 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 -- 172.21.15.173:0/4095275102 wait complete. 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 Processor -- start 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 -- start start 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd083b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.639+0000 7f135bb28800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564b3dd02020 con 0x564b3dd00fa0 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.640+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.640+0000 7f1357860640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd083b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42820/0 (socket says 172.21.15.173:42820) 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.640+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 learned_addr learned my addr 172.21.15.173:0/1315009507 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.640+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3dd088f0 con 0x564b3dd00fa0 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.640+0000 7f1357860640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd083b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f134806e7a0 tx=0x7f134806ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.641+0000 7f12357fa640 1 -- 172.21.15.173:0/1315009507 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f134806ed30 con 0x564b3dd00fa0 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.641+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b3dd088f0 con 0x564b3dd00fa0 2024-05-15T18:08:54.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.641+0000 7f12357fa640 1 -- 172.21.15.173:0/1315009507 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13480ba070 con 0x564b3dd00fa0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.641+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b3dd088f0 con 0x564b3dd00fa0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.641+0000 7f12357fa640 1 -- 172.21.15.173:0/1315009507 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1348064430 con 0x564b3dd00fa0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.641+0000 7f12357fa640 1 -- 172.21.15.173:0/1315009507 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1348060cf0 con 0x564b3dd00fa0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f12357fa640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1220036900 0x7f1220038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f12357fa640 1 -- 172.21.15.173:0/1315009507 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f134806a580 con 0x564b3dd00fa0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f135705f640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1220036900 0x7f1220038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dd13a20 0x564b3dd15ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd16630 con 0x564b3dd13a20 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f1358061640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dd13a20 0x564b3dd15ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.642+0000 7f135705f640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1220036900 0x7f1220038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x564b3dcdc000 tx=0x7f1340010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f1358061640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dd13a20 0x564b3dd15ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 20 realm 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd16a40 con 0x564b3dd13a20 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd17310 con 0x564b3dd13a20 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.643+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f135bb28800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dd181e0 0x564b3dd1a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1ad10 con 0x564b3dd181e0 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f1357860640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dd181e0 0x564b3dd1a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f1357860640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dd181e0 0x564b3dd1a5d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f135bb28800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f135bb28800 20 searching for the correct realm 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.644+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1c6a0 con 0x564b3dd181e0 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f1357860640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f134805bc20 0x7f13480b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1c6a0 con 0x7f134805bc20 2024-05-15T18:08:54.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f135705f640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f134805bc20 0x7f13480b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f135705f640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f134805bc20 0x7f13480b38e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f135705f640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f134000f070 0x7f134002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.645+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1c6a0 con 0x7f134000f070 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.646+0000 7f1358061640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f134000f070 0x7f134002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.646+0000 7f1358061640 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f134000f070 0x7f134002e910 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.647+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.647+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.647+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.647+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.647+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.647+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134805bc20 2024-05-15T18:08:54.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.648+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134805bc20 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.649+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.650+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.650+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.650+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.650+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.650+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.650+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.651+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134805bc20 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.652+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.653+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.653+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.653+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.653+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.653+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.653+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134805bc20 2024-05-15T18:08:54.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.654+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.654+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd181e0 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.654+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.654+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134000f070 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.654+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.654+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x564b3dd13a20 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd176b0 con 0x7f134805bc20 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:54.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1b7c0 con 0x564b3dd13a20 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1c060 con 0x564b3dd13a20 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.655+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1bbb0 con 0x7f134000f070 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 20 zone default found 2024-05-15T18:08:54.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 4 Realm: () 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 20 zonegroup default 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1bbb0 con 0x7f134000f070 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.656+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1bfe0 con 0x564b3dd181e0 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f135bb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f135bb28800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1e530 con 0x564b3dd181e0 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f135bb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f135bb28800 20 started sync module instance, tier type = 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f135bb28800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.657+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1d9d0 con 0x7f134805bc20 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.658+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.658+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94881159699952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1ed80 con 0x7f134805bc20 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.658+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1f5d0 con 0x564b3dd13a20 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.659+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94881159699952] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.660+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.660+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94881159702736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1f610 con 0x564b3dd13a20 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.660+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd20120 con 0x564b3dd181e0 2024-05-15T18:08:54.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.661+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94881159702736] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.662+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.662+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94881159707600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd20510 con 0x564b3dd181e0 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.662+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd20f70 con 0x7f134805bc20 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.664+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94881159707600] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.664+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.665+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94881159704864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134805bc20 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.665+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd221d0 con 0x564b3dd13a20 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.666+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.666+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94881159716640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd22a70 con 0x564b3dd13a20 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.666+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd23520 con 0x7f134000f070 2024-05-15T18:08:54.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.669+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94881159704864] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.670+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.670+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94881159713632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd234e0 con 0x7f134000f070 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.670+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd23fd0 con 0x7f134000f070 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.672+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94881159716640] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.672+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94881159713632] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.672+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.672+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94881159723680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd23030 con 0x7f134000f070 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.672+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd24660 con 0x7f134000f070 2024-05-15T18:08:54.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94881159723680] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94881159725488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd24a80 con 0x7f134000f070 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 20 add_watcher() i=0 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 20 add_watcher() i=1 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 20 add_watcher() i=2 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 20 add_watcher() i=3 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 20 add_watcher() i=4 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 20 add_watcher() i=5 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.675+0000 7f135bb28800 20 add_watcher() i=6 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.677+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94881159725488] v29'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.677+0000 7f135bb28800 20 add_watcher() i=7 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.677+0000 7f135bb28800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.677+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd27ab0 con 0x564b3dd13a20 2024-05-15T18:08:54.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.677+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.677+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94881159726544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd24ea0 con 0x564b3dd13a20 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.679+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94881159726544] v29'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.679+0000 7f120dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f135bb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f135bb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f135bb28800 5 note: GC not initialized 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f120cfe1640 20 reqs_thread_entry: start 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f135bb28800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f135bb28800 20 Filter name: none 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f11867fc640 20 reqs_thread_entry: start 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.680+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd5a540 con 0x564b3dd181e0 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd5a540 con 0x564b3dd181e0 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(63 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd5a540 con 0x564b3dd13a20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1b7c0 con 0x564b3dd13a20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.681+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1b7c0 con 0x7f134805bc20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd13a20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.682+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134805bc20 2024-05-15T18:08:54.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.683+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.683+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.683+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.683+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd13a20 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.683+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.683+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(74 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(76 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.684+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(77 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(78 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(79 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134805bc20 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(80 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.685+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd13a20 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(81 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd13a20 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(82 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(83 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134805bc20 2024-05-15T18:08:54.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(84 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.686+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.687+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(85 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.687+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd13a20 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.687+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(86 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.687+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.687+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(87 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.687+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.688+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(88 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.688+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134805bc20 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.688+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(89 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.688+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134000f070 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.688+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(90 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.688+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd13a20 2024-05-15T18:08:54.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.689+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(91 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.689+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x564b3dd181e0 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.689+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(92 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.689+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd21810 con 0x7f134805bc20 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.689+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(93 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.690+0000 7f120dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.690+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94881159726544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1b7c0 con 0x564b3dd13a20 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.691+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94881159726544] v29'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.691+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94881159699952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd5a500 con 0x7f134805bc20 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.692+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94881159699952] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.692+0000 7f135bb28800 20 remove_watcher() i=0 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.692+0000 7f135bb28800 2 removed watcher, disabling cache 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.692+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94881159702736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1ddf0 con 0x564b3dd13a20 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.694+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94881159702736] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.694+0000 7f135bb28800 20 remove_watcher() i=1 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.694+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94881159707600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd5a500 con 0x564b3dd181e0 2024-05-15T18:08:54.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.695+0000 7f1357860640 1 -- 172.21.15.173:0/1315009507 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94881159707600] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1348075030 con 0x564b3dd181e0 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.695+0000 7f135bb28800 20 remove_watcher() i=2 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.695+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94881159704864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1fbd0 con 0x7f134805bc20 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.696+0000 7f135705f640 1 -- 172.21.15.173:0/1315009507 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94881159704864] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1340037040 con 0x7f134805bc20 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.696+0000 7f135bb28800 20 remove_watcher() i=3 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.696+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94881159716640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1fbd0 con 0x564b3dd13a20 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.697+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94881159716640] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x564b3dd13a20 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.697+0000 7f135bb28800 20 remove_watcher() i=4 2024-05-15T18:08:54.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.697+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94881159713632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1fbd0 con 0x7f134000f070 2024-05-15T18:08:54.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.698+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94881159713632] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.698+0000 7f135bb28800 20 remove_watcher() i=5 2024-05-15T18:08:54.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.698+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94881159723680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd1fbd0 con 0x7f134000f070 2024-05-15T18:08:54.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.700+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94881159723680] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.700+0000 7f135bb28800 20 remove_watcher() i=6 2024-05-15T18:08:54.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.700+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94881159725488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564b3dd23aa0 con 0x7f134000f070 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94881159725488] v29'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135000a4a0 con 0x7f134000f070 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 20 remove_watcher() i=7 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f134000f070 msgr2=0x7f134002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f134000f070 0x7f134002e910 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dd13a20 msgr2=0x564b3dd15ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dd13a20 0x564b3dd15ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f134805bc20 msgr2=0x7f13480b38e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f134805bc20 0x7f13480b38e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dd181e0 msgr2=0x564b3dd1a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dd181e0 0x564b3dd1a5d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1220036900 msgr2=0x7f1220038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1220036900 0x7f1220038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x564b3dcdc000 tx=0x7f1340010000 comp rx=0 tx=0).stop 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 msgr2=0x564b3dd083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/1315009507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dd00fa0 0x564b3dd083b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f134806e7a0 tx=0x7f134806ef30 comp rx=0 tx=0).stop 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 reap_dead start 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f1358061640 1 -- 172.21.15.173:0/1315009507 reap_dead start 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 shutdown_connections 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 >> 172.21.15.173:0/1315009507 conn(0x564b3dcfd2b0 msgr2=0x564b3dcfa910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 shutdown_connections 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/1315009507 wait complete. 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12300368b0 msgr2=0x7f1230038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12300368b0 0x7f1230038d70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x564b3dcd7870 tx=0x7f134000f000 comp rx=0 tx=0).stop 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3db4fa40 msgr2=0x564b3db4deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3db4fa40 0x564b3db4deb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f134808c300 tx=0x7f1348076f50 comp rx=0 tx=0).stop 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 shutdown_connections 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12300368b0 0x7f1230038d70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 --2- 172.21.15.173:0/3259207773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3db4fa40 0x564b3db4deb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.701+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 >> 172.21.15.173:0/3259207773 conn(0x564b3dce5c90 msgr2=0x564b3dce6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 shutdown_connections 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/3259207773 wait complete. 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x564b3dce0bf0 msgr2=0x564b3dce3060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x564b3dce0bf0 0x564b3dce3060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dbdb340 msgr2=0x564b3dcda380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564b3dbdb340 0x564b3dcda380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dcdccb0 msgr2=0x564b3dcdf0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564b3dcdccb0 0x564b3dcdf0a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1240036950 msgr2=0x7f1240038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1240036950 0x7f1240038e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1340000f60 tx=0x7f1340001370 comp rx=0 tx=0).stop 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 msgr2=0x564b3dcd3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 --2- 172.21.15.173:0/4094789156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b3dbda130 0x564b3dcd3140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f134801d050 tx=0x7f1348003020 comp rx=0 tx=0).stop 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f1358061640 1 -- 172.21.15.173:0/4094789156 reap_dead start 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 shutdown_connections 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 >> 172.21.15.173:0/4094789156 conn(0x564b3dbd5770 msgr2=0x564b3dcc5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 shutdown_connections 2024-05-15T18:08:54.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.702+0000 7f135bb28800 1 -- 172.21.15.173:0/4094789156 wait complete. 2024-05-15T18:08:54.765 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-05-15T18:08:54.766 DEBUG:tasks.util.rgw: json result: [] 2024-05-15T18:08:54.766 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-05-15T18:08:54.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-05-15T18:08:54.766 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-05-15T18:08:54.810 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:54.810 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.833+0000 7f8026535800 1 Processor -- start 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.833+0000 7f8026535800 1 -- start start 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.833+0000 7f8026535800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5595f556da10 0x5595f556de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.833+0000 7f8026535800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595f54e21b0 con 0x5595f556e370 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.833+0000 7f8026535800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5595f5400050 con 0x5595f556da10 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.834+0000 7f80222f9640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5595f556da10 0x5595f556de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.834+0000 7f8019af8640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5595f556e370 0x5595f556e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35112/0 (socket says 172.21.15.173:35112) 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.834+0000 7f8019af8640 1 -- 172.21.15.173:0/2862922653 learned_addr learned my addr 172.21.15.173:0/2862922653 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.834+0000 7f80222f9640 1 -- 172.21.15.173:0/2862922653 >> v1:172.21.15.3:6789/0 conn(0x5595f556e370 legacy=0x5595f556e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.834+0000 7f80222f9640 1 -- 172.21.15.173:0/2862922653 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f556ef30 con 0x5595f556da10 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.836+0000 7f80222f9640 1 --2- 172.21.15.173:0/2862922653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f556de30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f801400a470 tx=0x7f801401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05f0cdb3f111e1e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.836+0000 7f8021af8640 1 -- 172.21.15.173:0/2862922653 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014057070 con 0x5595f556da10 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.836+0000 7f8021af8640 1 -- 172.21.15.173:0/2862922653 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8014052570 con 0x5595f556da10 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.836+0000 7f8021af8640 1 -- 172.21.15.173:0/2862922653 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014052870 con 0x5595f556da10 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.837+0000 7f8026535800 1 -- 172.21.15.173:0/2862922653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 msgr2=0x5595f556de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.837+0000 7f8026535800 1 --2- 172.21.15.173:0/2862922653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f556de30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f801400a470 tx=0x7f801401ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.837+0000 7f8026535800 1 -- 172.21.15.173:0/2862922653 shutdown_connections 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.837+0000 7f8026535800 1 --2- 172.21.15.173:0/2862922653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f556de30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.837+0000 7f8026535800 1 -- 172.21.15.173:0/2862922653 >> 172.21.15.173:0/2862922653 conn(0x5595f55695b0 msgr2=0x5595f556b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.837+0000 7f8026535800 1 -- 172.21.15.173:0/2862922653 shutdown_connections 2024-05-15T18:08:54.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.837+0000 7f8026535800 1 -- 172.21.15.173:0/2862922653 wait complete. 2024-05-15T18:08:54.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.850+0000 7f8026535800 1 Processor -- start 2024-05-15T18:08:54.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.850+0000 7f8026535800 1 -- start start 2024-05-15T18:08:54.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.851+0000 7f8026535800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f5662ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.851+0000 7f8026535800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5595f54ba1d0 con 0x5595f556da10 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.851+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f5662ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.851+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f5662ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42838/0 (socket says 172.21.15.173:42838) 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.851+0000 7f80222f9640 1 -- 172.21.15.173:0/795259402 learned_addr learned my addr 172.21.15.173:0/795259402 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.851+0000 7f80222f9640 1 -- 172.21.15.173:0/795259402 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f5663090 con 0x5595f556da10 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f80222f9640 1 --2- 172.21.15.173:0/795259402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f5662ac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f801401ced0 tx=0x7f801404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c193d97a9d104d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f7f10608640 1 -- 172.21.15.173:0/795259402 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014057040 con 0x5595f556da10 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f7f10608640 1 -- 172.21.15.173:0/795259402 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80140529a0 con 0x5595f556da10 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f7f10608640 1 -- 172.21.15.173:0/795259402 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014052cc0 con 0x5595f556da10 2024-05-15T18:08:54.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f8026535800 1 -- 172.21.15.173:0/795259402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 msgr2=0x5595f5662ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f8026535800 1 --2- 172.21.15.173:0/795259402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f5662ac0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f801401ced0 tx=0x7f801404c000 comp rx=0 tx=0).stop 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f8026535800 1 -- 172.21.15.173:0/795259402 shutdown_connections 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f8026535800 1 --2- 172.21.15.173:0/795259402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f5662ac0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.852+0000 7f8026535800 1 -- 172.21.15.173:0/795259402 >> 172.21.15.173:0/795259402 conn(0x5595f55695b0 msgr2=0x5595f565e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f8026535800 1 -- 172.21.15.173:0/795259402 shutdown_connections 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f8026535800 1 -- 172.21.15.173:0/795259402 wait complete. 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f8026535800 1 Processor -- start 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f8026535800 1 -- start start 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f8026535800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f566a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f8026535800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5595f556f460 con 0x5595f556da10 2024-05-15T18:08:54.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f566a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f566a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42854/0 (socket says 172.21.15.173:42854) 2024-05-15T18:08:54.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.853+0000 7f80222f9640 1 -- 172.21.15.173:0/211237107 learned_addr learned my addr 172.21.15.173:0/211237107 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.854+0000 7f80222f9640 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f566aa00 con 0x5595f556da10 2024-05-15T18:08:54.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.854+0000 7f80222f9640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f566a4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8014052740 tx=0x7f8014003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.854+0000 7f7f0ee05640 1 -- 172.21.15.173:0/211237107 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014073070 con 0x5595f556da10 2024-05-15T18:08:54.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.854+0000 7f7f0ee05640 1 -- 172.21.15.173:0/211237107 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801405d860 con 0x5595f556da10 2024-05-15T18:08:54.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.854+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595f566ac90 con 0x5595f556da10 2024-05-15T18:08:54.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.854+0000 7f7f0ee05640 1 -- 172.21.15.173:0/211237107 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014057070 con 0x5595f556da10 2024-05-15T18:08:54.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.854+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595f566d8f0 con 0x5595f556da10 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.855+0000 7f7f0ee05640 1 -- 172.21.15.173:0/211237107 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8014076070 con 0x5595f556da10 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.855+0000 7f7f0ee05640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f08036900 0x7f7f08038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f7f0ee05640 1 -- 172.21.15.173:0/211237107 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f801408def0 con 0x5595f556da10 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8019af8640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f08036900 0x7f7f08038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f556e370 0x5595f56716b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f5671c90 con 0x5595f556e370 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8022afa640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f556e370 0x5595f56716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8019af8640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f08036900 0x7f7f08038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f800c000f60 tx=0x7f800c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8022afa640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f556e370 0x5595f56716b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8022afa640 1 -- 172.21.15.173:0/211237107 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f556e370 2024-05-15T18:08:54.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.856+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f566ec80 con 0x5595f556e370 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.857+0000 7f8022afa640 1 -- 172.21.15.173:0/211237107 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f556e370 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.857+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f5673fe0 0x5595f56763d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.857+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f5676ac0 con 0x5595f5673fe0 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.857+0000 7f80222f9640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f5673fe0 0x5595f56763d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.857+0000 7f80222f9640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f5673fe0 0x5595f56763d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.857+0000 7f80222f9640 1 -- 172.21.15.173:0/211237107 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8014075030 con 0x5595f5673fe0 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.857+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f5672f90 con 0x5595f556e370 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.858+0000 7f8022afa640 1 -- 172.21.15.173:0/211237107 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f556e370 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.858+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5595f5677f70 0x5595f567a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.858+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f567ab20 con 0x5595f5677f70 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.858+0000 7f8019af8640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5595f5677f70 0x5595f567a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.858+0000 7f8019af8640 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5595f5677f70 0x5595f567a3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f8019af8640 1 -- 172.21.15.173:0/211237107 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f800c009050 con 0x5595f5677f70 2024-05-15T18:08:54.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f8026535800 1 Processor -- start 2024-05-15T18:08:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f8026535800 1 -- start start 2024-05-15T18:08:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f8026535800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5688f80 0x5595f56893a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f8026535800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5595f5460cf0 con 0x5595f5688f80 2024-05-15T18:08:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5688f80 0x5595f56893a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5688f80 0x5595f56893a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42858/0 (socket says 172.21.15.173:42858) 2024-05-15T18:08:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.859+0000 7f80222f9640 1 -- 172.21.15.173:0/3256133030 learned_addr learned my addr 172.21.15.173:0/3256133030 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.860+0000 7f80222f9640 1 -- 172.21.15.173:0/3256133030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f56898e0 con 0x5595f5688f80 2024-05-15T18:08:54.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.860+0000 7f80222f9640 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5688f80 0x5595f56893a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f801408c440 tx=0x7f8014076f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.860+0000 7f7f07fff640 1 -- 172.21.15.173:0/3256133030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014006910 con 0x5595f5688f80 2024-05-15T18:08:54.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.860+0000 7f7f07fff640 1 -- 172.21.15.173:0/3256133030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801408a070 con 0x5595f5688f80 2024-05-15T18:08:54.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.860+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595f568a350 con 0x5595f5688f80 2024-05-15T18:08:54.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.860+0000 7f7f07fff640 1 -- 172.21.15.173:0/3256133030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f801408c8e0 con 0x5595f5688f80 2024-05-15T18:08:54.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.860+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595f568a850 con 0x5595f5688f80 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.861+0000 7f7f07fff640 1 -- 172.21.15.173:0/3256133030 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f801408ca80 con 0x5595f5688f80 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.861+0000 7f7f07fff640 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7efc036900 0x7f7efc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.861+0000 7f7f07fff640 1 -- 172.21.15.173:0/3256133030 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8014093ad0 con 0x5595f5688f80 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.861+0000 7f8019af8640 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7efc036900 0x7f7efc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.861+0000 7f8026535800 1 Processor -- start 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f8026535800 1 -- start start 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f8019af8640 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7efc036900 0x7f7efc038dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f800c00bf50 tx=0x7f800c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f8026535800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f5696550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f8026535800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5595f5663350 con 0x5595f5696130 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f5696550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f5696550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42874/0 (socket says 172.21.15.173:42874) 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f80222f9640 1 -- 172.21.15.173:0/4243908366 learned_addr learned my addr 172.21.15.173:0/4243908366 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f80222f9640 1 -- 172.21.15.173:0/4243908366 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f5696b20 con 0x5595f5696130 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f80222f9640 1 --2- 172.21.15.173:0/4243908366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f5696550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8014085580 tx=0x7f80140648b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d6211782d647ff server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.862+0000 7f7f05ffb640 1 -- 172.21.15.173:0/4243908366 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014086a70 con 0x5595f5696130 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f7f05ffb640 1 -- 172.21.15.173:0/4243908366 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801408cd70 con 0x5595f5696130 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f7f05ffb640 1 -- 172.21.15.173:0/4243908366 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014086e60 con 0x5595f5696130 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 -- 172.21.15.173:0/4243908366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 msgr2=0x5595f5696550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 --2- 172.21.15.173:0/4243908366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f5696550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8014085580 tx=0x7f80140648b0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 -- 172.21.15.173:0/4243908366 shutdown_connections 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 --2- 172.21.15.173:0/4243908366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f5696550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 -- 172.21.15.173:0/4243908366 >> 172.21.15.173:0/4243908366 conn(0x5595f5692400 msgr2=0x5595f5690460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 -- 172.21.15.173:0/4243908366 shutdown_connections 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 -- 172.21.15.173:0/4243908366 wait complete. 2024-05-15T18:08:54.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 Processor -- start 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 -- start start 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f569d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.863+0000 7f8026535800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5595f5697180 con 0x5595f5696130 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f569d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f80222f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f569d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42880/0 (socket says 172.21.15.173:42880) 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 learned_addr learned my addr 172.21.15.173:0/2508136021 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f569d9c0 con 0x5595f5696130 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f80222f9640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f569d480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8014064980 tx=0x7f8014098fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f7ef3fff640 1 -- 172.21.15.173:0/2508136021 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80140b8070 con 0x5595f5696130 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f7ef3fff640 1 -- 172.21.15.173:0/2508136021 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8014069120 con 0x5595f5696130 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595f569d9c0 con 0x5595f5696130 2024-05-15T18:08:54.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f7ef3fff640 1 -- 172.21.15.173:0/2508136021 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014086430 con 0x5595f5696130 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.864+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595f569d9c0 con 0x5595f5696130 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.865+0000 7f7ef3fff640 1 -- 172.21.15.173:0/2508136021 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f80140bb070 con 0x5595f5696130 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.865+0000 7f7ef3fff640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.865+0000 7f7ef3fff640 1 -- 172.21.15.173:0/2508136021 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f80140a4070 con 0x5595f5696130 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.866+0000 7f8019af8640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.866+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.866+0000 7f8019af8640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f800c001b60 tx=0x7f800c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.866+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f56a8c60 0x5595f56ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.866+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ab870 con 0x5595f56a8c60 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.866+0000 7f8022afa640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f56a8c60 0x5595f56ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.866+0000 7f8022afa640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f56a8c60 0x5595f56ab120 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 realm 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56abc80 con 0x5595f56a8c60 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac550 con 0x5595f56a8c60 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f56ad650 0x5595f56afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.867+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b0050 con 0x5595f56ad650 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.868+0000 7f80222f9640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f56ad650 0x5595f56afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.868+0000 7f80222f9640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f56ad650 0x5595f56afa40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.868+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.868+0000 7f8026535800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.868+0000 7f8026535800 20 searching for the correct realm 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.868+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b1980 con 0x5595f56ad650 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.868+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f80222f9640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f80140bd060 0x7f8014093050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b1980 con 0x7f80140bd060 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f8019af8640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f80140bd060 0x7f8014093050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f8019af8640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f80140bd060 0x7f8014093050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c009050 con 0x7f80140bd060 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f8019af8640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f800c038040 0x7f800c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b1980 con 0x7f800c038040 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.869+0000 7f8022afa640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f800c038040 0x7f800c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.870+0000 7f8022afa640 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f800c038040 0x7f800c01bab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.870+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f801c00a4a0 con 0x7f800c038040 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.870+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.870+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.870+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.871+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.871+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.871+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x7f800c038040 2024-05-15T18:08:54.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.871+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.871+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x7f800c038040 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.871+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f80140bd060 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c009050 con 0x7f80140bd060 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x7f800c038040 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.872+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f80140bd060 2024-05-15T18:08:54.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f800c009050 con 0x7f80140bd060 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.873+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x7f800c038040 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.874+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f801c00a4a0 con 0x5595f56a8c60 2024-05-15T18:08:54.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c033040 con 0x7f800c038040 2024-05-15T18:08:54.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f80140bd060 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c009050 con 0x7f80140bd060 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.875+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.876+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.876+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.876+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.876+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.876+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.876+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.877+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.877+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f80140bd060 2024-05-15T18:08:54.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.877+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c009050 con 0x7f80140bd060 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.877+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56ad650 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.877+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.877+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f800c038040 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.877+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x5595f56a8c60 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5595f56ac8f0 con 0x7f80140bd060 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:54.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b0910 con 0x5595f56a8c60 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b0d00 con 0x5595f56a8c60 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.878+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b0d00 con 0x7f800c038040 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 20 zone default found 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 4 Realm: () 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 20 zonegroup default 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b1e00 con 0x7f800c038040 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b37e0 con 0x5595f56ad650 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.879+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b3b80 con 0x5595f56ad650 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f8026535800 20 started sync module instance, tier type = 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f8026535800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.880+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b2c80 con 0x7f80140bd060 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.881+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.881+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94102555928528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b3f20 con 0x7f80140bd060 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.881+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b47b0 con 0x5595f56a8c60 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.882+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.882+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94102555935424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b5050 con 0x5595f56a8c60 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.882+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b5b50 con 0x5595f56ad650 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.883+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94102555928528] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.884+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94102555935424] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.884+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.884+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94102555930784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b5050 con 0x5595f56ad650 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.884+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b6430 con 0x7f80140bd060 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.886+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94102555930784] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.886+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.886+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94102555937696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b6cd0 con 0x7f80140bd060 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.886+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b7690 con 0x5595f56a8c60 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.889+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.889+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94102555947968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b7e90 con 0x5595f56a8c60 2024-05-15T18:08:54.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.889+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b8980 con 0x7f800c038040 2024-05-15T18:08:54.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.892+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94102555937696] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.892+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.892+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94102555952208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b8940 con 0x7f800c038040 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.892+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b93b0 con 0x7f800c038040 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.894+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94102555947968] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.894+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94102555952208] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.897+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.897+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94102555944992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b78e0 con 0x7f800c038040 2024-05-15T18:08:54.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.897+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b9860 con 0x7f800c038040 2024-05-15T18:08:54.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94102555956144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b9c80 con 0x7f800c038040 2024-05-15T18:08:54.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8026535800 20 add_watcher() i=0 2024-05-15T18:08:54.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8026535800 20 add_watcher() i=1 2024-05-15T18:08:54.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8026535800 20 add_watcher() i=2 2024-05-15T18:08:54.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8026535800 20 add_watcher() i=3 2024-05-15T18:08:54.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8026535800 20 add_watcher() i=4 2024-05-15T18:08:54.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.899+0000 7f8026535800 20 add_watcher() i=5 2024-05-15T18:08:54.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.900+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94102555944992] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.900+0000 7f8026535800 20 add_watcher() i=6 2024-05-15T18:08:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.900+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94102555956144] v29'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.901+0000 7f8026535800 20 add_watcher() i=7 2024-05-15T18:08:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.901+0000 7f8026535800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.901+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b8ee0 con 0x5595f56a8c60 2024-05-15T18:08:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.901+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.901+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94102555957200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b8ee0 con 0x5595f56a8c60 2024-05-15T18:08:54.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.902+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94102555957200] v29'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.902+0000 7f7ed8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:54.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.902+0000 7f8026535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:54.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.902+0000 7f8026535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:54.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.902+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c5610 con 0x5595f56a8c60 2024-05-15T18:08:54.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.903+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.904+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c5c60 con 0x7f800c038040 2024-05-15T18:08:54.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.905+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.905+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c60e0 con 0x5595f56ad650 2024-05-15T18:08:54.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.906+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.906+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c6480 con 0x5595f56a8c60 2024-05-15T18:08:54.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.907+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.907+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c6a70 con 0x7f80140bd060 2024-05-15T18:08:54.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.908+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.908+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c7320 con 0x5595f56ad650 2024-05-15T18:08:54.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.909+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.909+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c7320 con 0x5595f56a8c60 2024-05-15T18:08:54.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.910+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.910+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c7320 con 0x7f800c038040 2024-05-15T18:08:54.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.911+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.911+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c73b0 con 0x7f80140bd060 2024-05-15T18:08:54.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.912+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.912+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c7920 con 0x5595f56ad650 2024-05-15T18:08:54.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.913+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.913+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c7920 con 0x7f80140bd060 2024-05-15T18:08:54.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.914+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.914+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c7e90 con 0x7f800c038040 2024-05-15T18:08:54.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.916+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.916+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c7e90 con 0x7f80140bd060 2024-05-15T18:08:54.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.916+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.917+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c80f0 con 0x7f800c038040 2024-05-15T18:08:54.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.918+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.918+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c80f0 con 0x5595f56a8c60 2024-05-15T18:08:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.919+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.919+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c80f0 con 0x5595f56ad650 2024-05-15T18:08:54.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.920+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.920+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c80f0 con 0x7f80140bd060 2024-05-15T18:08:54.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.921+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.921+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c80f0 con 0x5595f56ad650 2024-05-15T18:08:54.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.922+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.922+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c80f0 con 0x5595f56a8c60 2024-05-15T18:08:54.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.923+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.923+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8180 con 0x5595f56a8c60 2024-05-15T18:08:54.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.924+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.924+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8180 con 0x5595f56ad650 2024-05-15T18:08:54.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.925+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.925+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8180 con 0x7f80140bd060 2024-05-15T18:08:54.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.926+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.926+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8180 con 0x5595f56ad650 2024-05-15T18:08:54.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.927+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.927+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x5595f56ad650 2024-05-15T18:08:54.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.928+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.928+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x5595f56ad650 2024-05-15T18:08:54.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.929+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.929+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x5595f56ad650 2024-05-15T18:08:54.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.930+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.930+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x7f800c038040 2024-05-15T18:08:54.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.932+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.932+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x5595f56ad650 2024-05-15T18:08:54.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.933+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.933+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x7f800c038040 2024-05-15T18:08:54.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.934+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.934+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x5595f56ad650 2024-05-15T18:08:54.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.935+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.935+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x7f800c038040 2024-05-15T18:08:54.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.936+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.936+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c8200 con 0x7f80140bd060 2024-05-15T18:08:54.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f7e537fe640 20 reqs_thread_entry: start 2024-05-15T18:08:54.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:54.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 20 Filter name: none 2024-05-15T18:08:54.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f7e517fa640 20 reqs_thread_entry: start 2024-05-15T18:08:54.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-15T18:08:54.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 20 rados->read ofs=0 len=0 2024-05-15T18:08:54.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5595f56f3160 con 0x7f80140bd060 2024-05-15T18:08:54.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:54.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-05-15T18:08:54.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.938+0000 7f8026535800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-15T18:08:54.917 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-05-15T18:08:54.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.939+0000 7f7ed8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:54.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.939+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94102555957200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56c3040 con 0x5595f56a8c60 2024-05-15T18:08:54.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.940+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94102555957200] v29'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.940+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94102555928528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b97d0 con 0x7f80140bd060 2024-05-15T18:08:54.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.941+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94102555928528] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.941+0000 7f8026535800 20 remove_watcher() i=0 2024-05-15T18:08:54.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.941+0000 7f8026535800 2 removed watcher, disabling cache 2024-05-15T18:08:54.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.941+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94102555935424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b27d0 con 0x5595f56a8c60 2024-05-15T18:08:54.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.943+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94102555935424] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.943+0000 7f8026535800 20 remove_watcher() i=1 2024-05-15T18:08:54.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.943+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94102555930784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b27d0 con 0x5595f56ad650 2024-05-15T18:08:54.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.944+0000 7f80222f9640 1 -- 172.21.15.173:0/2508136021 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94102555930784] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80140ba030 con 0x5595f56ad650 2024-05-15T18:08:54.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.944+0000 7f8026535800 20 remove_watcher() i=2 2024-05-15T18:08:54.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.944+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94102555937696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b27d0 con 0x7f80140bd060 2024-05-15T18:08:54.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.945+0000 7f8019af8640 1 -- 172.21.15.173:0/2508136021 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94102555937696] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c045040 con 0x7f80140bd060 2024-05-15T18:08:54.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.945+0000 7f8026535800 20 remove_watcher() i=3 2024-05-15T18:08:54.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.945+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94102555947968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b4ba0 con 0x5595f56a8c60 2024-05-15T18:08:54.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.946+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94102555947968] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x5595f56a8c60 2024-05-15T18:08:54.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.946+0000 7f8026535800 20 remove_watcher() i=4 2024-05-15T18:08:54.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.946+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94102555952208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b27d0 con 0x7f800c038040 2024-05-15T18:08:54.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.947+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94102555952208] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.947+0000 7f8026535800 20 remove_watcher() i=5 2024-05-15T18:08:54.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.947+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94102555944992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b4ba0 con 0x7f800c038040 2024-05-15T18:08:54.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.948+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94102555944992] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.948+0000 7f8026535800 20 remove_watcher() i=6 2024-05-15T18:08:54.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.949+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94102555956144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5595f56b27d0 con 0x7f800c038040 2024-05-15T18:08:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94102555956144] v29'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f801c031040 con 0x7f800c038040 2024-05-15T18:08:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 20 remove_watcher() i=7 2024-05-15T18:08:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f800c038040 msgr2=0x7f800c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f800c038040 0x7f800c01bab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f56a8c60 msgr2=0x5595f56ab120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f56a8c60 0x5595f56ab120 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f80140bd060 msgr2=0x7f8014093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f80140bd060 0x7f8014093050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f56ad650 msgr2=0x5595f56afa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f56ad650 0x5595f56afa40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 msgr2=0x7f7eec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f800c001b60 tx=0x7f800c010000 comp rx=0 tx=0).stop 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 msgr2=0x5595f569d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8022afa640 1 -- 172.21.15.173:0/2508136021 reap_dead start 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f569d480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8014064980 tx=0x7f8014098fe0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 shutdown_connections 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/2508136021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5696130 0x5595f569d480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 >> 172.21.15.173:0/2508136021 conn(0x5595f5692400 msgr2=0x5595f568fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 shutdown_connections 2024-05-15T18:08:54.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/2508136021 wait complete. 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7efc036900 msgr2=0x7f7efc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7efc036900 0x7f7efc038dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f800c00bf50 tx=0x7f800c00f000 comp rx=0 tx=0).stop 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5688f80 msgr2=0x5595f56893a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5688f80 0x5595f56893a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f801408c440 tx=0x7f8014076f50 comp rx=0 tx=0).stop 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 shutdown_connections 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7efc036900 0x7f7efc038dc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 --2- 172.21.15.173:0/3256133030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f5688f80 0x5595f56893a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 >> 172.21.15.173:0/3256133030 conn(0x5595f567d020 msgr2=0x5595f567d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.950+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 shutdown_connections 2024-05-15T18:08:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/3256133030 wait complete. 2024-05-15T18:08:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5595f5677f70 msgr2=0x5595f567a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5595f5677f70 0x5595f567a3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f556e370 msgr2=0x5595f56716b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5595f556e370 0x5595f56716b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f5673fe0 msgr2=0x5595f56763d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5595f5673fe0 0x5595f56763d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f08036900 msgr2=0x7f7f08038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f08036900 0x7f7f08038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f800c000f60 tx=0x7f800c0012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 msgr2=0x5595f566a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 --2- 172.21.15.173:0/211237107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f556da10 0x5595f566a4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8014052740 tx=0x7f8014003020 comp rx=0 tx=0).stop 2024-05-15T18:08:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8022afa640 1 -- 172.21.15.173:0/211237107 reap_dead start 2024-05-15T18:08:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 shutdown_connections 2024-05-15T18:08:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 >> 172.21.15.173:0/211237107 conn(0x5595f55695b0 msgr2=0x5595f565cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 shutdown_connections 2024-05-15T18:08:54.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:54.951+0000 7f8026535800 1 -- 172.21.15.173:0/211237107 wait complete. 2024-05-15T18:08:54.939 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-15T18:08:54.940 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-05-15T18:08:54.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-05-15T18:08:54.940 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-05-15T18:08:54.984 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:54.984 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:54.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a9335800 1 Processor -- start 2024-05-15T18:08:54.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a9335800 1 -- start start 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a9335800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562c5726c5b0 0x562c5726c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a9335800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c5726d050 con 0x562c5726b2c0 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a9335800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x562c570fd050 con 0x562c5726c5b0 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a50f9640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562c5726c5b0 0x562c5726c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a50f9640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562c5726c5b0 0x562c5726c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42896/0 (socket says 172.21.15.173:42896) 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a48f8640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x562c5726b2c0 0x562c5726b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35124/0 (socket says 172.21.15.173:35124) 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.007+0000 7f16a50f9640 1 -- 172.21.15.173:0/3530348082 learned_addr learned my addr 172.21.15.173:0/3530348082 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.008+0000 7f16a50f9640 1 -- 172.21.15.173:0/3530348082 >> v1:172.21.15.3:6789/0 conn(0x562c5726b2c0 legacy=0x562c5726b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.008+0000 7f16a50f9640 1 -- 172.21.15.173:0/3530348082 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5726be50 con 0x562c5726c5b0 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a50f9640 1 --2- 172.21.15.173:0/3530348082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726c5b0 0x562c5726c9d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1698005fd0 tx=0x7f169801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21afe8bec0f3686b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f169ffff640 1 -- 172.21.15.173:0/3530348082 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698052540 con 0x562c5726c5b0 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f169ffff640 1 -- 172.21.15.173:0/3530348082 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f169804e070 con 0x562c5726c5b0 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f169ffff640 1 -- 172.21.15.173:0/3530348082 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698052890 con 0x562c5726c5b0 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a9335800 1 -- 172.21.15.173:0/3530348082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726c5b0 msgr2=0x562c5726c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a9335800 1 --2- 172.21.15.173:0/3530348082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726c5b0 0x562c5726c9d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1698005fd0 tx=0x7f169801cd80 comp rx=0 tx=0).stop 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a9335800 1 -- 172.21.15.173:0/3530348082 shutdown_connections 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a9335800 1 --2- 172.21.15.173:0/3530348082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726c5b0 0x562c5726c9d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:54.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a9335800 1 -- 172.21.15.173:0/3530348082 >> 172.21.15.173:0/3530348082 conn(0x562c57265d30 msgr2=0x562c57268150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:54.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a9335800 1 -- 172.21.15.173:0/3530348082 shutdown_connections 2024-05-15T18:08:54.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.010+0000 7f16a9335800 1 -- 172.21.15.173:0/3530348082 wait complete. 2024-05-15T18:08:55.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.024+0000 7f16a9335800 1 Processor -- start 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.024+0000 7f16a9335800 1 -- start start 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.024+0000 7f16a9335800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c5726acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.024+0000 7f16a9335800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562c571b71d0 con 0x562c5726b2c0 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.024+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c5726acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.025+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c5726acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42912/0 (socket says 172.21.15.173:42912) 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.025+0000 7f16a50f9640 1 -- 172.21.15.173:0/3636573766 learned_addr learned my addr 172.21.15.173:0/3636573766 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.025+0000 7f16a50f9640 1 -- 172.21.15.173:0/3636573766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5735e2e0 con 0x562c5726b2c0 2024-05-15T18:08:55.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.025+0000 7f16a50f9640 1 --2- 172.21.15.173:0/3636573766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c5726acf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f169800a190 tx=0x7f169804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7e315665bada8a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.025+0000 7f1593606640 1 -- 172.21.15.173:0/3636573766 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698052410 con 0x562c5726b2c0 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.025+0000 7f1593606640 1 -- 172.21.15.173:0/3636573766 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1698062070 con 0x562c5726b2c0 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.025+0000 7f1593606640 1 -- 172.21.15.173:0/3636573766 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698052700 con 0x562c5726b2c0 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 -- 172.21.15.173:0/3636573766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 msgr2=0x562c5726acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 --2- 172.21.15.173:0/3636573766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c5726acf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f169800a190 tx=0x7f169804c000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 -- 172.21.15.173:0/3636573766 shutdown_connections 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 --2- 172.21.15.173:0/3636573766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c5726acf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 -- 172.21.15.173:0/3636573766 >> 172.21.15.173:0/3636573766 conn(0x562c57265d30 msgr2=0x562c57357fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 -- 172.21.15.173:0/3636573766 shutdown_connections 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 -- 172.21.15.173:0/3636573766 wait complete. 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 Processor -- start 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 -- start start 2024-05-15T18:08:55.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c573673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.026+0000 7f16a9335800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562c57274770 con 0x562c5726b2c0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c573673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c573673d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42920/0 (socket says 172.21.15.173:42920) 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f16a50f9640 1 -- 172.21.15.173:0/2355679417 learned_addr learned my addr 172.21.15.173:0/2355679417 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f16a50f9640 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c57367910 con 0x562c5726b2c0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f16a50f9640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c573673d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f169805f040 tx=0x7f1698003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f1591e03640 1 -- 172.21.15.173:0/2355679417 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169805d630 con 0x562c5726b2c0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f1591e03640 1 -- 172.21.15.173:0/2355679417 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1698058040 con 0x562c5726b2c0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.027+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c57367ba0 con 0x562c5726b2c0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.028+0000 7f1591e03640 1 -- 172.21.15.173:0/2355679417 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169805d900 con 0x562c5726b2c0 2024-05-15T18:08:55.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.028+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5736a850 con 0x562c5726b2c0 2024-05-15T18:08:55.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f1591e03640 1 -- 172.21.15.173:0/2355679417 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1698050070 con 0x562c5726b2c0 2024-05-15T18:08:55.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f1591e03640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f158c036900 0x7f158c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f1591e03640 1 -- 172.21.15.173:0/2355679417 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f169808e430 con 0x562c5726b2c0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f16a48f8640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f158c036900 0x7f158c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c5726c5b0 0x562c5736e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c5736eb50 con 0x562c5726c5b0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f16a58fa640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c5726c5b0 0x562c5736e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f16a48f8640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f158c036900 0x7f158c038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1690000f60 tx=0x7f1690001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.029+0000 7f16a58fa640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c5726c5b0 0x562c5736e610 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.030+0000 7f16a58fa640 1 -- 172.21.15.173:0/2355679417 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c5726c5b0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.030+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c5736bbc0 con 0x562c5726c5b0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.030+0000 7f16a58fa640 1 -- 172.21.15.173:0/2355679417 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16a00083e0 con 0x562c5726c5b0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.030+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c57370e40 0x562c57373230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.030+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c57373920 con 0x562c57370e40 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.030+0000 7f16a50f9640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c57370e40 0x562c57373230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.030+0000 7f16a50f9640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c57370e40 0x562c57373230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.031+0000 7f16a50f9640 1 -- 172.21.15.173:0/2355679417 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1698077020 con 0x562c57370e40 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.031+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c5736fdf0 con 0x562c5726c5b0 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.031+0000 7f16a58fa640 1 -- 172.21.15.173:0/2355679417 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16a00083e0 con 0x562c5726c5b0 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.031+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562c57374d80 0x562c57377240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.031+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573779d0 con 0x562c57374d80 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.031+0000 7f16a48f8640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562c57374d80 0x562c57377240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.032+0000 7f16a48f8640 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562c57374d80 0x562c57377240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.032+0000 7f16a48f8640 1 -- 172.21.15.173:0/2355679417 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f169000f690 con 0x562c57374d80 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.032+0000 7f16a9335800 1 Processor -- start 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.032+0000 7f16a9335800 1 -- start start 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.033+0000 7f16a9335800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57385df0 0x562c57386210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.033+0000 7f16a9335800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562c5715dcf0 con 0x562c57385df0 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.033+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57385df0 0x562c57386210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.033+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57385df0 0x562c57386210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42926/0 (socket says 172.21.15.173:42926) 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.033+0000 7f16a50f9640 1 -- 172.21.15.173:0/1200087941 learned_addr learned my addr 172.21.15.173:0/1200087941 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.033+0000 7f16a50f9640 1 -- 172.21.15.173:0/1200087941 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c57386750 con 0x562c57385df0 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.033+0000 7f16a50f9640 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57385df0 0x562c57386210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1698051fc0 tx=0x7f1698051650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.034+0000 7f158affd640 1 -- 172.21.15.173:0/1200087941 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698072b40 con 0x562c57385df0 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.034+0000 7f158affd640 1 -- 172.21.15.173:0/1200087941 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1698072ce0 con 0x562c57385df0 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.034+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c573871c0 con 0x562c57385df0 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.034+0000 7f158affd640 1 -- 172.21.15.173:0/1200087941 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1698051730 con 0x562c57385df0 2024-05-15T18:08:55.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.034+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c573871c0 con 0x562c57385df0 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.034+0000 7f158affd640 1 -- 172.21.15.173:0/1200087941 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16980518d0 con 0x562c57385df0 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f158affd640 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f157c036900 0x7f157c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f158affd640 1 -- 172.21.15.173:0/1200087941 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1698069070 con 0x562c57385df0 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a48f8640 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f157c036900 0x7f157c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a9335800 1 Processor -- start 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a9335800 1 -- start start 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a48f8640 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f157c036900 0x7f157c038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x562c57377dd0 tx=0x7f169000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a9335800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c573931d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a9335800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562c573629b0 con 0x562c57392db0 2024-05-15T18:08:55.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c573931d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c573931d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42940/0 (socket says 172.21.15.173:42940) 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.035+0000 7f16a50f9640 1 -- 172.21.15.173:0/4268336767 learned_addr learned my addr 172.21.15.173:0/4268336767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a50f9640 1 -- 172.21.15.173:0/4268336767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c573937a0 con 0x562c57392db0 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a50f9640 1 --2- 172.21.15.173:0/4268336767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c573931d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16980739e0 tx=0x7f1698086b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f54992558ea6ed server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f1588ff9640 1 -- 172.21.15.173:0/4268336767 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16980867e0 con 0x562c57392db0 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f1588ff9640 1 -- 172.21.15.173:0/4268336767 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16980a6070 con 0x562c57392db0 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f1588ff9640 1 -- 172.21.15.173:0/4268336767 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16980721f0 con 0x562c57392db0 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a9335800 1 -- 172.21.15.173:0/4268336767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 msgr2=0x562c573931d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a9335800 1 --2- 172.21.15.173:0/4268336767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c573931d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16980739e0 tx=0x7f1698086b10 comp rx=0 tx=0).stop 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a9335800 1 -- 172.21.15.173:0/4268336767 shutdown_connections 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a9335800 1 --2- 172.21.15.173:0/4268336767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c573931d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a9335800 1 -- 172.21.15.173:0/4268336767 >> 172.21.15.173:0/4268336767 conn(0x562c5738f0c0 msgr2=0x562c5738d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a9335800 1 -- 172.21.15.173:0/4268336767 shutdown_connections 2024-05-15T18:08:55.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.036+0000 7f16a9335800 1 -- 172.21.15.173:0/4268336767 wait complete. 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.037+0000 7f16a9335800 1 Processor -- start 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.037+0000 7f16a9335800 1 -- start start 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.037+0000 7f16a9335800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c5739a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.037+0000 7f16a9335800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562c57393e30 con 0x562c57392db0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.037+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c5739a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.037+0000 7f16a50f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c5739a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42952/0 (socket says 172.21.15.173:42952) 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.037+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 learned_addr learned my addr 172.21.15.173:0/3863592597 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.038+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5739a670 con 0x562c57392db0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.038+0000 7f16a50f9640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c5739a130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1698065d80 tx=0x7f169805aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.038+0000 7f157affd640 1 -- 172.21.15.173:0/3863592597 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169807ce60 con 0x562c57392db0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.038+0000 7f157affd640 1 -- 172.21.15.173:0/3863592597 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16980b6070 con 0x562c57392db0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.038+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c5739a670 con 0x562c57392db0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.038+0000 7f157affd640 1 -- 172.21.15.173:0/3863592597 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169808b390 con 0x562c57392db0 2024-05-15T18:08:55.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.038+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5739a670 con 0x562c57392db0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.039+0000 7f157affd640 1 -- 172.21.15.173:0/3863592597 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f16980a0070 con 0x562c57392db0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.039+0000 7f157affd640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1570036900 0x7f1570038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.039+0000 7f157affd640 1 -- 172.21.15.173:0/3863592597 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f169809d030 con 0x562c57392db0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.039+0000 7f16a48f8640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1570036900 0x7f1570038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c573a5710 0x562c573a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573a8320 con 0x562c573a5710 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a48f8640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1570036900 0x7f1570038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f169000fee0 tx=0x7f1690010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a58fa640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c573a5710 0x562c573a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a58fa640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c573a5710 0x562c573a7bd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.040+0000 7f16a9335800 20 realm 2024-05-15T18:08:55.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573a8730 con 0x562c573a5710 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a5710 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573a93a0 con 0x562c573a5710 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c573a9d60 0x562c573ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573ac760 con 0x562c573a9d60 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.041+0000 7f16a50f9640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c573a9d60 0x562c573ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a50f9640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c573a9d60 0x562c573ac150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a9335800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a9335800 20 searching for the correct realm 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573ae090 con 0x562c573a9d60 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a50f9640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1698086c20 0x7f1698066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573ae090 con 0x7f1698086c20 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.042+0000 7f16a48f8640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1698086c20 0x7f1698066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.043+0000 7f16a48f8640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1698086c20 0x7f1698066790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.043+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.043+0000 7f16a48f8640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f169000f070 0x7f169003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.043+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573ae090 con 0x7f169000f070 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.043+0000 7f16a58fa640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f169000f070 0x7f169003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.044+0000 7f16a58fa640 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f169000f070 0x7f169003a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.044+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.044+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a5710 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.044+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.044+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a5710 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.044+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.044+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x7f169000f070 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x7f169000f070 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x7f1698086c20 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a9d60 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.045+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a5710 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.046+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.046+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x7f169000f070 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.046+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.046+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a5710 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.046+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.046+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x7f1698086c20 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a9d60 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a9d60 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x7f169000f070 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.047+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a9d60 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a9d60 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a5710 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a5710 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.048+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x7f169000f070 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.049+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.049+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a9d60 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.049+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.049+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x7f1698086c20 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.049+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.049+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a5710 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.050+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.050+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x7f169000f070 2024-05-15T18:08:55.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.050+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.050+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a9d60 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.050+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.050+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x7f169000f070 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.050+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.051+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x7f1698086c20 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.051+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.051+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a9d60 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.051+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.051+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x7f169000f070 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.051+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.051+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x562c573a5710 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f16a0026040 con 0x7f1698086c20 2024-05-15T18:08:55.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573a9000 con 0x562c573a5710 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573ad020 con 0x562c573a5710 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.052+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573ad020 con 0x7f169000f070 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 zone default found 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 4 Realm: () 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 zonegroup default 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573ad940 con 0x7f169000f070 2024-05-15T18:08:55.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573ad940 con 0x562c573a9d60 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573afef0 con 0x562c573a9d60 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.053+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.054+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.054+0000 7f16a9335800 20 started sync module instance, tier type = 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.054+0000 7f16a9335800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.054+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573af390 con 0x7f1698086c20 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.055+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.055+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94748442029792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b0290 con 0x7f1698086c20 2024-05-15T18:08:55.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.055+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b0ae0 con 0x562c573a5710 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.055+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94748442029792] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.056+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.056+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94748442035760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b0a50 con 0x562c573a5710 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.056+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b19a0 con 0x562c573a9d60 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.057+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94748442035760] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.057+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.057+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94748442039536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b1d90 con 0x562c573a9d60 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.057+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b27d0 con 0x7f1698086c20 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.058+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.058+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94748442045376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b3490 con 0x7f1698086c20 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.058+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94748442039536] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.058+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b0f10 con 0x562c573a5710 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.059+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.059+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94748442048976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b42a0 con 0x562c573a5710 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.059+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b4d10 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.060+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94748442045376] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.060+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.060+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94748442052576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b4cd0 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.060+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b5720 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.060+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94748442048976] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.061+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94748442052576] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.062+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.062+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94748442046432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b5270 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.062+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b5fc0 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.063+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.063+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94748442057488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b5270 con 0x7f169000f070 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a9335800 20 add_watcher() i=0 2024-05-15T18:08:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a9335800 20 add_watcher() i=1 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a9335800 20 add_watcher() i=2 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94748442046432] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a9335800 20 add_watcher() i=3 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a9335800 20 add_watcher() i=4 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a9335800 20 add_watcher() i=5 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.064+0000 7f16a9335800 20 add_watcher() i=6 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.065+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94748442057488] v29'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.065+0000 7f16a9335800 20 add_watcher() i=7 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.065+0000 7f16a9335800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.065+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573b3df0 con 0x562c573a5710 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.065+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.065+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94748442058544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b3df0 con 0x562c573a5710 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.066+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94748442058544] v29'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.066+0000 7f155b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.066+0000 7f16a9335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.066+0000 7f16a9335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.066+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c1970 con 0x562c573a5710 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.068+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.068+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c1fc0 con 0x7f169000f070 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.069+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.069+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c2440 con 0x562c573a9d60 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.070+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.070+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c27e0 con 0x562c573a5710 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.071+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.071+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c2da0 con 0x7f1698086c20 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.072+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.072+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3310 con 0x562c573a9d60 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.073+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.073+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3710 con 0x562c573a5710 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.074+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.074+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3710 con 0x7f169000f070 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.075+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.075+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3710 con 0x7f1698086c20 2024-05-15T18:08:55.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.076+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.076+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x562c573a9d60 2024-05-15T18:08:55.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.077+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.077+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x7f1698086c20 2024-05-15T18:08:55.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.078+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.078+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x7f169000f070 2024-05-15T18:08:55.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.079+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.079+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x7f1698086c20 2024-05-15T18:08:55.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.080+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.080+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x7f169000f070 2024-05-15T18:08:55.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.081+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.081+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x562c573a5710 2024-05-15T18:08:55.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.083+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.083+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x562c573a9d60 2024-05-15T18:08:55.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.084+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.084+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3bc0 con 0x7f1698086c20 2024-05-15T18:08:55.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.085+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.085+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a9d60 2024-05-15T18:08:55.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.086+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.086+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a5710 2024-05-15T18:08:55.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.088+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.088+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a5710 2024-05-15T18:08:55.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.089+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.089+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c80 con 0x562c573a9d60 2024-05-15T18:08:55.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.090+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.091+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c80 con 0x7f1698086c20 2024-05-15T18:08:55.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.091+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.092+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a9d60 2024-05-15T18:08:55.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.093+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.093+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a9d60 2024-05-15T18:08:55.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.094+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.094+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a9d60 2024-05-15T18:08:55.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.095+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.095+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a9d60 2024-05-15T18:08:55.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.096+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.096+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x7f169000f070 2024-05-15T18:08:55.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.097+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.097+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a9d60 2024-05-15T18:08:55.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.098+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.098+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x7f169000f070 2024-05-15T18:08:55.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.100+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.100+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x562c573a9d60 2024-05-15T18:08:55.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.101+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.101+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x7f169000f070 2024-05-15T18:08:55.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.102+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.102+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573c3c50 con 0x7f1698086c20 2024-05-15T18:08:55.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.103+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.103+0000 7f155a7e4640 20 reqs_thread_entry: start 2024-05-15T18:08:55.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.103+0000 7f16a9335800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:55.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.103+0000 7f16a9335800 20 Filter name: none 2024-05-15T18:08:55.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.103+0000 7f14cbfff640 20 reqs_thread_entry: start 2024-05-15T18:08:55.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.104+0000 7f16a9335800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-15T18:08:55.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.104+0000 7f16a9335800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.104+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562c573eed60 con 0x7f169000f070 2024-05-15T18:08:55.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.104+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.104+0000 7f16a9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.104+0000 7f16a9335800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-15T18:08:55.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.104+0000 7f16a9335800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-15T18:08:55.083 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-05-15T18:08:55.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.105+0000 7f155b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.105+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94748442058544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573bf4e0 con 0x562c573a5710 2024-05-15T18:08:55.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.106+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94748442058544] v29'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.106+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94748442029792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b5f30 con 0x7f1698086c20 2024-05-15T18:08:55.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.107+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94748442029792] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.107+0000 7f16a9335800 20 remove_watcher() i=0 2024-05-15T18:08:55.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.107+0000 7f16a9335800 2 removed watcher, disabling cache 2024-05-15T18:08:55.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.107+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94748442035760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b5f30 con 0x562c573a5710 2024-05-15T18:08:55.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.108+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94748442035760] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.108+0000 7f16a9335800 20 remove_watcher() i=1 2024-05-15T18:08:55.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.108+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94748442039536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b0630 con 0x562c573a9d60 2024-05-15T18:08:55.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.109+0000 7f16a50f9640 1 -- 172.21.15.173:0/3863592597 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94748442039536] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1698094020 con 0x562c573a9d60 2024-05-15T18:08:55.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.109+0000 7f16a9335800 20 remove_watcher() i=2 2024-05-15T18:08:55.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.110+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94748442045376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b5f30 con 0x7f1698086c20 2024-05-15T18:08:55.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.111+0000 7f16a48f8640 1 -- 172.21.15.173:0/3863592597 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94748442045376] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1690037040 con 0x7f1698086c20 2024-05-15T18:08:55.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.111+0000 7f16a9335800 20 remove_watcher() i=3 2024-05-15T18:08:55.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.111+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94748442048976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b14f0 con 0x562c573a5710 2024-05-15T18:08:55.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.112+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94748442048976] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x562c573a5710 2024-05-15T18:08:55.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.112+0000 7f16a9335800 20 remove_watcher() i=4 2024-05-15T18:08:55.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.112+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94748442052576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b0630 con 0x7f169000f070 2024-05-15T18:08:55.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.113+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94748442052576] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.113+0000 7f16a9335800 20 remove_watcher() i=5 2024-05-15T18:08:55.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.113+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94748442046432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b2bc0 con 0x7f169000f070 2024-05-15T18:08:55.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.115+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94748442046432] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.115+0000 7f16a9335800 20 remove_watcher() i=6 2024-05-15T18:08:55.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.115+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94748442057488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562c573b39d0 con 0x7f169000f070 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94748442057488] v29'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16a00083e0 con 0x7f169000f070 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 20 remove_watcher() i=7 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f169000f070 msgr2=0x7f169003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f169000f070 0x7f169003a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c573a5710 msgr2=0x562c573a7bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c573a5710 0x562c573a7bd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1698086c20 msgr2=0x7f1698066790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1698086c20 0x7f1698066790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c573a9d60 msgr2=0x562c573ac150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c573a9d60 0x562c573ac150 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1570036900 msgr2=0x7f1570038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1570036900 0x7f1570038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f169000fee0 tx=0x7f1690010000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 msgr2=0x562c5739a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a58fa640 1 -- 172.21.15.173:0/3863592597 reap_dead start 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c5739a130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1698065d80 tx=0x7f169805aed0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 shutdown_connections 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 --2- 172.21.15.173:0/3863592597 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57392db0 0x562c5739a130 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 >> 172.21.15.173:0/3863592597 conn(0x562c5738f0c0 msgr2=0x562c5738c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 shutdown_connections 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.116+0000 7f16a9335800 1 -- 172.21.15.173:0/3863592597 wait complete. 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f157c036900 msgr2=0x7f157c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f157c036900 0x7f157c038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x562c57377dd0 tx=0x7f169000f000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57385df0 msgr2=0x562c57386210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57385df0 0x562c57386210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1698051fc0 tx=0x7f1698051650 comp rx=0 tx=0).stop 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 shutdown_connections 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f157c036900 0x7f157c038dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/1200087941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c57385df0 0x562c57386210 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 >> 172.21.15.173:0/1200087941 conn(0x562c57379e90 msgr2=0x562c5737a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 shutdown_connections 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/1200087941 wait complete. 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562c57374d80 msgr2=0x562c57377240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562c57374d80 0x562c57377240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c5726c5b0 msgr2=0x562c5736e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562c5726c5b0 0x562c5736e610 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c57370e40 msgr2=0x562c57373230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562c57370e40 0x562c57373230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f158c036900 msgr2=0x7f158c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f158c036900 0x7f158c038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1690000f60 tx=0x7f1690001370 comp rx=0 tx=0).stop 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 msgr2=0x562c573673d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 --2- 172.21.15.173:0/2355679417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562c5726b2c0 0x562c573673d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f169805f040 tx=0x7f1698003330 comp rx=0 tx=0).stop 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a58fa640 1 -- 172.21.15.173:0/2355679417 reap_dead start 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 shutdown_connections 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 >> 172.21.15.173:0/2355679417 conn(0x562c57265d30 msgr2=0x562c573567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 shutdown_connections 2024-05-15T18:08:55.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.117+0000 7f16a9335800 1 -- 172.21.15.173:0/2355679417 wait complete. 2024-05-15T18:08:55.103 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-15T18:08:55.104 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-15T18:08:55.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-15T18:08:55.104 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-15T18:08:55.189 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:55.190 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:55.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.212+0000 7f1bef731800 1 Processor -- start 2024-05-15T18:08:55.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1bef731800 1 -- start start 2024-05-15T18:08:55.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1bef731800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5614aa3235e0 0x5614aa323a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1bef731800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614aa324080 con 0x5614aa3222a0 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1bef731800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5614aa1b4050 con 0x5614aa3235e0 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1be3fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5614aa3222a0 0x5614aa322750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35136/0 (socket says 172.21.15.173:35136) 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1be3fff640 1 -- 172.21.15.173:0/3502672496 learned_addr learned my addr 172.21.15.173:0/3502672496 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3502672496 >> v2:172.21.15.3:3300/0 conn(0x5614aa3235e0 0x5614aa323a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1beac2e640 1 -- 172.21.15.173:0/3502672496 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162052015 0 0) 0x5614aa324080 con 0x5614aa3222a0 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1beac2e640 1 -- 172.21.15.173:0/3502672496 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bd8001e10 con 0x5614aa3222a0 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.213+0000 7f1beb42f640 1 -- 172.21.15.173:0/3502672496 >> v1:172.21.15.3:6789/0 conn(0x5614aa3222a0 legacy=0x5614aa322750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.214+0000 7f1beb42f640 1 -- 172.21.15.173:0/3502672496 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614aa322e60 con 0x5614aa3235e0 2024-05-15T18:08:55.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3502672496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3235e0 0x5614aa323a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00a470 tx=0x7f1bdc01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572c8dabff6157bc server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1beac2e640 1 -- 172.21.15.173:0/3502672496 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc057070 con 0x5614aa3235e0 2024-05-15T18:08:55.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1beac2e640 1 -- 172.21.15.173:0/3502672496 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc052570 con 0x5614aa3235e0 2024-05-15T18:08:55.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1beac2e640 1 -- 172.21.15.173:0/3502672496 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc052870 con 0x5614aa3235e0 2024-05-15T18:08:55.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1bef731800 1 -- 172.21.15.173:0/3502672496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3235e0 msgr2=0x5614aa323a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1bef731800 1 --2- 172.21.15.173:0/3502672496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3235e0 0x5614aa323a00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00a470 tx=0x7f1bdc01cdb0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1bef731800 1 -- 172.21.15.173:0/3502672496 shutdown_connections 2024-05-15T18:08:55.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1bef731800 1 --2- 172.21.15.173:0/3502672496 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3235e0 0x5614aa323a00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1bef731800 1 -- 172.21.15.173:0/3502672496 >> 172.21.15.173:0/3502672496 conn(0x5614aa31cd30 msgr2=0x5614aa31f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1bef731800 1 -- 172.21.15.173:0/3502672496 shutdown_connections 2024-05-15T18:08:55.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.216+0000 7f1bef731800 1 -- 172.21.15.173:0/3502672496 wait complete. 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.230+0000 7f1bef731800 1 Processor -- start 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.231+0000 7f1bef731800 1 -- start start 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.231+0000 7f1bef731800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa4168d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.231+0000 7f1bef731800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5614aa26e1d0 con 0x5614aa3222a0 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.231+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa4168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.231+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa4168d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42962/0 (socket says 172.21.15.173:42962) 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.231+0000 7f1beb42f640 1 -- 172.21.15.173:0/2803081900 learned_addr learned my addr 172.21.15.173:0/2803081900 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.231+0000 7f1beb42f640 1 -- 172.21.15.173:0/2803081900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614aa416ea0 con 0x5614aa3222a0 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.232+0000 7f1beb42f640 1 --2- 172.21.15.173:0/2803081900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa4168d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc000c00 tx=0x7f1bdc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89f45ff5edec4ec server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.232+0000 7f1ad960a640 1 -- 172.21.15.173:0/2803081900 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc057040 con 0x5614aa3222a0 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.232+0000 7f1ad960a640 1 -- 172.21.15.173:0/2803081900 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc0528d0 con 0x5614aa3222a0 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.232+0000 7f1ad960a640 1 -- 172.21.15.173:0/2803081900 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc052bd0 con 0x5614aa3222a0 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.232+0000 7f1bef731800 1 -- 172.21.15.173:0/2803081900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 msgr2=0x5614aa4168d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.232+0000 7f1bef731800 1 --2- 172.21.15.173:0/2803081900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa4168d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc000c00 tx=0x7f1bdc04c000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 -- 172.21.15.173:0/2803081900 shutdown_connections 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 --2- 172.21.15.173:0/2803081900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa4168d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 -- 172.21.15.173:0/2803081900 >> 172.21.15.173:0/2803081900 conn(0x5614aa31cd30 msgr2=0x5614aa40dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 -- 172.21.15.173:0/2803081900 shutdown_connections 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 -- 172.21.15.173:0/2803081900 wait complete. 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 Processor -- start 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 -- start start 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa41e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1bef731800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5614aa321400 con 0x5614aa3222a0 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa41e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa41e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42970/0 (socket says 172.21.15.173:42970) 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.233+0000 7f1beb42f640 1 -- 172.21.15.173:0/3505794311 learned_addr learned my addr 172.21.15.173:0/3505794311 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.234+0000 7f1beb42f640 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614aa41e640 con 0x5614aa3222a0 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.234+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa41e100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc000c00 tx=0x7f1bdc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.234+0000 7f1ad7e07640 1 -- 172.21.15.173:0/3505794311 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc073070 con 0x5614aa3222a0 2024-05-15T18:08:55.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.234+0000 7f1ad7e07640 1 -- 172.21.15.173:0/3505794311 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc05d570 con 0x5614aa3222a0 2024-05-15T18:08:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.234+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614aa41e8d0 con 0x5614aa3222a0 2024-05-15T18:08:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.234+0000 7f1ad7e07640 1 -- 172.21.15.173:0/3505794311 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc057070 con 0x5614aa3222a0 2024-05-15T18:08:55.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.234+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614aa421580 con 0x5614aa3222a0 2024-05-15T18:08:55.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.235+0000 7f1ad7e07640 1 -- 172.21.15.173:0/3505794311 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bdc076070 con 0x5614aa3222a0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.235+0000 7f1ad7e07640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ad0036950 0x7f1ad0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.235+0000 7f1ad7e07640 1 -- 172.21.15.173:0/3505794311 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1bdc08e180 con 0x5614aa3222a0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ad0036950 0x7f1ad0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa3235e0 0x5614aa425340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa425880 con 0x5614aa3235e0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1bebc30640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa3235e0 0x5614aa425340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ad0036950 0x7f1ad0038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4000f60 tx=0x7f1bd40010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1bebc30640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa3235e0 0x5614aa425340 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1bebc30640 1 -- 172.21.15.173:0/3505794311 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa3235e0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.236+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4228f0 con 0x5614aa3235e0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.237+0000 7f1bebc30640 1 -- 172.21.15.173:0/3505794311 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa3235e0 2024-05-15T18:08:55.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.237+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa427bb0 0x5614aa429fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.237+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa42a690 con 0x5614aa427bb0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.237+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa427bb0 0x5614aa429fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.237+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa427bb0 0x5614aa429fa0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.237+0000 7f1beb42f640 1 -- 172.21.15.173:0/3505794311 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bdc075030 con 0x5614aa427bb0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.237+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa426b30 con 0x5614aa3235e0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.238+0000 7f1bebc30640 1 -- 172.21.15.173:0/3505794311 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa3235e0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.238+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5614aa42baf0 0x5614aa42df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.238+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa42e6c0 con 0x5614aa42baf0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.238+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5614aa42baf0 0x5614aa42df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.238+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5614aa42baf0 0x5614aa42df60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.239+0000 7f1be3fff640 1 -- 172.21.15.173:0/3505794311 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bd4009050 con 0x5614aa42baf0 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.239+0000 7f1bef731800 1 Processor -- start 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.239+0000 7f1bef731800 1 -- start start 2024-05-15T18:08:55.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.240+0000 7f1bef731800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa43cb20 0x5614aa43cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.240+0000 7f1bef731800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5614aa214cf0 con 0x5614aa43cb20 2024-05-15T18:08:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.240+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa43cb20 0x5614aa43cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.240+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa43cb20 0x5614aa43cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42984/0 (socket says 172.21.15.173:42984) 2024-05-15T18:08:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.240+0000 7f1beb42f640 1 -- 172.21.15.173:0/1815494831 learned_addr learned my addr 172.21.15.173:0/1815494831 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.240+0000 7f1beb42f640 1 -- 172.21.15.173:0/1815494831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614aa43d480 con 0x5614aa43cb20 2024-05-15T18:08:55.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.240+0000 7f1beb42f640 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa43cb20 0x5614aa43cf40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc077c10 tx=0x7f1bdc066ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.241+0000 7f1ad5602640 1 -- 172.21.15.173:0/1815494831 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc08b2a0 con 0x5614aa43cb20 2024-05-15T18:08:55.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.241+0000 7f1ad5602640 1 -- 172.21.15.173:0/1815494831 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc08a020 con 0x5614aa43cb20 2024-05-15T18:08:55.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.241+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614aa43def0 con 0x5614aa43cb20 2024-05-15T18:08:55.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.241+0000 7f1ad5602640 1 -- 172.21.15.173:0/1815494831 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc05dc10 con 0x5614aa43cb20 2024-05-15T18:08:55.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.241+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614aa43e3f0 con 0x5614aa43cb20 2024-05-15T18:08:55.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1ad5602640 1 -- 172.21.15.173:0/1815494831 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bdc095060 con 0x5614aa43cb20 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1ad5602640 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ac4036950 0x7f1ac4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1ad5602640 1 -- 172.21.15.173:0/1815494831 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1bdc07f040 con 0x5614aa43cb20 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1be3fff640 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ac4036950 0x7f1ac4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1bef731800 1 Processor -- start 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1be3fff640 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ac4036950 0x7f1ac4038e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400bf90 tx=0x7f1bd400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1bef731800 1 -- start start 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1bef731800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa449c10 0x5614aa44a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1bef731800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5614aa417160 con 0x5614aa449c10 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa449c10 0x5614aa44a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa449c10 0x5614aa44a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42988/0 (socket says 172.21.15.173:42988) 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.242+0000 7f1beb42f640 1 -- 172.21.15.173:0/4091286471 learned_addr learned my addr 172.21.15.173:0/4091286471 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.243+0000 7f1beb42f640 1 -- 172.21.15.173:0/4091286471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614aa44a600 con 0x5614aa449c10 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.243+0000 7f1beb42f640 1 --2- 172.21.15.173:0/4091286471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa449c10 0x5614aa44a030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc006690 tx=0x7f1bdc05dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5ccb4be4dd12e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.243+0000 7f1aceffd640 1 -- 172.21.15.173:0/4091286471 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc0a8070 con 0x5614aa449c10 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.243+0000 7f1aceffd640 1 -- 172.21.15.173:0/4091286471 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc08c3e0 con 0x5614aa449c10 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.243+0000 7f1aceffd640 1 -- 172.21.15.173:0/4091286471 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc09d040 con 0x5614aa449c10 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 -- 172.21.15.173:0/4091286471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa449c10 msgr2=0x5614aa44a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 --2- 172.21.15.173:0/4091286471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa449c10 0x5614aa44a030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc006690 tx=0x7f1bdc05dee0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 -- 172.21.15.173:0/4091286471 shutdown_connections 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 --2- 172.21.15.173:0/4091286471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa449c10 0x5614aa44a030 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 -- 172.21.15.173:0/4091286471 >> 172.21.15.173:0/4091286471 conn(0x5614aa445f70 msgr2=0x5614aa443fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 -- 172.21.15.173:0/4091286471 shutdown_connections 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 -- 172.21.15.173:0/4091286471 wait complete. 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 Processor -- start 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 -- start start 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa451230 0x5614aa451650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1bef731800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5614aa44acb0 con 0x5614aa451230 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.244+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa451230 0x5614aa451650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1beb42f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa451230 0x5614aa451650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:42994/0 (socket says 172.21.15.173:42994) 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 learned_addr learned my addr 172.21.15.173:0/3168305879 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614aa451b90 con 0x5614aa451230 2024-05-15T18:08:55.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa451230 0x5614aa451650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0a6040 tx=0x7f1bdc095f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1acd7fa640 1 -- 172.21.15.173:0/3168305879 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc0b1020 con 0x5614aa451230 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1acd7fa640 1 -- 172.21.15.173:0/3168305879 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc078d60 con 0x5614aa451230 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614aa451b90 con 0x5614aa451230 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.245+0000 7f1acd7fa640 1 -- 172.21.15.173:0/3168305879 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bdc0a8040 con 0x5614aa451230 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.246+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614aa451b90 con 0x5614aa451230 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.246+0000 7f1acd7fa640 1 -- 172.21.15.173:0/3168305879 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bdc0b4020 con 0x5614aa451230 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.247+0000 7f1acd7fa640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ab4036880 0x7f1ab4038d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.247+0000 7f1acd7fa640 1 -- 172.21.15.173:0/3168305879 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f1bdc0b7ab0 con 0x5614aa451230 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.247+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ab4036880 0x7f1ab4038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.247+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ab4036880 0x7f1ab4038d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5614aa426160 tx=0x7f1bd4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa45cdc0 0x5614aa45f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa45f9d0 con 0x5614aa45cdc0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bebc30640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa45cdc0 0x5614aa45f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bebc30640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa45cdc0 0x5614aa45f280 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 20 realm 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa45fde0 con 0x5614aa45cdc0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.248+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4606b0 con 0x5614aa45cdc0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa4617b0 0x5614aa463ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4641b0 con 0x5614aa4617b0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa4617b0 0x5614aa463ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa4617b0 0x5614aa463ba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.249+0000 7f1bef731800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.250+0000 7f1bef731800 20 searching for the correct realm 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.250+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa465ae0 con 0x5614aa4617b0 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.250+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.250+0000 7f1beb42f640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1bdc0b6020 0x7f1bdc0611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.250+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa465ae0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.250+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1bdc0b6020 0x7f1bdc0611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.250+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1bdc0b6020 0x7f1bdc0611b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.251+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.251+0000 7f1be3fff640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1bd4037040 0x7f1bd4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.251+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa465ae0 con 0x7f1bd4037040 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.251+0000 7f1bebc30640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1bd4037040 0x7f1bd4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.251+0000 7f1bebc30640 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1bd4037040 0x7f1bd4036410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1be400a4a0 con 0x7f1bd4037040 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x7f1bd4037040 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.252+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.253+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x7f1bd4037040 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.253+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bdc0b6020 2024-05-15T18:08:55.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.253+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.253+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.253+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.253+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x7f1bd4037040 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bdc0b6020 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.254+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x7f1bd4037040 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.255+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1be400a4a0 con 0x5614aa45cdc0 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be4033040 con 0x7f1bd4037040 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.256+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bdc0b6020 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.257+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bdc0b6020 2024-05-15T18:08:55.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa4617b0 2024-05-15T18:08:55.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.258+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bd4037040 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x5614aa45cdc0 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5614aa460a50 con 0x7f1bdc0b6020 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:55.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa464a70 con 0x5614aa45cdc0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.259+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa464e60 con 0x5614aa45cdc0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa464e60 con 0x7f1bd4037040 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:55.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 zone default found 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 4 Realm: () 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 zonegroup default 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa464610 con 0x7f1bd4037040 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.260+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa464640 con 0x5614aa4617b0 2024-05-15T18:08:55.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa467a30 con 0x5614aa4617b0 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1bef731800 20 started sync module instance, tier type = 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1bef731800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.261+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa466de0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.262+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.262+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94646756078032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa466a40 con 0x7f1bdc0b6020 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.262+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa468960 con 0x5614aa45cdc0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.263+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.264+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94646756083376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa469200 con 0x5614aa45cdc0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.264+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa469cb0 con 0x5614aa4617b0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.265+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94646756078032] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.268+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94646756083376] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.268+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.268+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94646756081296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa469200 con 0x5614aa4617b0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.268+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46a5d0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.271+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94646756081296] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.271+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.271+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94646756085072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa469170 con 0x7f1bdc0b6020 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.271+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46b490 con 0x5614aa45cdc0 2024-05-15T18:08:55.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.273+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.273+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94646756094432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46bd30 con 0x5614aa45cdc0 2024-05-15T18:08:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.273+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46c7a0 con 0x7f1bd4037040 2024-05-15T18:08:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.276+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94646756085072] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.276+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.276+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94646756098672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46c760 con 0x7f1bd4037040 2024-05-15T18:08:55.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.276+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46d1b0 con 0x7f1bd4037040 2024-05-15T18:08:55.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.279+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94646756094432] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.279+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.279+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94646756096128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46d1b0 con 0x7f1bd4037040 2024-05-15T18:08:55.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.279+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46db70 con 0x7f1bd4037040 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94646756098672] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94646756092352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46db70 con 0x7f1bd4037040 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bef731800 20 add_watcher() i=0 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bef731800 20 add_watcher() i=1 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bef731800 20 add_watcher() i=2 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bef731800 20 add_watcher() i=3 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bef731800 20 add_watcher() i=4 2024-05-15T18:08:55.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.282+0000 7f1bef731800 20 add_watcher() i=5 2024-05-15T18:08:55.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94646756092352] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94646756096128] v29'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bef731800 20 add_watcher() i=6 2024-05-15T18:08:55.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bef731800 20 add_watcher() i=7 2024-05-15T18:08:55.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bef731800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:55.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46db70 con 0x5614aa45cdc0 2024-05-15T18:08:55.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.285+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94646756103872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46db20 con 0x5614aa45cdc0 2024-05-15T18:08:55.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.287+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94646756103872] v29'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.287+0000 7f1aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.287+0000 7f1bef731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:55.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.287+0000 7f1bef731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:55.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.288+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa479360 con 0x5614aa45cdc0 2024-05-15T18:08:55.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.289+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.289+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa479a30 con 0x7f1bd4037040 2024-05-15T18:08:55.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.290+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.290+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa479e50 con 0x5614aa4617b0 2024-05-15T18:08:55.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.291+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.291+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa479dc0 con 0x5614aa45cdc0 2024-05-15T18:08:55.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.292+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.292+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa47a470 con 0x7f1bdc0b6020 2024-05-15T18:08:55.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.295+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.295+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa47ae90 con 0x5614aa4617b0 2024-05-15T18:08:55.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.296+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.296+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa47ae90 con 0x5614aa45cdc0 2024-05-15T18:08:55.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.297+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.297+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa47ae90 con 0x7f1bd4037040 2024-05-15T18:08:55.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.299+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.299+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa47b270 con 0x7f1bdc0b6020 2024-05-15T18:08:55.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.300+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.300+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa47b720 con 0x5614aa4617b0 2024-05-15T18:08:55.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.303+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.303+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa47b720 con 0x7f1bdc0b6020 2024-05-15T18:08:55.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.304+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.304+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4771a0 con 0x7f1bd4037040 2024-05-15T18:08:55.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.305+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.305+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4771a0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.306+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.306+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4771a0 con 0x7f1bd4037040 2024-05-15T18:08:55.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.307+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.307+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa45cdc0 2024-05-15T18:08:55.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.309+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.309+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.310+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.310+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.311+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.311+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.312+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.312+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa45cdc0 2024-05-15T18:08:55.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.313+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.313+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa45cdc0 2024-05-15T18:08:55.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.315+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.316+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.318+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.318+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.319+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.319+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.320+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.320+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.321+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.321+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.322+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.322+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.323+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.323+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x7f1bd4037040 2024-05-15T18:08:55.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.324+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.302 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.324+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.325+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.325+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x7f1bd4037040 2024-05-15T18:08:55.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.326+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.326+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x5614aa4617b0 2024-05-15T18:08:55.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.328+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.328+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x7f1bd4037040 2024-05-15T18:08:55.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.329+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.329+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa476fd0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.330+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.330+0000 7f1aa0fe1640 20 reqs_thread_entry: start 2024-05-15T18:08:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 20 Filter name: none 2024-05-15T18:08:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1a1a7fc640 20 reqs_thread_entry: start 2024-05-15T18:08:55.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:08:55.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4a6a20 con 0x7f1bd4037040 2024-05-15T18:08:55.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-15T18:08:55.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.331+0000 7f1bef731800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:08:55.310 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-05-15T18:08:55.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.332+0000 7f1aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.332+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94646756103872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa4a5150 con 0x5614aa45cdc0 2024-05-15T18:08:55.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.333+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94646756103872] v29'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.333+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94646756078032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46d6c0 con 0x7f1bdc0b6020 2024-05-15T18:08:55.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.334+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94646756078032] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.334+0000 7f1bef731800 20 remove_watcher() i=0 2024-05-15T18:08:55.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.334+0000 7f1bef731800 2 removed watcher, disabling cache 2024-05-15T18:08:55.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.334+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94646756083376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46d6c0 con 0x5614aa45cdc0 2024-05-15T18:08:55.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.336+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94646756083376] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.336+0000 7f1bef731800 20 remove_watcher() i=1 2024-05-15T18:08:55.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.336+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94646756081296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46d6c0 con 0x5614aa4617b0 2024-05-15T18:08:55.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.337+0000 7f1beb42f640 1 -- 172.21.15.173:0/3168305879 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94646756081296] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bdc0ab040 con 0x5614aa4617b0 2024-05-15T18:08:55.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.337+0000 7f1bef731800 20 remove_watcher() i=2 2024-05-15T18:08:55.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.337+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94646756085072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa467e90 con 0x7f1bdc0b6020 2024-05-15T18:08:55.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.338+0000 7f1be3fff640 1 -- 172.21.15.173:0/3168305879 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94646756085072] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bd4009050 con 0x7f1bdc0b6020 2024-05-15T18:08:55.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.338+0000 7f1bef731800 20 remove_watcher() i=3 2024-05-15T18:08:55.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.338+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94646756094432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46d6c0 con 0x5614aa45cdc0 2024-05-15T18:08:55.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.339+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94646756094432] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x5614aa45cdc0 2024-05-15T18:08:55.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.339+0000 7f1bef731800 20 remove_watcher() i=4 2024-05-15T18:08:55.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.339+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94646756098672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa468d50 con 0x7f1bd4037040 2024-05-15T18:08:55.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.340+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94646756098672] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.340+0000 7f1bef731800 20 remove_watcher() i=5 2024-05-15T18:08:55.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.340+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94646756096128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa467e90 con 0x7f1bd4037040 2024-05-15T18:08:55.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.341+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94646756096128] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.341+0000 7f1bef731800 20 remove_watcher() i=6 2024-05-15T18:08:55.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.341+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94646756092352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5614aa46b1e0 con 0x7f1bd4037040 2024-05-15T18:08:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94646756092352] v29'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be4031040 con 0x7f1bd4037040 2024-05-15T18:08:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 20 remove_watcher() i=7 2024-05-15T18:08:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1bd4037040 msgr2=0x7f1bd4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1bd4037040 0x7f1bd4036410 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa45cdc0 msgr2=0x5614aa45f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa45cdc0 0x5614aa45f280 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1bdc0b6020 msgr2=0x7f1bdc0611b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f1bdc0b6020 0x7f1bdc0611b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa4617b0 msgr2=0x5614aa463ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa4617b0 0x5614aa463ba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ab4036880 msgr2=0x7f1ab4038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ab4036880 0x7f1ab4038d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5614aa426160 tx=0x7f1bd4010000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa451230 msgr2=0x5614aa451650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bef731800 1 --2- 172.21.15.173:0/3168305879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa451230 0x5614aa451650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0a6040 tx=0x7f1bdc095f80 comp rx=0 tx=0).stop 2024-05-15T18:08:55.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 reap_dead start 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.342+0000 7f1bebc30640 1 -- 172.21.15.173:0/3168305879 reap_dead start 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 shutdown_connections 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 >> 172.21.15.173:0/3168305879 conn(0x5614aa445f70 msgr2=0x5614aa4435d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 shutdown_connections 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3168305879 wait complete. 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ac4036950 msgr2=0x7f1ac4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ac4036950 0x7f1ac4038e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bd400bf90 tx=0x7f1bd400f000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa43cb20 msgr2=0x5614aa43cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa43cb20 0x5614aa43cf40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc077c10 tx=0x7f1bdc066ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 shutdown_connections 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ac4036950 0x7f1ac4038e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/1815494831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa43cb20 0x5614aa43cf40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 >> 172.21.15.173:0/1815494831 conn(0x5614aa430bc0 msgr2=0x5614aa430fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 shutdown_connections 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/1815494831 wait complete. 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5614aa42baf0 msgr2=0x5614aa42df60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5614aa42baf0 0x5614aa42df60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa3235e0 msgr2=0x5614aa425340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5614aa3235e0 0x5614aa425340 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa427bb0 msgr2=0x5614aa429fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5614aa427bb0 0x5614aa429fa0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ad0036950 msgr2=0x7f1ad0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1ad0036950 0x7f1ad0038e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4000f60 tx=0x7f1bd40010a0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 msgr2=0x5614aa41e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bef731800 1 --2- 172.21.15.173:0/3505794311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5614aa3222a0 0x5614aa41e100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc000c00 tx=0x7f1bdc003020 comp rx=0 tx=0).stop 2024-05-15T18:08:55.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.343+0000 7f1bebc30640 1 -- 172.21.15.173:0/3505794311 reap_dead start 2024-05-15T18:08:55.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.344+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 shutdown_connections 2024-05-15T18:08:55.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.344+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 >> 172.21.15.173:0/3505794311 conn(0x5614aa31cd30 msgr2=0x5614aa40c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.344+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 shutdown_connections 2024-05-15T18:08:55.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.344+0000 7f1bef731800 1 -- 172.21.15.173:0/3505794311 wait complete. 2024-05-15T18:08:55.330 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-15T18:08:55.330 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-15T18:08:55.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-15T18:08:55.331 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-15T18:08:55.375 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:55.375 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d6923800 1 Processor -- start 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d6923800 1 -- start start 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d6923800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559d49557620 0x559d49559a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d6923800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d49559f50 con 0x559d495513b0 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d6923800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x559d493e4050 con 0x559d49557620 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d1e58640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559d49557620 0x559d49559a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d2659640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x559d495513b0 0x559d495517d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35138/0 (socket says 172.21.15.173:35138) 2024-05-15T18:08:55.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.398+0000 7f61d2659640 1 -- 172.21.15.173:0/2363933060 learned_addr learned my addr 172.21.15.173:0/2363933060 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:55.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.399+0000 7f61d1e58640 1 -- 172.21.15.173:0/2363933060 >> v1:172.21.15.3:6789/0 conn(0x559d495513b0 legacy=0x559d495517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.399+0000 7f61d1e58640 1 -- 172.21.15.173:0/2363933060 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4955b160 con 0x559d49557620 2024-05-15T18:08:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.400+0000 7f61d1e58640 1 --2- 172.21.15.173:0/2363933060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49557620 0x559d49559a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61c800a470 tx=0x7f61c801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749f821dd5b2b68b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d1657640 1 -- 172.21.15.173:0/2363933060 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c8057070 con 0x559d49557620 2024-05-15T18:08:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d1657640 1 -- 172.21.15.173:0/2363933060 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c8052570 con 0x559d49557620 2024-05-15T18:08:55.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d1657640 1 -- 172.21.15.173:0/2363933060 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c8052870 con 0x559d49557620 2024-05-15T18:08:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d6923800 1 -- 172.21.15.173:0/2363933060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49557620 msgr2=0x559d49559a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d6923800 1 --2- 172.21.15.173:0/2363933060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49557620 0x559d49559a10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f61c800a470 tx=0x7f61c801ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d6923800 1 -- 172.21.15.173:0/2363933060 shutdown_connections 2024-05-15T18:08:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d6923800 1 --2- 172.21.15.173:0/2363933060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49557620 0x559d49559a10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d6923800 1 -- 172.21.15.173:0/2363933060 >> 172.21.15.173:0/2363933060 conn(0x559d4954cd30 msgr2=0x559d4954f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d6923800 1 -- 172.21.15.173:0/2363933060 shutdown_connections 2024-05-15T18:08:55.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.401+0000 7f61d6923800 1 -- 172.21.15.173:0/2363933060 wait complete. 2024-05-15T18:08:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d6923800 1 Processor -- start 2024-05-15T18:08:55.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d6923800 1 -- start start 2024-05-15T18:08:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d6923800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d496446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d6923800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559d4949e1d0 con 0x559d495513b0 2024-05-15T18:08:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d496446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d496446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43012/0 (socket says 172.21.15.173:43012) 2024-05-15T18:08:55.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d2659640 1 -- 172.21.15.173:0/2393823612 learned_addr learned my addr 172.21.15.173:0/2393823612 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d2659640 1 -- 172.21.15.173:0/2393823612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d49644c90 con 0x559d495513b0 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.415+0000 7f61d2659640 1 --2- 172.21.15.173:0/2393823612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d496446c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61c4001e10 tx=0x7f61c400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c7b4eabd525b2d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f60c0608640 1 -- 172.21.15.173:0/2393823612 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c4012020 con 0x559d495513b0 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f60c0608640 1 -- 172.21.15.173:0/2393823612 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c400e5a0 con 0x559d495513b0 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f60c0608640 1 -- 172.21.15.173:0/2393823612 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c400e8e0 con 0x559d495513b0 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f61d6923800 1 -- 172.21.15.173:0/2393823612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 msgr2=0x559d496446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f61d6923800 1 --2- 172.21.15.173:0/2393823612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d496446c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61c4001e10 tx=0x7f61c400b780 comp rx=0 tx=0).stop 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f61d6923800 1 -- 172.21.15.173:0/2393823612 shutdown_connections 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f61d6923800 1 --2- 172.21.15.173:0/2393823612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d496446c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f61d6923800 1 -- 172.21.15.173:0/2393823612 >> 172.21.15.173:0/2393823612 conn(0x559d4954cd30 msgr2=0x559d4963ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f61d6923800 1 -- 172.21.15.173:0/2393823612 shutdown_connections 2024-05-15T18:08:55.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.416+0000 7f61d6923800 1 -- 172.21.15.173:0/2393823612 wait complete. 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d6923800 1 Processor -- start 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d6923800 1 -- start start 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d6923800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d4964c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d6923800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559d4955a420 con 0x559d495513b0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d4964c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d4964c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43024/0 (socket says 172.21.15.173:43024) 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d2659640 1 -- 172.21.15.173:0/2291977058 learned_addr learned my addr 172.21.15.173:0/2291977058 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.417+0000 7f61d2659640 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4964c7d0 con 0x559d495513b0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.418+0000 7f61d2659640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d4964c290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61c400b7c0 tx=0x7f61c4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.418+0000 7f60bee05640 1 -- 172.21.15.173:0/2291977058 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c4012030 con 0x559d495513b0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.418+0000 7f60bee05640 1 -- 172.21.15.173:0/2291977058 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c4001470 con 0x559d495513b0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.418+0000 7f60bee05640 1 -- 172.21.15.173:0/2291977058 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c401a8d0 con 0x559d495513b0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.418+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d4964ca60 con 0x559d495513b0 2024-05-15T18:08:55.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.418+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d4964f710 con 0x559d495513b0 2024-05-15T18:08:55.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f60bee05640 1 -- 172.21.15.173:0/2291977058 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f61c4015020 con 0x559d495513b0 2024-05-15T18:08:55.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f60bee05640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60b8036900 0x7f60b8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f60bee05640 1 -- 172.21.15.173:0/2291977058 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f61c4020030 con 0x559d495513b0 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f61d1e58640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60b8036900 0x7f60b8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d49557620 0x559d496534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d49653aa0 con 0x559d49557620 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f61d2e5a640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d49557620 0x559d496534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f61d1e58640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60b8036900 0x7f60b8038dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61c8054000 tx=0x7f61c804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.419+0000 7f61d2e5a640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d49557620 0x559d496534d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.420+0000 7f61d2e5a640 1 -- 172.21.15.173:0/2291977058 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d49557620 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.420+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d49650aa0 con 0x559d49557620 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.420+0000 7f61d2e5a640 1 -- 172.21.15.173:0/2291977058 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d49557620 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.420+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d49655db0 0x559d496581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.420+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d49658840 con 0x559d49655db0 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.420+0000 7f61d2659640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d49655db0 0x559d496581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.420+0000 7f61d2659640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d49655db0 0x559d496581a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.421+0000 7f61d2659640 1 -- 172.21.15.173:0/2291977058 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d49655db0 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.421+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d49654d60 con 0x559d49557620 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.421+0000 7f61d2e5a640 1 -- 172.21.15.173:0/2291977058 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d49557620 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.421+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x559d49659cf0 0x559d4965c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.421+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d4965c8a0 con 0x559d49659cf0 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.421+0000 7f61d1e58640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x559d49659cf0 0x559d4965c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.422+0000 7f61d1e58640 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x559d49659cf0 0x559d4965c140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.422+0000 7f61d1e58640 1 -- 172.21.15.173:0/2291977058 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61c805a040 con 0x559d49659cf0 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.422+0000 7f61d6923800 1 Processor -- start 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.422+0000 7f61d6923800 1 -- start start 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.422+0000 7f61d6923800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d4966ac90 0x559d4966b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.422+0000 7f61d6923800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559d49444cf0 con 0x559d4966ac90 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d4966ac90 0x559d4966b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d4966ac90 0x559d4966b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43038/0 (socket says 172.21.15.173:43038) 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f61d2659640 1 -- 172.21.15.173:0/1986171474 learned_addr learned my addr 172.21.15.173:0/1986171474 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f61d2659640 1 -- 172.21.15.173:0/1986171474 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4966b5f0 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f61d2659640 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d4966ac90 0x559d4966b0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61c404ad60 tx=0x7f61c400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f60b7fff640 1 -- 172.21.15.173:0/1986171474 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c40185b0 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f60b7fff640 1 -- 172.21.15.173:0/1986171474 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c4017c50 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f60b7fff640 1 -- 172.21.15.173:0/1986171474 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c401ac50 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d4966c060 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.423+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d4966c560 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.424+0000 7f60b7fff640 1 -- 172.21.15.173:0/1986171474 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f61c4044490 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.424+0000 7f60b7fff640 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60ac036950 0x7f60ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.424+0000 7f60b7fff640 1 -- 172.21.15.173:0/1986171474 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f61c4036050 con 0x559d4966ac90 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.424+0000 7f61d1e58640 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60ac036950 0x7f60ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d6923800 1 Processor -- start 2024-05-15T18:08:55.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d6923800 1 -- start start 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d1e58640 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60ac036950 0x7f60ac038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x559d496509c0 tx=0x7f61c8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d6923800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d49678180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d6923800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559d49645010 con 0x559d49677d60 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d49678180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d49678180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43044/0 (socket says 172.21.15.173:43044) 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d2659640 1 -- 172.21.15.173:0/2078505516 learned_addr learned my addr 172.21.15.173:0/2078505516 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d2659640 1 -- 172.21.15.173:0/2078505516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d49678750 con 0x559d49677d60 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.425+0000 7f61d2659640 1 --2- 172.21.15.173:0/2078505516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d49678180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f61c4016db0 tx=0x7f61c4054000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720cbe2b7d00f84e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f60b5ffb640 1 -- 172.21.15.173:0/2078505516 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c4030b40 con 0x559d49677d60 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f60b5ffb640 1 -- 172.21.15.173:0/2078505516 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c4024420 con 0x559d49677d60 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f60b5ffb640 1 -- 172.21.15.173:0/2078505516 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c4044780 con 0x559d49677d60 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 -- 172.21.15.173:0/2078505516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 msgr2=0x559d49678180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 --2- 172.21.15.173:0/2078505516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d49678180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f61c4016db0 tx=0x7f61c4054000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 -- 172.21.15.173:0/2078505516 shutdown_connections 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 --2- 172.21.15.173:0/2078505516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d49678180 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 -- 172.21.15.173:0/2078505516 >> 172.21.15.173:0/2078505516 conn(0x559d496740c0 msgr2=0x559d49672120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 -- 172.21.15.173:0/2078505516 shutdown_connections 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 -- 172.21.15.173:0/2078505516 wait complete. 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 Processor -- start 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.426+0000 7f61d6923800 1 -- start start 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d6923800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d4967f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d6923800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559d49678e00 con 0x559d49677d60 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d4967f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d2659640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d4967f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43048/0 (socket says 172.21.15.173:43048) 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 learned_addr learned my addr 172.21.15.173:0/1695814691 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4967f6c0 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d2659640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d4967f180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61c4023e10 tx=0x7f61c4050e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f60a3fff640 1 -- 172.21.15.173:0/1695814691 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c406e020 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f60a3fff640 1 -- 172.21.15.173:0/1695814691 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c4023560 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d4967f6c0 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.427+0000 7f60a3fff640 1 -- 172.21.15.173:0/1695814691 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c4023840 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.428+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d4967fb60 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.428+0000 7f60a3fff640 1 -- 172.21.15.173:0/1695814691 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f61c4071020 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.428+0000 7f60a3fff640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f609c0368b0 0x7f609c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.428+0000 7f60a3fff640 1 -- 172.21.15.173:0/1695814691 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f61c405d050 con 0x559d49677d60 2024-05-15T18:08:55.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.429+0000 7f61d1e58640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f609c0368b0 0x7f609c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.429+0000 7f61d1e58640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f609c0368b0 0x7f609c038d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559d4965cca0 tx=0x7f61c804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.429+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.429+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d4968a940 0x559d4968ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.429+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d4968d550 con 0x559d4968a940 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.429+0000 7f61d2e5a640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d4968a940 0x559d4968ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.429+0000 7f61d2e5a640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d4968a940 0x559d4968ce00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 realm 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d4968d960 con 0x559d4968a940 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:55.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e230 con 0x559d4968a940 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x559d4968a940 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d4968f330 0x559d49691720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.430+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d49691d30 con 0x559d4968f330 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d2659640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d4968f330 0x559d49691720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d2659640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d4968f330 0x559d49691720 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d6923800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d6923800 20 searching for the correct realm 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d49693660 con 0x559d4968f330 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.431+0000 7f61d2659640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f61c4073020 0x7f61c4015310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.432+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d49693660 con 0x7f61c4073020 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.432+0000 7f61d1e58640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f61c4073020 0x7f61c4015310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.432+0000 7f61d1e58640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f61c4073020 0x7f61c4015310 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.432+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.432+0000 7f61d1e58640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f61c8074040 0x7f61c8081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.432+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d49693660 con 0x7f61c8074040 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.432+0000 7f61d2e5a640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f61c8074040 0x7f61c8081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.433+0000 7f61d2e5a640 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f61c8074040 0x7f61c8081410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.433+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f61cc00a4a0 con 0x7f61c8074040 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.433+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x559d4968a940 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.433+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.433+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x559d4968a940 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.434+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.434+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x7f61c8074040 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.434+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x7f61c8074040 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.434+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x7f61c8074040 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.434+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x7f61c8074040 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.434+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x7f61c4073020 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x559d4968f330 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x559d4968a940 2024-05-15T18:08:55.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x7f61c8074040 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x7f61c8074040 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x559d4968a940 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.435+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d4968e5d0 con 0x7f61c4073020 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.436+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.436+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968f330 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.436+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.436+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968f330 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.436+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.436+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c8074040 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x7f61c8074040 2024-05-15T18:08:55.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968f330 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968f330 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968a940 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968a940 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f61cc00a4a0 con 0x559d4968a940 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.437+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c8074040 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc033040 con 0x7f61c8074040 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968f330 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v22'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c4073020 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968a940 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.438+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c8074040 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968f330 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c8074040 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c4073020 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.439+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968f330 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.440+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.440+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c8074040 2024-05-15T18:08:55.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.440+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.440+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x559d4968a940 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.440+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.440+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f61c808e060 con 0x7f61c4073020 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d496925f0 con 0x559d4968a940 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d496929e0 con 0x559d4968a940 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.441+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d496929e0 con 0x7f61c8074040 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 zone default found 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 4 Realm: () 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:55.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 zonegroup default 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d49693ae0 con 0x7f61c8074040 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d496954c0 con 0x559d4968f330 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d49695860 con 0x559d4968f330 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 started sync module instance, tier type = 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:55.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.442+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49694960 con 0x7f61c4073020 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.443+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.443+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94134029862064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49695c00 con 0x7f61c4073020 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.444+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49696450 con 0x559d4968a940 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.445+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.445+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94134029869440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49696cf0 con 0x559d4968a940 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.445+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496977c0 con 0x559d4968f330 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.446+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94134029862064] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.446+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94134029869440] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.449+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.449+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94134029864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49696cf0 con 0x559d4968f330 2024-05-15T18:08:55.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.449+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496980c0 con 0x7f61c4073020 2024-05-15T18:08:55.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.450+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.450+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94134029878448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49698d80 con 0x7f61c4073020 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.450+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496997d0 con 0x559d4968a940 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.450+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94134029864320] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.451+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.451+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94134029882048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49699bc0 con 0x559d4968a940 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.451+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969a5e0 con 0x7f61c8074040 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.454+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94134029878448] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.454+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.454+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94134029885648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969a5a0 con 0x7f61c8074040 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.454+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969b020 con 0x7f61c8074040 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.456+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94134029882048] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.457+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94134029885648] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.457+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.457+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94134029879504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969ab70 con 0x7f61c8074040 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.457+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969b8c0 con 0x7f61c8074040 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94134029879504] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94134029871168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969ab70 con 0x7f61c8074040 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 20 add_watcher() i=0 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 20 add_watcher() i=1 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 20 add_watcher() i=2 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 20 add_watcher() i=3 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 20 add_watcher() i=4 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 20 add_watcher() i=5 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.459+0000 7f61d6923800 20 add_watcher() i=6 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.460+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94134029871168] v29'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.460+0000 7f61d6923800 20 add_watcher() i=7 2024-05-15T18:08:55.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.460+0000 7f61d6923800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:55.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.460+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d4969e8f0 con 0x559d4968a940 2024-05-15T18:08:55.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.460+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.460+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94134029890576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969bdf0 con 0x559d4968a940 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.461+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94134029890576] v29'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.461+0000 7f6088fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.461+0000 7f61d6923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.461+0000 7f61d6923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.462+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a7250 con 0x559d4968a940 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.463+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.463+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a78a0 con 0x7f61c8074040 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.464+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.464+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a7d00 con 0x559d4968f330 2024-05-15T18:08:55.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.465+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.465+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a7c20 con 0x559d4968a940 2024-05-15T18:08:55.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.466+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.466+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a8270 con 0x7f61c4073020 2024-05-15T18:08:55.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.467+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.467+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a87e0 con 0x559d4968f330 2024-05-15T18:08:55.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.468+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.468+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a8810 con 0x559d4968a940 2024-05-15T18:08:55.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.469+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.469+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a8cc0 con 0x7f61c8074040 2024-05-15T18:08:55.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.470+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.470+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a8cc0 con 0x7f61c4073020 2024-05-15T18:08:55.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.471+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.471+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a92b0 con 0x559d4968f330 2024-05-15T18:08:55.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.472+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.472+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a92b0 con 0x7f61c4073020 2024-05-15T18:08:55.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.473+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.473+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c8074040 2024-05-15T18:08:55.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.474+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.474+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c4073020 2024-05-15T18:08:55.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.475+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.476+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c8074040 2024-05-15T18:08:55.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.477+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.477+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968a940 2024-05-15T18:08:55.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.478+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.478+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.479+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.479+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c4073020 2024-05-15T18:08:55.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.480+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.480+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.481+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.481+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968a940 2024-05-15T18:08:55.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.482+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.482+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968a940 2024-05-15T18:08:55.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.483+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.483+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.484+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.484+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c4073020 2024-05-15T18:08:55.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.485+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.485+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.486+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.486+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.487+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.487+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.489+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.489+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.490+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.490+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c8074040 2024-05-15T18:08:55.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.491+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.491+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.492+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.492+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c8074040 2024-05-15T18:08:55.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.493+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.493+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x559d4968f330 2024-05-15T18:08:55.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.494+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.494+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c8074040 2024-05-15T18:08:55.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.495+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.495+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a9760 con 0x7f61c4073020 2024-05-15T18:08:55.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f60037fe640 20 reqs_thread_entry: start 2024-05-15T18:08:55.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f61d6923800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:55.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f61d6923800 20 Filter name: none 2024-05-15T18:08:55.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f60017fa640 20 reqs_thread_entry: start 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f61d6923800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f61d6923800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d496d4660 con 0x559d4968a940 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.497+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.498+0000 7f61d6923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.498+0000 7f61d6923800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.498+0000 7f61d6923800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:55.476 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, user does not exist 2024-05-15T18:08:55.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.498+0000 7f6088fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.498+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94134029890576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496a4da0 con 0x559d4968a940 2024-05-15T18:08:55.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.499+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94134029890576] v29'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.499+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94134029862064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969b410 con 0x7f61c4073020 2024-05-15T18:08:55.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.500+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94134029862064] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.500+0000 7f61d6923800 20 remove_watcher() i=0 2024-05-15T18:08:55.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.500+0000 7f61d6923800 2 removed watcher, disabling cache 2024-05-15T18:08:55.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.500+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94134029869440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969b410 con 0x559d4968a940 2024-05-15T18:08:55.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.502+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94134029869440] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.502+0000 7f61d6923800 20 remove_watcher() i=1 2024-05-15T18:08:55.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.502+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94134029864320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d4969b410 con 0x559d4968f330 2024-05-15T18:08:55.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.503+0000 7f61d2659640 1 -- 172.21.15.173:0/1695814691 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94134029864320] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c402dcf0 con 0x559d4968f330 2024-05-15T18:08:55.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.503+0000 7f61d6923800 20 remove_watcher() i=2 2024-05-15T18:08:55.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.503+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94134029878448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49694d80 con 0x7f61c4073020 2024-05-15T18:08:55.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.504+0000 7f61d1e58640 1 -- 172.21.15.173:0/1695814691 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94134029878448] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61c807f070 con 0x7f61c4073020 2024-05-15T18:08:55.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.504+0000 7f61d6923800 20 remove_watcher() i=3 2024-05-15T18:08:55.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.504+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94134029882048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49694d80 con 0x559d4968a940 2024-05-15T18:08:55.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.505+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94134029882048] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x559d4968a940 2024-05-15T18:08:55.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.505+0000 7f61d6923800 20 remove_watcher() i=4 2024-05-15T18:08:55.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.505+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94134029885648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d496992c0 con 0x7f61c8074040 2024-05-15T18:08:55.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.506+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94134029885648] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.506+0000 7f61d6923800 20 remove_watcher() i=5 2024-05-15T18:08:55.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.506+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94134029879504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49694d80 con 0x7f61c8074040 2024-05-15T18:08:55.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.507+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94134029879504] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.507+0000 7f61d6923800 20 remove_watcher() i=6 2024-05-15T18:08:55.485 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.507+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94134029871168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d49694d80 con 0x7f61c8074040 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94134029871168] v29'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61cc031040 con 0x7f61c8074040 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 20 remove_watcher() i=7 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f61c8074040 msgr2=0x7f61c8081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f61c8074040 0x7f61c8081410 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d4968a940 msgr2=0x559d4968ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d4968a940 0x559d4968ce00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f61c4073020 msgr2=0x7f61c4015310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f61c4073020 0x7f61c4015310 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d4968f330 msgr2=0x559d49691720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d4968f330 0x559d49691720 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f609c0368b0 msgr2=0x7f609c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f609c0368b0 0x7f609c038d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559d4965cca0 tx=0x7f61c804f000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 msgr2=0x559d4967f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d2e5a640 1 -- 172.21.15.173:0/1695814691 reap_dead start 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d4967f180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f61c4023e10 tx=0x7f61c4050e90 comp rx=0 tx=0).stop 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 shutdown_connections 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.508+0000 7f61d6923800 1 --2- 172.21.15.173:0/1695814691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d49677d60 0x559d4967f180 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 >> 172.21.15.173:0/1695814691 conn(0x559d496740c0 msgr2=0x559d49671720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 shutdown_connections 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1695814691 wait complete. 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60ac036950 msgr2=0x7f60ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60ac036950 0x7f60ac038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x559d496509c0 tx=0x7f61c8005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:55.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d4966ac90 msgr2=0x559d4966b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d4966ac90 0x559d4966b0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61c404ad60 tx=0x7f61c400db20 comp rx=0 tx=0).stop 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 shutdown_connections 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60ac036950 0x7f60ac038e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/1986171474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d4966ac90 0x559d4966b0b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 >> 172.21.15.173:0/1986171474 conn(0x559d4965ed30 msgr2=0x559d4965f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 shutdown_connections 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/1986171474 wait complete. 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x559d49659cf0 msgr2=0x559d4965c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x559d49659cf0 0x559d4965c140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d49557620 msgr2=0x559d496534d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559d49557620 0x559d496534d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d49655db0 msgr2=0x559d496581a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559d49655db0 0x559d496581a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60b8036900 msgr2=0x7f60b8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f60b8036900 0x7f60b8038dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f61c8054000 tx=0x7f61c804e000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 msgr2=0x559d4964c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d6923800 1 --2- 172.21.15.173:0/2291977058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559d495513b0 0x559d4964c290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61c400b7c0 tx=0x7f61c4000ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.509+0000 7f61d2e5a640 1 -- 172.21.15.173:0/2291977058 reap_dead start 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.510+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 shutdown_connections 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.510+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 >> 172.21.15.173:0/2291977058 conn(0x559d4954cd30 msgr2=0x559d4963e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.510+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 shutdown_connections 2024-05-15T18:08:55.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.510+0000 7f61d6923800 1 -- 172.21.15.173:0/2291977058 wait complete. 2024-05-15T18:08:55.495 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-15T18:08:55.496 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-15T18:08:55.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-15T18:08:55.496 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-15T18:08:55.542 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:55.542 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc48a90c800 1 Processor -- start 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc48a90c800 1 -- start start 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc48a90c800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55f69bfe57a0 0x55f69bfe7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc48a90c800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f69bfe80d0 con 0x55f69bfe1c90 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc48a90c800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55f69be72050 con 0x55f69bfe57a0 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc47fc11640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55f69bfe57a0 0x55f69bfe7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc488412640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55f69bfe1c90 0x55f69bfe4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35144/0 (socket says 172.21.15.173:35144) 2024-05-15T18:08:55.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc488412640 1 -- 172.21.15.173:0/2113290761 learned_addr learned my addr 172.21.15.173:0/2113290761 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:55.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc47fc11640 1 -- 172.21.15.173:0/2113290761 >> v1:172.21.15.3:6789/0 conn(0x55f69bfe1c90 legacy=0x55f69bfe4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.566+0000 7fc47fc11640 1 -- 172.21.15.173:0/2113290761 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69bfe92b0 con 0x55f69bfe57a0 2024-05-15T18:08:55.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc47fc11640 1 --2- 172.21.15.173:0/2113290761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe57a0 0x55f69bfe7b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc47000a470 tx=0x7fc47001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853a6815e6276aea server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc487c11640 1 -- 172.21.15.173:0/2113290761 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc470057070 con 0x55f69bfe57a0 2024-05-15T18:08:55.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc487c11640 1 -- 172.21.15.173:0/2113290761 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc470052570 con 0x55f69bfe57a0 2024-05-15T18:08:55.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc487c11640 1 -- 172.21.15.173:0/2113290761 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc470052870 con 0x55f69bfe57a0 2024-05-15T18:08:55.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc48a90c800 1 -- 172.21.15.173:0/2113290761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe57a0 msgr2=0x55f69bfe7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2113290761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe57a0 0x55f69bfe7b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc47000a470 tx=0x7fc47001ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:55.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc48a90c800 1 -- 172.21.15.173:0/2113290761 shutdown_connections 2024-05-15T18:08:55.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2113290761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe57a0 0x55f69bfe7b90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc48a90c800 1 -- 172.21.15.173:0/2113290761 >> 172.21.15.173:0/2113290761 conn(0x55f69bfdb640 msgr2=0x55f69bfdda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc48a90c800 1 -- 172.21.15.173:0/2113290761 shutdown_connections 2024-05-15T18:08:55.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.568+0000 7fc48a90c800 1 -- 172.21.15.173:0/2113290761 wait complete. 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.582+0000 7fc48a90c800 1 Processor -- start 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.582+0000 7fc48a90c800 1 -- start start 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.582+0000 7fc48a90c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.582+0000 7fc48a90c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f69bf2c1f0 con 0x55f69bfe1c90 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc488412640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc488412640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0d2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43076/0 (socket says 172.21.15.173:43076) 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc488412640 1 -- 172.21.15.173:0/2245265922 learned_addr learned my addr 172.21.15.173:0/2245265922 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc488412640 1 -- 172.21.15.173:0/2245265922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69c0d2d40 con 0x55f69bfe1c90 2024-05-15T18:08:55.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc488412640 1 --2- 172.21.15.173:0/2245265922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0d2770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc478001d50 tx=0x7fc47800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b05eef4b9008a52 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc37660c640 1 -- 172.21.15.173:0/2245265922 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc478013030 con 0x55f69bfe1c90 2024-05-15T18:08:55.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc37660c640 1 -- 172.21.15.173:0/2245265922 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47800e470 con 0x55f69bfe1c90 2024-05-15T18:08:55.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.583+0000 7fc37660c640 1 -- 172.21.15.173:0/2245265922 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc47800e810 con 0x55f69bfe1c90 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 -- 172.21.15.173:0/2245265922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 msgr2=0x55f69c0d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2245265922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0d2770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc478001d50 tx=0x7fc47800b6c0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 -- 172.21.15.173:0/2245265922 shutdown_connections 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2245265922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0d2770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 -- 172.21.15.173:0/2245265922 >> 172.21.15.173:0/2245265922 conn(0x55f69bfdb640 msgr2=0x55f69c0ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 -- 172.21.15.173:0/2245265922 shutdown_connections 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 -- 172.21.15.173:0/2245265922 wait complete. 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 Processor -- start 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.584+0000 7fc48a90c800 1 -- start start 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc48a90c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0da310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc48a90c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f69bfe85a0 con 0x55f69bfe1c90 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc488412640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0da310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc488412640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0da310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43080/0 (socket says 172.21.15.173:43080) 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc488412640 1 -- 172.21.15.173:0/2350806980 learned_addr learned my addr 172.21.15.173:0/2350806980 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc488412640 1 -- 172.21.15.173:0/2350806980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69c0da850 con 0x55f69bfe1c90 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc488412640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0da310 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc478004000 tx=0x7fc478000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc374e09640 1 -- 172.21.15.173:0/2350806980 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc478027070 con 0x55f69bfe1c90 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc374e09640 1 -- 172.21.15.173:0/2350806980 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4780013d0 con 0x55f69bfe1c90 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f69c0daae0 con 0x55f69bfe1c90 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.585+0000 7fc374e09640 1 -- 172.21.15.173:0/2350806980 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc478019ac0 con 0x55f69bfe1c90 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.586+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f69c0dd790 con 0x55f69bfe1c90 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.586+0000 7fc48a90c800 1 Processor -- start 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.586+0000 7fc48a90c800 1 -- start start 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.586+0000 7fc48a90c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.586+0000 7fc48a90c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f69bed2cf0 con 0x55f69c0e7bc0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.586+0000 7fc374e09640 1 -- 172.21.15.173:0/2350806980 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc47802a070 con 0x55f69bfe1c90 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc488c13640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc488c13640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0e7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43094/0 (socket says 172.21.15.173:43094) 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc488c13640 1 -- 172.21.15.173:0/2067508194 learned_addr learned my addr 172.21.15.173:0/2067508194 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc374e09640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc370036900 0x7fc370038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc374e09640 1 -- 172.21.15.173:0/2350806980 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc47801f070 con 0x55f69bfe1c90 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc488412640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc370036900 0x7fc370038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc488c13640 1 -- 172.21.15.173:0/2067508194 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69c0e8520 con 0x55f69c0e7bc0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc488c13640 1 --2- 172.21.15.173:0/2067508194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0e7fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc48000a430 tx=0x7fc48000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef8d18e4728e01d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc488412640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc370036900 0x7fc370038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc47802ae80 tx=0x7fc478017f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc36e7fc640 1 -- 172.21.15.173:0/2067508194 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc480015070 con 0x55f69c0e7bc0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc36e7fc640 1 -- 172.21.15.173:0/2067508194 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc480001670 con 0x55f69c0e7bc0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.587+0000 7fc36e7fc640 1 -- 172.21.15.173:0/2067508194 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc480001990 con 0x55f69c0e7bc0 2024-05-15T18:08:55.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 -- 172.21.15.173:0/2067508194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 msgr2=0x55f69c0e7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2067508194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0e7fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc48000a430 tx=0x7fc48000a8f0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 -- 172.21.15.173:0/2067508194 shutdown_connections 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2067508194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0e7fe0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 -- 172.21.15.173:0/2067508194 >> 172.21.15.173:0/2067508194 conn(0x55f69bfe57a0 msgr2=0x55f69c0e4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 -- 172.21.15.173:0/2067508194 shutdown_connections 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 -- 172.21.15.173:0/2067508194 wait complete. 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 Processor -- start 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 -- start start 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0ef150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc48a90c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f69c0e8eb0 con 0x55f69c0e7bc0 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc488c13640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc488c13640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0ef150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43110/0 (socket says 172.21.15.173:43110) 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.588+0000 7fc488c13640 1 -- 172.21.15.173:0/2975686263 learned_addr learned my addr 172.21.15.173:0/2975686263 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.589+0000 7fc488c13640 1 -- 172.21.15.173:0/2975686263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69c0ef690 con 0x55f69c0e7bc0 2024-05-15T18:08:55.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.589+0000 7fc488c13640 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0ef150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc48000a930 tx=0x7fc480003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.589+0000 7fc36cff9640 1 -- 172.21.15.173:0/2975686263 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc480020020 con 0x55f69c0e7bc0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.589+0000 7fc36cff9640 1 -- 172.21.15.173:0/2975686263 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4800108b0 con 0x55f69c0e7bc0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.589+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f69c0ef920 con 0x55f69c0e7bc0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.589+0000 7fc36cff9640 1 -- 172.21.15.173:0/2975686263 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc480015040 con 0x55f69c0e7bc0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.589+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f69c0f25d0 con 0x55f69c0e7bc0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.590+0000 7fc36cff9640 1 -- 172.21.15.173:0/2975686263 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc480023020 con 0x55f69c0e7bc0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.590+0000 7fc36cff9640 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc360036950 0x7fc360038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.590+0000 7fc36cff9640 1 -- 172.21.15.173:0/2975686263 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc48004bd90 con 0x55f69c0e7bc0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.590+0000 7fc47fc11640 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc360036950 0x7fc360038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc48a90c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc48a90c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc48a90c800 1 Processor -- start 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc47fc11640 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc360036950 0x7fc360038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc470054000 tx=0x7fc47004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc48a90c800 1 -- start start 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc48a90c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c10ba10 0x55f69c10be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc48a90c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f69c0d30c0 con 0x55f69c10ba10 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc488412640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c10ba10 0x55f69c10be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc488412640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c10ba10 0x55f69c10be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43122/0 (socket says 172.21.15.173:43122) 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.591+0000 7fc488412640 1 -- 172.21.15.173:0/2659945006 learned_addr learned my addr 172.21.15.173:0/2659945006 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.592+0000 7fc488412640 1 -- 172.21.15.173:0/2659945006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f69c10c370 con 0x55f69c10ba10 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.592+0000 7fc488412640 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c10ba10 0x55f69c10be30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc478019640 tx=0x7fc478017c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.592+0000 7fc34cfe1640 1 -- 172.21.15.173:0/2659945006 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc47803c070 con 0x55f69c10ba10 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.592+0000 7fc34cfe1640 1 -- 172.21.15.173:0/2659945006 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47803d040 con 0x55f69c10ba10 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.592+0000 7fc34cfe1640 1 -- 172.21.15.173:0/2659945006 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc47802b800 con 0x55f69c10ba10 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.592+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f69c10cde0 con 0x55f69c10ba10 2024-05-15T18:08:55.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.592+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f69c10d2e0 con 0x55f69c10ba10 2024-05-15T18:08:55.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc34cfe1640 1 -- 172.21.15.173:0/2659945006 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc478016070 con 0x55f69c10ba10 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc34cfe1640 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc2c8036900 0x7fc2c8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc34cfe1640 1 -- 172.21.15.173:0/2659945006 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc478014070 con 0x55f69c10ba10 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc47fc11640 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc2c8036900 0x7fc2c8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc3067fc640 20 reqs_thread_entry: start 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc47fc11640 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc2c8036900 0x7fc2c8038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc470055040 tx=0x7fc470005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f69c1194d0 0x55f69c11b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.593+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f69c11bff0 con 0x55f69c1194d0 2024-05-15T18:08:55.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.594+0000 7fc488c13640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f69c1194d0 0x55f69c11b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.594+0000 7fc488c13640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f69c1194d0 0x55f69c11b920 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.594+0000 7fc488c13640 1 -- 172.21.15.173:0/2350806980 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc480010d70 con 0x55f69c1194d0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.594+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f69c11ddc0 0x55f69c1201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.594+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:2 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f69c1208a0 con 0x55f69c11ddc0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.594+0000 7fc488412640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f69c11ddc0 0x55f69c1201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.595+0000 7fc488412640 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f69c11ddc0 0x55f69c1201b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.595+0000 7fc488412640 1 -- 172.21.15.173:0/2350806980 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(2 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc47803f070 con 0x55f69c11ddc0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.595+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f69c11d2b0 con 0x55f69c11ddc0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.596+0000 7fc488412640 1 -- 172.21.15.173:0/2350806980 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [stat,call,call,writefull 0~993] v29'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fc47803f070 con 0x55f69c11ddc0 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc360036950 msgr2=0x7fc360038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc360036950 0x7fc360038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc470054000 tx=0x7fc47004e000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 msgr2=0x55f69c0ef150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0ef150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc48000a930 tx=0x7fc480003370 comp rx=0 tx=0).stop 2024-05-15T18:08:55.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 shutdown_connections 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc360036950 0x7fc360038e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2975686263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c0e7bc0 0x55f69c0ef150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 >> 172.21.15.173:0/2975686263 conn(0x55f69bfe57a0 msgr2=0x55f69c0e1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 shutdown_connections 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2975686263 wait complete. 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc2c8036900 msgr2=0x7fc2c8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc2c8036900 0x7fc2c8038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc470055040 tx=0x7fc470005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c10ba10 msgr2=0x55f69c10be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c10ba10 0x55f69c10be30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc478019640 tx=0x7fc478017c60 comp rx=0 tx=0).stop 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 shutdown_connections 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc2c8036900 0x7fc2c8038dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2659945006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69c10ba10 0x55f69c10be30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 >> 172.21.15.173:0/2659945006 conn(0x55f69c1004f0 msgr2=0x55f69c100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 shutdown_connections 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.597+0000 7fc48a90c800 1 -- 172.21.15.173:0/2659945006 wait complete. 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f69c1194d0 msgr2=0x55f69c11b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f69c1194d0 0x55f69c11b920 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f69c11ddc0 msgr2=0x55f69c1201b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f69c11ddc0 0x55f69c1201b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc370036900 msgr2=0x7fc370038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc370036900 0x7fc370038dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc47802ae80 tx=0x7fc478017f90 comp rx=0 tx=0).stop 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 msgr2=0x55f69c0da310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0da310 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc478004000 tx=0x7fc478000bc0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 shutdown_connections 2024-05-15T18:08:55.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f69c1194d0 0x55f69c11b920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f69c11ddc0 0x55f69c1201b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc370036900 0x7fc370038dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 --2- 172.21.15.173:0/2350806980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f69bfe1c90 0x55f69c0da310 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 >> 172.21.15.173:0/2350806980 conn(0x55f69bfdb640 msgr2=0x55f69c0cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 shutdown_connections 2024-05-15T18:08:55.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.598+0000 7fc48a90c800 1 -- 172.21.15.173:0/2350806980 wait complete. 2024-05-15T18:08:55.585 INFO:teuthology.orchestra.run.smithi173.stdout:{"id":"74ac2443-e34d-4255-b728-cefe496e7fb2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-15T18:08:55.586 DEBUG:tasks.util.rgw: json result: {'id': '74ac2443-e34d-4255-b728-cefe496e7fb2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-15T18:08:55.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-15T18:08:55.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-15T18:08:55.587 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-15T18:08:55.631 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:55.631 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.654+0000 7f0b78416800 1 Processor -- start 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.654+0000 7f0b78416800 1 -- start start 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.654+0000 7f0b78416800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b777f2a450 0x55b777f2c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.654+0000 7f0b78416800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b777f2ce10 con 0x55b777f25fc0 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.654+0000 7f0b78416800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55b777db8050 con 0x55b777f2a450 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.655+0000 7f0b6bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b777f2a450 0x55b777f2c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.655+0000 7f0b6bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b777f2a450 0x55b777f2c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43130/0 (socket says 172.21.15.173:43130) 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.655+0000 7f0b73b5c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55b777f25fc0 0x55b777f263e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35148/0 (socket says 172.21.15.173:35148) 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.655+0000 7f0b6bfff640 1 -- 172.21.15.173:0/3302439286 learned_addr learned my addr 172.21.15.173:0/3302439286 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.655+0000 7f0b6bfff640 1 -- 172.21.15.173:0/3302439286 >> v1:172.21.15.3:6789/0 conn(0x55b777f25fc0 legacy=0x55b777f263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.655+0000 7f0b6bfff640 1 -- 172.21.15.173:0/3302439286 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b777f2e040 con 0x55b777f2a450 2024-05-15T18:08:55.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/3302439286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f2a450 0x55b777f2c840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00a6b0 tx=0x7f0b5c01eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e849bc69e0be750c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b7335b640 1 -- 172.21.15.173:0/3302439286 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c059070 con 0x55b777f2a450 2024-05-15T18:08:55.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b7335b640 1 -- 172.21.15.173:0/3302439286 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c050050 con 0x55b777f2a450 2024-05-15T18:08:55.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b7335b640 1 -- 172.21.15.173:0/3302439286 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b5c00a350 con 0x55b777f2a450 2024-05-15T18:08:55.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b78416800 1 -- 172.21.15.173:0/3302439286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f2a450 msgr2=0x55b777f2c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b78416800 1 --2- 172.21.15.173:0/3302439286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f2a450 0x55b777f2c840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00a6b0 tx=0x7f0b5c01eed0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b78416800 1 -- 172.21.15.173:0/3302439286 shutdown_connections 2024-05-15T18:08:55.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b78416800 1 --2- 172.21.15.173:0/3302439286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f2a450 0x55b777f2c840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b78416800 1 -- 172.21.15.173:0/3302439286 >> 172.21.15.173:0/3302439286 conn(0x55b777f215a0 msgr2=0x55b777f239c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.657+0000 7f0b78416800 1 -- 172.21.15.173:0/3302439286 shutdown_connections 2024-05-15T18:08:55.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.658+0000 7f0b78416800 1 -- 172.21.15.173:0/3302439286 wait complete. 2024-05-15T18:08:55.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.671+0000 7f0b78416800 1 Processor -- start 2024-05-15T18:08:55.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.671+0000 7f0b78416800 1 -- start start 2024-05-15T18:08:55.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.671+0000 7f0b78416800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b778016500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.671+0000 7f0b78416800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b777e721c0 con 0x55b777f25fc0 2024-05-15T18:08:55.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b778016500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b778016500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43140/0 (socket says 172.21.15.173:43140) 2024-05-15T18:08:55.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0b73b5c640 1 -- 172.21.15.173:0/2992487655 learned_addr learned my addr 172.21.15.173:0/2992487655 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0b73b5c640 1 -- 172.21.15.173:0/2992487655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b778016ad0 con 0x55b777f25fc0 2024-05-15T18:08:55.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/2992487655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b778016500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400b230 tx=0x7f0b6400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6025e14cad3ef07b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0a61e0b640 1 -- 172.21.15.173:0/2992487655 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6400e5c0 con 0x55b777f25fc0 2024-05-15T18:08:55.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0a61e0b640 1 -- 172.21.15.173:0/2992487655 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b64006070 con 0x55b777f25fc0 2024-05-15T18:08:55.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.672+0000 7f0a61e0b640 1 -- 172.21.15.173:0/2992487655 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6400e890 con 0x55b777f25fc0 2024-05-15T18:08:55.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 -- 172.21.15.173:0/2992487655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 msgr2=0x55b778016500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 --2- 172.21.15.173:0/2992487655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b778016500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400b230 tx=0x7f0b6400b6f0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 -- 172.21.15.173:0/2992487655 shutdown_connections 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 --2- 172.21.15.173:0/2992487655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b778016500 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 -- 172.21.15.173:0/2992487655 >> 172.21.15.173:0/2992487655 conn(0x55b777f215a0 msgr2=0x55b778011e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 -- 172.21.15.173:0/2992487655 shutdown_connections 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 -- 172.21.15.173:0/2992487655 wait complete. 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 Processor -- start 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 -- start start 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b77801e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.673+0000 7f0b78416800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b777f2d2e0 con 0x55b777f25fc0 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b77801e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b77801e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43148/0 (socket says 172.21.15.173:43148) 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0b73b5c640 1 -- 172.21.15.173:0/3599379864 learned_addr learned my addr 172.21.15.173:0/3599379864 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0b73b5c640 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b77801e650 con 0x55b777f25fc0 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b77801e110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b64000fd0 tx=0x7f0b64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0a5bfff640 1 -- 172.21.15.173:0/3599379864 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6400f8d0 con 0x55b777f25fc0 2024-05-15T18:08:55.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0a5bfff640 1 -- 172.21.15.173:0/3599379864 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6400fa90 con 0x55b777f25fc0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b77801e8e0 con 0x55b777f25fc0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0a5bfff640 1 -- 172.21.15.173:0/3599379864 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6400fdb0 con 0x55b777f25fc0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.674+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b778021540 con 0x55b777f25fc0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.675+0000 7f0a5bfff640 1 -- 172.21.15.173:0/3599379864 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b64017070 con 0x55b777f25fc0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.675+0000 7f0a5bfff640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a5c036900 0x7f0a5c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.675+0000 7f0a5bfff640 1 -- 172.21.15.173:0/3599379864 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0b64015020 con 0x55b777f25fc0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.675+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a5c036900 0x7f0a5c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.675+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b777f2a450 0x55b778025300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.675+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778025880 con 0x55b777f2a450 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.675+0000 7f0b7435d640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b777f2a450 0x55b778025300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a5c036900 0x7f0a5c038dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c056000 tx=0x7f0b5c00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b7435d640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b777f2a450 0x55b778025300 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b7435d640 1 -- 172.21.15.173:0/3599379864 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b777f2a450 2024-05-15T18:08:55.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780228d0 con 0x55b777f2a450 2024-05-15T18:08:55.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b7435d640 1 -- 172.21.15.173:0/3599379864 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b777f2a450 2024-05-15T18:08:55.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b778027bd0 0x55b778029fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b77802a660 con 0x55b778027bd0 2024-05-15T18:08:55.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.676+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b778027bd0 0x55b778029fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.677+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b778027bd0 0x55b778029fc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.677+0000 7f0b73b5c640 1 -- 172.21.15.173:0/3599379864 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b6402e070 con 0x55b778027bd0 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.677+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778026b80 con 0x55b777f2a450 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.677+0000 7f0b7435d640 1 -- 172.21.15.173:0/3599379864 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b777f2a450 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.677+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b77802bb10 0x55b77802df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.677+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b77802e6c0 con 0x55b77802bb10 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.678+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b77802bb10 0x55b77802df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.678+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b77802bb10 0x55b77802df60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.678+0000 7f0b6bfff640 1 -- 172.21.15.173:0/3599379864 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b5c05c040 con 0x55b77802bb10 2024-05-15T18:08:55.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b78416800 1 Processor -- start 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b78416800 1 -- start start 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b78416800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77803cab0 0x55b77803ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b78416800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b777e18cf0 con 0x55b77803cab0 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77803cab0 0x55b77803ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77803cab0 0x55b77803ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43164/0 (socket says 172.21.15.173:43164) 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b73b5c640 1 -- 172.21.15.173:0/456548564 learned_addr learned my addr 172.21.15.173:0/456548564 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b73b5c640 1 -- 172.21.15.173:0/456548564 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b77803d410 con 0x55b77803cab0 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.679+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77803cab0 0x55b77803ced0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b640176e0 tx=0x7f0b64017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.680+0000 7f0a597fa640 1 -- 172.21.15.173:0/456548564 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64040b30 con 0x55b77803cab0 2024-05-15T18:08:55.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.680+0000 7f0a597fa640 1 -- 172.21.15.173:0/456548564 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b64040cd0 con 0x55b77803cab0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.680+0000 7f0a597fa640 1 -- 172.21.15.173:0/456548564 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64044aa0 con 0x55b77803cab0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.680+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b77803de80 con 0x55b77803cab0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.680+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b77803e380 con 0x55b77803cab0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.680+0000 7f0a597fa640 1 -- 172.21.15.173:0/456548564 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b64044c40 con 0x55b77803cab0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0a597fa640 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a4c036950 0x7f0a4c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0a597fa640 1 -- 172.21.15.173:0/456548564 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0b6403daa0 con 0x55b77803cab0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a4c036950 0x7f0a4c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b78416800 1 Processor -- start 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b78416800 1 -- start start 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a4c036950 0x7f0a4c038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55b7780227f0 tx=0x7f0b5c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b78416800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b77804e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b78416800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b778016e50 con 0x55b77804df90 2024-05-15T18:08:55.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b77804e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b77804e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43178/0 (socket says 172.21.15.173:43178) 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.681+0000 7f0b73b5c640 1 -- 172.21.15.173:0/1046342523 learned_addr learned my addr 172.21.15.173:0/1046342523 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b73b5c640 1 -- 172.21.15.173:0/1046342523 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b77804e980 con 0x55b77804df90 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/1046342523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b77804e3b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b640449f0 tx=0x7f0b6404b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d670e48bc3f4ca server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0a52ffd640 1 -- 172.21.15.173:0/1046342523 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6404b710 con 0x55b77804df90 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0a52ffd640 1 -- 172.21.15.173:0/1046342523 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6405c030 con 0x55b77804df90 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0a52ffd640 1 -- 172.21.15.173:0/1046342523 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64031d70 con 0x55b77804df90 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b78416800 1 -- 172.21.15.173:0/1046342523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 msgr2=0x55b77804e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b78416800 1 --2- 172.21.15.173:0/1046342523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b77804e3b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b640449f0 tx=0x7f0b6404b610 comp rx=0 tx=0).stop 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b78416800 1 -- 172.21.15.173:0/1046342523 shutdown_connections 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b78416800 1 --2- 172.21.15.173:0/1046342523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b77804e3b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b78416800 1 -- 172.21.15.173:0/1046342523 >> 172.21.15.173:0/1046342523 conn(0x55b778045ea0 msgr2=0x55b778043f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.682+0000 7f0b78416800 1 -- 172.21.15.173:0/1046342523 shutdown_connections 2024-05-15T18:08:55.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b78416800 1 -- 172.21.15.173:0/1046342523 wait complete. 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b78416800 1 Processor -- start 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b78416800 1 -- start start 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b78416800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b7780553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b78416800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b77804f0a0 con 0x55b77804df90 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b7780553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b73b5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b7780553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43194/0 (socket says 172.21.15.173:43194) 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 learned_addr learned my addr 172.21.15.173:0/303148303 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.683+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b778055900 con 0x55b77804df90 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.684+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b7780553c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b640449f0 tx=0x7f0b640283f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.684+0000 7f0a517fa640 1 -- 172.21.15.173:0/303148303 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b6403f250 con 0x55b77804df90 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.684+0000 7f0a517fa640 1 -- 172.21.15.173:0/303148303 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b64019b90 con 0x55b77804df90 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.684+0000 7f0a517fa640 1 -- 172.21.15.173:0/303148303 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b64026390 con 0x55b77804df90 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.684+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b778055900 con 0x55b77804df90 2024-05-15T18:08:55.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.684+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b778055900 con 0x55b77804df90 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0a517fa640 1 -- 172.21.15.173:0/303148303 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b64053040 con 0x55b77804df90 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0a517fa640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a3c036900 0x7f0a3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0a517fa640 1 -- 172.21.15.173:0/303148303 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0b6406fb10 con 0x55b77804df90 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a3c036900 0x7f0a3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b778060a70 0x55b778062f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778063680 con 0x55b778060a70 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0b7435d640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b778060a70 0x55b778062f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.685+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a3c036900 0x7f0a3c038dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c008560 tx=0x7f0b5c062040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b7435d640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b778060a70 0x55b778062f30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 20 realm 2024-05-15T18:08:55.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778063a90 con 0x55b778060a70 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778064360 con 0x55b778060a70 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.686+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b78416800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b7780651f0 0x55b7780675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778067d40 con 0x55b7780651f0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b7780651f0 0x55b7780675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b7780651f0 0x55b7780675e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b78416800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b78416800 20 searching for the correct realm 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.687+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778069720 con 0x55b7780651f0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b73b5c640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b6400f070 0x7f0b64033110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778069720 con 0x7f0b6400f070 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b6400f070 0x7f0b64033110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b6400f070 0x7f0b64033110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b6bfff640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b5c079040 0x7f0b5c054950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.688+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778069720 con 0x7f0b5c079040 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.689+0000 7f0b7435d640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b5c079040 0x7f0b5c054950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.689+0000 7f0b7435d640 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b5c079040 0x7f0b5c054950 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.689+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.689+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.689+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.689+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b6400f070 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.690+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.691+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b6400f070 2024-05-15T18:08:55.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.692+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.693+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b6400f070 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.694+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b6400f070 2024-05-15T18:08:55.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.695+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b7780651f0 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b5c079040 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x55b778060a70 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b778064700 con 0x7f0b6400f070 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:55.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.696+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780686f0 con 0x55b778060a70 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778068ae0 con 0x55b778060a70 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778068ae0 con 0x7f0b5c079040 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 zone default found 2024-05-15T18:08:55.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 4 Realm: () 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 zonegroup default 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778068f00 con 0x7f0b5c079040 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.697+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778068f00 con 0x55b7780651f0 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b78416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b78416800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b77806b5d0 con 0x55b7780651f0 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b78416800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b78416800 20 started sync module instance, tier type = 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b78416800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.698+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806aa70 con 0x7f0b6400f070 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.699+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.699+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94246481079952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806be20 con 0x7f0b6400f070 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.699+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806c670 con 0x55b778060a70 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.700+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94246481079952] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.700+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.700+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94246481082736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806c670 con 0x55b778060a70 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.700+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806d190 con 0x55b7780651f0 2024-05-15T18:08:55.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.701+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.701+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94246481087584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806da30 con 0x55b7780651f0 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.701+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806e520 con 0x7f0b6400f070 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.702+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94246481082736] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.702+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94246481087584] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.702+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.702+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94246481092592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806e910 con 0x7f0b6400f070 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.702+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806f160 con 0x55b778060a70 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.703+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.703+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94246481096368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b77806fa30 con 0x55b778060a70 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.704+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780704f0 con 0x7f0b5c079040 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.708+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94246481092592] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.708+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.708+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94246481100736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780704b0 con 0x7f0b5c079040 2024-05-15T18:08:55.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.708+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b778070f00 con 0x7f0b5c079040 2024-05-15T18:08:55.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.709+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94246481096368] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.709+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.709+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94246481098112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b778070f00 con 0x7f0b5c079040 2024-05-15T18:08:55.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.709+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b778071910 con 0x7f0b5c079040 2024-05-15T18:08:55.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v29'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94246481106016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b778071d30 con 0x7f0b5c079040 2024-05-15T18:08:55.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 20 add_watcher() i=0 2024-05-15T18:08:55.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 20 add_watcher() i=1 2024-05-15T18:08:55.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 20 add_watcher() i=2 2024-05-15T18:08:55.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 20 add_watcher() i=3 2024-05-15T18:08:55.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 20 add_watcher() i=4 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94246481100736] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 20 add_watcher() i=5 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94246481098112] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.712+0000 7f0b78416800 20 add_watcher() i=6 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.713+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94246481106016] v29'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.713+0000 7f0b78416800 20 add_watcher() i=7 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.713+0000 7f0b78416800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.713+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b778071880 con 0x55b778060a70 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.713+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.713+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94246481084864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b778071880 con 0x55b778060a70 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.715+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94246481084864] v29'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.715+0000 7f0a29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.715+0000 7f0b78416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.715+0000 7f0b78416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.715+0000 7f0b78416800 5 note: GC not initialized 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0a28fe1640 20 reqs_thread_entry: start 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0b78416800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0b78416800 20 Filter name: none 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f09a27fc640 20 reqs_thread_entry: start 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8270 con 0x55b778060a70 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8270 con 0x7f0b6400f070 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.716+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8270 con 0x55b778060a70 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8230 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a87b0 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a87b0 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a87b0 con 0x55b778060a70 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.717+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a87b0 con 0x55b778060a70 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.718+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.719+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.719+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b6400f070 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.719+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.719+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.719+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.719+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.719+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.720+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b6400f070 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.721+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.722+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.723+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.723+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.723+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.723+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.723+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.723+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.723+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.724+0000 7f0a29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.724+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94246481084864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.725+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94246481084864] v29'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.725+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94246481079952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b6400f070 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.726+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94246481079952] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.726+0000 7f0b78416800 20 remove_watcher() i=0 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.726+0000 7f0b78416800 2 removed watcher, disabling cache 2024-05-15T18:08:55.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.726+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94246481082736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.727+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94246481082736] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.728+0000 7f0b78416800 20 remove_watcher() i=1 2024-05-15T18:08:55.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.728+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94246481087584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b7780651f0 2024-05-15T18:08:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.729+0000 7f0b73b5c640 1 -- 172.21.15.173:0/303148303 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94246481087584] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6406a070 con 0x55b7780651f0 2024-05-15T18:08:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.729+0000 7f0b78416800 20 remove_watcher() i=2 2024-05-15T18:08:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.729+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94246481092592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b6400f070 2024-05-15T18:08:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.730+0000 7f0b6bfff640 1 -- 172.21.15.173:0/303148303 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94246481092592] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b5c072070 con 0x7f0b6400f070 2024-05-15T18:08:55.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.730+0000 7f0b78416800 20 remove_watcher() i=3 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.730+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94246481096368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x55b778060a70 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.732+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94246481096368] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x55b778060a70 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.732+0000 7f0b78416800 20 remove_watcher() i=4 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.732+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94246481100736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.733+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94246481100736] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.733+0000 7f0b78416800 20 remove_watcher() i=5 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.733+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94246481098112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.734+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94246481098112] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.734+0000 7f0b78416800 20 remove_watcher() i=6 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.734+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94246481106016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b7780a8710 con 0x7f0b5c079040 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94246481106016] v29'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b6c00a4a0 con 0x7f0b5c079040 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 20 remove_watcher() i=7 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b5c079040 msgr2=0x7f0b5c054950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b5c079040 0x7f0b5c054950 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b778060a70 msgr2=0x55b778062f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b778060a70 0x55b778062f30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b6400f070 msgr2=0x7f0b64033110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b6400f070 0x7f0b64033110 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b7780651f0 msgr2=0x55b7780675e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b7780651f0 0x55b7780675e0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a3c036900 msgr2=0x7f0a3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a3c036900 0x7f0a3c038dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c008560 tx=0x7f0b5c062040 comp rx=0 tx=0).stop 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 msgr2=0x55b7780553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 --2- 172.21.15.173:0/303148303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77804df90 0x55b7780553c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0b640449f0 tx=0x7f0b640283f0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 reap_dead start 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b7435d640 1 -- 172.21.15.173:0/303148303 reap_dead start 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 shutdown_connections 2024-05-15T18:08:55.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 >> 172.21.15.173:0/303148303 conn(0x55b778045ea0 msgr2=0x55b778043500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 shutdown_connections 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.735+0000 7f0b78416800 1 -- 172.21.15.173:0/303148303 wait complete. 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a4c036950 msgr2=0x7f0a4c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a4c036950 0x7f0a4c038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55b7780227f0 tx=0x7f0b5c005ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77803cab0 msgr2=0x55b77803ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77803cab0 0x55b77803ced0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0b640176e0 tx=0x7f0b64017d50 comp rx=0 tx=0).stop 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 shutdown_connections 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a4c036950 0x7f0a4c038e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/456548564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b77803cab0 0x55b77803ced0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 >> 172.21.15.173:0/456548564 conn(0x55b778030b50 msgr2=0x55b778030f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 shutdown_connections 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/456548564 wait complete. 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b77802bb10 msgr2=0x55b77802df60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b77802bb10 0x55b77802df60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b777f2a450 msgr2=0x55b778025300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b777f2a450 0x55b778025300 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b778027bd0 msgr2=0x55b778029fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b778027bd0 0x55b778029fc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a5c036900 msgr2=0x7f0a5c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a5c036900 0x7f0a5c038dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c056000 tx=0x7f0b5c00a000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 msgr2=0x55b77801e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 --2- 172.21.15.173:0/3599379864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b777f25fc0 0x55b77801e110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b64000fd0 tx=0x7f0b64000ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b7435d640 1 -- 172.21.15.173:0/3599379864 reap_dead start 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 shutdown_connections 2024-05-15T18:08:55.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 >> 172.21.15.173:0/3599379864 conn(0x55b777f215a0 msgr2=0x55b778010620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 shutdown_connections 2024-05-15T18:08:55.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.736+0000 7f0b78416800 1 -- 172.21.15.173:0/3599379864 wait complete. 2024-05-15T18:08:55.722 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[],"summary":[]} 2024-05-15T18:08:55.723 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-15T18:08:55.723 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:55.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:55.723 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:55.806 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:55.807 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a20006800 1 Processor -- start 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a20006800 1 -- start start 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a20006800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55f0a39d7460 0x55f0a39d9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a20006800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0a39d9e20 con 0x55f0a39d2fd0 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a20006800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55f0a3865050 con 0x55f0a39d7460 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a17fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55f0a39d7460 0x55f0a39d9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a1db05640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55f0a39d2fd0 0x55f0a39d33f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35152/0 (socket says 172.21.15.173:35152) 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a1db05640 1 -- 172.21.15.173:0/1766738165 learned_addr learned my addr 172.21.15.173:0/1766738165 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a17fff640 1 -- 172.21.15.173:0/1766738165 >> v1:172.21.15.3:6789/0 conn(0x55f0a39d2fd0 legacy=0x55f0a39d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a17fff640 1 -- 172.21.15.173:0/1766738165 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a39db050 con 0x55f0a39d7460 2024-05-15T18:08:55.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.830+0000 7f0a1d304640 1 -- 172.21.15.173:0/1766738165 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 575019160 0 0) 0x55f0a39d9e20 con 0x55f0a39d2fd0 2024-05-15T18:08:55.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.832+0000 7f0a17fff640 1 --2- 172.21.15.173:0/1766738165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d7460 0x55f0a39d9850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800a470 tx=0x7f0a0801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370d9dbbe1a7881d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a1d304640 1 -- 172.21.15.173:0/1766738165 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a08057070 con 0x55f0a39d7460 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a1d304640 1 -- 172.21.15.173:0/1766738165 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a08052570 con 0x55f0a39d7460 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a1d304640 1 -- 172.21.15.173:0/1766738165 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a08052870 con 0x55f0a39d7460 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a20006800 1 -- 172.21.15.173:0/1766738165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d7460 msgr2=0x55f0a39d9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a20006800 1 --2- 172.21.15.173:0/1766738165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d7460 0x55f0a39d9850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800a470 tx=0x7f0a0801ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a20006800 1 -- 172.21.15.173:0/1766738165 shutdown_connections 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a20006800 1 --2- 172.21.15.173:0/1766738165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d7460 0x55f0a39d9850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a20006800 1 -- 172.21.15.173:0/1766738165 >> 172.21.15.173:0/1766738165 conn(0x55f0a39ce5b0 msgr2=0x55f0a39d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a20006800 1 -- 172.21.15.173:0/1766738165 shutdown_connections 2024-05-15T18:08:55.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.833+0000 7f0a20006800 1 -- 172.21.15.173:0/1766738165 wait complete. 2024-05-15T18:08:55.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a20006800 1 Processor -- start 2024-05-15T18:08:55.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a20006800 1 -- start start 2024-05-15T18:08:55.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a20006800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3946e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a20006800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f0a391f1d0 con 0x55f0a39d2fd0 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3946e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3946e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43206/0 (socket says 172.21.15.173:43206) 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a1db05640 1 -- 172.21.15.173:0/2335234359 learned_addr learned my addr 172.21.15.173:0/2335234359 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.847+0000 7f0a1db05640 1 -- 172.21.15.173:0/2335234359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a3ac5f90 con 0x55f0a39d2fd0 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f0a1db05640 1 --2- 172.21.15.173:0/2335234359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3946e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000b240 tx=0x7f0a1000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca1396ac6fec623 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f090be07640 1 -- 172.21.15.173:0/2335234359 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10008070 con 0x55f0a39d2fd0 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f090be07640 1 -- 172.21.15.173:0/2335234359 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1000d500 con 0x55f0a39d2fd0 2024-05-15T18:08:55.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f090be07640 1 -- 172.21.15.173:0/2335234359 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1000d860 con 0x55f0a39d2fd0 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f0a20006800 1 -- 172.21.15.173:0/2335234359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 msgr2=0x55f0a3946e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f0a20006800 1 --2- 172.21.15.173:0/2335234359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3946e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000b240 tx=0x7f0a1000b700 comp rx=0 tx=0).stop 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f0a20006800 1 -- 172.21.15.173:0/2335234359 shutdown_connections 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f0a20006800 1 --2- 172.21.15.173:0/2335234359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3946e40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.848+0000 7f0a20006800 1 -- 172.21.15.173:0/2335234359 >> 172.21.15.173:0/2335234359 conn(0x55f0a39ce5b0 msgr2=0x55f0a3abfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a20006800 1 -- 172.21.15.173:0/2335234359 shutdown_connections 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a20006800 1 -- 172.21.15.173:0/2335234359 wait complete. 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a20006800 1 Processor -- start 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a20006800 1 -- start start 2024-05-15T18:08:55.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a20006800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3acf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a20006800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f0a39da2f0 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3acf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3acf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43208/0 (socket says 172.21.15.173:43208) 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.849+0000 7f0a1db05640 1 -- 172.21.15.173:0/1493932405 learned_addr learned my addr 172.21.15.173:0/1493932405 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.850+0000 7f0a1db05640 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a3acf7f0 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.850+0000 7f0a1db05640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3acf2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55f0a3946470 tx=0x7f0a10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.850+0000 7f090a604640 1 -- 172.21.15.173:0/1493932405 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10019870 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.850+0000 7f090a604640 1 -- 172.21.15.173:0/1493932405 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10019a10 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.850+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0a3acfa80 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.850+0000 7f090a604640 1 -- 172.21.15.173:0/1493932405 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10019d30 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.850+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a3ad2730 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.851+0000 7f090a604640 1 -- 172.21.15.173:0/1493932405 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0a10017040 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.851+0000 7f090a604640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0904036900 0x7f0904038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.851+0000 7f090a604640 1 -- 172.21.15.173:0/1493932405 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0a10015020 con 0x55f0a39d2fd0 2024-05-15T18:08:55.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.851+0000 7f0a17fff640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0904036900 0x7f0904038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.851+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a39d7460 0x55f0a3ad64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.851+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3ad6a30 con 0x55f0a39d7460 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.851+0000 7f0a1e306640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a39d7460 0x55f0a3ad64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a17fff640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0904036900 0x7f0904038dc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a08054000 tx=0x7f0a0804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a1e306640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a39d7460 0x55f0a3ad64f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a1e306640 1 -- 172.21.15.173:0/1493932405 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a39d7460 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3ad3ac0 con 0x55f0a39d7460 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a1e306640 1 -- 172.21.15.173:0/1493932405 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a39d7460 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3ad8db0 0x55f0a3adb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3adb840 con 0x55f0a3ad8db0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.852+0000 7f0a1db05640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3ad8db0 0x55f0a3adb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.853+0000 7f0a1db05640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3ad8db0 0x55f0a3adb1a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.853+0000 7f0a1db05640 1 -- 172.21.15.173:0/1493932405 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a1002d070 con 0x55f0a3ad8db0 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.853+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3ad7d60 con 0x55f0a39d7460 2024-05-15T18:08:55.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.853+0000 7f0a1e306640 1 -- 172.21.15.173:0/1493932405 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a39d7460 2024-05-15T18:08:55.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.853+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55f0a3adccf0 0x55f0a3adf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.853+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3adf8a0 con 0x55f0a3adccf0 2024-05-15T18:08:55.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.853+0000 7f0a17fff640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55f0a3adccf0 0x55f0a3adf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.854+0000 7f0a17fff640 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55f0a3adccf0 0x55f0a3adf140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.854+0000 7f0a17fff640 1 -- 172.21.15.173:0/1493932405 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a0805a040 con 0x55f0a3adccf0 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.854+0000 7f0a20006800 1 Processor -- start 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.854+0000 7f0a20006800 1 -- start start 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a20006800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3aedc30 0x55f0a3aee050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a20006800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f0a38c5cf0 con 0x55f0a3aedc30 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3aedc30 0x55f0a3aee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3aedc30 0x55f0a3aee050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43216/0 (socket says 172.21.15.173:43216) 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a1db05640 1 -- 172.21.15.173:0/3091515879 learned_addr learned my addr 172.21.15.173:0/3091515879 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a1db05640 1 -- 172.21.15.173:0/3091515879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a3aee590 con 0x55f0a3aedc30 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a1db05640 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3aedc30 0x55f0a3aee050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000ffd0 tx=0x7f0a1004cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f09037fe640 1 -- 172.21.15.173:0/3091515879 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1000f940 con 0x55f0a3aedc30 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f09037fe640 1 -- 172.21.15.173:0/3091515879 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1001a3c0 con 0x55f0a3aedc30 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0a3aef000 con 0x55f0a3aedc30 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f09037fe640 1 -- 172.21.15.173:0/3091515879 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1001a6c0 con 0x55f0a3aedc30 2024-05-15T18:08:55.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.855+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a3aef500 con 0x55f0a3aedc30 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.856+0000 7f09037fe640 1 -- 172.21.15.173:0/3091515879 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0a1003f200 con 0x55f0a3aedc30 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.856+0000 7f09037fe640 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08f8036950 0x7f08f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.856+0000 7f09037fe640 1 -- 172.21.15.173:0/3091515879 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0a10052060 con 0x55f0a3aedc30 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.856+0000 7f0a17fff640 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08f8036950 0x7f08f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a20006800 1 Processor -- start 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a20006800 1 -- start start 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a17fff640 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08f8036950 0x7f08f8038e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55f0a3ad39e0 tx=0x7f0a08005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a20006800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3afb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a20006800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f0a3aca720 con 0x55f0a3afaf90 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3afb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3afb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43218/0 (socket says 172.21.15.173:43218) 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a1db05640 1 -- 172.21.15.173:0/3721956828 learned_addr learned my addr 172.21.15.173:0/3721956828 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a1db05640 1 -- 172.21.15.173:0/3721956828 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a3afb980 con 0x55f0a3afaf90 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.857+0000 7f0a1db05640 1 --2- 172.21.15.173:0/3721956828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3afb3b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000fb00 tx=0x7f0a10030f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7e79ec14f5c058 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f09017fa640 1 -- 172.21.15.173:0/3721956828 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1001c610 con 0x55f0a3afaf90 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f09017fa640 1 -- 172.21.15.173:0/3721956828 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10051020 con 0x55f0a3afaf90 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f09017fa640 1 -- 172.21.15.173:0/3721956828 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10010df0 con 0x55f0a3afaf90 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 -- 172.21.15.173:0/3721956828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 msgr2=0x55f0a3afb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 --2- 172.21.15.173:0/3721956828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3afb3b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000fb00 tx=0x7f0a10030f70 comp rx=0 tx=0).stop 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 -- 172.21.15.173:0/3721956828 shutdown_connections 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 --2- 172.21.15.173:0/3721956828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3afb3b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 -- 172.21.15.173:0/3721956828 >> 172.21.15.173:0/3721956828 conn(0x55f0a3af7210 msgr2=0x55f0a3af5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 -- 172.21.15.173:0/3721956828 shutdown_connections 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 -- 172.21.15.173:0/3721956828 wait complete. 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 Processor -- start 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.858+0000 7f0a20006800 1 -- start start 2024-05-15T18:08:55.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a20006800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3b02260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a20006800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f0a3afbff0 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3b02260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a1db05640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3b02260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43228/0 (socket says 172.21.15.173:43228) 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 learned_addr learned my addr 172.21.15.173:0/4043419739 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a3b027a0 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a1db05640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3b02260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0a100269b0 tx=0x7f0a1004e400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f08ef7fe640 1 -- 172.21.15.173:0/4043419739 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1001a860 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f08ef7fe640 1 -- 172.21.15.173:0/4043419739 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10069030 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0a3b027a0 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.859+0000 7f08ef7fe640 1 -- 172.21.15.173:0/4043419739 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10018d40 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.860+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a3b027a0 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.860+0000 7f08ef7fe640 1 -- 172.21.15.173:0/4043419739 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0a10030610 con 0x55f0a3afaf90 2024-05-15T18:08:55.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.860+0000 7f08ef7fe640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08e80368b0 0x7f08e8038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.860+0000 7f08ef7fe640 1 -- 172.21.15.173:0/4043419739 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0a1005e070 con 0x55f0a3afaf90 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a17fff640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08e80368b0 0x7f08e8038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a3b0d810 0x55f0a3b0fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b10420 con 0x55f0a3b0d810 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a1e306640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a3b0d810 0x55f0a3b0fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a17fff640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08e80368b0 0x7f08e8038d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a0801ced0 tx=0x7f0a0804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a1e306640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a3b0d810 0x55f0a3b0fcd0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a20006800 20 realm 2024-05-15T18:08:55.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.861+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b10830 con 0x55f0a3b0d810 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b11100 con 0x55f0a3b0d810 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3b11f90 0x55f0a3b14380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b14ae0 con 0x55f0a3b11f90 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.862+0000 7f0a1db05640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3b11f90 0x55f0a3b14380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a1db05640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3b11f90 0x55f0a3b14380 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a20006800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a20006800 20 searching for the correct realm 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b164c0 con 0x55f0a3b11f90 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a1db05640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0a1003b070 0x7f0a1002f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b164c0 con 0x7f0a1003b070 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.863+0000 7f0a17fff640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0a1003b070 0x7f0a1002f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.864+0000 7f0a17fff640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0a1003b070 0x7f0a1002f3e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.864+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.864+0000 7f0a17fff640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0a08083040 0x7f0a08075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.864+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b164c0 con 0x7f0a08083040 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.864+0000 7f0a1e306640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0a08083040 0x7f0a08075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.864+0000 7f0a1e306640 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0a08083040 0x7f0a08075430 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x7f0a08083040 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.865+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x7f0a08083040 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x7f0a1003b070 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b11f90 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.866+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x7f0a08083040 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x7f0a1003b070 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b11f90 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.867+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b114a0 con 0x55f0a3b11f90 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a08083040 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b11f90 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b11f90 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.868+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b0d810 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b0d810 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a08083040 2024-05-15T18:08:55.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b11f90 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.869+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a1003b070 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b0d810 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a08083040 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b11f90 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.870+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a08083040 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.871+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.871+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a1003b070 2024-05-15T18:08:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.871+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.871+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b11f90 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.871+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.871+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a08083040 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x55f0a3b0d810 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0a10085040 con 0x7f0a1003b070 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b15490 con 0x55f0a3b0d810 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b15880 con 0x55f0a3b0d810 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.872+0000 7f0a20006800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b15880 con 0x7f0a08083040 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 zone default found 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 4 Realm: () 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:55.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 zonegroup default 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b15ca0 con 0x7f0a08083040 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b15ca0 con 0x55f0a3b11f90 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.873+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b18370 con 0x55f0a3b11f90 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.874+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.874+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.874+0000 7f0a20006800 20 started sync module instance, tier type = 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.874+0000 7f0a20006800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.874+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b17810 con 0x7f0a1003b070 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.875+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.875+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94492026829824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b18bc0 con 0x7f0a1003b070 2024-05-15T18:08:55.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.875+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b19410 con 0x55f0a3b0d810 2024-05-15T18:08:55.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.877+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.877+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94492026829824] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.878+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94492026832656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b19450 con 0x55f0a3b0d810 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.878+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b19f60 con 0x55f0a3b11f90 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.878+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94492026832656] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.879+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.879+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94492026837520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1a350 con 0x55f0a3b11f90 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.879+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1ad90 con 0x7f0a1003b070 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.881+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94492026837520] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.881+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.881+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94492026841184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1b180 con 0x7f0a1003b070 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.881+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1bba0 con 0x55f0a3b0d810 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.884+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.884+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94492026844816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1c470 con 0x55f0a3b0d810 2024-05-15T18:08:55.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.884+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1cf60 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.884+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94492026841184] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.885+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94492026844816] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.885+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.885+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94492026849840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1bf70 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.885+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1d800 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.886+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.886+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94492026852176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1bf70 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.886+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1e360 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.886+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94492026849840] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94492026852176] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94492026834784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1de70 con 0x7f0a08083040 2024-05-15T18:08:55.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 20 add_watcher() i=0 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 20 add_watcher() i=1 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 20 add_watcher() i=2 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 20 add_watcher() i=3 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 20 add_watcher() i=4 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 20 add_watcher() i=5 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.887+0000 7f0a20006800 20 add_watcher() i=6 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.888+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94492026834784] v29'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.888+0000 7f0a20006800 20 add_watcher() i=7 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.888+0000 7f0a20006800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.888+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b21350 con 0x55f0a3b0d810 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.888+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.888+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94492026855024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1e740 con 0x55f0a3b0d810 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.889+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94492026855024] v29'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.889+0000 7f08cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 5 note: GC not initialized 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f08ce7fc640 20 reqs_thread_entry: start 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 20 Filter name: none 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f083ffff640 20 reqs_thread_entry: start 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b54240 con 0x55f0a3b0d810 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.890+0000 7f0a20006800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:could not fetch user info: no user info saved 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.891+0000 7f08cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:55.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.891+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94492026855024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b54200 con 0x55f0a3b0d810 2024-05-15T18:08:55.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.892+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94492026855024] v29'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.892+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94492026829824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b54200 con 0x7f0a1003b070 2024-05-15T18:08:55.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.895+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94492026829824] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.895+0000 7f0a20006800 20 remove_watcher() i=0 2024-05-15T18:08:55.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.895+0000 7f0a20006800 2 removed watcher, disabling cache 2024-05-15T18:08:55.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.895+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94492026832656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b17c00 con 0x55f0a3b0d810 2024-05-15T18:08:55.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.896+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94492026832656] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.896+0000 7f0a20006800 20 remove_watcher() i=1 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.896+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94492026837520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b17c00 con 0x55f0a3b11f90 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.897+0000 7f0a1db05640 1 -- 172.21.15.173:0/4043419739 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94492026837520] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a10075070 con 0x55f0a3b11f90 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.897+0000 7f0a20006800 20 remove_watcher() i=2 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.897+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94492026841184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b19a10 con 0x7f0a1003b070 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.898+0000 7f0a17fff640 1 -- 172.21.15.173:0/4043419739 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94492026841184] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08070030 con 0x7f0a1003b070 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.898+0000 7f0a20006800 20 remove_watcher() i=3 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.898+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94492026844816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b17c00 con 0x55f0a3b0d810 2024-05-15T18:08:55.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.901+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94492026844816] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x55f0a3b0d810 2024-05-15T18:08:55.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.901+0000 7f0a20006800 20 remove_watcher() i=4 2024-05-15T18:08:55.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.901+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94492026849840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b19a10 con 0x7f0a08083040 2024-05-15T18:08:55.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.902+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94492026849840] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.902+0000 7f0a20006800 20 remove_watcher() i=5 2024-05-15T18:08:55.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.902+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94492026852176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b1b690 con 0x7f0a08083040 2024-05-15T18:08:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.904+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94492026852176] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.904+0000 7f0a20006800 20 remove_watcher() i=6 2024-05-15T18:08:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.904+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94492026834784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55f0a3b17c00 con 0x7f0a08083040 2024-05-15T18:08:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94492026834784] v29'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x7f0a08083040 2024-05-15T18:08:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 20 remove_watcher() i=7 2024-05-15T18:08:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0a08083040 msgr2=0x7f0a08075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0a08083040 0x7f0a08075430 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a3b0d810 msgr2=0x55f0a3b0fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a3b0d810 0x55f0a3b0fcd0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0a1003b070 msgr2=0x7f0a1002f3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0a1003b070 0x7f0a1002f3e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3b11f90 msgr2=0x55f0a3b14380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3b11f90 0x55f0a3b14380 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08e80368b0 msgr2=0x7f08e8038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08e80368b0 0x7f08e8038d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a0801ced0 tx=0x7f0a0804f000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a1e306640 1 -- 172.21.15.173:0/4043419739 reap_dead start 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 msgr2=0x55f0a3b02260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3b02260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0a100269b0 tx=0x7f0a1004e400 comp rx=0 tx=0).stop 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 shutdown_connections 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 --2- 172.21.15.173:0/4043419739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3afaf90 0x55f0a3b02260 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 >> 172.21.15.173:0/4043419739 conn(0x55f0a3af7210 msgr2=0x55f0a3af4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 shutdown_connections 2024-05-15T18:08:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.905+0000 7f0a20006800 1 -- 172.21.15.173:0/4043419739 wait complete. 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08f8036950 msgr2=0x7f08f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08f8036950 0x7f08f8038e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55f0a3ad39e0 tx=0x7f0a08005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3aedc30 msgr2=0x55f0a3aee050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3aedc30 0x55f0a3aee050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000ffd0 tx=0x7f0a1004cbe0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 shutdown_connections 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08f8036950 0x7f08f8038e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/3091515879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a3aedc30 0x55f0a3aee050 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 >> 172.21.15.173:0/3091515879 conn(0x55f0a3ae1cd0 msgr2=0x55f0a3ae20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 shutdown_connections 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/3091515879 wait complete. 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55f0a3adccf0 msgr2=0x55f0a3adf140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55f0a3adccf0 0x55f0a3adf140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a39d7460 msgr2=0x55f0a3ad64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55f0a39d7460 0x55f0a3ad64f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3ad8db0 msgr2=0x55f0a3adb1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55f0a3ad8db0 0x55f0a3adb1a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0904036900 msgr2=0x7f0904038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0904036900 0x7f0904038dc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a08054000 tx=0x7f0a0804e000 comp rx=0 tx=0).stop 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 msgr2=0x55f0a3acf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 --2- 172.21.15.173:0/1493932405 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f0a39d2fd0 0x55f0a3acf2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55f0a3946470 tx=0x7f0a10000ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a1e306640 1 -- 172.21.15.173:0/1493932405 reap_dead start 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 shutdown_connections 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 >> 172.21.15.173:0/1493932405 conn(0x55f0a39ce5b0 msgr2=0x55f0a3abe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 shutdown_connections 2024-05-15T18:08:55.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.906+0000 7f0a20006800 1 -- 172.21.15.173:0/1493932405 wait complete. 2024-05-15T18:08:55.892 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-15T18:08:55.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-15T18:08:55.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-15T18:08:55.893 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-05-15T18:08:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa03103f800 1 Processor -- start 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa03103f800 1 -- start start 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa03103f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e225865380 0x55e225867820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa03103f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e225867ea0 con 0x55e2257d4860 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa03103f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55e2256f2050 con 0x55e225865380 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa027fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e225865380 0x55e225867820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa02eb3e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55e2257d4860 0x55e225863c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35158/0 (socket says 172.21.15.173:35158) 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa02eb3e640 1 -- 172.21.15.173:0/3019919313 learned_addr learned my addr 172.21.15.173:0/3019919313 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa027fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e225865380 0x55e225867820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43240/0 (socket says 172.21.15.173:43240) 2024-05-15T18:08:55.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa027fff640 1 -- 172.21.15.173:0/3019919313 >> v1:172.21.15.3:6789/0 conn(0x55e2257d4860 legacy=0x55e225863c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.971+0000 7fa027fff640 1 -- 172.21.15.173:0/3019919313 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2258690d0 con 0x55e225865380 2024-05-15T18:08:55.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.973+0000 7fa027fff640 1 --2- 172.21.15.173:0/3019919313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225865380 0x55e225867820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa01800a470 tx=0x7fa01801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521087262df0ddc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.973+0000 7fa02e33d640 1 -- 172.21.15.173:0/3019919313 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa018057070 con 0x55e225865380 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.973+0000 7fa02e33d640 1 -- 172.21.15.173:0/3019919313 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa018052570 con 0x55e225865380 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.973+0000 7fa02e33d640 1 -- 172.21.15.173:0/3019919313 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa018052870 con 0x55e225865380 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.974+0000 7fa03103f800 1 -- 172.21.15.173:0/3019919313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225865380 msgr2=0x55e225867820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.974+0000 7fa03103f800 1 --2- 172.21.15.173:0/3019919313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225865380 0x55e225867820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa01800a470 tx=0x7fa01801ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.974+0000 7fa03103f800 1 -- 172.21.15.173:0/3019919313 shutdown_connections 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.974+0000 7fa03103f800 1 --2- 172.21.15.173:0/3019919313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225865380 0x55e225867820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.974+0000 7fa03103f800 1 -- 172.21.15.173:0/3019919313 >> 172.21.15.173:0/3019919313 conn(0x55e22585b500 msgr2=0x55e22585d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.974+0000 7fa03103f800 1 -- 172.21.15.173:0/3019919313 shutdown_connections 2024-05-15T18:08:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.974+0000 7fa03103f800 1 -- 172.21.15.173:0/3019919313 wait complete. 2024-05-15T18:08:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.987+0000 7fa03103f800 1 Processor -- start 2024-05-15T18:08:55.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.987+0000 7fa03103f800 1 -- start start 2024-05-15T18:08:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7fa03103f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e225952740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7fa03103f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e2257ac170 con 0x55e2257d4860 2024-05-15T18:08:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e225952740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e225952740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43256/0 (socket says 172.21.15.173:43256) 2024-05-15T18:08:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7fa02eb3e640 1 -- 172.21.15.173:0/409546301 learned_addr learned my addr 172.21.15.173:0/409546301 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7fa02eb3e640 1 -- 172.21.15.173:0/409546301 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e225952d10 con 0x55e2257d4860 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/409546301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e225952740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa020001de0 tx=0x7fa02000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e98f8a81facd8c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7f9f1ce09640 1 -- 172.21.15.173:0/409546301 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa020012020 con 0x55e2257d4860 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7f9f1ce09640 1 -- 172.21.15.173:0/409546301 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa02000e5a0 con 0x55e2257d4860 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.988+0000 7f9f1ce09640 1 -- 172.21.15.173:0/409546301 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02000e8c0 con 0x55e2257d4860 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.989+0000 7fa03103f800 1 -- 172.21.15.173:0/409546301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 msgr2=0x55e225952740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.989+0000 7fa03103f800 1 --2- 172.21.15.173:0/409546301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e225952740 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa020001de0 tx=0x7fa02000b6c0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.989+0000 7fa03103f800 1 -- 172.21.15.173:0/409546301 shutdown_connections 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.989+0000 7fa03103f800 1 --2- 172.21.15.173:0/409546301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e225952740 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.989+0000 7fa03103f800 1 -- 172.21.15.173:0/409546301 >> 172.21.15.173:0/409546301 conn(0x55e22585b500 msgr2=0x55e22594e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.989+0000 7fa03103f800 1 -- 172.21.15.173:0/409546301 shutdown_connections 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.989+0000 7fa03103f800 1 -- 172.21.15.173:0/409546301 wait complete. 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa03103f800 1 Processor -- start 2024-05-15T18:08:55.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa03103f800 1 -- start start 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa03103f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e22595a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa03103f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e225868370 con 0x55e2257d4860 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e22595a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e22595a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43258/0 (socket says 172.21.15.173:43258) 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa02eb3e640 1 -- 172.21.15.173:0/2453316563 learned_addr learned my addr 172.21.15.173:0/2453316563 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.990+0000 7fa02eb3e640 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22595a7f0 con 0x55e2257d4860 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.991+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e22595a2b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa02000c010 tx=0x7fa020000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.991+0000 7f9f1b606640 1 -- 172.21.15.173:0/2453316563 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa020012070 con 0x55e2257d4860 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.991+0000 7f9f1b606640 1 -- 172.21.15.173:0/2453316563 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa02001a7a0 con 0x55e2257d4860 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.991+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e22595aa80 con 0x55e2257d4860 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.991+0000 7f9f1b606640 1 -- 172.21.15.173:0/2453316563 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02001aa80 con 0x55e2257d4860 2024-05-15T18:08:55.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.991+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22595d730 con 0x55e2257d4860 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7f9f1b606640 1 -- 172.21.15.173:0/2453316563 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa020015020 con 0x55e2257d4860 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7f9f1b606640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f14036950 0x7f9f14038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7f9f1b606640 1 -- 172.21.15.173:0/2453316563 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa020020070 con 0x55e2257d4860 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7fa027fff640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f14036950 0x7f9f14038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e225865380 0x55e2259614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e225961a30 con 0x55e225865380 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7fa02f33f640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e225865380 0x55e2259614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7fa027fff640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f14036950 0x7f9f14038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa018054000 tx=0x7fa01804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.992+0000 7fa02f33f640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e225865380 0x55e2259614f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.993+0000 7fa02f33f640 1 -- 172.21.15.173:0/2453316563 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e225865380 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.993+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e22595eac0 con 0x55e225865380 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.993+0000 7fa02f33f640 1 -- 172.21.15.173:0/2453316563 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e225865380 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.993+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e225963d80 0x55e225966170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.993+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e225966860 con 0x55e225963d80 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.993+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e225963d80 0x55e225966170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.993+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e225963d80 0x55e225966170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.994+0000 7fa02eb3e640 1 -- 172.21.15.173:0/2453316563 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa02002b070 con 0x55e225963d80 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.994+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e225962d30 con 0x55e225865380 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.994+0000 7fa02f33f640 1 -- 172.21.15.173:0/2453316563 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e225865380 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.994+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e225967d10 0x55e22596a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.994+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e22596a8c0 con 0x55e225967d10 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.994+0000 7fa027fff640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e225967d10 0x55e22596a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.995+0000 7fa027fff640 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e225967d10 0x55e22596a160 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.995+0000 7fa027fff640 1 -- 172.21.15.173:0/2453316563 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa01805a040 con 0x55e225967d10 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.995+0000 7fa03103f800 1 Processor -- start 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.995+0000 7fa03103f800 1 -- start start 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.995+0000 7fa03103f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225861790 0x55e22585fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.995+0000 7fa03103f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e225752cf0 con 0x55e225861790 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225861790 0x55e22585fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225861790 0x55e22585fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43268/0 (socket says 172.21.15.173:43268) 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1643277183 learned_addr learned my addr 172.21.15.173:0/1643277183 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1643277183 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e225860140 con 0x55e225861790 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225861790 0x55e22585fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa02004aa30 tx=0x7fa02004ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7f9f18e01640 1 -- 172.21.15.173:0/1643277183 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0200490e0 con 0x55e225861790 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7f9f18e01640 1 -- 172.21.15.173:0/1643277183 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa020049280 con 0x55e225861790 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7f9f18e01640 1 -- 172.21.15.173:0/1643277183 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa020049560 con 0x55e225861790 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2258603d0 con 0x55e225861790 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.996+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2258608d0 con 0x55e225861790 2024-05-15T18:08:55.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.997+0000 7f9f18e01640 1 -- 172.21.15.173:0/1643277183 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa020044000 con 0x55e225861790 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.997+0000 7f9f18e01640 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f08036950 0x7f9f08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.997+0000 7f9f18e01640 1 -- 172.21.15.173:0/1643277183 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa02004dbe0 con 0x55e225861790 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.997+0000 7fa027fff640 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f08036950 0x7f9f08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.997+0000 7fa03103f800 1 Processor -- start 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa03103f800 1 -- start start 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa027fff640 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f08036950 0x7f9f08038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55e225962330 tx=0x7fa018005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa03103f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e2259884f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa03103f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e225953090 con 0x55e2259880d0 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e2259884f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e2259884f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43276/0 (socket says 172.21.15.173:43276) 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa02eb3e640 1 -- 172.21.15.173:0/4064667345 learned_addr learned my addr 172.21.15.173:0/4064667345 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa02eb3e640 1 -- 172.21.15.173:0/4064667345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e225988ac0 con 0x55e2259880d0 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/4064667345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e2259884f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa02001a6f0 tx=0x7fa020046f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e43b9ef67f00bf server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7f9f127fc640 1 -- 172.21.15.173:0/4064667345 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02005c070 con 0x55e2259880d0 2024-05-15T18:08:55.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7f9f127fc640 1 -- 172.21.15.173:0/4064667345 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa02003f000 con 0x55e2259880d0 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.998+0000 7f9f127fc640 1 -- 172.21.15.173:0/4064667345 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02003d070 con 0x55e2259880d0 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 -- 172.21.15.173:0/4064667345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 msgr2=0x55e2259884f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 --2- 172.21.15.173:0/4064667345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e2259884f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa02001a6f0 tx=0x7fa020046f80 comp rx=0 tx=0).stop 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 -- 172.21.15.173:0/4064667345 shutdown_connections 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 --2- 172.21.15.173:0/4064667345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e2259884f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 -- 172.21.15.173:0/4064667345 >> 172.21.15.173:0/4064667345 conn(0x55e2259843a0 msgr2=0x55e225982400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 -- 172.21.15.173:0/4064667345 shutdown_connections 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 -- 172.21.15.173:0/4064667345 wait complete. 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 Processor -- start 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 -- start start 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e22598f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:55.999+0000 7fa03103f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e225989120 con 0x55e2259880d0 2024-05-15T18:08:55.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e22598f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7fa02eb3e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e22598f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43280/0 (socket says 172.21.15.173:43280) 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 learned_addr learned my addr 172.21.15.173:0/1074333350 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22598f950 con 0x55e2259880d0 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e22598f410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa02000bc10 tx=0x7fa02003f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7f9f10ff9640 1 -- 172.21.15.173:0/1074333350 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa020067020 con 0x55e2259880d0 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7f9f10ff9640 1 -- 172.21.15.173:0/1074333350 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa020047680 con 0x55e2259880d0 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7f9f10ff9640 1 -- 172.21.15.173:0/1074333350 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa02005c040 con 0x55e2259880d0 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e22598f950 con 0x55e2259880d0 2024-05-15T18:08:55.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.000+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e22598f950 con 0x55e2259880d0 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.001+0000 7f9f10ff9640 1 -- 172.21.15.173:0/1074333350 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa02006a020 con 0x55e2259880d0 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.001+0000 7f9f10ff9640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ef8036900 0x7f9ef8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.001+0000 7f9f10ff9640 1 -- 172.21.15.173:0/1074333350 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa020052030 con 0x55e2259880d0 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.001+0000 7fa027fff640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ef8036900 0x7f9ef8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.002+0000 7fa027fff640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ef8036900 0x7f9ef8038dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55e22596acc0 tx=0x7fa01804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.002+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.002+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e22599aad0 0x55e22599cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.002+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e22599d6e0 con 0x55e22599aad0 2024-05-15T18:08:55.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.002+0000 7fa02f33f640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e22599aad0 0x55e22599cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.002+0000 7fa02f33f640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e22599aad0 0x55e22599cf90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 realm 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e22599daf0 con 0x55e22599aad0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e3c0 con 0x55e22599aad0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:55.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x55e22599aad0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e22599f4c0 0x55e2259a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a1ec0 con 0x55e22599f4c0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.003+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e22599f4c0 0x55e2259a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e22599f4c0 0x55e2259a18b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa03103f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa03103f800 20 searching for the correct realm 2024-05-15T18:08:55.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a37f0 con 0x55e22599f4c0 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa02eb3e640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa02006c020 0x7fa02004c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a37f0 con 0x7fa02006c020 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.004+0000 7fa027fff640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa02006c020 0x7fa02004c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.005+0000 7fa027fff640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa02006c020 0x7fa02004c530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.005+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.005+0000 7fa027fff640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa018074040 0x7fa018081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.005+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a37f0 con 0x7fa018074040 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.005+0000 7fa02f33f640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa018074040 0x7fa018081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.006+0000 7fa02f33f640 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa018074040 0x7fa018081410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.006+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa02800a4a0 con 0x7fa018074040 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.006+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x55e22599aad0 2024-05-15T18:08:55.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.006+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.006+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x55e22599aad0 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.006+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.006+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x7fa018074040 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x7fa018074040 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x7fa018074040 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x7fa018074040 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x7fa02006c020 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x55e22599f4c0 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.007+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x55e22599aad0 2024-05-15T18:08:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x7fa018074040 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x7fa018074040 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x55e22599aad0 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e22599e760 con 0x7fa02006c020 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.008+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa01808e060 con 0x55e22599f4c0 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa01808e060 con 0x55e22599f4c0 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa018074040 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x7fa018074040 2024-05-15T18:08:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599f4c0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.009+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599f4c0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599aad0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599aad0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa02800a4a0 con 0x55e22599aad0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa018074040 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa028033040 con 0x7fa018074040 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.010+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599f4c0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa02006c020 2024-05-15T18:08:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599aad0 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa018074040 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.011+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599f4c0 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa018074040 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa02006c020 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599f4c0 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.012+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa018074040 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.013+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.013+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x55e22599aad0 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.013+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.013+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fa020083040 con 0x7fa02006c020 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a2780 con 0x55e22599aad0 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a2b70 con 0x55e22599aad0 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.014+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a2b70 con 0x7fa018074040 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 zone default found 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 4 Realm: () 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 zonegroup default 2024-05-15T18:08:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a2300 con 0x7fa018074040 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a2300 con 0x55e22599f4c0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.015+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a5740 con 0x55e22599f4c0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.016+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.016+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.016+0000 7fa03103f800 20 started sync module instance, tier type = 2024-05-15T18:08:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.016+0000 7fa03103f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.016+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a4af0 con 0x7fa02006c020 2024-05-15T18:08:56.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.017+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.017+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94429781839632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a4750 con 0x7fa02006c020 2024-05-15T18:08:56.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.017+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a6670 con 0x55e22599aad0 2024-05-15T18:08:56.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.019+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.019+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94429781844896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a6e10 con 0x55e22599aad0 2024-05-15T18:08:56.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.019+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a7910 con 0x55e22599f4c0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.019+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94429781839632] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.020+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.020+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94429781849088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a7d30 con 0x55e22599f4c0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.020+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a8770 con 0x7fa02006c020 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.020+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94429781844896] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.022+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94429781849088] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.022+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.022+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94429781842848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a6860 con 0x7fa02006c020 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.022+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a9180 con 0x55e22599aad0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.025+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.025+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94429781855920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a98c0 con 0x55e22599aad0 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.025+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259aa3c0 con 0x7fa018074040 2024-05-15T18:08:56.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.027+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94429781842848] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.027+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.027+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94429781860016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259aa380 con 0x7fa018074040 2024-05-15T18:08:56.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.027+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259aae00 con 0x7fa018074040 2024-05-15T18:08:56.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.031+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94429781855920] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.031+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.031+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94429781862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259aadc0 con 0x7fa018074040 2024-05-15T18:08:56.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.031+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259ab810 con 0x7fa018074040 2024-05-15T18:08:56.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v29'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94429781860016] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94429781865312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259abc30 con 0x7fa018074040 2024-05-15T18:08:56.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 20 add_watcher() i=0 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 20 add_watcher() i=1 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 20 add_watcher() i=2 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 20 add_watcher() i=3 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 20 add_watcher() i=4 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 20 add_watcher() i=5 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94429781862640] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.033+0000 7fa03103f800 20 add_watcher() i=6 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.034+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94429781865312] v29'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.034+0000 7fa03103f800 20 add_watcher() i=7 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.034+0000 7fa03103f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.034+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a82a0 con 0x55e22599aad0 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.034+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.034+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94429781866368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a82a0 con 0x55e22599aad0 2024-05-15T18:08:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.036+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94429781866368] v29'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.036+0000 7f9ee57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.036+0000 7fa03103f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.036+0000 7fa03103f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.036+0000 7fa03103f800 5 note: GC not initialized 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7f9e5ffff640 20 reqs_thread_entry: start 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 20 Filter name: none 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7f9e5dffb640 20 reqs_thread_entry: start 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e1c50 con 0x55e22599aad0 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-15T18:08:56.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.037+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e03f0 con 0x55e22599aad0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e03f0 con 0x7fa018074040 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-05-15T18:08:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.038+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e0d30 con 0x55e22599aad0 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.039+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v29'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.039+0000 7fa03103f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.039+0000 7fa03103f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.039+0000 7fa03103f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.039+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94429782084128 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e5540 con 0x55e22599aad0 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.039+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify (1) cookie 94429781855920 notify 124554051584 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55e2259e10d0 con 0x55e22599aad0 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.039+0000 7f9f127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94429781855920 notifier 4287 bl.length()=567 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.040+0000 7f9f127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.040+0000 7f9f127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.040+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 notify.4 [notify cookie 94429782084128 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.040+0000 7f9f127fc640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9ef4003ea0 con 0x55e22599aad0 2024-05-15T18:08:56.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.040+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.040+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== watch-notify(notify_complete (2) cookie 94429782084128 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e2259e16a0 con 0x55e22599aad0 2024-05-15T18:08:56.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.040+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e09f0 con 0x55e22599aad0 2024-05-15T18:08:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.041+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.041+0000 7fa03103f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-15T18:08:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.041+0000 7fa03103f800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-15T18:08:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.041+0000 7fa03103f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-15T18:08:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.041+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94429782084080 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e5540 con 0x7fa02006c020 2024-05-15T18:08:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== watch-notify(notify (1) cookie 94429781842848 notify 124554051584 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7fa018088040 con 0x7fa02006c020 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7f9f11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94429781842848 notifier 4287 bl.length()=169 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7f9f11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7f9f11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(69 notify.3 [notify cookie 94429782084080 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7f9f11ffb640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9e64003400 con 0x7fa02006c020 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== watch-notify(notify_complete (2) cookie 94429782084080 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e2258690d0 con 0x7fa02006c020 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.042+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e3520 con 0x7fa018074040 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.043+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.043+0000 7fa03103f800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.043+0000 7fa03103f800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.043+0000 7fa03103f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.043+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94429782098048 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e2259e5960 con 0x7fa02006c020 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== watch-notify(notify (1) cookie 94429781842848 notify 124554051585 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55e2258690d0 con 0x7fa02006c020 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7f9f127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94429781842848 notifier 4287 bl.length()=177 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7f9f127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7f9f127fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-15T18:08:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(72 notify.3 [notify cookie 94429782098048 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7f9f127fc640 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9ef4003ea0 con 0x7fa02006c020 2024-05-15T18:08:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== watch-notify(notify_complete (2) cookie 94429782098048 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa018081950 con 0x7fa02006c020 2024-05-15T18:08:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.044+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.027 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.045+0000 7f9ee57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.045+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94429781866368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e225996f60 con 0x55e22599aad0 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.046+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94429781866368] v29'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.046+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94429781839632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259ab780 con 0x7fa02006c020 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.048+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94429781839632] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.048+0000 7fa03103f800 20 remove_watcher() i=0 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.048+0000 7fa03103f800 2 removed watcher, disabling cache 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.048+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94429781844896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259ab780 con 0x55e22599aad0 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.050+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94429781844896] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.050+0000 7fa03103f800 20 remove_watcher() i=1 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.050+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94429781849088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a63a0 con 0x55e22599f4c0 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.051+0000 7fa02eb3e640 1 -- 172.21.15.173:0/1074333350 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94429781849088] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa02002b070 con 0x55e22599f4c0 2024-05-15T18:08:56.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.051+0000 7fa03103f800 20 remove_watcher() i=2 2024-05-15T18:08:56.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.051+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94429781842848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259ab780 con 0x7fa02006c020 2024-05-15T18:08:56.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.052+0000 7fa027fff640 1 -- 172.21.15.173:0/1074333350 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94429781842848] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01807f070 con 0x7fa02006c020 2024-05-15T18:08:56.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.052+0000 7fa03103f800 20 remove_watcher() i=3 2024-05-15T18:08:56.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.052+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94429781855920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a7400 con 0x55e22599aad0 2024-05-15T18:08:56.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.053+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94429781855920] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x55e22599aad0 2024-05-15T18:08:56.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.053+0000 7fa03103f800 20 remove_watcher() i=4 2024-05-15T18:08:56.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.053+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94429781860016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a63a0 con 0x7fa018074040 2024-05-15T18:08:56.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.054+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94429781860016] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.054+0000 7fa03103f800 20 remove_watcher() i=5 2024-05-15T18:08:56.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.054+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94429781862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259ab780 con 0x7fa018074040 2024-05-15T18:08:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.056+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94429781862640] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.056+0000 7fa03103f800 20 remove_watcher() i=6 2024-05-15T18:08:56.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.056+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94429781865312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e2259a7400 con 0x7fa018074040 2024-05-15T18:08:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94429781865312] v29'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa028031040 con 0x7fa018074040 2024-05-15T18:08:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 20 remove_watcher() i=7 2024-05-15T18:08:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa018074040 msgr2=0x7fa018081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa018074040 0x7fa018081410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e22599aad0 msgr2=0x55e22599cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e22599aad0 0x55e22599cf90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa02006c020 msgr2=0x7fa02004c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa02006c020 0x7fa02004c530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e22599f4c0 msgr2=0x55e2259a18b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e22599f4c0 0x55e2259a18b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ef8036900 msgr2=0x7f9ef8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ef8036900 0x7f9ef8038dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55e22596acc0 tx=0x7fa01804f000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 msgr2=0x55e22598f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa02f33f640 1 -- 172.21.15.173:0/1074333350 reap_dead start 2024-05-15T18:08:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e22598f410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa02000bc10 tx=0x7fa02003f290 comp rx=0 tx=0).stop 2024-05-15T18:08:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 shutdown_connections 2024-05-15T18:08:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 --2- 172.21.15.173:0/1074333350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2259880d0 0x55e22598f410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 >> 172.21.15.173:0/1074333350 conn(0x55e2259843a0 msgr2=0x55e225981a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 shutdown_connections 2024-05-15T18:08:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.057+0000 7fa03103f800 1 -- 172.21.15.173:0/1074333350 wait complete. 2024-05-15T18:08:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f08036950 msgr2=0x7f9f08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f08036950 0x7f9f08038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55e225962330 tx=0x7fa018005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225861790 msgr2=0x55e22585fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225861790 0x55e22585fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa02004aa30 tx=0x7fa02004ac30 comp rx=0 tx=0).stop 2024-05-15T18:08:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 shutdown_connections 2024-05-15T18:08:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f08036950 0x7f9f08038e10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/1643277183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e225861790 0x55e22585fc00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 >> 172.21.15.173:0/1643277183 conn(0x55e22596cdc0 msgr2=0x55e22596d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 shutdown_connections 2024-05-15T18:08:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/1643277183 wait complete. 2024-05-15T18:08:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e225967d10 msgr2=0x55e22596a160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e225967d10 0x55e22596a160 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e225865380 msgr2=0x55e2259614f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e225865380 0x55e2259614f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e225963d80 msgr2=0x55e225966170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e225963d80 0x55e225966170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f14036950 msgr2=0x7f9f14038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9f14036950 0x7f9f14038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa018054000 tx=0x7fa01804e000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 msgr2=0x55e22595a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 --2- 172.21.15.173:0/2453316563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e2257d4860 0x55e22595a2b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa02000c010 tx=0x7fa020000ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa02f33f640 1 -- 172.21.15.173:0/2453316563 reap_dead start 2024-05-15T18:08:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 shutdown_connections 2024-05-15T18:08:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 >> 172.21.15.173:0/2453316563 conn(0x55e22585b500 msgr2=0x55e22594c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 shutdown_connections 2024-05-15T18:08:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.058+0000 7fa03103f800 1 -- 172.21.15.173:0/2453316563 wait complete. 2024-05-15T18:08:56.049 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:56.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-15T18:08:56.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-15T18:08:56.049 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-05-15T18:08:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:56.098 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:56.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281e4df800 1 Processor -- start 2024-05-15T18:08:56.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281e4df800 1 -- start start 2024-05-15T18:08:56.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281e4df800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e055abf720 0x55e055ac1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281e4df800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e055ac2050 con 0x55e055abbc10 2024-05-15T18:08:56.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281e4df800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55e05594c050 con 0x55e055abf720 2024-05-15T18:08:56.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281b7dd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e055abf720 0x55e055ac1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281bfde640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55e055abbc10 0x55e055abe000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35172/0 (socket says 172.21.15.173:35172) 2024-05-15T18:08:56.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.122+0000 7f281bfde640 1 -- 172.21.15.173:0/441194124 learned_addr learned my addr 172.21.15.173:0/441194124 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:56.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.123+0000 7f281b7dd640 1 -- 172.21.15.173:0/441194124 >> v1:172.21.15.3:6789/0 conn(0x55e055abbc10 legacy=0x55e055abe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.123+0000 7f281b7dd640 1 -- 172.21.15.173:0/441194124 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e055ac3230 con 0x55e055abf720 2024-05-15T18:08:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281b7dd640 1 --2- 172.21.15.173:0/441194124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abf720 0x55e055ac1b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f281000a470 tx=0x7f281001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab281974feabbcd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281afdc640 1 -- 172.21.15.173:0/441194124 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2810057070 con 0x55e055abf720 2024-05-15T18:08:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281afdc640 1 -- 172.21.15.173:0/441194124 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810052570 con 0x55e055abf720 2024-05-15T18:08:56.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281afdc640 1 -- 172.21.15.173:0/441194124 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2810052870 con 0x55e055abf720 2024-05-15T18:08:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281e4df800 1 -- 172.21.15.173:0/441194124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abf720 msgr2=0x55e055ac1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281e4df800 1 --2- 172.21.15.173:0/441194124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abf720 0x55e055ac1b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f281000a470 tx=0x7f281001ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281e4df800 1 -- 172.21.15.173:0/441194124 shutdown_connections 2024-05-15T18:08:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281e4df800 1 --2- 172.21.15.173:0/441194124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abf720 0x55e055ac1b10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281e4df800 1 -- 172.21.15.173:0/441194124 >> 172.21.15.173:0/441194124 conn(0x55e055ab55c0 msgr2=0x55e055ab79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281e4df800 1 -- 172.21.15.173:0/441194124 shutdown_connections 2024-05-15T18:08:56.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.125+0000 7f281e4df800 1 -- 172.21.15.173:0/441194124 wait complete. 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.139+0000 7f281e4df800 1 Processor -- start 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.139+0000 7f281e4df800 1 -- start start 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.139+0000 7f281e4df800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055abb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.139+0000 7f281e4df800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e055a061f0 con 0x55e055abbc10 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.139+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055abb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.140+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055abb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43298/0 (socket says 172.21.15.173:43298) 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.140+0000 7f281bfde640 1 -- 172.21.15.173:0/3563796831 learned_addr learned my addr 172.21.15.173:0/3563796831 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.140+0000 7f281bfde640 1 -- 172.21.15.173:0/3563796831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e055ab9b10 con 0x55e055abbc10 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.140+0000 7f281bfde640 1 --2- 172.21.15.173:0/3563796831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055abb550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f280c001610 tx=0x7f280c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f41144bd63a51e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.140+0000 7f2709e0b640 1 -- 172.21.15.173:0/3563796831 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c004520 con 0x55e055abbc10 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.140+0000 7f2709e0b640 1 -- 172.21.15.173:0/3563796831 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c0046e0 con 0x55e055abbc10 2024-05-15T18:08:56.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.140+0000 7f2709e0b640 1 -- 172.21.15.173:0/3563796831 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c004a80 con 0x55e055abbc10 2024-05-15T18:08:56.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 -- 172.21.15.173:0/3563796831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 msgr2=0x55e055abb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 --2- 172.21.15.173:0/3563796831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055abb550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f280c001610 tx=0x7f280c006f90 comp rx=0 tx=0).stop 2024-05-15T18:08:56.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 -- 172.21.15.173:0/3563796831 shutdown_connections 2024-05-15T18:08:56.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 --2- 172.21.15.173:0/3563796831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055abb550 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 -- 172.21.15.173:0/3563796831 >> 172.21.15.173:0/3563796831 conn(0x55e055ab55c0 msgr2=0x55e055ba7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 -- 172.21.15.173:0/3563796831 shutdown_connections 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 -- 172.21.15.173:0/3563796831 wait complete. 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 Processor -- start 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 -- start start 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055bb6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.141+0000 7f281e4df800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e055ac2520 con 0x55e055abbc10 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055bb6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055bb6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43300/0 (socket says 172.21.15.173:43300) 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f281bfde640 1 -- 172.21.15.173:0/2607437577 learned_addr learned my addr 172.21.15.173:0/2607437577 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f281bfde640 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e055bb6980 con 0x55e055abbc10 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f281bfde640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055bb6440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55e055abab80 tx=0x7f280c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f2703fff640 1 -- 172.21.15.173:0/2607437577 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c024070 con 0x55e055abbc10 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f2703fff640 1 -- 172.21.15.173:0/2607437577 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c019040 con 0x55e055abbc10 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f2703fff640 1 -- 172.21.15.173:0/2607437577 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c0138b0 con 0x55e055abbc10 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e055bb6c10 con 0x55e055abbc10 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.142+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e055bb98c0 con 0x55e055abbc10 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.143+0000 7f2703fff640 1 -- 172.21.15.173:0/2607437577 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f280c027070 con 0x55e055abbc10 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.143+0000 7f2703fff640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2704036950 0x7f2704038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.143+0000 7f2703fff640 1 -- 172.21.15.173:0/2607437577 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f280c04bae0 con 0x55e055abbc10 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.143+0000 7f281b7dd640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2704036950 0x7f2704038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.143+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055abf720 0x55e055bbd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.143+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bbdc00 con 0x55e055abf720 2024-05-15T18:08:56.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281c7df640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055abf720 0x55e055bbd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281b7dd640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2704036950 0x7f2704038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2810054000 tx=0x7f281004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281c7df640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055abf720 0x55e055bbd680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281c7df640 1 -- 172.21.15.173:0/2607437577 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055abf720 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bbac30 con 0x55e055abf720 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281c7df640 1 -- 172.21.15.173:0/2607437577 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28140083e0 con 0x55e055abf720 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bbff10 0x55e055bc2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bc29f0 con 0x55e055bbff10 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.144+0000 7f281bfde640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bbff10 0x55e055bc2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.145+0000 7f281bfde640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bbff10 0x55e055bc2300 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.145+0000 7f281bfde640 1 -- 172.21.15.173:0/2607437577 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f280c026030 con 0x55e055bbff10 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.145+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bbeec0 con 0x55e055abf720 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.145+0000 7f281c7df640 1 -- 172.21.15.173:0/2607437577 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28140083e0 con 0x55e055abf720 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.145+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e055bc3ea0 0x55e055bc62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.145+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bc6a60 con 0x55e055bc3ea0 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.146+0000 7f281b7dd640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e055bc3ea0 0x55e055bc62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.147+0000 7f281b7dd640 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e055bc3ea0 0x55e055bc62d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.148+0000 7f281b7dd640 1 -- 172.21.15.173:0/2607437577 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f281005a040 con 0x55e055bc3ea0 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.148+0000 7f281e4df800 1 Processor -- start 2024-05-15T18:08:56.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.148+0000 7f281e4df800 1 -- start start 2024-05-15T18:08:56.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.148+0000 7f281e4df800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055bd4ea0 0x55e055bd52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.148+0000 7f281e4df800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e0559accf0 con 0x55e055bd4ea0 2024-05-15T18:08:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055bd4ea0 0x55e055bd52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055bd4ea0 0x55e055bd52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43314/0 (socket says 172.21.15.173:43314) 2024-05-15T18:08:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f281bfde640 1 -- 172.21.15.173:0/4115584847 learned_addr learned my addr 172.21.15.173:0/4115584847 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f281bfde640 1 -- 172.21.15.173:0/4115584847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e055bd5800 con 0x55e055bd4ea0 2024-05-15T18:08:56.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f281bfde640 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055bd4ea0 0x55e055bd52c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f280c010520 tx=0x7f280c0473b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f27017fa640 1 -- 172.21.15.173:0/4115584847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c013c30 con 0x55e055bd4ea0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f27017fa640 1 -- 172.21.15.173:0/4115584847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c013dd0 con 0x55e055bd4ea0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e055bd6270 con 0x55e055bd4ea0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f27017fa640 1 -- 172.21.15.173:0/4115584847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c0430d0 con 0x55e055bd4ea0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.150+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e055bd6770 con 0x55e055bd4ea0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.151+0000 7f27017fa640 1 -- 172.21.15.173:0/4115584847 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f280c030070 con 0x55e055bd4ea0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.151+0000 7f27017fa640 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26f4036950 0x7f26f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.151+0000 7f27017fa640 1 -- 172.21.15.173:0/4115584847 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f280c03b3f0 con 0x55e055bd4ea0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.151+0000 7f281b7dd640 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26f4036950 0x7f26f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281e4df800 1 Processor -- start 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281e4df800 1 -- start start 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281b7dd640 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26f4036950 0x7f26f4038e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55e055bbe0b0 tx=0x7f2810005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281e4df800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281e4df800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e055ab9e90 con 0x55e055be1ff0 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43328/0 (socket says 172.21.15.173:43328) 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281bfde640 1 -- 172.21.15.173:0/153793249 learned_addr learned my addr 172.21.15.173:0/153793249 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281bfde640 1 -- 172.21.15.173:0/153793249 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e055be29e0 con 0x55e055be1ff0 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.152+0000 7f281bfde640 1 --2- 172.21.15.173:0/153793249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be2410 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f280c025fd0 tx=0x7f280c026d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52000985b92d89 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f26faffd640 1 -- 172.21.15.173:0/153793249 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c03ed60 con 0x55e055be1ff0 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f26faffd640 1 -- 172.21.15.173:0/153793249 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c0109b0 con 0x55e055be1ff0 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f26faffd640 1 -- 172.21.15.173:0/153793249 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c03e2a0 con 0x55e055be1ff0 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 -- 172.21.15.173:0/153793249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 msgr2=0x55e055be2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 --2- 172.21.15.173:0/153793249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be2410 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f280c025fd0 tx=0x7f280c026d50 comp rx=0 tx=0).stop 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 -- 172.21.15.173:0/153793249 shutdown_connections 2024-05-15T18:08:56.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 --2- 172.21.15.173:0/153793249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be2410 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 -- 172.21.15.173:0/153793249 >> 172.21.15.173:0/153793249 conn(0x55e055bde2c0 msgr2=0x55e055bdc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 -- 172.21.15.173:0/153793249 shutdown_connections 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 -- 172.21.15.173:0/153793249 wait complete. 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 Processor -- start 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 -- start start 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.153+0000 7f281e4df800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e055be30b0 con 0x55e055be1ff0 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f281bfde640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43332/0 (socket says 172.21.15.173:43332) 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 learned_addr learned my addr 172.21.15.173:0/1517112698 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e055be98e0 con 0x55e055be1ff0 2024-05-15T18:08:56.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f281bfde640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be93a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f280c010960 tx=0x7f280c032560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f26f97fa640 1 -- 172.21.15.173:0/1517112698 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c04b440 con 0x55e055be1ff0 2024-05-15T18:08:56.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f26f97fa640 1 -- 172.21.15.173:0/1517112698 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c063030 con 0x55e055be1ff0 2024-05-15T18:08:56.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e055be98e0 con 0x55e055be1ff0 2024-05-15T18:08:56.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f26f97fa640 1 -- 172.21.15.173:0/1517112698 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f280c03e4c0 con 0x55e055be1ff0 2024-05-15T18:08:56.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.154+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e055be98e0 con 0x55e055be1ff0 2024-05-15T18:08:56.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.155+0000 7f26f97fa640 1 -- 172.21.15.173:0/1517112698 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f280c010070 con 0x55e055be1ff0 2024-05-15T18:08:56.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.155+0000 7f26f97fa640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26e4036950 0x7f26e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.155+0000 7f26f97fa640 1 -- 172.21.15.173:0/1517112698 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f280c00c150 con 0x55e055be1ff0 2024-05-15T18:08:56.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.155+0000 7f281b7dd640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26e4036950 0x7f26e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281b7dd640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26e4036950 0x7f26e4038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55e055bc6e60 tx=0x7f281004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055bf4b70 0x55e055bf7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf7780 con 0x55e055bf4b70 2024-05-15T18:08:56.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281c7df640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055bf4b70 0x55e055bf7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281c7df640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055bf4b70 0x55e055bf7030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.156+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 realm 2024-05-15T18:08:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf7b90 con 0x55e055bf4b70 2024-05-15T18:08:56.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x55e055bf4b70 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8800 con 0x55e055bf4b70 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bf91c0 0x55e055bfb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfbc00 con 0x55e055bf91c0 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.157+0000 7f281bfde640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bf91c0 0x55e055bfb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281bfde640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bf91c0 0x55e055bfb5b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281e4df800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281e4df800 20 searching for the correct realm 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfd510 con 0x55e055bf91c0 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281bfde640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f280c032030 0x7f280c032680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfd510 con 0x7f280c032030 2024-05-15T18:08:56.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.158+0000 7f281b7dd640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f280c032030 0x7f280c032680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.159+0000 7f281b7dd640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f280c032030 0x7f280c032680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.159+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.159+0000 7f281b7dd640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2810074040 0x7f2810081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.159+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfd510 con 0x7f2810074040 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.159+0000 7f281c7df640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2810074040 0x7f2810081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.159+0000 7f281c7df640 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2810074040 0x7f2810081410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x55e055bf4b70 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x55e055bf4b70 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x7f2810074040 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.160+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x7f2810074040 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x7f280c032030 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x55e055bf91c0 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x55e055bf4b70 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.161+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x7f2810074040 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x55e055bf4b70 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e055bf8460 con 0x7f280c032030 2024-05-15T18:08:56.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f281008e060 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.162+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f281008e060 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f281008e060 con 0x7f2810074040 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.163+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf4b70 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf4b70 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x7f2810074040 2024-05-15T18:08:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf91c0 2024-05-15T18:08:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.164+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x7f280c032030 2024-05-15T18:08:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf4b70 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x7f2810074040 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf91c0 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.165+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x7f2810074040 2024-05-15T18:08:56.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.166+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.166+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x7f280c032030 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.166+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.166+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf91c0 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.166+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.166+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x7f2810074040 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x55e055bf4b70 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f2814026040 con 0x7f280c032030 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfbfa0 con 0x55e055bf4b70 2024-05-15T18:08:56.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.167+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfc390 con 0x55e055bf4b70 2024-05-15T18:08:56.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfc390 con 0x7f2810074040 2024-05-15T18:08:56.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 zone default found 2024-05-15T18:08:56.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 4 Realm: () 2024-05-15T18:08:56.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 zonegroup default 2024-05-15T18:08:56.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfc890 con 0x7f2810074040 2024-05-15T18:08:56.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.168+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfc890 con 0x55e055bf91c0 2024-05-15T18:08:56.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055bff460 con 0x55e055bf91c0 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281e4df800 20 started sync module instance, tier type = 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281e4df800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.169+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfe810 con 0x7f280c032030 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.173+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.173+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421999676416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfe470 con 0x7f280c032030 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.173+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c00390 con 0x55e055bf4b70 2024-05-15T18:08:56.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.174+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421999676416] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.174+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.174+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421999681248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c007b0 con 0x55e055bf4b70 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.174+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c01170 con 0x55e055bf91c0 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.176+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.176+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421999684800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c01a10 con 0x55e055bf91c0 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.176+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c024d0 con 0x7f280c032030 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.176+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421999681248] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.177+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.177+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421999689632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c028c0 con 0x7f280c032030 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.177+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c03340 con 0x55e055bf4b70 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.177+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421999684800] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.178+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.178+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421999693360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c03300 con 0x55e055bf4b70 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.178+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c03dc0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.179+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421999689632] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.179+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421999693360] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.180+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.180+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421999687008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c03dc0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.180+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c041f0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.181+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421999687008] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.181+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.181+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421999682304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c03910 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.181+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c04c30 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421999682304] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421999697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c04c30 con 0x7f2810074040 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 20 add_watcher() i=0 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 20 add_watcher() i=1 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 20 add_watcher() i=2 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 20 add_watcher() i=3 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 20 add_watcher() i=4 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 20 add_watcher() i=5 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.182+0000 7f281e4df800 20 add_watcher() i=6 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.183+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421999697824] v29'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.183+0000 7f281e4df800 20 add_watcher() i=7 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.183+0000 7f281e4df800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.183+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055c08050 con 0x55e055bf4b70 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.184+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.184+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421999700352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c054c0 con 0x55e055bf4b70 2024-05-15T18:08:56.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421999700352] v29'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f26d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 5 note: GC not initialized 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f26d0fe1640 20 reqs_thread_entry: start 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 20 Filter name: none 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f264a7fc640 20 reqs_thread_entry: start 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.185+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055c3b520 con 0x7f2810074040 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055c39cc0 con 0x55e055bf4b70 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 20 rados_obj.operate() r=0 bl.length=7 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.186+0000 7f281e4df800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e055c3a0b0 con 0x55e055bf4b70 2024-05-15T18:08:56.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.187+0000 7f281e4df800 20 get_user_info_from_index found 0 xattrs 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.188+0000 7f26d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.188+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421999700352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c076d0 con 0x55e055bf4b70 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.189+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94421999700352] v29'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.189+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421999676416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c04950 con 0x7f280c032030 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.190+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94421999676416] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.190+0000 7f281e4df800 20 remove_watcher() i=0 2024-05-15T18:08:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.190+0000 7f281e4df800 2 removed watcher, disabling cache 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.190+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421999681248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfec00 con 0x55e055bf4b70 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.191+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94421999681248] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.191+0000 7f281e4df800 20 remove_watcher() i=1 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.191+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421999684800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfec00 con 0x55e055bf91c0 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.192+0000 7f281bfde640 1 -- 172.21.15.173:0/1517112698 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94421999684800] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f280c054070 con 0x55e055bf91c0 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.192+0000 7f281e4df800 20 remove_watcher() i=2 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.192+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421999689632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfec00 con 0x7f280c032030 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.193+0000 7f281b7dd640 1 -- 172.21.15.173:0/1517112698 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94421999689632] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f281007f070 con 0x7f280c032030 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.193+0000 7f281e4df800 20 remove_watcher() i=3 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.193+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421999693360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c01fa0 con 0x55e055bf4b70 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.194+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94421999693360] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x55e055bf4b70 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.194+0000 7f281e4df800 20 remove_watcher() i=4 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.194+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421999687008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055bfec00 con 0x7f2810074040 2024-05-15T18:08:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.195+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94421999687008] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.195+0000 7f281e4df800 20 remove_watcher() i=5 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.195+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421999682304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c02e30 con 0x7f2810074040 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.196+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94421999682304] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.196+0000 7f281e4df800 20 remove_watcher() i=6 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.196+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421999697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e055c02e30 con 0x7f2810074040 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.197+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94421999697824] v29'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28140083e0 con 0x7f2810074040 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.197+0000 7f281e4df800 20 remove_watcher() i=7 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2810074040 msgr2=0x7f2810081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2810074040 0x7f2810081410 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055bf4b70 msgr2=0x55e055bf7030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055bf4b70 0x55e055bf7030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f280c032030 msgr2=0x7f280c032680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f280c032030 0x7f280c032680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bf91c0 msgr2=0x55e055bfb5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bf91c0 0x55e055bfb5b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26e4036950 msgr2=0x7f26e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26e4036950 0x7f26e4038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55e055bc6e60 tx=0x7f281004f000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 msgr2=0x55e055be93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281c7df640 1 -- 172.21.15.173:0/1517112698 reap_dead start 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be93a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f280c010960 tx=0x7f280c032560 comp rx=0 tx=0).stop 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 shutdown_connections 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/1517112698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055be1ff0 0x55e055be93a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 >> 172.21.15.173:0/1517112698 conn(0x55e055bde2c0 msgr2=0x55e055bdb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 shutdown_connections 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/1517112698 wait complete. 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26f4036950 msgr2=0x7f26f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26f4036950 0x7f26f4038e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55e055bbe0b0 tx=0x7f2810005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:56.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055bd4ea0 msgr2=0x55e055bd52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055bd4ea0 0x55e055bd52c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f280c010520 tx=0x7f280c0473b0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 shutdown_connections 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f26f4036950 0x7f26f4038e10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 --2- 172.21.15.173:0/4115584847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055bd4ea0 0x55e055bd52c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 >> 172.21.15.173:0/4115584847 conn(0x55e055bc8f40 msgr2=0x55e055bc9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 shutdown_connections 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.198+0000 7f281e4df800 1 -- 172.21.15.173:0/4115584847 wait complete. 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e055bc3ea0 msgr2=0x55e055bc62d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e055bc3ea0 0x55e055bc62d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055abf720 msgr2=0x55e055bbd680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e055abf720 0x55e055bbd680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bbff10 msgr2=0x55e055bc2300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e055bbff10 0x55e055bc2300 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2704036950 msgr2=0x7f2704038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2704036950 0x7f2704038e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2810054000 tx=0x7f281004e000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 msgr2=0x55e055bb6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 --2- 172.21.15.173:0/2607437577 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e055abbc10 0x55e055bb6440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55e055abab80 tx=0x7f280c000f40 comp rx=0 tx=0).stop 2024-05-15T18:08:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281c7df640 1 -- 172.21.15.173:0/2607437577 reap_dead start 2024-05-15T18:08:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 shutdown_connections 2024-05-15T18:08:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 >> 172.21.15.173:0/2607437577 conn(0x55e055ab55c0 msgr2=0x55e055aba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 shutdown_connections 2024-05-15T18:08:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.199+0000 7f281e4df800 1 -- 172.21.15.173:0/2607437577 wait complete. 2024-05-15T18:08:56.201 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-05-15T18:08:56.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.202 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:56.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b9616800 1 Processor -- start 2024-05-15T18:08:56.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b9616800 1 -- start start 2024-05-15T18:08:56.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b9616800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557cde5f3990 0x557cde5f1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b9616800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557cde5f2920 con 0x557cde5f23e0 2024-05-15T18:08:56.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b9616800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x557cde50f050 con 0x557cde5f3990 2024-05-15T18:08:56.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b4c84640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557cde5f3990 0x557cde5f1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b4483640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x557cde5f23e0 0x557cde685ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35176/0 (socket says 172.21.15.173:35176) 2024-05-15T18:08:56.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b4483640 1 -- 172.21.15.173:0/2354704473 learned_addr learned my addr 172.21.15.173:0/2354704473 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:56.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b4c84640 1 -- 172.21.15.173:0/2354704473 >> v1:172.21.15.3:6789/0 conn(0x557cde5f23e0 legacy=0x557cde685ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.271+0000 7f72b4c84640 1 -- 172.21.15.173:0/2354704473 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde5f2af0 con 0x557cde5f3990 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.273+0000 7f72b4c84640 1 --2- 172.21.15.173:0/2354704473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f3990 0x557cde5f1ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f72ac005fd0 tx=0x7f72ac01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6785dcd96d1849 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.273+0000 7f72b3c82640 1 -- 172.21.15.173:0/2354704473 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac052560 con 0x557cde5f3990 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.273+0000 7f72b3c82640 1 -- 172.21.15.173:0/2354704473 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac052700 con 0x557cde5f3990 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.273+0000 7f72b3c82640 1 -- 172.21.15.173:0/2354704473 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac052a60 con 0x557cde5f3990 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.274+0000 7f72b9616800 1 -- 172.21.15.173:0/2354704473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f3990 msgr2=0x557cde5f1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.274+0000 7f72b9616800 1 --2- 172.21.15.173:0/2354704473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f3990 0x557cde5f1ea0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f72ac005fd0 tx=0x7f72ac01ccc0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.274+0000 7f72b9616800 1 -- 172.21.15.173:0/2354704473 shutdown_connections 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.274+0000 7f72b9616800 1 --2- 172.21.15.173:0/2354704473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f3990 0x557cde5f1ea0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.274+0000 7f72b9616800 1 -- 172.21.15.173:0/2354704473 >> 172.21.15.173:0/2354704473 conn(0x557cde679780 msgr2=0x557cde67bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.274+0000 7f72b9616800 1 -- 172.21.15.173:0/2354704473 shutdown_connections 2024-05-15T18:08:56.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.274+0000 7f72b9616800 1 -- 172.21.15.173:0/2354704473 wait complete. 2024-05-15T18:08:56.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.288+0000 7f72b9616800 1 Processor -- start 2024-05-15T18:08:56.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.288+0000 7f72b9616800 1 -- start start 2024-05-15T18:08:56.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.288+0000 7f72b9616800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde771930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.288+0000 7f72b9616800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557cde5c91d0 con 0x557cde5f23e0 2024-05-15T18:08:56.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.288+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde771930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.289+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde771930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43364/0 (socket says 172.21.15.173:43364) 2024-05-15T18:08:56.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.289+0000 7f72b4c84640 1 -- 172.21.15.173:0/1564302150 learned_addr learned my addr 172.21.15.173:0/1564302150 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.289+0000 7f72b4c84640 1 -- 172.21.15.173:0/1564302150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde771f00 con 0x557cde5f23e0 2024-05-15T18:08:56.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.289+0000 7f72b4c84640 1 --2- 172.21.15.173:0/1564302150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde771930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f72ac007000 tx=0x7f72ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9117911f39f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.289+0000 7f71a2e0d640 1 -- 172.21.15.173:0/1564302150 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac0529e0 con 0x557cde5f23e0 2024-05-15T18:08:56.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.289+0000 7f71a2e0d640 1 -- 172.21.15.173:0/1564302150 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac052b80 con 0x557cde5f23e0 2024-05-15T18:08:56.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.289+0000 7f71a2e0d640 1 -- 172.21.15.173:0/1564302150 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac05c430 con 0x557cde5f23e0 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 -- 172.21.15.173:0/1564302150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 msgr2=0x557cde771930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 --2- 172.21.15.173:0/1564302150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde771930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f72ac007000 tx=0x7f72ac04c000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 -- 172.21.15.173:0/1564302150 shutdown_connections 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 --2- 172.21.15.173:0/1564302150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde771930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 -- 172.21.15.173:0/1564302150 >> 172.21.15.173:0/1564302150 conn(0x557cde679780 msgr2=0x557cde76d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 -- 172.21.15.173:0/1564302150 shutdown_connections 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 -- 172.21.15.173:0/1564302150 wait complete. 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 Processor -- start 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.290+0000 7f72b9616800 1 -- start start 2024-05-15T18:08:56.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b9616800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde7793c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b9616800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557cde689a20 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde7793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde7793c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43372/0 (socket says 172.21.15.173:43372) 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b4c84640 1 -- 172.21.15.173:0/1705783265 learned_addr learned my addr 172.21.15.173:0/1705783265 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b4c84640 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde779900 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b4c84640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde7793c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0526d0 tx=0x7f72ac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f71a160a640 1 -- 172.21.15.173:0/1705783265 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac075070 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f71a160a640 1 -- 172.21.15.173:0/1705783265 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac070540 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f71a160a640 1 -- 172.21.15.173:0/1705783265 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac070820 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.291+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cde779b90 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.292+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cde77c840 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.292+0000 7f71a160a640 1 -- 172.21.15.173:0/1705783265 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72ac078070 con 0x557cde5f23e0 2024-05-15T18:08:56.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.292+0000 7f71a160a640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f719c036950 0x7f719c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f71a160a640 1 -- 172.21.15.173:0/1705783265 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72ac06d070 con 0x557cde5f23e0 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b4483640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f719c036950 0x7f719c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde5f3990 0x557cde780600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde780b80 con 0x557cde5f3990 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b5485640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde5f3990 0x557cde780600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b4483640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f719c036950 0x7f719c038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f729c000f60 tx=0x7f729c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b5485640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde5f3990 0x557cde780600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b5485640 1 -- 172.21.15.173:0/1705783265 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde5f3990 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.293+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde77dbb0 con 0x557cde5f3990 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.294+0000 7f72b5485640 1 -- 172.21.15.173:0/1705783265 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde5f3990 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.294+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde782ec0 0x557cde7852b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.294+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7859a0 con 0x557cde782ec0 2024-05-15T18:08:56.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.294+0000 7f72b4c84640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde782ec0 0x557cde7852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.294+0000 7f72b4c84640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde782ec0 0x557cde7852b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.294+0000 7f72b4c84640 1 -- 172.21.15.173:0/1705783265 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72ac077030 con 0x557cde782ec0 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.294+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde781e70 con 0x557cde5f3990 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.295+0000 7f72b5485640 1 -- 172.21.15.173:0/1705783265 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde5f3990 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.295+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557cde786e50 0x557cde789280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.295+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde789a10 con 0x557cde786e50 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.295+0000 7f72b4483640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557cde786e50 0x557cde789280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.295+0000 7f72b4483640 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557cde786e50 0x557cde789280 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.295+0000 7f72b4483640 1 -- 172.21.15.173:0/1705783265 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f729c009050 con 0x557cde786e50 2024-05-15T18:08:56.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.296+0000 7f72b9616800 1 Processor -- start 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.296+0000 7f72b9616800 1 -- start start 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.296+0000 7f72b9616800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde797e70 0x557cde798290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.296+0000 7f72b9616800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557cde56fcf0 con 0x557cde797e70 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.296+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde797e70 0x557cde798290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.296+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde797e70 0x557cde798290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43376/0 (socket says 172.21.15.173:43376) 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.296+0000 7f72b4c84640 1 -- 172.21.15.173:0/597869723 learned_addr learned my addr 172.21.15.173:0/597869723 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.297+0000 7f72b4c84640 1 -- 172.21.15.173:0/597869723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde7987d0 con 0x557cde797e70 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.297+0000 7f72b4c84640 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde797e70 0x557cde798290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72ac051fd0 tx=0x7f72ac051e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.297+0000 7f719a7fc640 1 -- 172.21.15.173:0/597869723 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac06f4a0 con 0x557cde797e70 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.297+0000 7f719a7fc640 1 -- 172.21.15.173:0/597869723 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac0793b0 con 0x557cde797e70 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.297+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cde799240 con 0x557cde797e70 2024-05-15T18:08:56.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.297+0000 7f719a7fc640 1 -- 172.21.15.173:0/597869723 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac079690 con 0x557cde797e70 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.297+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cde799740 con 0x557cde797e70 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.298+0000 7f719a7fc640 1 -- 172.21.15.173:0/597869723 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72ac088070 con 0x557cde797e70 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.298+0000 7f719a7fc640 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f718c0369a0 0x7f718c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.298+0000 7f719a7fc640 1 -- 172.21.15.173:0/597869723 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72ac085070 con 0x557cde797e70 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.298+0000 7f72b4483640 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f718c0369a0 0x7f718c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.298+0000 7f72b9616800 1 Processor -- start 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b9616800 1 -- start start 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b4483640 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f718c0369a0 0x7f718c038e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bf50 tx=0x7f729c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b9616800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7a5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b9616800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557cde772220 con 0x557cde7a5010 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43382/0 (socket says 172.21.15.173:43382) 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b4c84640 1 -- 172.21.15.173:0/213880272 learned_addr learned my addr 172.21.15.173:0/213880272 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b4c84640 1 -- 172.21.15.173:0/213880272 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde7a5a00 con 0x557cde7a5010 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.299+0000 7f72b4c84640 1 --2- 172.21.15.173:0/213880272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7a5430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f72ac079eb0 tx=0x7f72ac098f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3018bd009009eee server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f718bfff640 1 -- 172.21.15.173:0/213880272 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac070af0 con 0x557cde7a5010 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f718bfff640 1 -- 172.21.15.173:0/213880272 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac078540 con 0x557cde7a5010 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f718bfff640 1 -- 172.21.15.173:0/213880272 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac0788c0 con 0x557cde7a5010 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 -- 172.21.15.173:0/213880272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 msgr2=0x557cde7a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 --2- 172.21.15.173:0/213880272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7a5430 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f72ac079eb0 tx=0x7f72ac098f80 comp rx=0 tx=0).stop 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 -- 172.21.15.173:0/213880272 shutdown_connections 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 --2- 172.21.15.173:0/213880272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7a5430 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 -- 172.21.15.173:0/213880272 >> 172.21.15.173:0/213880272 conn(0x557cde7a12e0 msgr2=0x557cde79f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 -- 172.21.15.173:0/213880272 shutdown_connections 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 -- 172.21.15.173:0/213880272 wait complete. 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 Processor -- start 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.300+0000 7f72b9616800 1 -- start start 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b9616800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b9616800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557cde7a6060 con 0x557cde7a5010 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b4c84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7ac360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43394/0 (socket says 172.21.15.173:43394) 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 learned_addr learned my addr 172.21.15.173:0/2175083450 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cde7ac8a0 con 0x557cde7a5010 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b4c84640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7ac360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f72ac07a830 tx=0x7f72ac067180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f718a7fc640 1 -- 172.21.15.173:0/2175083450 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac07a8a0 con 0x557cde7a5010 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f718a7fc640 1 -- 172.21.15.173:0/2175083450 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac07aa40 con 0x557cde7a5010 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cde7ac8a0 con 0x557cde7a5010 2024-05-15T18:08:56.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.301+0000 7f718a7fc640 1 -- 172.21.15.173:0/2175083450 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72ac07ad20 con 0x557cde7a5010 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.302+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cde7ac8a0 con 0x557cde7a5010 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.302+0000 7f718a7fc640 1 -- 172.21.15.173:0/2175083450 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72ac0ab040 con 0x557cde7a5010 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.302+0000 7f718a7fc640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7180036900 0x7f7180038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f718a7fc640 1 -- 172.21.15.173:0/2175083450 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72ac0a9020 con 0x557cde7a5010 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b4483640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7180036900 0x7f7180038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde7b78f0 0x557cde7b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7ba500 con 0x557cde7b78f0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b5485640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde7b78f0 0x557cde7b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b4483640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7180036900 0x7f7180038dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f729c001b60 tx=0x7f729c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b5485640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde7b78f0 0x557cde7b9db0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b9616800 20 realm 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.303+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7ba910 con 0x557cde7b78f0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x557cde7b78f0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb580 con 0x557cde7b78f0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde7bbf40 0x557cde7be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7be870 con 0x557cde7bbf40 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b4c84640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde7bbf40 0x557cde7be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.304+0000 7f72b4c84640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde7bbf40 0x557cde7be330 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b9616800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b9616800 20 searching for the correct realm 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c0280 con 0x557cde7bbf40 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b4c84640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72ac0ae040 0x7f72ac062200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c0280 con 0x7f72ac0ae040 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.305+0000 7f72b4483640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72ac0ae040 0x7f72ac062200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.306+0000 7f72b4483640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72ac0ae040 0x7f72ac062200 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.306+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.306+0000 7f72b4483640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c037040 0x7f729c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.306+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c0280 con 0x7f729c037040 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.306+0000 7f72b5485640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c037040 0x7f729c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.306+0000 7f72b5485640 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c037040 0x7f729c036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x557cde7b78f0 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x557cde7b78f0 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x7f729c037040 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.307+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x7f729c037040 2024-05-15T18:08:56.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x7f72ac0ae040 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x557cde7bbf40 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x557cde7b78f0 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.308+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f729c037040 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7b78f0 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f72ac0ae040 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7bbf40 2024-05-15T18:08:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7bbf40 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.309+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.310+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f729c037040 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.310+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.310+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7bbf40 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.310+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.310+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7bbf40 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.311+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.311+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7b78f0 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.311+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.311+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7b78f0 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.311+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.311+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f729c037040 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7bbf40 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f72ac0ae040 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7b78f0 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.312+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f729c037040 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7bbf40 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f729c037040 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f72ac0ae040 2024-05-15T18:08:56.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.313+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7bbf40 2024-05-15T18:08:56.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f729c037040 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x557cde7b78f0 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f72a4026040 con 0x7f72ac0ae040 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b9616800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b9616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b9616800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b9616800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b9616800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b9616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.314+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bb1e0 con 0x557cde7b78f0 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bf210 con 0x557cde7b78f0 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bf210 con 0x7f729c037040 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 zone default found 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 4 Realm: () 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 zonegroup default 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.315+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bf630 con 0x7f729c037040 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bfa50 con 0x557cde7bbf40 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7bfeb0 con 0x557cde7bbf40 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 20 started sync module instance, tier type = 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.316+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c15d0 con 0x7f72ac0ae040 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.317+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.317+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93994796980592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c2240 con 0x7f72ac0ae040 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.317+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c2c00 con 0x557cde7b78f0 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.318+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93994796980592] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.318+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.318+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93994796984144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c2b70 con 0x557cde7b78f0 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.318+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c3ac0 con 0x557cde7bbf40 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.320+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.320+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93994796987920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c4360 con 0x557cde7bbf40 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.320+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c4e10 con 0x7f72ac0ae040 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.321+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.321+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93994796995072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c5ad0 con 0x7f72ac0ae040 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.321+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c6510 con 0x557cde7b78f0 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.322+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93994796984144] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.322+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93994796987920] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.322+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.322+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93994796990128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c2ff0 con 0x557cde7b78f0 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.322+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c6df0 con 0x7f729c037040 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.323+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93994796995072] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.323+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.323+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93994796996128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c6d60 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.324+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c7800 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.325+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93994796990128] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.325+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.325+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93994796996128] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.325+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93994796998624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c7800 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.325+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c68b0 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93994797000880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c81c0 con 0x7f729c037040 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 20 add_watcher() i=0 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 20 add_watcher() i=1 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 20 add_watcher() i=2 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 20 add_watcher() i=3 2024-05-15T18:08:56.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 20 add_watcher() i=4 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 20 add_watcher() i=5 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93994796998624] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.327+0000 7f72b9616800 20 add_watcher() i=6 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.328+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93994797000880] v29'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.328+0000 7f72b9616800 20 add_watcher() i=7 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.328+0000 7f72b9616800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.328+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c81c0 con 0x557cde7b78f0 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.329+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.329+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93994797006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c8130 con 0x557cde7b78f0 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93994797006096] v29'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f716afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f72b9616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f72b9616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f72b9616800 5 note: GC not initialized 2024-05-15T18:08:56.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f7169fe3640 20 reqs_thread_entry: start 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f72b9616800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.330+0000 7f72b9616800 20 Filter name: none 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.331+0000 7f70db7fe640 20 reqs_thread_entry: start 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.331+0000 7f72b9616800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.331+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557cde7fe180 con 0x557cde7b78f0 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.331+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.331+0000 7f72b9616800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:56.317 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:56.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.332+0000 7f716afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.332+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93994797006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7fd0d0 con 0x557cde7b78f0 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.333+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93994797006096] v29'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.333+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93994796980592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c7d10 con 0x7f72ac0ae040 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.334+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93994796980592] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.334+0000 7f72b9616800 20 remove_watcher() i=0 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.334+0000 7f72b9616800 2 removed watcher, disabling cache 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.334+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93994796984144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c1970 con 0x557cde7b78f0 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.335+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93994796984144] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.335+0000 7f72b9616800 20 remove_watcher() i=1 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.335+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93994796987920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c1970 con 0x557cde7bbf40 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.336+0000 7f72b4c84640 1 -- 172.21.15.173:0/2175083450 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93994796987920] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac0a2030 con 0x557cde7bbf40 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.336+0000 7f72b9616800 20 remove_watcher() i=2 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.336+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93994796995072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c2750 con 0x7f72ac0ae040 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.337+0000 7f72b4483640 1 -- 172.21.15.173:0/2175083450 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93994796995072] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c009050 con 0x7f72ac0ae040 2024-05-15T18:08:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.337+0000 7f72b9616800 20 remove_watcher() i=3 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.337+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93994796990128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c2750 con 0x557cde7b78f0 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.338+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93994796990128] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x557cde7b78f0 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.338+0000 7f72b9616800 20 remove_watcher() i=4 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.338+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93994796996128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c3eb0 con 0x7f729c037040 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.339+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93994796996128] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.339+0000 7f72b9616800 20 remove_watcher() i=5 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.339+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93994796998624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c3eb0 con 0x7f729c037040 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.340+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93994796998624] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.340+0000 7f72b9616800 20 remove_watcher() i=6 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.340+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93994797000880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557cde7c2750 con 0x7f729c037040 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93994797000880] v29'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a40083e0 con 0x7f729c037040 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 20 remove_watcher() i=7 2024-05-15T18:08:56.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c037040 msgr2=0x7f729c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c037040 0x7f729c036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde7b78f0 msgr2=0x557cde7b9db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde7b78f0 0x557cde7b9db0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72ac0ae040 msgr2=0x7f72ac062200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72ac0ae040 0x7f72ac062200 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde7bbf40 msgr2=0x557cde7be330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.341+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde7bbf40 0x557cde7be330 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7180036900 msgr2=0x7f7180038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7180036900 0x7f7180038dc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f729c001b60 tx=0x7f729c010000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 msgr2=0x557cde7ac360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/2175083450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde7a5010 0x557cde7ac360 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f72ac07a830 tx=0x7f72ac067180 comp rx=0 tx=0).stop 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 reap_dead start 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b5485640 1 -- 172.21.15.173:0/2175083450 reap_dead start 2024-05-15T18:08:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 shutdown_connections 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 >> 172.21.15.173:0/2175083450 conn(0x557cde7a12e0 msgr2=0x557cde79e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 shutdown_connections 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/2175083450 wait complete. 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f718c0369a0 msgr2=0x7f718c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f718c0369a0 0x7f718c038e60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bf50 tx=0x7f729c00f000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde797e70 msgr2=0x557cde798290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde797e70 0x557cde798290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f72ac051fd0 tx=0x7f72ac051e60 comp rx=0 tx=0).stop 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 shutdown_connections 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f718c0369a0 0x7f718c038e60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/597869723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde797e70 0x557cde798290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 >> 172.21.15.173:0/597869723 conn(0x557cde78bf10 msgr2=0x557cde78c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 shutdown_connections 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/597869723 wait complete. 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557cde786e50 msgr2=0x557cde789280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557cde786e50 0x557cde789280 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde5f3990 msgr2=0x557cde780600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557cde5f3990 0x557cde780600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde782ec0 msgr2=0x557cde7852b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.342+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557cde782ec0 0x557cde7852b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f719c036950 msgr2=0x7f719c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f719c036950 0x7f719c038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f729c000f60 tx=0x7f729c0012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 msgr2=0x557cde7793c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 --2- 172.21.15.173:0/1705783265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557cde5f23e0 0x557cde7793c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0526d0 tx=0x7f72ac003330 comp rx=0 tx=0).stop 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b5485640 1 -- 172.21.15.173:0/1705783265 reap_dead start 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 shutdown_connections 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 >> 172.21.15.173:0/1705783265 conn(0x557cde679780 msgr2=0x557cde76ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 shutdown_connections 2024-05-15T18:08:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.343+0000 7f72b9616800 1 -- 172.21.15.173:0/1705783265 wait complete. 2024-05-15T18:08:56.330 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:56.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-15T18:08:56.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-15T18:08:56.331 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-15T18:08:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.399+0000 7f8fa4b3c800 1 Processor -- start 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.399+0000 7f8fa4b3c800 1 -- start start 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.399+0000 7f8fa4b3c800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x556a908f2140 0x556a908f2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.399+0000 7f8fa4b3c800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a908f2be0 con 0x556a908f3350 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.399+0000 7f8fa4b3c800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x556a90783050 con 0x556a908f2140 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.400+0000 7f8fa083a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x556a908f2140 0x556a908f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.400+0000 7f8fa083a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x556a908f2140 0x556a908f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43400/0 (socket says 172.21.15.173:43400) 2024-05-15T18:08:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.400+0000 7f8fa083a640 1 -- 172.21.15.173:0/3087054184 learned_addr learned my addr 172.21.15.173:0/3087054184 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.400+0000 7f8fa083a640 1 -- 172.21.15.173:0/3087054184 >> v1:172.21.15.3:6789/0 conn(0x556a908f3350 legacy=0x556a908f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.400+0000 7f8fa083a640 1 -- 172.21.15.173:0/3087054184 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a908f3f10 con 0x556a908f2140 2024-05-15T18:08:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa083a640 1 --2- 172.21.15.173:0/3087054184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908f2560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f98005fd0 tx=0x7f8f9801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4797142a00fea22c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8f9f838640 1 -- 172.21.15.173:0/3087054184 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98052540 con 0x556a908f2140 2024-05-15T18:08:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8f9f838640 1 -- 172.21.15.173:0/3087054184 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9804e070 con 0x556a908f2140 2024-05-15T18:08:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8f9f838640 1 -- 172.21.15.173:0/3087054184 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98052890 con 0x556a908f2140 2024-05-15T18:08:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/3087054184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 msgr2=0x556a908f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/3087054184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908f2560 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f98005fd0 tx=0x7f8f9801cd80 comp rx=0 tx=0).stop 2024-05-15T18:08:56.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/3087054184 shutdown_connections 2024-05-15T18:08:56.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/3087054184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908f2560 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/3087054184 >> 172.21.15.173:0/3087054184 conn(0x556a908ed780 msgr2=0x556a908efba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/3087054184 shutdown_connections 2024-05-15T18:08:56.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.402+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/3087054184 wait complete. 2024-05-15T18:08:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.416+0000 7f8fa4b3c800 1 Processor -- start 2024-05-15T18:08:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.416+0000 7f8fa4b3c800 1 -- start start 2024-05-15T18:08:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.416+0000 7f8fa4b3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908677f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.416+0000 7f8fa4b3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556a9083d1d0 con 0x556a908f2140 2024-05-15T18:08:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.416+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.416+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908677f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43408/0 (socket says 172.21.15.173:43408) 2024-05-15T18:08:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.416+0000 7f8fa083a640 1 -- 172.21.15.173:0/574626955 learned_addr learned my addr 172.21.15.173:0/574626955 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.417+0000 7f8fa083a640 1 -- 172.21.15.173:0/574626955 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a90865db0 con 0x556a908f2140 2024-05-15T18:08:56.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.417+0000 7f8fa083a640 1 --2- 172.21.15.173:0/574626955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908677f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f9801ba70 tx=0x7f8f9804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dea1c3a921ecace server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.417+0000 7f8e8ee0d640 1 -- 172.21.15.173:0/574626955 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98052820 con 0x556a908f2140 2024-05-15T18:08:56.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.417+0000 7f8e8ee0d640 1 -- 172.21.15.173:0/574626955 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98062070 con 0x556a908f2140 2024-05-15T18:08:56.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.417+0000 7f8e8ee0d640 1 -- 172.21.15.173:0/574626955 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98052b10 con 0x556a908f2140 2024-05-15T18:08:56.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/574626955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 msgr2=0x556a908677f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/574626955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908677f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8f9801ba70 tx=0x7f8f9804c000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/574626955 shutdown_connections 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/574626955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a908677f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/574626955 >> 172.21.15.173:0/574626955 conn(0x556a908ed780 msgr2=0x556a909df080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/574626955 shutdown_connections 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/574626955 wait complete. 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 Processor -- start 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 -- start start 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a909ed430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa4b3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556a908fb820 con 0x556a908f2140 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.418+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a909ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a909ed430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43424/0 (socket says 172.21.15.173:43424) 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8fa083a640 1 -- 172.21.15.173:0/1399851555 learned_addr learned my addr 172.21.15.173:0/1399851555 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8fa083a640 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a909ed970 con 0x556a908f2140 2024-05-15T18:08:56.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a909ed430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8f9805f040 tx=0x7f8f98003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8e8d60a640 1 -- 172.21.15.173:0/1399851555 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98071570 con 0x556a908f2140 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8e8d60a640 1 -- 172.21.15.173:0/1399851555 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98058040 con 0x556a908f2140 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8e8d60a640 1 -- 172.21.15.173:0/1399851555 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98071880 con 0x556a908f2140 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a909edc00 con 0x556a908f2140 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.419+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a909f08b0 con 0x556a908f2140 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.420+0000 7f8e8d60a640 1 -- 172.21.15.173:0/1399851555 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f98050070 con 0x556a908f2140 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.420+0000 7f8e8d60a640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e88036900 0x7f8e88038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.420+0000 7f8e8d60a640 1 -- 172.21.15.173:0/1399851555 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8f9808e480 con 0x556a908f2140 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.420+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e88036900 0x7f8e88038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.420+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a908f3350 0x556a909f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.420+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a909f4bf0 con 0x556a908f3350 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.420+0000 7f8fa103b640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a908f3350 0x556a909f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.421+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e88036900 0x7f8e88038dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001e10 tx=0x7f8f88001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.421+0000 7f8fa103b640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a908f3350 0x556a909f4670 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.421+0000 7f8fa103b640 1 -- 172.21.15.173:0/1399851555 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a908f3350 2024-05-15T18:08:56.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.421+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a909f1c40 con 0x556a908f3350 2024-05-15T18:08:56.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.421+0000 7f8fa103b640 1 -- 172.21.15.173:0/1399851555 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f900083e0 con 0x556a908f3350 2024-05-15T18:08:56.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.421+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a909f6f00 0x556a909f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.421+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a909f99e0 con 0x556a909f6f00 2024-05-15T18:08:56.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.422+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a909f6f00 0x556a909f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.422+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a909f6f00 0x556a909f92f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.422+0000 7f8fa083a640 1 -- 172.21.15.173:0/1399851555 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a909f6f00 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.422+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a909f5eb0 con 0x556a908f3350 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.422+0000 7f8fa103b640 1 -- 172.21.15.173:0/1399851555 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f900083e0 con 0x556a908f3350 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.423+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556a909fae90 0x556a909fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.423+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a909fda50 con 0x556a909fae90 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.423+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556a909fae90 0x556a909fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.423+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556a909fae90 0x556a909fd2c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa0039640 1 -- 172.21.15.173:0/1399851555 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f880106a0 con 0x556a909fae90 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa4b3c800 1 Processor -- start 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa4b3c800 1 -- start start 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa4b3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a0beb0 0x556a90a0c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa4b3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556a907e3cf0 con 0x556a90a0beb0 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a0beb0 0x556a90a0c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a0beb0 0x556a90a0c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43428/0 (socket says 172.21.15.173:43428) 2024-05-15T18:08:56.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa083a640 1 -- 172.21.15.173:0/1422748230 learned_addr learned my addr 172.21.15.173:0/1422748230 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.424+0000 7f8fa083a640 1 -- 172.21.15.173:0/1422748230 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a90a0c810 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.425+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a0beb0 0x556a90a0c2d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8f9808ca00 tx=0x7f8f980706d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.425+0000 7f8e867fc640 1 -- 172.21.15.173:0/1422748230 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98092020 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.425+0000 7f8e867fc640 1 -- 172.21.15.173:0/1422748230 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98066530 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.425+0000 7f8e867fc640 1 -- 172.21.15.173:0/1422748230 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98051d40 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.425+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a90a0d280 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.425+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a90a0d780 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8e867fc640 1 -- 172.21.15.173:0/1422748230 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f98095020 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8e867fc640 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e78036900 0x7f8e78038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8e867fc640 1 -- 172.21.15.173:0/1422748230 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8f9808b050 con 0x556a90a0beb0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e78036900 0x7f8e78038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8fa4b3c800 1 Processor -- start 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8fa4b3c800 1 -- start start 2024-05-15T18:08:56.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e78036900 0x7f8e78038dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x556a909f5080 tx=0x7f8f88006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8fa4b3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.426+0000 7f8fa4b3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556a90866070 con 0x556a90a18fa0 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.427+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.427+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a193c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43430/0 (socket says 172.21.15.173:43430) 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.427+0000 7f8fa083a640 1 -- 172.21.15.173:0/853589120 learned_addr learned my addr 172.21.15.173:0/853589120 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.427+0000 7f8fa083a640 1 -- 172.21.15.173:0/853589120 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a90a19990 con 0x556a90a18fa0 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.428+0000 7f8fa083a640 1 --2- 172.21.15.173:0/853589120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a193c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8f980656f0 tx=0x7f8f98072c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a784304b10ef0fb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.428+0000 7f8e77fff640 1 -- 172.21.15.173:0/853589120 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98072170 con 0x556a90a18fa0 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.428+0000 7f8e77fff640 1 -- 172.21.15.173:0/853589120 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98084d10 con 0x556a90a18fa0 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.428+0000 7f8e77fff640 1 -- 172.21.15.173:0/853589120 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98072e20 con 0x556a90a18fa0 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/853589120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 msgr2=0x556a90a193c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/853589120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a193c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8f980656f0 tx=0x7f8f98072c40 comp rx=0 tx=0).stop 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/853589120 shutdown_connections 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/853589120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a193c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/853589120 >> 172.21.15.173:0/853589120 conn(0x556a90a15300 msgr2=0x556a90a13360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/853589120 shutdown_connections 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/853589120 wait complete. 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 Processor -- start 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 -- start start 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa4b3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556a90a1a040 con 0x556a90a18fa0 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa083a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a203b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43432/0 (socket says 172.21.15.173:43432) 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.429+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 learned_addr learned my addr 172.21.15.173:0/1086933709 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.430+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a90a208f0 con 0x556a90a18fa0 2024-05-15T18:08:56.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.430+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a203b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f980656f0 tx=0x7f8f980a4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.430+0000 7f8e767fc640 1 -- 172.21.15.173:0/1086933709 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f98072890 con 0x556a90a18fa0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.430+0000 7f8e767fc640 1 -- 172.21.15.173:0/1086933709 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98072170 con 0x556a90a18fa0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.430+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a90a208f0 con 0x556a90a18fa0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.430+0000 7f8e767fc640 1 -- 172.21.15.173:0/1086933709 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f980678a0 con 0x556a90a18fa0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.430+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a90a208f0 con 0x556a90a18fa0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.431+0000 7f8e767fc640 1 -- 172.21.15.173:0/1086933709 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f980bc030 con 0x556a90a18fa0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.431+0000 7f8e767fc640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e6c036860 0x7f8e6c038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.431+0000 7f8e767fc640 1 -- 172.21.15.173:0/1086933709 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8f980ba070 con 0x556a90a18fa0 2024-05-15T18:08:56.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.431+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e6c036860 0x7f8e6c038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.431+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e6c036860 0x7f8e6c038d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x556a909fde50 tx=0x7f8f88011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a90a2ba20 0x556a90a2dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2e630 con 0x556a90a2ba20 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa103b640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a90a2ba20 0x556a90a2dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa103b640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a90a2ba20 0x556a90a2dee0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 20 realm 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2ea40 con 0x556a90a2ba20 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.432+0000 7f8fa4b3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x556a90a2ba20 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f6b0 con 0x556a90a2ba20 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a90a30070 0x556a90a32460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a32ab0 con 0x556a90a30070 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a90a30070 0x556a90a32460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.433+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a90a30070 0x556a90a32460 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa4b3c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa4b3c800 20 searching for the correct realm 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a343c0 con 0x556a90a30070 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa083a640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f9808e7a0 0x7f8f98088a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a343c0 con 0x7f8f9808e7a0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.434+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f9808e7a0 0x7f8f98088a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.435+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f9808e7a0 0x7f8f98088a60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.435+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.435+0000 7f8fa0039640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8f880393c0 0x7f8f88039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.435+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a343c0 con 0x7f8f880393c0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.435+0000 7f8fa103b640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8f880393c0 0x7f8f88039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.435+0000 7f8fa103b640 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8f880393c0 0x7f8f88039810 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x556a90a2ba20 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x556a90a2ba20 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x7f8f880393c0 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.436+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x7f8f880393c0 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x7f8f9808e7a0 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x556a90a30070 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x556a90a2ba20 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.437+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f880393c0 2024-05-15T18:08:56.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a2ba20 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a30070 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.438+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a30070 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f880393c0 2024-05-15T18:08:56.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a30070 2024-05-15T18:08:56.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a30070 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a2ba20 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.439+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a2ba20 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.440+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.440+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f880393c0 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.440+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.440+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a30070 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a2ba20 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f880393c0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.441+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a30070 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f880393c0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a30070 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.442+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f880393c0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.443+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.443+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x556a90a2ba20 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.443+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.443+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8f90026040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a2f310 con 0x556a90a2ba20 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a32e50 con 0x556a90a2ba20 2024-05-15T18:08:56.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.444+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a32e50 con 0x7f8f880393c0 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 zone default found 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 4 Realm: () 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 zonegroup default 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a33f50 con 0x7f8f880393c0 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a337c0 con 0x556a90a30070 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.445+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a36220 con 0x556a90a30070 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.446+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.446+0000 7f8fa4b3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.446+0000 7f8fa4b3c800 20 started sync module instance, tier type = 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.446+0000 7f8fa4b3c800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.446+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a356c0 con 0x7f8f9808e7a0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.447+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.447+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93916181516816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a365c0 con 0x7f8f9808e7a0 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.447+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a36e50 con 0x556a90a2ba20 2024-05-15T18:08:56.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.448+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.448+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93916181516816] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.448+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93916181522784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a376f0 con 0x556a90a2ba20 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.448+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a35af0 con 0x556a90a30070 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.449+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93916181522784] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.449+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.449+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93916181525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a38160 con 0x556a90a30070 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.449+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a38b20 con 0x7f8f9808e7a0 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.450+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93916181525536] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.450+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.450+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93916181527728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a39370 con 0x7f8f9808e7a0 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.450+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a39d30 con 0x556a90a2ba20 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.451+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.451+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93916181534848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a3a150 con 0x556a90a2ba20 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.451+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a3ac50 con 0x7f8f880393c0 2024-05-15T18:08:56.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.451+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93916181527728] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.452+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93916181534848] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.452+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.452+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93916181538624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a39ca0 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.452+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a3b4f0 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.453+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93916181538624] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.453+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.453+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93916181532352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a39ca0 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.453+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a3bb10 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93916181532352] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93916181542496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a3bf30 con 0x7f8f880393c0 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 20 add_watcher() i=0 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 20 add_watcher() i=1 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 20 add_watcher() i=2 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 20 add_watcher() i=3 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 20 add_watcher() i=4 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 20 add_watcher() i=5 2024-05-15T18:08:56.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.454+0000 7f8fa4b3c800 20 add_watcher() i=6 2024-05-15T18:08:56.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.455+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93916181542496] v29'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.455+0000 7f8fa4b3c800 20 add_watcher() i=7 2024-05-15T18:08:56.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.455+0000 7f8fa4b3c800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.455+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a3ef60 con 0x556a90a2ba20 2024-05-15T18:08:56.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.456+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.456+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93916181543552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a3c3c0 con 0x556a90a2ba20 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93916181543552] v29'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8e577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 5 note: GC not initialized 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8e567e4640 20 reqs_thread_entry: start 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 20 Filter name: none 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8e4f7fe640 20 reqs_thread_entry: start 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.457+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a723c0 con 0x556a90a2ba20 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa4b3c800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:56.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa4b3c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa4b3c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa4b3c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a74cf0 con 0x7f8f9808e7a0 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.458+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a783c0 con 0x556a90a2ba20 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v29'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8fa4b3c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8fa4b3c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8fa4b3c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93916181790256 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556a90a73ce0 con 0x556a90a2ba20 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 93916181534848 notify 124554051585 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f8f9002d040 con 0x556a90a2ba20 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8e77fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 93916181534848 notifier 4308 bl.length()=567 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8e77fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8e77fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.459+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(65 notify.4 [notify cookie 93916181790256 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.460+0000 7f8e77fff640 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8e64003ea0 con 0x556a90a2ba20 2024-05-15T18:08:56.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.460+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.460+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 93916181790256 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8f90010040 con 0x556a90a2ba20 2024-05-15T18:08:56.445 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.461+0000 7f8e577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.461+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93916181543552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a77210 con 0x556a90a2ba20 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.462+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93916181543552] v29'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.462+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93916181516816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a77210 con 0x7f8f9808e7a0 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.463+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93916181516816] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.463+0000 7f8fa4b3c800 20 remove_watcher() i=0 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.463+0000 7f8fa4b3c800 2 removed watcher, disabling cache 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.463+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93916181522784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a35210 con 0x556a90a2ba20 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.464+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93916181522784] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.464+0000 7f8fa4b3c800 20 remove_watcher() i=1 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.464+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93916181525536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a35210 con 0x556a90a30070 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.466+0000 7f8fa083a640 1 -- 172.21.15.173:0/1086933709 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93916181525536] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f9808cd70 con 0x556a90a30070 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.466+0000 7f8fa4b3c800 20 remove_watcher() i=2 2024-05-15T18:08:56.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.466+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93916181527728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a37420 con 0x7f8f9808e7a0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.467+0000 7f8fa0039640 1 -- 172.21.15.173:0/1086933709 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93916181527728] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f88036040 con 0x7f8f9808e7a0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.467+0000 7f8fa4b3c800 20 remove_watcher() i=3 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.467+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93916181534848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a37420 con 0x556a90a2ba20 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.468+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93916181534848] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x556a90a2ba20 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.468+0000 7f8fa4b3c800 20 remove_watcher() i=4 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.468+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93916181538624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a39880 con 0x7f8f880393c0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.469+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93916181538624] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.469+0000 7f8fa4b3c800 20 remove_watcher() i=5 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.469+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93916181532352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a37420 con 0x7f8f880393c0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.470+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93916181532352] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.470+0000 7f8fa4b3c800 20 remove_watcher() i=6 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.470+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93916181542496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556a90a37420 con 0x7f8f880393c0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93916181542496] v29'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f900083e0 con 0x7f8f880393c0 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 20 remove_watcher() i=7 2024-05-15T18:08:56.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8f880393c0 msgr2=0x7f8f88039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8f880393c0 0x7f8f88039810 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a90a2ba20 msgr2=0x556a90a2dee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a90a2ba20 0x556a90a2dee0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f9808e7a0 msgr2=0x7f8f98088a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f9808e7a0 0x7f8f98088a60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a90a30070 msgr2=0x556a90a32460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a90a30070 0x556a90a32460 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e6c036860 msgr2=0x7f8e6c038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e6c036860 0x7f8e6c038d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x556a909fde50 tx=0x7f8f88011000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 msgr2=0x556a90a203b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1086933709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a18fa0 0x556a90a203b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f980656f0 tx=0x7f8f980a4040 comp rx=0 tx=0).stop 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 reap_dead start 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa103b640 1 -- 172.21.15.173:0/1086933709 reap_dead start 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 shutdown_connections 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 >> 172.21.15.173:0/1086933709 conn(0x556a90a15300 msgr2=0x556a90a12960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 shutdown_connections 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1086933709 wait complete. 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e78036900 msgr2=0x7f8e78038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e78036900 0x7f8e78038dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x556a909f5080 tx=0x7f8f88006000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a0beb0 msgr2=0x556a90a0c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a0beb0 0x556a90a0c2d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8f9808ca00 tx=0x7f8f980706d0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 shutdown_connections 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e78036900 0x7f8e78038dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1422748230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a90a0beb0 0x556a90a0c2d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 >> 172.21.15.173:0/1422748230 conn(0x556a909fff50 msgr2=0x556a90a00350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 shutdown_connections 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.471+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1422748230 wait complete. 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556a909fae90 msgr2=0x556a909fd2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556a909fae90 0x556a909fd2c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a908f3350 msgr2=0x556a909f4670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556a908f3350 0x556a909f4670 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a909f6f00 msgr2=0x556a909f92f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556a909f6f00 0x556a909f92f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e88036900 msgr2=0x7f8e88038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8e88036900 0x7f8e88038dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001e10 tx=0x7f8f88001390 comp rx=0 tx=0).stop 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 msgr2=0x556a909ed430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 --2- 172.21.15.173:0/1399851555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556a908f2140 0x556a909ed430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8f9805f040 tx=0x7f8f98003330 comp rx=0 tx=0).stop 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa103b640 1 -- 172.21.15.173:0/1399851555 reap_dead start 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 shutdown_connections 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 >> 172.21.15.173:0/1399851555 conn(0x556a908ed780 msgr2=0x556a908665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 shutdown_connections 2024-05-15T18:08:56.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.472+0000 7f8fa4b3c800 1 -- 172.21.15.173:0/1399851555 wait complete. 2024-05-15T18:08:56.457 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:56.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.458 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.525+0000 7f17a6733800 1 Processor -- start 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.525+0000 7f17a6733800 1 -- start start 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f17a6733800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55fc72f69bd0 0x55fc72f6bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f17a6733800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc72f70010 con 0x55fc72f6c500 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f17a6733800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55fc72dfa050 con 0x55fc72f69bd0 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f17a23d1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55fc72f69bd0 0x55fc72f6bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f179bfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55fc72f6c500 0x55fc72f6e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35206/0 (socket says 172.21.15.173:35206) 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f179bfff640 1 -- 172.21.15.173:0/1673804525 learned_addr learned my addr 172.21.15.173:0/1673804525 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f17a23d1640 1 -- 172.21.15.173:0/1673804525 >> v1:172.21.15.3:6789/0 conn(0x55fc72f6c500 legacy=0x55fc72f6e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.526+0000 7f17a23d1640 1 -- 172.21.15.173:0/1673804525 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc72f711f0 con 0x55fc72f69bd0 2024-05-15T18:08:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.528+0000 7f17a23d1640 1 --2- 172.21.15.173:0/1673804525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69bd0 0x55fc72f6bfc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f179400a470 tx=0x7f179401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0d9e3631e97703 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.528+0000 7f17a1bd0640 1 -- 172.21.15.173:0/1673804525 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794057070 con 0x55fc72f69bd0 2024-05-15T18:08:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.528+0000 7f17a1bd0640 1 -- 172.21.15.173:0/1673804525 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1794052570 con 0x55fc72f69bd0 2024-05-15T18:08:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.528+0000 7f17a1bd0640 1 -- 172.21.15.173:0/1673804525 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794052870 con 0x55fc72f69bd0 2024-05-15T18:08:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.529+0000 7f17a6733800 1 -- 172.21.15.173:0/1673804525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69bd0 msgr2=0x55fc72f6bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.529+0000 7f17a6733800 1 --2- 172.21.15.173:0/1673804525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69bd0 0x55fc72f6bfc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f179400a470 tx=0x7f179401ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.529+0000 7f17a6733800 1 -- 172.21.15.173:0/1673804525 shutdown_connections 2024-05-15T18:08:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.529+0000 7f17a6733800 1 --2- 172.21.15.173:0/1673804525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69bd0 0x55fc72f6bfc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.529+0000 7f17a6733800 1 -- 172.21.15.173:0/1673804525 >> 172.21.15.173:0/1673804525 conn(0x55fc72f635a0 msgr2=0x55fc72f659c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.529+0000 7f17a6733800 1 -- 172.21.15.173:0/1673804525 shutdown_connections 2024-05-15T18:08:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.529+0000 7f17a6733800 1 -- 172.21.15.173:0/1673804525 wait complete. 2024-05-15T18:08:56.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.542+0000 7f17a6733800 1 Processor -- start 2024-05-15T18:08:56.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.542+0000 7f17a6733800 1 -- start start 2024-05-15T18:08:56.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.543+0000 7f17a6733800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc7305a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.543+0000 7f17a6733800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fc72eb41d0 con 0x55fc72f6c500 2024-05-15T18:08:56.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.543+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc7305a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.543+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc7305a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43440/0 (socket says 172.21.15.173:43440) 2024-05-15T18:08:56.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.543+0000 7f17a23d1640 1 -- 172.21.15.173:0/1869379396 learned_addr learned my addr 172.21.15.173:0/1869379396 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.543+0000 7f17a23d1640 1 -- 172.21.15.173:0/1869379396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc7305adf0 con 0x55fc72f6c500 2024-05-15T18:08:56.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.543+0000 7f17a23d1640 1 --2- 172.21.15.173:0/1869379396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc7305a820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f179400a470 tx=0x7f179404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a35a11b64f9a21 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f1690608640 1 -- 172.21.15.173:0/1869379396 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794057040 con 0x55fc72f6c500 2024-05-15T18:08:56.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f1690608640 1 -- 172.21.15.173:0/1869379396 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1794052950 con 0x55fc72f6c500 2024-05-15T18:08:56.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f1690608640 1 -- 172.21.15.173:0/1869379396 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794052c70 con 0x55fc72f6c500 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f17a6733800 1 -- 172.21.15.173:0/1869379396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 msgr2=0x55fc7305a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f17a6733800 1 --2- 172.21.15.173:0/1869379396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc7305a820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f179400a470 tx=0x7f179404c000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f17a6733800 1 -- 172.21.15.173:0/1869379396 shutdown_connections 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f17a6733800 1 --2- 172.21.15.173:0/1869379396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc7305a820 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f17a6733800 1 -- 172.21.15.173:0/1869379396 >> 172.21.15.173:0/1869379396 conn(0x55fc72f635a0 msgr2=0x55fc730560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f17a6733800 1 -- 172.21.15.173:0/1869379396 shutdown_connections 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.544+0000 7f17a6733800 1 -- 172.21.15.173:0/1869379396 wait complete. 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a6733800 1 Processor -- start 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a6733800 1 -- start start 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a6733800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc73062250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a6733800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fc72f70480 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc73062250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc73062250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43448/0 (socket says 172.21.15.173:43448) 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a23d1640 1 -- 172.21.15.173:0/1186529053 learned_addr learned my addr 172.21.15.173:0/1186529053 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.545+0000 7f17a23d1640 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc73062790 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.546+0000 7f17a23d1640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc73062250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1794044810 tx=0x7f1794002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.546+0000 7f168ee05640 1 -- 172.21.15.173:0/1186529053 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794057070 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.546+0000 7f168ee05640 1 -- 172.21.15.173:0/1186529053 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179405d650 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.546+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc73062a20 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.546+0000 7f168ee05640 1 -- 172.21.15.173:0/1186529053 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179405d930 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.546+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc730656d0 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f168ee05640 1 -- 172.21.15.173:0/1186529053 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f179405dad0 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f168ee05640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1688036900 0x7f1688038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f168ee05640 1 -- 172.21.15.173:0/1186529053 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f179408e0e0 con 0x55fc72f6c500 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f179bfff640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1688036900 0x7f1688038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc73067480 0x55fc73069870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc73069db0 con 0x55fc73067480 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f17a2bd2640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc73067480 0x55fc73069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f179bfff640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1688036900 0x7f1688038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f178c000f60 tx=0x7f178c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.547+0000 7f17a2bd2640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc73067480 0x55fc73069870 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.548+0000 7f17a2bd2640 1 -- 172.21.15.173:0/1186529053 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc73067480 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.548+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc73066a60 con 0x55fc73067480 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.548+0000 7f17a2bd2640 1 -- 172.21.15.173:0/1186529053 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc73067480 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.548+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc7306c100 0x55fc7306e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.548+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc7306ebe0 con 0x55fc7306c100 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.548+0000 7f17a23d1640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc7306c100 0x55fc7306e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.548+0000 7f17a23d1640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc7306c100 0x55fc7306e4f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.549+0000 7f17a23d1640 1 -- 172.21.15.173:0/1186529053 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1794076070 con 0x55fc7306c100 2024-05-15T18:08:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.549+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc7306b0b0 con 0x55fc73067480 2024-05-15T18:08:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.549+0000 7f17a2bd2640 1 -- 172.21.15.173:0/1186529053 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc73067480 2024-05-15T18:08:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.549+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fc73070090 0x55fc730724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.549+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc73072c40 con 0x55fc73070090 2024-05-15T18:08:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.549+0000 7f179bfff640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fc73070090 0x55fc730724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.550+0000 7f179bfff640 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fc73070090 0x55fc730724e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.550+0000 7f179bfff640 1 -- 172.21.15.173:0/1186529053 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f178c009050 con 0x55fc73070090 2024-05-15T18:08:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.550+0000 7f17a6733800 1 Processor -- start 2024-05-15T18:08:56.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.550+0000 7f17a6733800 1 -- start start 2024-05-15T18:08:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.550+0000 7f17a6733800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69770 0x55fc72f67be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.550+0000 7f17a6733800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fc72e5acf0 con 0x55fc72f69770 2024-05-15T18:08:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69770 0x55fc72f67be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69770 0x55fc72f67be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43452/0 (socket says 172.21.15.173:43452) 2024-05-15T18:08:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f17a23d1640 1 -- 172.21.15.173:0/748215399 learned_addr learned my addr 172.21.15.173:0/748215399 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f17a23d1640 1 -- 172.21.15.173:0/748215399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc72f68120 con 0x55fc72f69770 2024-05-15T18:08:56.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f17a23d1640 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69770 0x55fc72f67be0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1794052fb0 tx=0x7f179405cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f1687fff640 1 -- 172.21.15.173:0/748215399 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794086120 con 0x55fc72f69770 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f1687fff640 1 -- 172.21.15.173:0/748215399 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179408c7c0 con 0x55fc72f69770 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc72f683b0 con 0x55fc72f69770 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f1687fff640 1 -- 172.21.15.173:0/748215399 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f179408caa0 con 0x55fc72f69770 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.551+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc72f688b0 con 0x55fc72f69770 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.552+0000 7f1687fff640 1 -- 172.21.15.173:0/748215399 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f179408cc40 con 0x55fc72f69770 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.552+0000 7f1687fff640 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f167c036950 0x7f167c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.552+0000 7f1687fff640 1 -- 172.21.15.173:0/748215399 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f179408fb90 con 0x55fc72f69770 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.552+0000 7f179bfff640 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f167c036950 0x7f167c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.552+0000 7f17a6733800 1 Processor -- start 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.552+0000 7f17a6733800 1 -- start start 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f179bfff640 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f167c036950 0x7f167c038e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bf50 tx=0x7f178c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f17a6733800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730907c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f17a6733800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fc7305b0b0 con 0x55fc730903a0 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730907c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43462/0 (socket says 172.21.15.173:43462) 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f17a23d1640 1 -- 172.21.15.173:0/1787205563 learned_addr learned my addr 172.21.15.173:0/1787205563 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f17a23d1640 1 -- 172.21.15.173:0/1787205563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc73090d90 con 0x55fc730903a0 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f17a23d1640 1 --2- 172.21.15.173:0/1787205563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730907c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1794077b70 tx=0x7f179406fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eb66c609a665d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f1685ffb640 1 -- 172.21.15.173:0/1787205563 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794008160 con 0x55fc730903a0 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f1685ffb640 1 -- 172.21.15.173:0/1787205563 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179409d030 con 0x55fc730903a0 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.553+0000 7f1685ffb640 1 -- 172.21.15.173:0/1787205563 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794079d10 con 0x55fc730903a0 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 -- 172.21.15.173:0/1787205563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 msgr2=0x55fc730907c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 --2- 172.21.15.173:0/1787205563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730907c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1794077b70 tx=0x7f179406fae0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 -- 172.21.15.173:0/1787205563 shutdown_connections 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 --2- 172.21.15.173:0/1787205563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730907c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 -- 172.21.15.173:0/1787205563 >> 172.21.15.173:0/1787205563 conn(0x55fc7308c700 msgr2=0x55fc7308a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 -- 172.21.15.173:0/1787205563 shutdown_connections 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 -- 172.21.15.173:0/1787205563 wait complete. 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 Processor -- start 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 -- start start 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a6733800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fc73091440 con 0x55fc730903a0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a23d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43476/0 (socket says 172.21.15.173:43476) 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.554+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 learned_addr learned my addr 172.21.15.173:0/4278978834 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.555+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc73097c30 con 0x55fc730903a0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.555+0000 7f17a23d1640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730976f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f179406fe80 tx=0x7f1794089120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.555+0000 7f1673fff640 1 -- 172.21.15.173:0/4278978834 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17940065b0 con 0x55fc730903a0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.555+0000 7f1673fff640 1 -- 172.21.15.173:0/4278978834 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1794065870 con 0x55fc730903a0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.555+0000 7f1673fff640 1 -- 172.21.15.173:0/4278978834 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1794006750 con 0x55fc730903a0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.555+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc73097c30 con 0x55fc730903a0 2024-05-15T18:08:56.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.555+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc73097c30 con 0x55fc730903a0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.556+0000 7f1673fff640 1 -- 172.21.15.173:0/4278978834 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1794079450 con 0x55fc730903a0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.556+0000 7f1673fff640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f166c036860 0x7f166c038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.556+0000 7f1673fff640 1 -- 172.21.15.173:0/4278978834 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f17940aa070 con 0x55fc730903a0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.556+0000 7f179bfff640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f166c036860 0x7f166c038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc730a2e30 0x55fc730a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a5a40 con 0x55fc730a2e30 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a2bd2640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc730a2e30 0x55fc730a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f179bfff640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f166c036860 0x7f166c038d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f178c001b60 tx=0x7f178c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a2bd2640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc730a2e30 0x55fc730a52f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 20 realm 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a5e50 con 0x55fc730a2e30 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.557+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6720 con 0x55fc730a2e30 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a6733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc730a75b0 0x55fc730a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730aa100 con 0x55fc730a75b0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a23d1640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc730a75b0 0x55fc730a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.558+0000 7f17a23d1640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc730a75b0 0x55fc730a99a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f17a6733800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f17a6733800 20 searching for the correct realm 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730abae0 con 0x55fc730a75b0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f17a23d1640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f17940ad030 0x7f17940a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730abae0 con 0x7f17940ad030 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f179bfff640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f17940ad030 0x7f17940a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.559+0000 7f179bfff640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f17940ad030 0x7f17940a8130 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.560+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178c009050 con 0x7f17940ad030 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.560+0000 7f179bfff640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f178c038040 0x7f178c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.560+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730abae0 con 0x7f178c038040 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.560+0000 7f17a2bd2640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f178c038040 0x7f178c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.560+0000 7f17a2bd2640 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f178c038040 0x7f178c01bab0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.560+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.560+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.561+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f17940ad030 2024-05-15T18:08:56.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178c009050 con 0x7f17940ad030 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.562+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f17940ad030 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f178c009050 con 0x7f17940ad030 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.563+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.564+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f17940ad030 2024-05-15T18:08:56.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178c009050 con 0x7f17940ad030 2024-05-15T18:08:56.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.565+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.566+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.566+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.566+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.566+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.566+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.566+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f17940ad030 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178c009050 con 0x7f17940ad030 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a75b0 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f178c038040 2024-05-15T18:08:56.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.567+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x55fc730a2e30 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fc730a6ac0 con 0x7f17940ad030 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f178c045040 con 0x7f17940ad030 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730aaab0 con 0x55fc730a2e30 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730aaea0 con 0x55fc730a2e30 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.568+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730aaea0 con 0x7f178c038040 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 zone default found 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 4 Realm: () 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 zonegroup default 2024-05-15T18:08:56.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730ab2c0 con 0x7f178c038040 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730ab2c0 con 0x55fc730a75b0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730ad990 con 0x55fc730a75b0 2024-05-15T18:08:56.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.569+0000 7f17a6733800 20 started sync module instance, tier type = 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.570+0000 7f17a6733800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.570+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730ace30 con 0x7f17940ad030 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.571+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178c045040 con 0x7f17940ad030 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.571+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542750208544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730aca90 con 0x7f17940ad030 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.571+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730ae800 con 0x55fc730a2e30 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.573+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.573+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542750213456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730af0a0 con 0x55fc730a2e30 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.573+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730afb70 con 0x55fc730a75b0 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.573+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542750208544] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178c045040 con 0x7f17940ad030 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.576+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542750213456] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.576+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.576+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542750211376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730af0a0 con 0x55fc730a75b0 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.576+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b0450 con 0x7f17940ad030 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.579+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542750211376] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.579+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178c045040 con 0x7f17940ad030 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.579+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542750215152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b0cf0 con 0x7f17940ad030 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.579+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b16b0 con 0x55fc730a2e30 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.581+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.581+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542750225376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b1df0 con 0x55fc730a2e30 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.581+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b2910 con 0x7f178c038040 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.582+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542750215152] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178c045040 con 0x7f17940ad030 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.582+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542750225376] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.584+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.584+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542750229472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b28d0 con 0x7f178c038040 2024-05-15T18:08:56.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.584+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b31b0 con 0x7f178c038040 2024-05-15T18:08:56.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.585+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542750229472] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.585+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.585+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542750222400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b2d80 con 0x7f178c038040 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.585+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b37a0 con 0x7f178c038040 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542750222400] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542750233232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b3760 con 0x7f178c038040 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 20 add_watcher() i=0 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 20 add_watcher() i=1 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 20 add_watcher() i=2 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 20 add_watcher() i=3 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 20 add_watcher() i=4 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 20 add_watcher() i=5 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.586+0000 7f17a6733800 20 add_watcher() i=6 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.587+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542750233232] v29'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.587+0000 7f17a6733800 20 add_watcher() i=7 2024-05-15T18:08:56.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.587+0000 7f17a6733800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.587+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b6b90 con 0x55fc730a2e30 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.587+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.588+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542750230736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b40b0 con 0x55fc730a2e30 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542750230736] v29'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f1658fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f17a6733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f17a6733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f17a6733800 5 note: GC not initialized 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f15d37fe640 20 reqs_thread_entry: start 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f17a6733800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.590+0000 7f17a6733800 20 Filter name: none 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.591+0000 7f15d17fa640 20 reqs_thread_entry: start 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.591+0000 7f17a6733800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.591+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fc730e9c90 con 0x55fc730a2e30 2024-05-15T18:08:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.591+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.591+0000 7f17a6733800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:56.572 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.592+0000 7f1658fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.592+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542750230736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc7309cae0 con 0x55fc730a2e30 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.593+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94542750230736] v29'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.593+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542750208544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b28d0 con 0x7f17940ad030 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.596+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94542750208544] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178c045040 con 0x7f17940ad030 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.596+0000 7f17a6733800 20 remove_watcher() i=0 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.596+0000 7f17a6733800 2 removed watcher, disabling cache 2024-05-15T18:08:56.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.596+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542750213456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730ad220 con 0x55fc730a2e30 2024-05-15T18:08:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.597+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94542750213456] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.597+0000 7f17a6733800 20 remove_watcher() i=1 2024-05-15T18:08:56.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.597+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542750211376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730ad220 con 0x55fc730a75b0 2024-05-15T18:08:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.598+0000 7f17a23d1640 1 -- 172.21.15.173:0/4278978834 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94542750211376] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17940b3020 con 0x55fc730a75b0 2024-05-15T18:08:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.598+0000 7f17a6733800 20 remove_watcher() i=2 2024-05-15T18:08:56.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.598+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542750215152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730add30 con 0x7f17940ad030 2024-05-15T18:08:56.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.599+0000 7f179bfff640 1 -- 172.21.15.173:0/4278978834 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94542750215152] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f178c045040 con 0x7f17940ad030 2024-05-15T18:08:56.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.599+0000 7f17a6733800 20 remove_watcher() i=3 2024-05-15T18:08:56.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.599+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542750225376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730aebf0 con 0x55fc730a2e30 2024-05-15T18:08:56.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.601+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94542750225376] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x55fc730a2e30 2024-05-15T18:08:56.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.601+0000 7f17a6733800 20 remove_watcher() i=4 2024-05-15T18:08:56.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.601+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542750229472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730aebf0 con 0x7f178c038040 2024-05-15T18:08:56.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.602+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94542750229472] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.602+0000 7f17a6733800 20 remove_watcher() i=5 2024-05-15T18:08:56.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.602+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542750222400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b23e0 con 0x7f178c038040 2024-05-15T18:08:56.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.603+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94542750222400] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.603+0000 7f17a6733800 20 remove_watcher() i=6 2024-05-15T18:08:56.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.603+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542750233232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fc730b0840 con 0x7f178c038040 2024-05-15T18:08:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94542750233232] v29'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f179c00a4a0 con 0x7f178c038040 2024-05-15T18:08:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 20 remove_watcher() i=7 2024-05-15T18:08:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f178c038040 msgr2=0x7f178c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f178c038040 0x7f178c01bab0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc730a2e30 msgr2=0x55fc730a52f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc730a2e30 0x55fc730a52f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f17940ad030 msgr2=0x7f17940a8130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f17940ad030 0x7f17940a8130 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc730a75b0 msgr2=0x55fc730a99a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc730a75b0 0x55fc730a99a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f166c036860 msgr2=0x7f166c038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f166c036860 0x7f166c038d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f178c001b60 tx=0x7f178c010000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 msgr2=0x55fc730976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a2bd2640 1 -- 172.21.15.173:0/4278978834 reap_dead start 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730976f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f179406fe80 tx=0x7f1794089120 comp rx=0 tx=0).stop 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 shutdown_connections 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 --2- 172.21.15.173:0/4278978834 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc730903a0 0x55fc730976f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.604+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 >> 172.21.15.173:0/4278978834 conn(0x55fc7308c700 msgr2=0x55fc73089d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 shutdown_connections 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/4278978834 wait complete. 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f167c036950 msgr2=0x7f167c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f167c036950 0x7f167c038e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178c00bf50 tx=0x7f178c00f000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69770 msgr2=0x55fc72f67be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69770 0x55fc72f67be0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1794052fb0 tx=0x7f179405cf20 comp rx=0 tx=0).stop 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 shutdown_connections 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f167c036950 0x7f167c038e10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/748215399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f69770 0x55fc72f67be0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 >> 172.21.15.173:0/748215399 conn(0x55fc73075140 msgr2=0x55fc73075540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 shutdown_connections 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/748215399 wait complete. 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fc73070090 msgr2=0x55fc730724e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fc73070090 0x55fc730724e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc73067480 msgr2=0x55fc73069870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fc73067480 0x55fc73069870 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc7306c100 msgr2=0x55fc7306e4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fc7306c100 0x55fc7306e4f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1688036900 msgr2=0x7f1688038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1688036900 0x7f1688038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f178c000f60 tx=0x7f178c0012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 msgr2=0x55fc73062250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 --2- 172.21.15.173:0/1186529053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc72f6c500 0x55fc73062250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1794044810 tx=0x7f1794002fb0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a2bd2640 1 -- 172.21.15.173:0/1186529053 reap_dead start 2024-05-15T18:08:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 shutdown_connections 2024-05-15T18:08:56.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 >> 172.21.15.173:0/1186529053 conn(0x55fc72f635a0 msgr2=0x55fc730548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.605+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 shutdown_connections 2024-05-15T18:08:56.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.606+0000 7f17a6733800 1 -- 172.21.15.173:0/1186529053 wait complete. 2024-05-15T18:08:56.591 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:56.591 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-15T18:08:56.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-15T18:08:56.592 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-15T18:08:56.636 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:56.636 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:56.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72b3487800 1 Processor -- start 2024-05-15T18:08:56.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72b3487800 1 -- start start 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72b3487800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56437d76b5e0 0x56437d76ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72b3487800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56437d76c080 con 0x56437d76a2a0 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72b3487800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56437d5fc050 con 0x56437d76b5e0 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72b0f86640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56437d76b5e0 0x56437d76ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72abfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x56437d76a2a0 0x56437d76a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35210/0 (socket says 172.21.15.173:35210) 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.660+0000 7f72b0f86640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56437d76b5e0 0x56437d76ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43480/0 (socket says 172.21.15.173:43480) 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.661+0000 7f72abfff640 1 -- 172.21.15.173:0/229339200 learned_addr learned my addr 172.21.15.173:0/229339200 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.661+0000 7f72b0f86640 1 -- 172.21.15.173:0/229339200 >> v1:172.21.15.3:6789/0 conn(0x56437d76a2a0 legacy=0x56437d76a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.661+0000 7f72b0f86640 1 -- 172.21.15.173:0/229339200 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437d76ae60 con 0x56437d76b5e0 2024-05-15T18:08:56.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.663+0000 7f72b0f86640 1 --2- 172.21.15.173:0/229339200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76b5e0 0x56437d76ba00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72a400a470 tx=0x7f72a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ed126fb0f8669c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.663+0000 7f72ab7fe640 1 -- 172.21.15.173:0/229339200 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4057070 con 0x56437d76b5e0 2024-05-15T18:08:56.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.663+0000 7f72ab7fe640 1 -- 172.21.15.173:0/229339200 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a4052570 con 0x56437d76b5e0 2024-05-15T18:08:56.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.663+0000 7f72ab7fe640 1 -- 172.21.15.173:0/229339200 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4052870 con 0x56437d76b5e0 2024-05-15T18:08:56.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.664+0000 7f72b3487800 1 -- 172.21.15.173:0/229339200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76b5e0 msgr2=0x56437d76ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.664+0000 7f72b3487800 1 --2- 172.21.15.173:0/229339200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76b5e0 0x56437d76ba00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72a400a470 tx=0x7f72a401ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:56.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.664+0000 7f72b3487800 1 -- 172.21.15.173:0/229339200 shutdown_connections 2024-05-15T18:08:56.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.664+0000 7f72b3487800 1 --2- 172.21.15.173:0/229339200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76b5e0 0x56437d76ba00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.664+0000 7f72b3487800 1 -- 172.21.15.173:0/229339200 >> 172.21.15.173:0/229339200 conn(0x56437d764d30 msgr2=0x56437d767150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.664+0000 7f72b3487800 1 -- 172.21.15.173:0/229339200 shutdown_connections 2024-05-15T18:08:56.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.664+0000 7f72b3487800 1 -- 172.21.15.173:0/229339200 wait complete. 2024-05-15T18:08:56.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.677+0000 7f72b3487800 1 Processor -- start 2024-05-15T18:08:56.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.677+0000 7f72b3487800 1 -- start start 2024-05-15T18:08:56.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.677+0000 7f72b3487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d769cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.677+0000 7f72b3487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56437d6b61d0 con 0x56437d76a2a0 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.677+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d769cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.677+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d769cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43496/0 (socket says 172.21.15.173:43496) 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.677+0000 7f72b0f86640 1 -- 172.21.15.173:0/189714881 learned_addr learned my addr 172.21.15.173:0/189714881 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.678+0000 7f72b0f86640 1 -- 172.21.15.173:0/189714881 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437d85f610 con 0x56437d76a2a0 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.678+0000 7f72b0f86640 1 --2- 172.21.15.173:0/189714881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d769cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72a4055040 tx=0x7f72a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a524dceb9b216f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.678+0000 7f719ee05640 1 -- 172.21.15.173:0/189714881 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4057040 con 0x56437d76a2a0 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.678+0000 7f719ee05640 1 -- 172.21.15.173:0/189714881 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a4052a50 con 0x56437d76a2a0 2024-05-15T18:08:56.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.678+0000 7f719ee05640 1 -- 172.21.15.173:0/189714881 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4052d70 con 0x56437d76a2a0 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 -- 172.21.15.173:0/189714881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 msgr2=0x56437d769cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 --2- 172.21.15.173:0/189714881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d769cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72a4055040 tx=0x7f72a404c000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 -- 172.21.15.173:0/189714881 shutdown_connections 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 --2- 172.21.15.173:0/189714881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d769cd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 -- 172.21.15.173:0/189714881 >> 172.21.15.173:0/189714881 conn(0x56437d764d30 msgr2=0x56437d857100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 -- 172.21.15.173:0/189714881 shutdown_connections 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 -- 172.21.15.173:0/189714881 wait complete. 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 Processor -- start 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 -- start start 2024-05-15T18:08:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d864350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.679+0000 7f72b3487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56437d7737b0 con 0x56437d76a2a0 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d864350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d864350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43508/0 (socket says 172.21.15.173:43508) 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f72b0f86640 1 -- 172.21.15.173:0/535937745 learned_addr learned my addr 172.21.15.173:0/535937745 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f72b0f86640 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437d864890 con 0x56437d76a2a0 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f72b0f86640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d864350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72a4000c00 tx=0x7f72a4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f719d602640 1 -- 172.21.15.173:0/535937745 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4073070 con 0x56437d76a2a0 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f719d602640 1 -- 172.21.15.173:0/535937745 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a405d570 con 0x56437d76a2a0 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56437d864b20 con 0x56437d76a2a0 2024-05-15T18:08:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f719d602640 1 -- 172.21.15.173:0/535937745 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4057070 con 0x56437d76a2a0 2024-05-15T18:08:56.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.680+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56437d8677d0 con 0x56437d76a2a0 2024-05-15T18:08:56.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.681+0000 7f719d602640 1 -- 172.21.15.173:0/535937745 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72a4076070 con 0x56437d76a2a0 2024-05-15T18:08:56.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.681+0000 7f719d602640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7198036950 0x7f7198038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.681+0000 7f719d602640 1 -- 172.21.15.173:0/535937745 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72a408dca0 con 0x56437d76a2a0 2024-05-15T18:08:56.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.681+0000 7f72abfff640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7198036950 0x7f7198038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.681+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d76b5e0 0x56437d86b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.681+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d86bb60 con 0x56437d76b5e0 2024-05-15T18:08:56.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.681+0000 7f72b1787640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d76b5e0 0x56437d86b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72abfff640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7198036950 0x7f7198038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f729c000f60 tx=0x7f729c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72b1787640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d76b5e0 0x56437d86b590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72b1787640 1 -- 172.21.15.173:0/535937745 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d76b5e0 2024-05-15T18:08:56.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d868b60 con 0x56437d76b5e0 2024-05-15T18:08:56.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72b1787640 1 -- 172.21.15.173:0/535937745 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d76b5e0 2024-05-15T18:08:56.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d86de90 0x56437d870280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d870970 con 0x56437d86de90 2024-05-15T18:08:56.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.682+0000 7f72b0f86640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d86de90 0x56437d870280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.683+0000 7f72b0f86640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d86de90 0x56437d870280 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.683+0000 7f72b0f86640 1 -- 172.21.15.173:0/535937745 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72a4075030 con 0x56437d86de90 2024-05-15T18:08:56.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.683+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d86ce40 con 0x56437d76b5e0 2024-05-15T18:08:56.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.683+0000 7f72b1787640 1 -- 172.21.15.173:0/535937745 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d76b5e0 2024-05-15T18:08:56.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.683+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56437d871e20 0x56437d874270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.683+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8749d0 con 0x56437d871e20 2024-05-15T18:08:56.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.684+0000 7f72abfff640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56437d871e20 0x56437d874270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.684+0000 7f72abfff640 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56437d871e20 0x56437d874270 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.684+0000 7f72abfff640 1 -- 172.21.15.173:0/535937745 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f729c009050 con 0x56437d871e20 2024-05-15T18:08:56.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b3487800 1 Processor -- start 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b3487800 1 -- start start 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b3487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d882e30 0x56437d883250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b3487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56437d65ccf0 con 0x56437d882e30 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d882e30 0x56437d883250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d882e30 0x56437d883250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43520/0 (socket says 172.21.15.173:43520) 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b0f86640 1 -- 172.21.15.173:0/1938283359 learned_addr learned my addr 172.21.15.173:0/1938283359 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.685+0000 7f72b0f86640 1 -- 172.21.15.173:0/1938283359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437d883790 con 0x56437d882e30 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.686+0000 7f72b0f86640 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d882e30 0x56437d883250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72a4066540 tx=0x7f72a4006670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.686+0000 7f71967fc640 1 -- 172.21.15.173:0/1938283359 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4076db0 con 0x56437d882e30 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.686+0000 7f71967fc640 1 -- 172.21.15.173:0/1938283359 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a4088070 con 0x56437d882e30 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.686+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56437d884200 con 0x56437d882e30 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.686+0000 7f71967fc640 1 -- 172.21.15.173:0/1938283359 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a40774e0 con 0x56437d882e30 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.686+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56437d884700 con 0x56437d882e30 2024-05-15T18:08:56.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.686+0000 7f71967fc640 1 -- 172.21.15.173:0/1938283359 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72a4094060 con 0x56437d882e30 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f71967fc640 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7188036950 0x7f7188038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f71967fc640 1 -- 172.21.15.173:0/1938283359 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72a4097ab0 con 0x56437d882e30 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72abfff640 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7188036950 0x7f7188038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72b3487800 1 Processor -- start 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72abfff640 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7188036950 0x7f7188038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bf50 tx=0x7f729c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72b3487800 1 -- start start 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72b3487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d890340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72b3487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56437d85f8a0 con 0x56437d88ff20 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d890340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d890340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43530/0 (socket says 172.21.15.173:43530) 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.687+0000 7f72b0f86640 1 -- 172.21.15.173:0/1488697951 learned_addr learned my addr 172.21.15.173:0/1488697951 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b0f86640 1 -- 172.21.15.173:0/1488697951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437d890910 con 0x56437d88ff20 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b0f86640 1 --2- 172.21.15.173:0/1488697951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d890340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f72a4091040 tx=0x7f72a406c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dab4acc9ae5c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f7187fff640 1 -- 172.21.15.173:0/1488697951 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a40a4020 con 0x56437d88ff20 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f7187fff640 1 -- 172.21.15.173:0/1488697951 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a405d870 con 0x56437d88ff20 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f7187fff640 1 -- 172.21.15.173:0/1488697951 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4097e80 con 0x56437d88ff20 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b3487800 1 -- 172.21.15.173:0/1488697951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 msgr2=0x56437d890340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b3487800 1 --2- 172.21.15.173:0/1488697951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d890340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f72a4091040 tx=0x7f72a406c3c0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b3487800 1 -- 172.21.15.173:0/1488697951 shutdown_connections 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b3487800 1 --2- 172.21.15.173:0/1488697951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d890340 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b3487800 1 -- 172.21.15.173:0/1488697951 >> 172.21.15.173:0/1488697951 conn(0x56437d88c280 msgr2=0x56437d88a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b3487800 1 -- 172.21.15.173:0/1488697951 shutdown_connections 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.688+0000 7f72b3487800 1 -- 172.21.15.173:0/1488697951 wait complete. 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b3487800 1 Processor -- start 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b3487800 1 -- start start 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b3487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d897270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b3487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56437d890fc0 con 0x56437d88ff20 2024-05-15T18:08:56.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d897270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b0f86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d897270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43546/0 (socket says 172.21.15.173:43546) 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 learned_addr learned my addr 172.21.15.173:0/3494392983 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.689+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437d8977b0 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.690+0000 7f72b0f86640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d897270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72a408c500 tx=0x7f72a4056f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.690+0000 7f71867fc640 1 -- 172.21.15.173:0/3494392983 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a406c890 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.690+0000 7f71867fc640 1 -- 172.21.15.173:0/3494392983 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a406ca30 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.690+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56437d8977b0 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.690+0000 7f71867fc640 1 -- 172.21.15.173:0/3494392983 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a406cd10 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.690+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56437d8977b0 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.691+0000 7f71867fc640 1 -- 172.21.15.173:0/3494392983 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72a40a7020 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.691+0000 7f71867fc640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f717c036aa0 0x7f717c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.691+0000 7f71867fc640 1 -- 172.21.15.173:0/3494392983 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f72a409c070 con 0x56437d88ff20 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.691+0000 7f72abfff640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f717c036aa0 0x7f717c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.691+0000 7f72abfff640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f717c036aa0 0x7f717c038f60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f729c001b60 tx=0x7f729c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.691+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d8a2890 0x56437d8a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a54a0 con 0x56437d8a2890 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b1787640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d8a2890 0x56437d8a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b1787640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d8a2890 0x56437d8a4d50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 20 realm 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a58b0 con 0x56437d8a2890 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:56.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.692+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6180 con 0x56437d8a2890 2024-05-15T18:08:56.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d8a7280 0x56437d8a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a9c80 con 0x56437d8a7280 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b0f86640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d8a7280 0x56437d8a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b0f86640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d8a7280 0x56437d8a9670 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 20 searching for the correct realm 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.693+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ab5b0 con 0x56437d8a7280 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.694+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.694+0000 7f72b0f86640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72a40a9050 0x7f72a4097050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.694+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ab5b0 con 0x7f72a40a9050 2024-05-15T18:08:56.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.694+0000 7f72abfff640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72a40a9050 0x7f72a4097050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.694+0000 7f72abfff640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72a40a9050 0x7f72a4097050 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.695+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72a40a9050 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.695+0000 7f72abfff640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c038040 0x7f729c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.695+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ab5b0 con 0x7f729c038040 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.695+0000 7f72b1787640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c038040 0x7f729c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.695+0000 7f72b1787640 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c038040 0x7f729c01bab0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.695+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f729c038040 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.695+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f729c038040 2024-05-15T18:08:56.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f729c038040 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.696+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f72a40a9050 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72a40a9050 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f729c038040 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.697+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f72a40a9050 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f729c009050 con 0x7f72a40a9050 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.698+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f729c038040 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.699+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.700+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72ac00a4a0 con 0x56437d8a2890 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.700+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.700+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac033040 con 0x7f729c038040 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.700+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.700+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.700+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f72a40a9050 2024-05-15T18:08:56.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.701+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72a40a9050 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.701+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.701+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.701+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.701+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.701+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f72a40a9050 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c009050 con 0x7f72a40a9050 2024-05-15T18:08:56.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a7280 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.702+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f729c038040 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x56437d8a2890 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56437d8a6520 con 0x7f72a40a9050 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8aa540 con 0x56437d8a2890 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.703+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8aa930 con 0x56437d8a2890 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8aa930 con 0x7f729c038040 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 zone default found 2024-05-15T18:08:56.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 4 Realm: () 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 zonegroup default 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8aba30 con 0x7f729c038040 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.704+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ad410 con 0x56437d8a7280 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ad7b0 con 0x56437d8a7280 2024-05-15T18:08:56.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b3487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b3487800 20 started sync module instance, tier type = 2024-05-15T18:08:56.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b3487800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.705+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ac8b0 con 0x7f72a40a9050 2024-05-15T18:08:56.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.706+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.706+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94847869043712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8adb50 con 0x7f72a40a9050 2024-05-15T18:08:56.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.706+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ae3e0 con 0x56437d8a2890 2024-05-15T18:08:56.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.708+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.708+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94847869050608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8aecb0 con 0x56437d8a2890 2024-05-15T18:08:56.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.708+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8af780 con 0x56437d8a7280 2024-05-15T18:08:56.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.709+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94847869043712] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.710+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94847869050608] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.710+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.710+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94847869045968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8aecb0 con 0x56437d8a7280 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.710+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b0060 con 0x7f72a40a9050 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.712+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94847869045968] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.712+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.712+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94847869052928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b0900 con 0x7f72a40a9050 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.712+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b12c0 con 0x56437d8a2890 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.714+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94847869052928] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.714+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.714+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94847869062672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b16e0 con 0x56437d8a2890 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.714+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b20a0 con 0x7f729c038040 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.715+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94847869062672] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.716+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.716+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94847869064208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b20a0 con 0x7f729c038040 2024-05-15T18:08:56.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.716+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b2a60 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.716+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94847869064208] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.717+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.717+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94847869066224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b2c40 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.717+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b3490 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.717+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94847869066224] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94847869069680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b32e0 con 0x7f729c038040 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 20 add_watcher() i=0 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 20 add_watcher() i=1 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 20 add_watcher() i=2 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 20 add_watcher() i=3 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 20 add_watcher() i=4 2024-05-15T18:08:56.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 20 add_watcher() i=5 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.718+0000 7f72b3487800 20 add_watcher() i=6 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.719+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94847869069680] v29'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.719+0000 7f72b3487800 20 add_watcher() i=7 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.719+0000 7f72b3487800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.719+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b6850 con 0x56437d8a2890 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.719+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.719+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94847869070736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b3d70 con 0x56437d8a2890 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.721+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94847869070736] v29'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.721+0000 7f71677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.721+0000 7f72b3487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.721+0000 7f72b3487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 5 note: GC not initialized 2024-05-15T18:08:56.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f71667e4640 20 reqs_thread_entry: start 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 20 Filter name: none 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f715f7fe640 20 reqs_thread_entry: start 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8e9dc0 con 0x56437d8a2890 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.722+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ec6f0 con 0x7f72a40a9050 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.723+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.723+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8f0220 con 0x56437d8a2890 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v29'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b3487800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b3487800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b3487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94847869320880 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56437d8ecf40 con 0x56437d8a2890 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94847869062672 notify 124554051586 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f72ac01e040 con 0x56437d8a2890 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f7187fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94847869062672 notifier 4322 bl.length()=567 2024-05-15T18:08:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f7187fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f7187fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(65 notify.4 [notify cookie 94847869320880 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f7187fff640 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7174003ea0 con 0x56437d8a2890 2024-05-15T18:08:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.724+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.725+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94847869320880 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f72ac018dd0 con 0x56437d8a2890 2024-05-15T18:08:56.712 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.725+0000 7f71677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.725+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94847869070736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b5f80 con 0x56437d8a2890 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.726+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94847869070736] v29'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.726+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94847869043712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b2d90 con 0x7f72a40a9050 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.727+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94847869043712] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.727+0000 7f72b3487800 20 remove_watcher() i=0 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.727+0000 7f72b3487800 2 removed watcher, disabling cache 2024-05-15T18:08:56.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.727+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94847869050608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b2d90 con 0x56437d8a2890 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.729+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94847869050608] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.729+0000 7f72b3487800 20 remove_watcher() i=1 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.729+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94847869045968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b2d90 con 0x56437d8a7280 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.730+0000 7f72b0f86640 1 -- 172.21.15.173:0/3494392983 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94847869045968] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4075030 con 0x56437d8a7280 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.730+0000 7f72b3487800 20 remove_watcher() i=2 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.730+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94847869052928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8accd0 con 0x7f72a40a9050 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.731+0000 7f72abfff640 1 -- 172.21.15.173:0/3494392983 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94847869052928] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f729c045040 con 0x7f72a40a9050 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.731+0000 7f72b3487800 20 remove_watcher() i=3 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.731+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94847869062672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8accd0 con 0x56437d8a2890 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.732+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94847869062672] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x56437d8a2890 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.732+0000 7f72b3487800 20 remove_watcher() i=4 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.732+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94847869064208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b0e10 con 0x7f729c038040 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.733+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94847869064208] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.733+0000 7f72b3487800 20 remove_watcher() i=5 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.733+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94847869066224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8accd0 con 0x7f729c038040 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.734+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94847869066224] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.734+0000 7f72b3487800 20 remove_watcher() i=6 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.734+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94847869069680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56437d8b0e10 con 0x7f729c038040 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94847869069680] v29'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac031040 con 0x7f729c038040 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 20 remove_watcher() i=7 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c038040 msgr2=0x7f729c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f729c038040 0x7f729c01bab0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d8a2890 msgr2=0x56437d8a4d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d8a2890 0x56437d8a4d50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72a40a9050 msgr2=0x7f72a4097050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f72a40a9050 0x7f72a4097050 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d8a7280 msgr2=0x56437d8a9670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d8a7280 0x56437d8a9670 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f717c036aa0 msgr2=0x7f717c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f717c036aa0 0x7f717c038f60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f729c001b60 tx=0x7f729c010000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 msgr2=0x56437d897270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b1787640 1 -- 172.21.15.173:0/3494392983 reap_dead start 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d897270 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f72a408c500 tx=0x7f72a4056f70 comp rx=0 tx=0).stop 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 shutdown_connections 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 --2- 172.21.15.173:0/3494392983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d88ff20 0x56437d897270 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 >> 172.21.15.173:0/3494392983 conn(0x56437d88c280 msgr2=0x56437d8898e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.735+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 shutdown_connections 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/3494392983 wait complete. 2024-05-15T18:08:56.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7188036950 msgr2=0x7f7188038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7188036950 0x7f7188038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bf50 tx=0x7f729c00f000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d882e30 msgr2=0x56437d883250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d882e30 0x56437d883250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72a4066540 tx=0x7f72a4006670 comp rx=0 tx=0).stop 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 shutdown_connections 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7188036950 0x7f7188038e10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/1938283359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d882e30 0x56437d883250 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 >> 172.21.15.173:0/1938283359 conn(0x56437d876ed0 msgr2=0x56437d8772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 shutdown_connections 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/1938283359 wait complete. 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56437d871e20 msgr2=0x56437d874270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56437d871e20 0x56437d874270 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d76b5e0 msgr2=0x56437d86b590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56437d76b5e0 0x56437d86b590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d86de90 msgr2=0x56437d870280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56437d86de90 0x56437d870280 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7198036950 msgr2=0x7f7198038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7198036950 0x7f7198038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f729c000f60 tx=0x7f729c0012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 msgr2=0x56437d864350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 --2- 172.21.15.173:0/535937745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56437d76a2a0 0x56437d864350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72a4000c00 tx=0x7f72a4003020 comp rx=0 tx=0).stop 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b1787640 1 -- 172.21.15.173:0/535937745 reap_dead start 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 shutdown_connections 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.736+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 >> 172.21.15.173:0/535937745 conn(0x56437d764d30 msgr2=0x56437d855900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.737+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 shutdown_connections 2024-05-15T18:08:56.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.737+0000 7f72b3487800 1 -- 172.21.15.173:0/535937745 wait complete. 2024-05-15T18:08:56.724 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:56.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.725 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf6891f800 1 Processor -- start 2024-05-15T18:08:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf6891f800 1 -- start start 2024-05-15T18:08:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf6891f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555956c71a00 0x555956c71e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf6891f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555956be6a40 con 0x555956c72360 2024-05-15T18:08:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf6891f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x555956b04050 con 0x555956c71a00 2024-05-15T18:08:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf645e7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555956c71a00 0x555956c71e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf63de6640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x555956c72360 0x555956c72810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35218/0 (socket says 172.21.15.173:35218) 2024-05-15T18:08:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf63de6640 1 -- 172.21.15.173:0/3939787652 learned_addr learned my addr 172.21.15.173:0/3939787652 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf645e7640 1 -- 172.21.15.173:0/3939787652 >> v1:172.21.15.3:6789/0 conn(0x555956c72360 legacy=0x555956c72810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.793+0000 7fcf645e7640 1 -- 172.21.15.173:0/3939787652 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555956c72f20 con 0x555956c71a00 2024-05-15T18:08:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.795+0000 7fcf645e7640 1 --2- 172.21.15.173:0/3939787652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956c71e20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a470 tx=0x7fcf5401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f124b9e7832852 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.795+0000 7fcf635e5640 1 -- 172.21.15.173:0/3939787652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54057070 con 0x555956c71a00 2024-05-15T18:08:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.795+0000 7fcf635e5640 1 -- 172.21.15.173:0/3939787652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54052570 con 0x555956c71a00 2024-05-15T18:08:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.795+0000 7fcf635e5640 1 -- 172.21.15.173:0/3939787652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54052870 con 0x555956c71a00 2024-05-15T18:08:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.796+0000 7fcf6891f800 1 -- 172.21.15.173:0/3939787652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 msgr2=0x555956c71e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.796+0000 7fcf6891f800 1 --2- 172.21.15.173:0/3939787652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956c71e20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a470 tx=0x7fcf5401ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.796+0000 7fcf6891f800 1 -- 172.21.15.173:0/3939787652 shutdown_connections 2024-05-15T18:08:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.796+0000 7fcf6891f800 1 --2- 172.21.15.173:0/3939787652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956c71e20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.796+0000 7fcf6891f800 1 -- 172.21.15.173:0/3939787652 >> 172.21.15.173:0/3939787652 conn(0x555956c6d5a0 msgr2=0x555956c6f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.796+0000 7fcf6891f800 1 -- 172.21.15.173:0/3939787652 shutdown_connections 2024-05-15T18:08:56.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.796+0000 7fcf6891f800 1 -- 172.21.15.173:0/3939787652 wait complete. 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf6891f800 1 Processor -- start 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf6891f800 1 -- start start 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf6891f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d66b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf6891f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555956bbe1d0 con 0x555956c71a00 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d66b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d66b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43574/0 (socket says 172.21.15.173:43574) 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf645e7640 1 -- 172.21.15.173:0/3989627120 learned_addr learned my addr 172.21.15.173:0/3989627120 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.810+0000 7fcf645e7640 1 -- 172.21.15.173:0/3989627120 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555956d670f0 con 0x555956c71a00 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.811+0000 7fcf645e7640 1 --2- 172.21.15.173:0/3989627120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d66b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf54055040 tx=0x7fcf5404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b8c295eafcbe41 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.811+0000 7fce5260c640 1 -- 172.21.15.173:0/3989627120 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54057040 con 0x555956c71a00 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.811+0000 7fce5260c640 1 -- 172.21.15.173:0/3989627120 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54052990 con 0x555956c71a00 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.811+0000 7fce5260c640 1 -- 172.21.15.173:0/3989627120 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54052c70 con 0x555956c71a00 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 -- 172.21.15.173:0/3989627120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 msgr2=0x555956d66b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 --2- 172.21.15.173:0/3989627120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d66b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf54055040 tx=0x7fcf5404c000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 -- 172.21.15.173:0/3989627120 shutdown_connections 2024-05-15T18:08:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 --2- 172.21.15.173:0/3989627120 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d66b20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 -- 172.21.15.173:0/3989627120 >> 172.21.15.173:0/3989627120 conn(0x555956c6d5a0 msgr2=0x555956d62440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 -- 172.21.15.173:0/3989627120 shutdown_connections 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 -- 172.21.15.173:0/3989627120 wait complete. 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 Processor -- start 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 -- start start 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d6e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf6891f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555956c73450 con 0x555956c71a00 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d6e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d6e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43588/0 (socket says 172.21.15.173:43588) 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.812+0000 7fcf645e7640 1 -- 172.21.15.173:0/2531510693 learned_addr learned my addr 172.21.15.173:0/2531510693 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.813+0000 7fcf645e7640 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555956d6eae0 con 0x555956c71a00 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.813+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d6e5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a470 tx=0x7fcf54003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.813+0000 7fce50e09640 1 -- 172.21.15.173:0/2531510693 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54073070 con 0x555956c71a00 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.813+0000 7fce50e09640 1 -- 172.21.15.173:0/2531510693 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5405d780 con 0x555956c71a00 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.813+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555956d6ed70 con 0x555956c71a00 2024-05-15T18:08:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.813+0000 7fce50e09640 1 -- 172.21.15.173:0/2531510693 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54057070 con 0x555956c71a00 2024-05-15T18:08:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.813+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555956d719d0 con 0x555956c71a00 2024-05-15T18:08:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.814+0000 7fce50e09640 1 -- 172.21.15.173:0/2531510693 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcf54076070 con 0x555956c71a00 2024-05-15T18:08:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.814+0000 7fce50e09640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce4c036900 0x7fce4c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.814+0000 7fce50e09640 1 -- 172.21.15.173:0/2531510693 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcf5408dec0 con 0x555956c71a00 2024-05-15T18:08:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.814+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce4c036900 0x7fce4c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.814+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956c72360 0x555956d75790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.814+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956d75d60 con 0x555956c72360 2024-05-15T18:08:56.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.814+0000 7fcf64de8640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956c72360 0x555956d75790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce4c036900 0x7fce4c038dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f60 tx=0x7fcf580012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf64de8640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956c72360 0x555956d75790 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf64de8640 1 -- 172.21.15.173:0/2531510693 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956c72360 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956d72d40 con 0x555956c72360 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf64de8640 1 -- 172.21.15.173:0/2531510693 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956c72360 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956d78090 0x555956d7a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956d7ab20 con 0x555956d78090 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.815+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956d78090 0x555956d7a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.816+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956d78090 0x555956d7a480 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.816+0000 7fcf645e7640 1 -- 172.21.15.173:0/2531510693 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf54075030 con 0x555956d78090 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.816+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956d77040 con 0x555956c72360 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.816+0000 7fcf64de8640 1 -- 172.21.15.173:0/2531510693 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956c72360 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.816+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555956d7bfd0 0x555956d7e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.816+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956d7eb80 con 0x555956d7bfd0 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.816+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555956d7bfd0 0x555956d7e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.817+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555956d7bfd0 0x555956d7e420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.817+0000 7fcf63de6640 1 -- 172.21.15.173:0/2531510693 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf58009050 con 0x555956d7bfd0 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf6891f800 1 Processor -- start 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf6891f800 1 -- start start 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf6891f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d8cfe0 0x555956d8d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf6891f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555956b64cf0 con 0x555956d8cfe0 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d8cfe0 0x555956d8d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d8cfe0 0x555956d8d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43592/0 (socket says 172.21.15.173:43592) 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf645e7640 1 -- 172.21.15.173:0/34516294 learned_addr learned my addr 172.21.15.173:0/34516294 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.818+0000 7fcf645e7640 1 -- 172.21.15.173:0/34516294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555956d8d940 con 0x555956d8cfe0 2024-05-15T18:08:56.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.819+0000 7fcf645e7640 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d8cfe0 0x555956d8d400 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf5408c410 tx=0x7fcf5405dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.819+0000 7fce49ffb640 1 -- 172.21.15.173:0/34516294 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5405cdf0 con 0x555956d8cfe0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.819+0000 7fce49ffb640 1 -- 172.21.15.173:0/34516294 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54006700 con 0x555956d8cfe0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.819+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555956d8e3b0 con 0x555956d8cfe0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.819+0000 7fce49ffb640 1 -- 172.21.15.173:0/34516294 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54006a00 con 0x555956d8cfe0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.819+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555956d8e8b0 con 0x555956d8cfe0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.819+0000 7fce49ffb640 1 -- 172.21.15.173:0/34516294 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcf540773b0 con 0x555956d8cfe0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fce49ffb640 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce3c036900 0x7fce3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fce49ffb640 1 -- 172.21.15.173:0/34516294 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcf54093aa0 con 0x555956d8cfe0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf63de6640 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce3c036900 0x7fce3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf6891f800 1 Processor -- start 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf6891f800 1 -- start start 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf63de6640 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce3c036900 0x7fce3c038dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800bf50 tx=0x7fcf5800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf6891f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956d9a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf6891f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555956d673b0 con 0x555956d9a100 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956d9a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956d9a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43604/0 (socket says 172.21.15.173:43604) 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.820+0000 7fcf645e7640 1 -- 172.21.15.173:0/2732487954 learned_addr learned my addr 172.21.15.173:0/2732487954 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fcf645e7640 1 -- 172.21.15.173:0/2732487954 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555956d9aaf0 con 0x555956d9a100 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2732487954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956d9a520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf54052040 tx=0x7fcf54002ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de3ff8d4faeae4f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fce437fe640 1 -- 172.21.15.173:0/2732487954 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5408cc30 con 0x555956d9a100 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fce437fe640 1 -- 172.21.15.173:0/2732487954 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5406c300 con 0x555956d9a100 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fce437fe640 1 -- 172.21.15.173:0/2732487954 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf54078ae0 con 0x555956d9a100 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fcf6891f800 1 -- 172.21.15.173:0/2732487954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 msgr2=0x555956d9a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2732487954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956d9a520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf54052040 tx=0x7fcf54002ef0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fcf6891f800 1 -- 172.21.15.173:0/2732487954 shutdown_connections 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2732487954 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956d9a520 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.821+0000 7fcf6891f800 1 -- 172.21.15.173:0/2732487954 >> 172.21.15.173:0/2732487954 conn(0x555956d96460 msgr2=0x555956d944c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf6891f800 1 -- 172.21.15.173:0/2732487954 shutdown_connections 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf6891f800 1 -- 172.21.15.173:0/2732487954 wait complete. 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf6891f800 1 Processor -- start 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf6891f800 1 -- start start 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf6891f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956da1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf6891f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555956d9b1a0 con 0x555956d9a100 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956da1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf645e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956da1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43608/0 (socket says 172.21.15.173:43608) 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 learned_addr learned my addr 172.21.15.173:0/2931329113 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.822+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555956da1a60 con 0x555956d9a100 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.823+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956da1520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf5405cfb0 tx=0x7fcf54059f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.823+0000 7fce41ffb640 1 -- 172.21.15.173:0/2931329113 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf540b5020 con 0x555956d9a100 2024-05-15T18:08:56.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.823+0000 7fce41ffb640 1 -- 172.21.15.173:0/2931329113 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5406c9d0 con 0x555956d9a100 2024-05-15T18:08:56.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.823+0000 7fce41ffb640 1 -- 172.21.15.173:0/2931329113 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf5407cc20 con 0x555956d9a100 2024-05-15T18:08:56.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.823+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555956da1a60 con 0x555956d9a100 2024-05-15T18:08:56.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.823+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555956da1f60 con 0x555956d9a100 2024-05-15T18:08:56.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fce41ffb640 1 -- 172.21.15.173:0/2931329113 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcf540b8020 con 0x555956d9a100 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fce41ffb640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce34036950 0x7fce34038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fce41ffb640 1 -- 172.21.15.173:0/2931329113 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcf540ab050 con 0x555956d9a100 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce34036950 0x7fce34038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956dacc50 0x555956daf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956daf860 con 0x555956dacc50 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.824+0000 7fcf64de8640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956dacc50 0x555956daf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce34036950 0x7fce34038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf58001b60 tx=0x7fcf58010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf64de8640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956dacc50 0x555956daf110 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 20 realm 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956dafc70 con 0x555956dacc50 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db0540 con 0x555956dacc50 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.825+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf6891f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956db13d0 0x555956db37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db3f20 con 0x555956db13d0 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956db13d0 0x555956db37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956db13d0 0x555956db37c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf6891f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf6891f800 20 searching for the correct realm 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.826+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db5900 con 0x555956db13d0 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf645e7640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcf540ba020 0x7fcf54057210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db5900 con 0x7fcf540ba020 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcf540ba020 0x7fcf54057210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcf540ba020 0x7fcf54057210 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf58009050 con 0x7fcf540ba020 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf63de6640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcf58038040 0x7fcf5801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.827+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db5900 con 0x7fcf58038040 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.828+0000 7fcf64de8640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcf58038040 0x7fcf5801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.828+0000 7fcf64de8640 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcf58038040 0x7fcf5801bab0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.828+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.828+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.828+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.828+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf540ba020 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf58009050 con 0x7fcf540ba020 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.829+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.830+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf540ba020 2024-05-15T18:08:56.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf58009050 con 0x7fcf540ba020 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.831+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.832+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.832+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.832+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.832+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.832+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.832+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf540ba020 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf58009050 con 0x7fcf540ba020 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.833+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf540ba020 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf58009050 con 0x7fcf540ba020 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.834+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956db13d0 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.835+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.835+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf58038040 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.835+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.835+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x555956dacc50 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.835+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.835+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555956db08e0 con 0x7fcf540ba020 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf58045040 con 0x7fcf540ba020 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db48d0 con 0x555956dacc50 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db4cc0 con 0x555956dacc50 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.836+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db4cc0 con 0x7fcf58038040 2024-05-15T18:08:56.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 zone default found 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 4 Realm: () 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 zonegroup default 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db50e0 con 0x7fcf58038040 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db5500 con 0x555956db13d0 2024-05-15T18:08:56.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956db77b0 con 0x555956db13d0 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 started sync module instance, tier type = 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.837+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db44c0 con 0x7fcf540ba020 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.838+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf58045040 con 0x7fcf540ba020 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.838+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93842197672176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db8000 con 0x7fcf540ba020 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.838+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db8850 con 0x555956dacc50 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.839+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93842197672176] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf58045040 con 0x7fcf540ba020 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.839+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.840+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93842197676960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db8c70 con 0x555956dacc50 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.840+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db9520 con 0x555956db13d0 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.841+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93842197676960] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.841+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.841+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93842197678496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db9910 con 0x555956db13d0 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.841+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dba330 con 0x7fcf540ba020 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.842+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93842197678496] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.842+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf58045040 con 0x7fcf540ba020 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.842+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93842197679616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbabd0 con 0x7fcf540ba020 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.842+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbb590 con 0x555956dacc50 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.843+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.843+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93842197689056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbbe30 con 0x555956dacc50 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.843+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbc900 con 0x7fcf58038040 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.844+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93842197679616] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf58045040 con 0x7fcf540ba020 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.844+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.844+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93842197693424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbc8c0 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.844+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbd310 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.844+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93842197689056] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.845+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.845+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93842197690752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbd310 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.845+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbdd20 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.845+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93842197693424] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93842197690752] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93842197696096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbd280 con 0x7fcf58038040 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 20 add_watcher() i=0 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 20 add_watcher() i=1 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 20 add_watcher() i=2 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 20 add_watcher() i=3 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 20 add_watcher() i=4 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 20 add_watcher() i=5 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.846+0000 7fcf6891f800 20 add_watcher() i=6 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.847+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93842197696096] v29'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.847+0000 7fcf6891f800 20 add_watcher() i=7 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.847+0000 7fcf6891f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.847+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956dc0d50 con 0x555956dacc50 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.847+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.847+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93842197698672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbe140 con 0x555956dacc50 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.848+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93842197698672] v29'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.848+0000 7fce1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.848+0000 7fcf6891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.848+0000 7fcf6891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.848+0000 7fcf6891f800 5 note: GC not initialized 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fce197e2640 20 reqs_thread_entry: start 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fcf6891f800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fcf6891f800 20 Filter name: none 2024-05-15T18:08:56.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fcd8affd640 20 reqs_thread_entry: start 2024-05-15T18:08:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fcf6891f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555956df3bf0 con 0x555956dacc50 2024-05-15T18:08:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.849+0000 7fcf6891f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:56.840 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.850+0000 7fce1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.850+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93842197698672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956df2b40 con 0x555956dacc50 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.851+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93842197698672] v29'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.851+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93842197672176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956df2b40 con 0x7fcf540ba020 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.852+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93842197672176] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf58045040 con 0x7fcf540ba020 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.852+0000 7fcf6891f800 20 remove_watcher() i=0 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.852+0000 7fcf6891f800 2 removed watcher, disabling cache 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.852+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93842197676960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db70f0 con 0x555956dacc50 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.853+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93842197676960] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.853+0000 7fcf6891f800 20 remove_watcher() i=1 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.853+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93842197678496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db70f0 con 0x555956db13d0 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.854+0000 7fcf645e7640 1 -- 172.21.15.173:0/2931329113 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93842197678496] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf54099070 con 0x555956db13d0 2024-05-15T18:08:56.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.854+0000 7fcf6891f800 20 remove_watcher() i=2 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.854+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93842197679616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db89a0 con 0x7fcf540ba020 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.855+0000 7fcf63de6640 1 -- 172.21.15.173:0/2931329113 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93842197679616] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf58045040 con 0x7fcf540ba020 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.855+0000 7fcf6891f800 20 remove_watcher() i=3 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.855+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93842197689056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db70f0 con 0x555956dacc50 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.856+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93842197689056] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x555956dacc50 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.856+0000 7fcf6891f800 20 remove_watcher() i=4 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.856+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93842197693424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956db70f0 con 0x7fcf58038040 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.857+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93842197693424] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.857+0000 7fcf6891f800 20 remove_watcher() i=5 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.857+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93842197690752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbc3f0 con 0x7fcf58038040 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.858+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93842197690752] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.858+0000 7fcf6891f800 20 remove_watcher() i=6 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.858+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93842197696096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555956dbc3f0 con 0x7fcf58038040 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93842197696096] v29'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf5c00a4a0 con 0x7fcf58038040 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 20 remove_watcher() i=7 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcf58038040 msgr2=0x7fcf5801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcf58038040 0x7fcf5801bab0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956dacc50 msgr2=0x555956daf110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956dacc50 0x555956daf110 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcf540ba020 msgr2=0x7fcf54057210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcf540ba020 0x7fcf54057210 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956db13d0 msgr2=0x555956db37c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956db13d0 0x555956db37c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce34036950 msgr2=0x7fce34038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce34036950 0x7fce34038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcf58001b60 tx=0x7fcf58010000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 msgr2=0x555956da1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf64de8640 1 -- 172.21.15.173:0/2931329113 reap_dead start 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956da1520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf5405cfb0 tx=0x7fcf54059f40 comp rx=0 tx=0).stop 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 shutdown_connections 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2931329113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d9a100 0x555956da1520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 >> 172.21.15.173:0/2931329113 conn(0x555956d96460 msgr2=0x555956d93ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 shutdown_connections 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.859+0000 7fcf6891f800 1 -- 172.21.15.173:0/2931329113 wait complete. 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce3c036900 msgr2=0x7fce3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce3c036900 0x7fce3c038dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800bf50 tx=0x7fcf5800f000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d8cfe0 msgr2=0x555956d8d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d8cfe0 0x555956d8d400 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf5408c410 tx=0x7fcf5405dc60 comp rx=0 tx=0).stop 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 shutdown_connections 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce3c036900 0x7fce3c038dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/34516294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956d8cfe0 0x555956d8d400 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 >> 172.21.15.173:0/34516294 conn(0x555956d81080 msgr2=0x555956d81480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 shutdown_connections 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/34516294 wait complete. 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555956d7bfd0 msgr2=0x555956d7e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555956d7bfd0 0x555956d7e420 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956c72360 msgr2=0x555956d75790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555956c72360 0x555956d75790 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956d78090 msgr2=0x555956d7a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555956d78090 0x555956d7a480 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce4c036900 msgr2=0x7fce4c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fce4c036900 0x7fce4c038dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f60 tx=0x7fcf580012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 msgr2=0x555956d6e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 --2- 172.21.15.173:0/2531510693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555956c71a00 0x555956d6e5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a470 tx=0x7fcf54003020 comp rx=0 tx=0).stop 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf64de8640 1 -- 172.21.15.173:0/2531510693 reap_dead start 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 shutdown_connections 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 >> 172.21.15.173:0/2531510693 conn(0x555956c6d5a0 msgr2=0x555956d60c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 shutdown_connections 2024-05-15T18:08:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.860+0000 7fcf6891f800 1 -- 172.21.15.173:0/2531510693 wait complete. 2024-05-15T18:08:56.851 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:56.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-15T18:08:56.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-15T18:08:56.851 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-05-15T18:08:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f363d123800 1 Processor -- start 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f363d123800 1 -- start start 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f363d123800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bddde79a20 0x55bddde79e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f363d123800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bddddeea60 con 0x55bddde7a380 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f363d123800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55bdddd0c050 con 0x55bddde79a20 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f3638e59640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bddde79a20 0x55bddde79e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f3638e59640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bddde79a20 0x55bddde79e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43624/0 (socket says 172.21.15.173:43624) 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f3638e59640 1 -- 172.21.15.173:0/2410472498 learned_addr learned my addr 172.21.15.173:0/2410472498 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.924+0000 7f3633fff640 1 --1- 172.21.15.173:0/2410472498 >> v1:172.21.15.3:6789/0 conn(0x55bddde7a380 0x55bddde7a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35234/0 (socket says 172.21.15.173:35234) 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.925+0000 7f3638e59640 1 -- 172.21.15.173:0/2410472498 >> v1:172.21.15.3:6789/0 conn(0x55bddde7a380 legacy=0x55bddde7a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.925+0000 7f3638e59640 1 -- 172.21.15.173:0/2410472498 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bddde7af40 con 0x55bddde79a20 2024-05-15T18:08:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f3638e59640 1 --2- 172.21.15.173:0/2410472498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bddde79e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f362c00a520 tx=0x7f362c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2eec2c206b0ea85 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f36337fe640 1 -- 172.21.15.173:0/2410472498 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c057070 con 0x55bddde79a20 2024-05-15T18:08:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f36337fe640 1 -- 172.21.15.173:0/2410472498 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c052570 con 0x55bddde79a20 2024-05-15T18:08:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f36337fe640 1 -- 172.21.15.173:0/2410472498 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c04ae60 con 0x55bddde79a20 2024-05-15T18:08:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f363d123800 1 -- 172.21.15.173:0/2410472498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 msgr2=0x55bddde79e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f363d123800 1 --2- 172.21.15.173:0/2410472498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bddde79e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f362c00a520 tx=0x7f362c01d010 comp rx=0 tx=0).stop 2024-05-15T18:08:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f363d123800 1 -- 172.21.15.173:0/2410472498 shutdown_connections 2024-05-15T18:08:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f363d123800 1 --2- 172.21.15.173:0/2410472498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bddde79e40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f363d123800 1 -- 172.21.15.173:0/2410472498 >> 172.21.15.173:0/2410472498 conn(0x55bddde755c0 msgr2=0x55bddde779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f363d123800 1 -- 172.21.15.173:0/2410472498 shutdown_connections 2024-05-15T18:08:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.927+0000 7f363d123800 1 -- 172.21.15.173:0/2410472498 wait complete. 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.941+0000 7f363d123800 1 Processor -- start 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.941+0000 7f363d123800 1 -- start start 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.941+0000 7f363d123800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf6ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.941+0000 7f363d123800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bddddc61f0 con 0x55bddde79a20 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.941+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf6ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.941+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf6ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43626/0 (socket says 172.21.15.173:43626) 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.941+0000 7f3638e59640 1 -- 172.21.15.173:0/2634405436 learned_addr learned my addr 172.21.15.173:0/2634405436 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.942+0000 7f3638e59640 1 -- 172.21.15.173:0/2634405436 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdddf6f1d0 con 0x55bddde79a20 2024-05-15T18:08:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.942+0000 7f3638e59640 1 --2- 172.21.15.173:0/2634405436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf6ec00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f362c055040 tx=0x7f362c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81679a996c4a7b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.942+0000 7f3526e05640 1 -- 172.21.15.173:0/2634405436 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c057040 con 0x55bddde79a20 2024-05-15T18:08:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.942+0000 7f3526e05640 1 -- 172.21.15.173:0/2634405436 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c052720 con 0x55bddde79a20 2024-05-15T18:08:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.942+0000 7f3526e05640 1 -- 172.21.15.173:0/2634405436 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c052a20 con 0x55bddde79a20 2024-05-15T18:08:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 -- 172.21.15.173:0/2634405436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 msgr2=0x55bdddf6ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 --2- 172.21.15.173:0/2634405436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf6ec00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f362c055040 tx=0x7f362c04c000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 -- 172.21.15.173:0/2634405436 shutdown_connections 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 --2- 172.21.15.173:0/2634405436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf6ec00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 -- 172.21.15.173:0/2634405436 >> 172.21.15.173:0/2634405436 conn(0x55bddde755c0 msgr2=0x55bdddf6a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 -- 172.21.15.173:0/2634405436 shutdown_connections 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 -- 172.21.15.173:0/2634405436 wait complete. 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 Processor -- start 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 -- start start 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf76680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f363d123800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bddde7b470 con 0x55bddde79a20 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf76680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf76680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43638/0 (socket says 172.21.15.173:43638) 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.943+0000 7f3638e59640 1 -- 172.21.15.173:0/1797541251 learned_addr learned my addr 172.21.15.173:0/1797541251 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.944+0000 7f3638e59640 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdddf76bc0 con 0x55bddde79a20 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.944+0000 7f3638e59640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf76680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f362c0524f0 tx=0x7f362c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.944+0000 7f3525602640 1 -- 172.21.15.173:0/1797541251 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c073070 con 0x55bddde79a20 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.944+0000 7f3525602640 1 -- 172.21.15.173:0/1797541251 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c05d440 con 0x55bddde79a20 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.944+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdddf76e50 con 0x55bddde79a20 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.944+0000 7f3525602640 1 -- 172.21.15.173:0/1797541251 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c057070 con 0x55bddde79a20 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.944+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdddf79ab0 con 0x55bddde79a20 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.945+0000 7f3525602640 1 -- 172.21.15.173:0/1797541251 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f362c076070 con 0x55bddde79a20 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.945+0000 7f3525602640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3520036950 0x7f3520038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.945+0000 7f3525602640 1 -- 172.21.15.173:0/1797541251 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f362c08dbd0 con 0x55bddde79a20 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.945+0000 7f3633fff640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3520036950 0x7f3520038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.945+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bddde7a380 0x55bdddf7d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.945+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddf7de40 con 0x55bddde7a380 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.945+0000 7f363965a640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bddde7a380 0x55bdddf7d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f3633fff640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3520036950 0x7f3520038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3624000f60 tx=0x7f3624001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f363965a640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bddde7a380 0x55bdddf7d870 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f363965a640 1 -- 172.21.15.173:0/1797541251 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363400a4a0 con 0x55bddde7a380 2024-05-15T18:08:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddf7ae40 con 0x55bddde7a380 2024-05-15T18:08:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f363965a640 1 -- 172.21.15.173:0/1797541251 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f363400a4a0 con 0x55bddde7a380 2024-05-15T18:08:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddf80150 0x55bdddf82540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddf82be0 con 0x55bdddf80150 2024-05-15T18:08:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.946+0000 7f3638e59640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddf80150 0x55bdddf82540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.947+0000 7f3638e59640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddf80150 0x55bdddf82540 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.947+0000 7f3638e59640 1 -- 172.21.15.173:0/1797541251 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f362c075030 con 0x55bdddf80150 2024-05-15T18:08:56.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.947+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddf7f100 con 0x55bddde7a380 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.947+0000 7f363965a640 1 -- 172.21.15.173:0/1797541251 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f363400a4a0 con 0x55bddde7a380 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.947+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bdddf84090 0x55bdddf864e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.947+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddf86c40 con 0x55bdddf84090 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.947+0000 7f3633fff640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bdddf84090 0x55bdddf864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.948+0000 7f3633fff640 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bdddf84090 0x55bdddf864e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.948+0000 7f3633fff640 1 -- 172.21.15.173:0/1797541251 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f362400f690 con 0x55bdddf84090 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f363d123800 1 Processor -- start 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f363d123800 1 -- start start 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f363d123800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddf950a0 0x55bdddf954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f363d123800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bdddd6ccf0 con 0x55bdddf950a0 2024-05-15T18:08:56.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddf950a0 0x55bdddf954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddf950a0 0x55bdddf954c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43646/0 (socket says 172.21.15.173:43646) 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f3638e59640 1 -- 172.21.15.173:0/1212608583 learned_addr learned my addr 172.21.15.173:0/1212608583 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f3638e59640 1 -- 172.21.15.173:0/1212608583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdddf95a00 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.949+0000 7f3638e59640 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddf950a0 0x55bdddf954c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f362c08c120 tx=0x7f362c006490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.950+0000 7f351e7fc640 1 -- 172.21.15.173:0/1212608583 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c092070 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.950+0000 7f351e7fc640 1 -- 172.21.15.173:0/1212608583 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c06e400 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.950+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdddf96470 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.950+0000 7f351e7fc640 1 -- 172.21.15.173:0/1212608583 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c076360 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.950+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdddf96970 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.950+0000 7f351e7fc640 1 -- 172.21.15.173:0/1212608583 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f362c095070 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f351e7fc640 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3510036950 0x7f3510038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f351e7fc640 1 -- 172.21.15.173:0/1212608583 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f362c098af0 con 0x55bdddf950a0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f3633fff640 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3510036950 0x7f3510038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f363d123800 1 Processor -- start 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f363d123800 1 -- start start 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f3633fff640 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3510036950 0x7f3510038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55bdddf7ad60 tx=0x7f362400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f363d123800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f363d123800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bdddf6f490 con 0x55bdddfa21e0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43648/0 (socket says 172.21.15.173:43648) 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f3638e59640 1 -- 172.21.15.173:0/1354185326 learned_addr learned my addr 172.21.15.173:0/1354185326 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.951+0000 7f3638e59640 1 -- 172.21.15.173:0/1354185326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdddfa2bd0 con 0x55bdddfa21e0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f3638e59640 1 --2- 172.21.15.173:0/1354185326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa2600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f362c008370 tx=0x7f362c08d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4c44fdeb5d5cdb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f350ffff640 1 -- 172.21.15.173:0/1354185326 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c0a9070 con 0x55bdddfa21e0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f350ffff640 1 -- 172.21.15.173:0/1354185326 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c077dd0 con 0x55bdddfa21e0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f350ffff640 1 -- 172.21.15.173:0/1354185326 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c08d240 con 0x55bdddfa21e0 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f363d123800 1 -- 172.21.15.173:0/1354185326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 msgr2=0x55bdddfa2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f363d123800 1 --2- 172.21.15.173:0/1354185326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa2600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f362c008370 tx=0x7f362c08d990 comp rx=0 tx=0).stop 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f363d123800 1 -- 172.21.15.173:0/1354185326 shutdown_connections 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f363d123800 1 --2- 172.21.15.173:0/1354185326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa2600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f363d123800 1 -- 172.21.15.173:0/1354185326 >> 172.21.15.173:0/1354185326 conn(0x55bdddf9e4f0 msgr2=0x55bdddf9c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f363d123800 1 -- 172.21.15.173:0/1354185326 shutdown_connections 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.952+0000 7f363d123800 1 -- 172.21.15.173:0/1354185326 wait complete. 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f363d123800 1 Processor -- start 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f363d123800 1 -- start start 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f363d123800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f363d123800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bdddfa3260 con 0x55bdddfa21e0 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f3638e59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43650/0 (socket says 172.21.15.173:43650) 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 learned_addr learned my addr 172.21.15.173:0/2785716094 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdddfa9b30 con 0x55bdddfa21e0 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f3638e59640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa95f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f362c0a7040 tx=0x7f362c092f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.953+0000 7f350e7fc640 1 -- 172.21.15.173:0/2785716094 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c0b4070 con 0x55bdddfa21e0 2024-05-15T18:08:56.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.954+0000 7f350e7fc640 1 -- 172.21.15.173:0/2785716094 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c07a0b0 con 0x55bdddfa21e0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.954+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdddfa9b30 con 0x55bdddfa21e0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.954+0000 7f350e7fc640 1 -- 172.21.15.173:0/2785716094 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362c0a9040 con 0x55bdddfa21e0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.954+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdddfa9b30 con 0x55bdddfa21e0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.954+0000 7f350e7fc640 1 -- 172.21.15.173:0/2785716094 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f362c0b7070 con 0x55bdddfa21e0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.954+0000 7f350e7fc640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3504036900 0x7f3504038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.955+0000 7f350e7fc640 1 -- 172.21.15.173:0/2785716094 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f362c0bab00 con 0x55bdddfa21e0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.955+0000 7f3633fff640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3504036900 0x7f3504038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.955+0000 7f3633fff640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3504036900 0x7f3504038dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55bdddf87040 tx=0x7f3624010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.955+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.955+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bdddfb4d10 0x55bdddfb71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.955+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb7920 con 0x55bdddfb4d10 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.955+0000 7f363965a640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bdddfb4d10 0x55bdddfb71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363965a640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bdddfb4d10 0x55bdddfb71d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 20 realm 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb7d30 con 0x55bdddfb4d10 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb8600 con 0x55bdddfb4d10 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.956+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f363d123800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddfb9700 0x55bdddfbbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbc100 con 0x55bdddfb9700 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f3638e59640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddfb9700 0x55bdddfbbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f3638e59640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddfb9700 0x55bdddfbbaf0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f363d123800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f363d123800 20 searching for the correct realm 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.957+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbda10 con 0x55bdddfb9700 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3638e59640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f362c0b9070 0x7f362c078440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbda10 con 0x7f362c0b9070 2024-05-15T18:08:56.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3633fff640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f362c0b9070 0x7f362c078440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3633fff640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f362c0b9070 0x7f362c078440 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3633fff640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f362400f070 0x7f362402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.958+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbda10 con 0x7f362400f070 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.959+0000 7f363965a640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f362400f070 0x7f362402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.959+0000 7f363965a640 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f362400f070 0x7f362402e910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.959+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f363400a4a0 con 0x7f362400f070 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.959+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.959+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.959+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x7f362400f070 2024-05-15T18:08:56.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x7f362400f070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362c0b9070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.960+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x7f362400f070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.961+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362c0b9070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x7f362400f070 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.962+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f363400a4a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634033040 con 0x7f362400f070 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.963+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.964+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.964+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362c0b9070 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.964+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.964+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.964+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.964+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362c0b9070 2024-05-15T18:08:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.965+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb9700 2024-05-15T18:08:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362400f070 2024-05-15T18:08:56.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfb89a0 con 0x7f362c0b9070 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.966+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbc9c0 con 0x55bdddfb4d10 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbcdb0 con 0x55bdddfb4d10 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363d123800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.967+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbcdb0 con 0x7f362400f070 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 zone default found 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 4 Realm: () 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 zonegroup default 2024-05-15T18:08:56.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbde90 con 0x7f362400f070 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbf870 con 0x55bdddfb9700 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbfc10 con 0x55bdddfb9700 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 started sync module instance, tier type = 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.968+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbed10 con 0x7f362c0b9070 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.970+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.970+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94273961453664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbffb0 con 0x7f362c0b9070 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.970+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc0860 con 0x55bdddfb4d10 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.970+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94273961453664] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.971+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.971+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94273961460560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc0c80 con 0x55bdddfb4d10 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.971+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc16a0 con 0x55bdddfb9700 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.972+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94273961460560] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.972+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.972+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94273961464208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc1ac0 con 0x55bdddfb9700 2024-05-15T18:08:56.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.972+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc2500 con 0x7f362c0b9070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.973+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94273961464208] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.973+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.973+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94273961455872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc2da0 con 0x7f362c0b9070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.973+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc3760 con 0x55bdddfb4d10 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.974+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94273961455872] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.974+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.974+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94273961472688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc3b80 con 0x55bdddfb4d10 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.974+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc4540 con 0x7f362400f070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.975+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.975+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94273961476240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc44b0 con 0x7f362400f070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.975+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc54b0 con 0x7f362400f070 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.975+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94273961472688] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.976+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.976+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94273961480064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc5470 con 0x7f362400f070 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.976+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc5eb0 con 0x7f362400f070 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.976+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94273961476240] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94273961480064] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94273961473744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc48e0 con 0x7f362400f070 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 20 add_watcher() i=0 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 20 add_watcher() i=1 2024-05-15T18:08:56.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 20 add_watcher() i=2 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 20 add_watcher() i=3 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 20 add_watcher() i=4 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 20 add_watcher() i=5 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.977+0000 7f363d123800 20 add_watcher() i=6 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.978+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94273961473744] v29'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.978+0000 7f363d123800 20 add_watcher() i=7 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.978+0000 7f363d123800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.978+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc8ea0 con 0x55bdddfb4d10 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.978+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.978+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94273961482624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc6390 con 0x55bdddfb4d10 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.980+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94273961482624] v29'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.980+0000 7f34eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.980+0000 7f363d123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.980+0000 7f363d123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.980+0000 7f363d123800 5 note: GC not initialized 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.980+0000 7f34edfe3640 20 reqs_thread_entry: start 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 20 Filter name: none 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f345f7fe640 20 reqs_thread_entry: start 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddffc360 con 0x55bdddfb4d10 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 20 rados->read ofs=0 len=0 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.981+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdddffcc70 con 0x7f362400f070 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.982+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.982+0000 7f363d123800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.982+0000 7f363d123800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.982+0000 7f363d123800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.982+0000 7f363d123800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.982+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdde0024a0 con 0x55bdddfb4d10 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v29'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363d123800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363d123800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363d123800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94273961729808 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdde000ff0 con 0x55bdddfb4d10 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94273961472688 notify 124554051587 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f363401e040 con 0x55bdddfb4d10 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f350ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94273961472688 notifier 4336 bl.length()=678 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f350ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f350ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f350ffff640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f34fc003ea0 con 0x55bdddfb4d10 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(65 notify.4 [notify cookie 94273961729808 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== watch-notify(notify_complete (2) cookie 94273961729808 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f36340387b0 con 0x55bdddfb4d10 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.983+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdde001f10 con 0x7f362400f070 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f363d123800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:08:56.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f363d123800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f363d123800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94273961729808 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bdde000b40 con 0x55bdddfb9700 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== watch-notify(notify (1) cookie 94273961464208 notify 124554051584 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55bdddf96470 con 0x55bdddfb9700 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f350f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051584 cookie 94273961464208 notifier 4336 bl.length()=177 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f350f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 notify.2 [notify cookie 94273961729808 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f350f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f350f7fe640 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f346c003430 con 0x55bdddfb9700 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== watch-notify(notify_complete (2) cookie 94273961729808 notify 124554051584 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bdddf95a00 con 0x55bdddfb9700 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.985+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.977 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-15T18:08:56.982548Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.986+0000 7f34eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:56.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.986+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94273961482624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdde000f70 con 0x55bdddfb4d10 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.987+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94273961482624] v29'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.987+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94273961453664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc5980 con 0x7f362c0b9070 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.988+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94273961453664] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.988+0000 7f363d123800 20 remove_watcher() i=0 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.988+0000 7f363d123800 2 removed watcher, disabling cache 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.988+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94273961460560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc5980 con 0x55bdddfb4d10 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.989+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94273961460560] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.989+0000 7f363d123800 20 remove_watcher() i=1 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.989+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94273961464208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc5980 con 0x55bdddfb9700 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.990+0000 7f3638e59640 1 -- 172.21.15.173:0/2785716094 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94273961464208] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f362c0b6030 con 0x55bdddfb9700 2024-05-15T18:08:56.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.990+0000 7f363d123800 20 remove_watcher() i=2 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.990+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94273961455872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc1190 con 0x7f362c0b9070 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.991+0000 7f3633fff640 1 -- 172.21.15.173:0/2785716094 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94273961455872] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3624037040 con 0x7f362c0b9070 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.991+0000 7f363d123800 20 remove_watcher() i=3 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.991+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94273961472688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc5980 con 0x55bdddfb4d10 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.992+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94273961472688] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x55bdddfb4d10 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.992+0000 7f363d123800 20 remove_watcher() i=4 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.992+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94273961476240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfbf100 con 0x7f362400f070 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.993+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94273961476240] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.993+0000 7f363d123800 20 remove_watcher() i=5 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.993+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94273961480064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc1190 con 0x7f362400f070 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.994+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94273961480064] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.994+0000 7f363d123800 20 remove_watcher() i=6 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.994+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94273961473744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bdddfc32b0 con 0x7f362400f070 2024-05-15T18:08:56.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94273961473744] v29'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3634031040 con 0x7f362400f070 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 20 remove_watcher() i=7 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f362400f070 msgr2=0x7f362402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f362400f070 0x7f362402e910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bdddfb4d10 msgr2=0x55bdddfb71d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bdddfb4d10 0x55bdddfb71d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f362c0b9070 msgr2=0x7f362c078440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f362c0b9070 0x7f362c078440 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddfb9700 msgr2=0x55bdddfbbaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddfb9700 0x55bdddfbbaf0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3504036900 msgr2=0x7f3504038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3504036900 0x7f3504038dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55bdddf87040 tx=0x7f3624010000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 msgr2=0x55bdddfa95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363965a640 1 -- 172.21.15.173:0/2785716094 reap_dead start 2024-05-15T18:08:56.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa95f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f362c0a7040 tx=0x7f362c092f00 comp rx=0 tx=0).stop 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 shutdown_connections 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 --2- 172.21.15.173:0/2785716094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddfa21e0 0x55bdddfa95f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 >> 172.21.15.173:0/2785716094 conn(0x55bdddf9e4f0 msgr2=0x55bdddf9bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 shutdown_connections 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.995+0000 7f363d123800 1 -- 172.21.15.173:0/2785716094 wait complete. 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3510036950 msgr2=0x7f3510038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3510036950 0x7f3510038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55bdddf7ad60 tx=0x7f362400f000 comp rx=0 tx=0).stop 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddf950a0 msgr2=0x55bdddf954c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddf950a0 0x55bdddf954c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f362c08c120 tx=0x7f362c006490 comp rx=0 tx=0).stop 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 shutdown_connections 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3510036950 0x7f3510038e10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1212608583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bdddf950a0 0x55bdddf954c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 >> 172.21.15.173:0/1212608583 conn(0x55bdddf89140 msgr2=0x55bdddf89540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 shutdown_connections 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1212608583 wait complete. 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bdddf84090 msgr2=0x55bdddf864e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bdddf84090 0x55bdddf864e0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bddde7a380 msgr2=0x55bdddf7d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bddde7a380 0x55bdddf7d870 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddf80150 msgr2=0x55bdddf82540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bdddf80150 0x55bdddf82540 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3520036950 msgr2=0x7f3520038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3520036950 0x7f3520038e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3624000f60 tx=0x7f3624001370 comp rx=0 tx=0).stop 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 msgr2=0x55bdddf76680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 --2- 172.21.15.173:0/1797541251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bddde79a20 0x55bdddf76680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f362c0524f0 tx=0x7f362c003020 comp rx=0 tx=0).stop 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363965a640 1 -- 172.21.15.173:0/1797541251 reap_dead start 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 shutdown_connections 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 >> 172.21.15.173:0/1797541251 conn(0x55bddde755c0 msgr2=0x55bdddf68d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 shutdown_connections 2024-05-15T18:08:56.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:56.996+0000 7f363d123800 1 -- 172.21.15.173:0/1797541251 wait complete. 2024-05-15T18:08:56.989 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-15T18:08:56.982548Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:56.989 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:56.989 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:57.033 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:57.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.057+0000 7f9df912f800 1 Processor -- start 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.057+0000 7f9df912f800 1 -- start start 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.057+0000 7f9df912f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56536f0a26e0 0x56536f0a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.057+0000 7f9df912f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56536f0a5010 con 0x56536f09ebd0 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.057+0000 7f9df912f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56536ef2f050 con 0x56536f0a26e0 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.058+0000 7f9df45ad640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56536f0a26e0 0x56536f0a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.058+0000 7f9df4dae640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x56536f09ebd0 0x56536f0a0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35236/0 (socket says 172.21.15.173:35236) 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.058+0000 7f9df4dae640 1 -- 172.21.15.173:0/1637983236 learned_addr learned my addr 172.21.15.173:0/1637983236 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.058+0000 7f9df45ad640 1 -- 172.21.15.173:0/1637983236 >> v1:172.21.15.3:6789/0 conn(0x56536f09ebd0 legacy=0x56536f0a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.058+0000 7f9df45ad640 1 -- 172.21.15.173:0/1637983236 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536f0a61f0 con 0x56536f0a26e0 2024-05-15T18:08:57.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df45ad640 1 --2- 172.21.15.173:0/1637983236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f0a26e0 0x56536f0a4ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9de800a470 tx=0x7f9de801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf18e108f86d6c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df3dac640 1 -- 172.21.15.173:0/1637983236 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8057070 con 0x56536f0a26e0 2024-05-15T18:08:57.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df3dac640 1 -- 172.21.15.173:0/1637983236 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de8052570 con 0x56536f0a26e0 2024-05-15T18:08:57.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df3dac640 1 -- 172.21.15.173:0/1637983236 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8052870 con 0x56536f0a26e0 2024-05-15T18:08:57.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df912f800 1 -- 172.21.15.173:0/1637983236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f0a26e0 msgr2=0x56536f0a4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df912f800 1 --2- 172.21.15.173:0/1637983236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f0a26e0 0x56536f0a4ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9de800a470 tx=0x7f9de801ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:57.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df912f800 1 -- 172.21.15.173:0/1637983236 shutdown_connections 2024-05-15T18:08:57.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df912f800 1 --2- 172.21.15.173:0/1637983236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f0a26e0 0x56536f0a4ad0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df912f800 1 -- 172.21.15.173:0/1637983236 >> 172.21.15.173:0/1637983236 conn(0x56536f0985a0 msgr2=0x56536f09a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df912f800 1 -- 172.21.15.173:0/1637983236 shutdown_connections 2024-05-15T18:08:57.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.060+0000 7f9df912f800 1 -- 172.21.15.173:0/1637983236 wait complete. 2024-05-15T18:08:57.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.074+0000 7f9df912f800 1 Processor -- start 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.074+0000 7f9df912f800 1 -- start start 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.074+0000 7f9df912f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f09e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.074+0000 7f9df912f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56536efe91d0 con 0x56536f09ebd0 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.074+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f09e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.074+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f09e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43676/0 (socket says 172.21.15.173:43676) 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.074+0000 7f9df4dae640 1 -- 172.21.15.173:0/1667005811 learned_addr learned my addr 172.21.15.173:0/1667005811 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.075+0000 7f9df4dae640 1 -- 172.21.15.173:0/1667005811 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536f09cad0 con 0x56536f09ebd0 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.075+0000 7f9df4dae640 1 --2- 172.21.15.173:0/1667005811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f09e510 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9de40017a0 tx=0x7f9de4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eae12d471f4900c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.075+0000 7f9ce2e0d640 1 -- 172.21.15.173:0/1667005811 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4004520 con 0x56536f09ebd0 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.075+0000 7f9ce2e0d640 1 -- 172.21.15.173:0/1667005811 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de40046c0 con 0x56536f09ebd0 2024-05-15T18:08:57.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.075+0000 7f9ce2e0d640 1 -- 172.21.15.173:0/1667005811 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4004a00 con 0x56536f09ebd0 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 -- 172.21.15.173:0/1667005811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 msgr2=0x56536f09e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 --2- 172.21.15.173:0/1667005811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f09e510 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9de40017a0 tx=0x7f9de4001c60 comp rx=0 tx=0).stop 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 -- 172.21.15.173:0/1667005811 shutdown_connections 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 --2- 172.21.15.173:0/1667005811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f09e510 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 -- 172.21.15.173:0/1667005811 >> 172.21.15.173:0/1667005811 conn(0x56536f0985a0 msgr2=0x56536f18b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 -- 172.21.15.173:0/1667005811 shutdown_connections 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 -- 172.21.15.173:0/1667005811 wait complete. 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 Processor -- start 2024-05-15T18:08:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 -- start start 2024-05-15T18:08:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.076+0000 7f9df912f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56536f0a54e0 con 0x56536f09ebd0 2024-05-15T18:08:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43684/0 (socket says 172.21.15.173:43684) 2024-05-15T18:08:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9df4dae640 1 -- 172.21.15.173:0/3505574671 learned_addr learned my addr 172.21.15.173:0/3505574671 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9df4dae640 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536f1999a0 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9df4dae640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f199460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9de4000f80 tx=0x7f9de4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9ce160a640 1 -- 172.21.15.173:0/3505574671 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4022020 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9ce160a640 1 -- 172.21.15.173:0/3505574671 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4014870 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56536f199c30 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9ce160a640 1 -- 172.21.15.173:0/3505574671 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4014bb0 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.077+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536f19c8e0 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.078+0000 7f9ce160a640 1 -- 172.21.15.173:0/3505574671 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9de4025020 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.078+0000 7f9ce160a640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cdc036950 0x7f9cdc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.078+0000 7f9ce160a640 1 -- 172.21.15.173:0/3505574671 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9de4018030 con 0x56536f09ebd0 2024-05-15T18:08:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.078+0000 7f9df45ad640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cdc036950 0x7f9cdc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.078+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f0a26e0 0x56536f1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.078+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1a0c30 con 0x56536f0a26e0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df55af640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f0a26e0 0x56536f1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df45ad640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cdc036950 0x7f9cdc038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9de8054000 tx=0x7f9de804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df55af640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f0a26e0 0x56536f1a06a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df55af640 1 -- 172.21.15.173:0/3505574671 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f0a26e0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f19dc50 con 0x56536f0a26e0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df55af640 1 -- 172.21.15.173:0/3505574671 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f0a26e0 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1a2f60 0x56536f1a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1a5a40 con 0x56536f1a2f60 2024-05-15T18:08:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.079+0000 7f9df4dae640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1a2f60 0x56536f1a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.080+0000 7f9df4dae640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1a2f60 0x56536f1a5350 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.080+0000 7f9df4dae640 1 -- 172.21.15.173:0/3505574671 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9de401b070 con 0x56536f1a2f60 2024-05-15T18:08:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.080+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1a1f10 con 0x56536f0a26e0 2024-05-15T18:08:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.080+0000 7f9df55af640 1 -- 172.21.15.173:0/3505574671 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f0a26e0 2024-05-15T18:08:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.080+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56536f1a6ea0 0x56536f1a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.080+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1a9a70 con 0x56536f1a6ea0 2024-05-15T18:08:57.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.081+0000 7f9df45ad640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56536f1a6ea0 0x56536f1a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.082+0000 7f9df45ad640 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56536f1a6ea0 0x56536f1a9310 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.082+0000 7f9df45ad640 1 -- 172.21.15.173:0/3505574671 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9de805a040 con 0x56536f1a6ea0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.082+0000 7f9df912f800 1 Processor -- start 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.082+0000 7f9df912f800 1 -- start start 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.082+0000 7f9df912f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1b7ed0 0x56536f1b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.082+0000 7f9df912f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56536ef8fcf0 con 0x56536f1b7ed0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1b7ed0 0x56536f1b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1b7ed0 0x56536f1b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43686/0 (socket says 172.21.15.173:43686) 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9df4dae640 1 -- 172.21.15.173:0/962167304 learned_addr learned my addr 172.21.15.173:0/962167304 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9df4dae640 1 -- 172.21.15.173:0/962167304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536f1b8830 con 0x56536f1b7ed0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9df4dae640 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1b7ed0 0x56536f1b82f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9de4006690 tx=0x7f9de40108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9cda7fc640 1 -- 172.21.15.173:0/962167304 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4044d70 con 0x56536f1b7ed0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9cda7fc640 1 -- 172.21.15.173:0/962167304 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de404c0d0 con 0x56536f1b7ed0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56536f1b92a0 con 0x56536f1b7ed0 2024-05-15T18:08:57.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9cda7fc640 1 -- 172.21.15.173:0/962167304 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de404c3b0 con 0x56536f1b7ed0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.083+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536f1b97a0 con 0x56536f1b7ed0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.084+0000 7f9cda7fc640 1 -- 172.21.15.173:0/962167304 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9de4010070 con 0x56536f1b7ed0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.084+0000 7f9cda7fc640 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ccc0369c0 0x7f9ccc038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.084+0000 7f9cda7fc640 1 -- 172.21.15.173:0/962167304 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9de4005070 con 0x56536f1b7ed0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.084+0000 7f9df45ad640 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ccc0369c0 0x7f9ccc038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.084+0000 7f9df912f800 1 Processor -- start 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.084+0000 7f9df912f800 1 -- start start 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.084+0000 7f9df45ad640 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ccc0369c0 0x7f9ccc038e80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56536f1a1510 tx=0x7f9de8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.085+0000 7f9df912f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.085+0000 7f9df912f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56536f09ce50 con 0x56536f1c4ff0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.085+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.085+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43698/0 (socket says 172.21.15.173:43698) 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.085+0000 7f9df4dae640 1 -- 172.21.15.173:0/2503905749 learned_addr learned my addr 172.21.15.173:0/2503905749 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.085+0000 7f9df4dae640 1 -- 172.21.15.173:0/2503905749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536f1c59e0 con 0x56536f1c4ff0 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.085+0000 7f9df4dae640 1 --2- 172.21.15.173:0/2503905749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1c5410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9de40069d0 tx=0x7f9de401e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1551b5867982a3e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9ccbfff640 1 -- 172.21.15.173:0/2503905749 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de405c020 con 0x56536f1c4ff0 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9ccbfff640 1 -- 172.21.15.173:0/2503905749 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de40494d0 con 0x56536f1c4ff0 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9ccbfff640 1 -- 172.21.15.173:0/2503905749 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4033cf0 con 0x56536f1c4ff0 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 -- 172.21.15.173:0/2503905749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 msgr2=0x56536f1c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 --2- 172.21.15.173:0/2503905749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1c5410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9de40069d0 tx=0x7f9de401e520 comp rx=0 tx=0).stop 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 -- 172.21.15.173:0/2503905749 shutdown_connections 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 --2- 172.21.15.173:0/2503905749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1c5410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 -- 172.21.15.173:0/2503905749 >> 172.21.15.173:0/2503905749 conn(0x56536f1c1350 msgr2=0x56536f1bf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 -- 172.21.15.173:0/2503905749 shutdown_connections 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 -- 172.21.15.173:0/2503905749 wait complete. 2024-05-15T18:08:57.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 Processor -- start 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 -- start start 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.086+0000 7f9df912f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56536f1c6090 con 0x56536f1c4ff0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9df4dae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43704/0 (socket says 172.21.15.173:43704) 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 learned_addr learned my addr 172.21.15.173:0/1996953088 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536f1cc950 con 0x56536f1c4ff0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9df4dae640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1cc410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9de40069d0 tx=0x7f9de4032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9cca7fc640 1 -- 172.21.15.173:0/1996953088 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4068070 con 0x56536f1c4ff0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9cca7fc640 1 -- 172.21.15.173:0/1996953088 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de401e770 con 0x56536f1c4ff0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56536f1cc950 con 0x56536f1c4ff0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9cca7fc640 1 -- 172.21.15.173:0/1996953088 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de405c070 con 0x56536f1c4ff0 2024-05-15T18:08:57.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.087+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536f1cc950 con 0x56536f1c4ff0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.088+0000 7f9cca7fc640 1 -- 172.21.15.173:0/1996953088 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9de406b070 con 0x56536f1c4ff0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9cca7fc640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cc00368b0 0x7f9cc0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9cca7fc640 1 -- 172.21.15.173:0/1996953088 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9de4053040 con 0x56536f1c4ff0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9df45ad640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cc00368b0 0x7f9cc0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f1d7a00 0x56536f1d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1da5f0 con 0x56536f1d7a00 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9df55af640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f1d7a00 0x56536f1d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9df55af640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f1d7a00 0x56536f1d9ea0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.089+0000 7f9df45ad640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cc00368b0 0x7f9cc0038d70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56536f1a9e70 tx=0x7f9de804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 realm 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1daa20 con 0x56536f1d7a00 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x56536f1d7a00 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db660 con 0x56536f1d7a00 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1dc020 0x56536f1de410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.090+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1de950 con 0x56536f1dc020 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.091+0000 7f9df4dae640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1dc020 0x56536f1de410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.091+0000 7f9df4dae640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1dc020 0x56536f1de410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.091+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.091+0000 7f9df912f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.091+0000 7f9df912f800 20 searching for the correct realm 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.091+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e0370 con 0x56536f1dc020 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df4dae640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9de406d070 0x7f9de40246e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e0370 con 0x7f9de406d070 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df45ad640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9de406d070 0x7f9de40246e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df45ad640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9de406d070 0x7f9de40246e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df45ad640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9de8074040 0x7f9de8081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e0370 con 0x7f9de8074040 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.092+0000 7f9df55af640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9de8074040 0x7f9de8081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.093+0000 7f9df55af640 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9de8074040 0x7f9de8081410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.093+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.093+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x56536f1d7a00 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.093+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.093+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x56536f1d7a00 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.093+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.093+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x7f9de8074040 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x7f9de8074040 2024-05-15T18:08:57.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x7f9de406d070 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x56536f1dc020 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.094+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x56536f1d7a00 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9dec026040 con 0x7f9de8074040 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9dec026040 con 0x56536f1d7a00 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9dec026040 con 0x7f9de406d070 2024-05-15T18:08:57.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.095+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de8074040 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.096+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1d7a00 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1d7a00 2024-05-15T18:08:57.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de8074040 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.097+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1dc020 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.098+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.098+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de406d070 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.098+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.098+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1d7a00 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.098+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.098+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de8074040 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1dc020 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de8074040 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de406d070 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.099+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1dc020 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de8074040 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x56536f1d7a00 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f9de808e060 con 0x7f9de406d070 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.100+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1db2c0 con 0x56536f1d7a00 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1df300 con 0x56536f1d7a00 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1df300 con 0x7f9de8074040 2024-05-15T18:08:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 20 zone default found 2024-05-15T18:08:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.101+0000 7f9df912f800 4 Realm: () 2024-05-15T18:08:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 zonegroup default 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1df720 con 0x7f9de8074040 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1dfb40 con 0x56536f1dc020 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e2220 con 0x56536f1dc020 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 started sync module instance, tier type = 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.102+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e16c0 con 0x7f9de406d070 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.103+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.103+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94916346515984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e25c0 con 0x7f9de406d070 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.103+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e2e10 con 0x56536f1d7a00 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.104+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94916346515984] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.105+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.105+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94916346521952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e3230 con 0x56536f1d7a00 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.105+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e3a80 con 0x56536f1dc020 2024-05-15T18:08:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.106+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94916346521952] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.106+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.106+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94916346523488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e3e70 con 0x56536f1dc020 2024-05-15T18:08:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.106+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e48c0 con 0x7f9de406d070 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.107+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.107+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94916346523488] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.107+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94916346528688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e4cb0 con 0x7f9de406d070 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.107+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e56d0 con 0x56536f1d7a00 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.108+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.108+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94916346532288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e5f70 con 0x56536f1d7a00 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.108+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e6a70 con 0x7f9de8074040 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.108+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94916346528688] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.109+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94916346532288] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.109+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.109+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94916346537312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e5a70 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.109+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e7310 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.110+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94916346537312] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.110+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.110+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94916346524672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e5a70 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.110+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e7890 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94916346524672] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94916346540928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e7850 con 0x7f9de8074040 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 20 add_watcher() i=0 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 20 add_watcher() i=1 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 20 add_watcher() i=2 2024-05-15T18:08:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 20 add_watcher() i=3 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 20 add_watcher() i=4 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 20 add_watcher() i=5 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.111+0000 7f9df912f800 20 add_watcher() i=6 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.112+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94916346540928] v29'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.112+0000 7f9df912f800 20 add_watcher() i=7 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.112+0000 7f9df912f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.112+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f1eacb0 con 0x56536f1d7a00 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.112+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.112+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94916346539360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e8170 con 0x56536f1d7a00 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.113+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94916346539360] v29'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.113+0000 7f9caafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.113+0000 7f9df912f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.113+0000 7f9df912f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.113+0000 7f9df912f800 5 note: GC not initialized 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.113+0000 7f9ca9fe3640 20 reqs_thread_entry: start 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.114+0000 7f9df912f800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.114+0000 7f9df912f800 20 Filter name: none 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.114+0000 7f9c1b7fe640 20 reqs_thread_entry: start 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.114+0000 7f9df912f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.114+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56536f21dda0 con 0x56536f1d7a00 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.114+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.114+0000 7f9df912f800 20 rados_obj.operate() r=0 bl.length=502 2024-05-15T18:08:57.107 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-15T18:08:56.982548Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.115+0000 7f9caafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.115+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94916346539360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f21c950 con 0x56536f1d7a00 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.116+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94916346539360] v29'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.116+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94916346515984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e6d10 con 0x7f9de406d070 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.117+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94916346515984] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.117+0000 7f9df912f800 20 remove_watcher() i=0 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.117+0000 7f9df912f800 2 removed watcher, disabling cache 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.117+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94916346521952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e1210 con 0x56536f1d7a00 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.118+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94916346521952] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.118+0000 7f9df912f800 20 remove_watcher() i=1 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.118+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94916346523488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e1210 con 0x56536f1dc020 2024-05-15T18:08:57.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.119+0000 7f9df4dae640 1 -- 172.21.15.173:0/1996953088 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94916346523488] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de406a030 con 0x56536f1dc020 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.119+0000 7f9df912f800 20 remove_watcher() i=2 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.119+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94916346528688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e2f60 con 0x7f9de406d070 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.120+0000 7f9df45ad640 1 -- 172.21.15.173:0/1996953088 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94916346528688] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9de807f070 con 0x7f9de406d070 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.120+0000 7f9df912f800 20 remove_watcher() i=3 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.120+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94916346532288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e1210 con 0x56536f1d7a00 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.121+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94916346532288] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x56536f1d7a00 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.121+0000 7f9df912f800 20 remove_watcher() i=4 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.121+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94916346537312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e43b0 con 0x7f9de8074040 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.122+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94916346537312] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.122+0000 7f9df912f800 20 remove_watcher() i=5 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.122+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94916346524672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e2f60 con 0x7f9de8074040 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.123+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94916346524672] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.123+0000 7f9df912f800 20 remove_watcher() i=6 2024-05-15T18:08:57.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.123+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94916346540928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56536f1e2f60 con 0x7f9de8074040 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94916346540928] v29'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dec0083e0 con 0x7f9de8074040 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 20 remove_watcher() i=7 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9de8074040 msgr2=0x7f9de8081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9de8074040 0x7f9de8081410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f1d7a00 msgr2=0x56536f1d9ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f1d7a00 0x56536f1d9ea0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9de406d070 msgr2=0x7f9de40246e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9de406d070 0x7f9de40246e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1dc020 msgr2=0x56536f1de410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1dc020 0x56536f1de410 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cc00368b0 msgr2=0x7f9cc0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cc00368b0 0x7f9cc0038d70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56536f1a9e70 tx=0x7f9de804f000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 msgr2=0x56536f1cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df55af640 1 -- 172.21.15.173:0/1996953088 reap_dead start 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1cc410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9de40069d0 tx=0x7f9de4032ea0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 shutdown_connections 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 --2- 172.21.15.173:0/1996953088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1c4ff0 0x56536f1cc410 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 >> 172.21.15.173:0/1996953088 conn(0x56536f1c1350 msgr2=0x56536f1be9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 shutdown_connections 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.124+0000 7f9df912f800 1 -- 172.21.15.173:0/1996953088 wait complete. 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ccc0369c0 msgr2=0x7f9ccc038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ccc0369c0 0x7f9ccc038e80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56536f1a1510 tx=0x7f9de8005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1b7ed0 msgr2=0x56536f1b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1b7ed0 0x56536f1b82f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9de4006690 tx=0x7f9de40108f0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 shutdown_connections 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ccc0369c0 0x7f9ccc038e80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/962167304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f1b7ed0 0x56536f1b82f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 >> 172.21.15.173:0/962167304 conn(0x56536f1abf70 msgr2=0x56536f1ac370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 shutdown_connections 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/962167304 wait complete. 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56536f1a6ea0 msgr2=0x56536f1a9310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56536f1a6ea0 0x56536f1a9310 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f0a26e0 msgr2=0x56536f1a06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56536f0a26e0 0x56536f1a06a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1a2f60 msgr2=0x56536f1a5350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56536f1a2f60 0x56536f1a5350 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cdc036950 msgr2=0x7f9cdc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9cdc036950 0x7f9cdc038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9de8054000 tx=0x7f9de804e000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 msgr2=0x56536f199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 --2- 172.21.15.173:0/3505574671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56536f09ebd0 0x56536f199460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9de4000f80 tx=0x7f9de4001250 comp rx=0 tx=0).stop 2024-05-15T18:08:57.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df55af640 1 -- 172.21.15.173:0/3505574671 reap_dead start 2024-05-15T18:08:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 shutdown_connections 2024-05-15T18:08:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 >> 172.21.15.173:0/3505574671 conn(0x56536f0985a0 msgr2=0x56536f09d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 shutdown_connections 2024-05-15T18:08:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.125+0000 7f9df912f800 1 -- 172.21.15.173:0/3505574671 wait complete. 2024-05-15T18:08:57.119 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-15T18:08:56.982548Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:57.119 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-15T18:08:57.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-15T18:08:57.119 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-05-15T18:08:57.202 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:57.202 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126c375800 1 Processor -- start 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126c375800 1 -- start start 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126c375800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55be15c365f0 0x55be15c389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126c375800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be15c38fb0 con 0x55be15c303d0 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126c375800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55be15ac3050 con 0x55be15c365f0 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126967a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55be15c365f0 0x55be15c389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f1269e7b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55be15c303d0 0x55be15c307f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35250/0 (socket says 172.21.15.173:35250) 2024-05-15T18:08:57.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f1269e7b640 1 -- 172.21.15.173:0/1107692443 learned_addr learned my addr 172.21.15.173:0/1107692443 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:57.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126967a640 1 -- 172.21.15.173:0/1107692443 >> v1:172.21.15.3:6789/0 conn(0x55be15c303d0 legacy=0x55be15c307f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.226+0000 7f126967a640 1 -- 172.21.15.173:0/1107692443 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be15c3a190 con 0x55be15c365f0 2024-05-15T18:08:57.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.228+0000 7f126967a640 1 --2- 172.21.15.173:0/1107692443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c365f0 0x55be15c389e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f125400a470 tx=0x7f125401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa3f7384cea3199 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.228+0000 7f1268e79640 1 -- 172.21.15.173:0/1107692443 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1254057070 con 0x55be15c365f0 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.228+0000 7f1268e79640 1 -- 172.21.15.173:0/1107692443 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1254052570 con 0x55be15c365f0 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.228+0000 7f1268e79640 1 -- 172.21.15.173:0/1107692443 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1254052870 con 0x55be15c365f0 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.229+0000 7f126c375800 1 -- 172.21.15.173:0/1107692443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c365f0 msgr2=0x55be15c389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.229+0000 7f126c375800 1 --2- 172.21.15.173:0/1107692443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c365f0 0x55be15c389e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f125400a470 tx=0x7f125401ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.229+0000 7f126c375800 1 -- 172.21.15.173:0/1107692443 shutdown_connections 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.229+0000 7f126c375800 1 --2- 172.21.15.173:0/1107692443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c365f0 0x55be15c389e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.229+0000 7f126c375800 1 -- 172.21.15.173:0/1107692443 >> 172.21.15.173:0/1107692443 conn(0x55be15c2bd40 msgr2=0x55be15c2e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.229+0000 7f126c375800 1 -- 172.21.15.173:0/1107692443 shutdown_connections 2024-05-15T18:08:57.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.229+0000 7f126c375800 1 -- 172.21.15.173:0/1107692443 wait complete. 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f126c375800 1 Processor -- start 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f126c375800 1 -- start start 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f126c375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f126c375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55be15b7d1c0 con 0x55be15c303d0 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d23760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43730/0 (socket says 172.21.15.173:43730) 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f1269e7b640 1 -- 172.21.15.173:0/3074712009 learned_addr learned my addr 172.21.15.173:0/3074712009 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.243+0000 7f1269e7b640 1 -- 172.21.15.173:0/3074712009 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be15d23d30 con 0x55be15c303d0 2024-05-15T18:08:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.244+0000 7f1269e7b640 1 --2- 172.21.15.173:0/3074712009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d23760 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f125c0017a0 tx=0x7f125c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c463c570d2e2fdf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.244+0000 7f1157e07640 1 -- 172.21.15.173:0/3074712009 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c004520 con 0x55be15c303d0 2024-05-15T18:08:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.244+0000 7f1157e07640 1 -- 172.21.15.173:0/3074712009 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c0046c0 con 0x55be15c303d0 2024-05-15T18:08:57.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.244+0000 7f1157e07640 1 -- 172.21.15.173:0/3074712009 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c004a00 con 0x55be15c303d0 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 -- 172.21.15.173:0/3074712009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 msgr2=0x55be15d23760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 --2- 172.21.15.173:0/3074712009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d23760 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f125c0017a0 tx=0x7f125c001c60 comp rx=0 tx=0).stop 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 -- 172.21.15.173:0/3074712009 shutdown_connections 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 --2- 172.21.15.173:0/3074712009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d23760 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 -- 172.21.15.173:0/3074712009 >> 172.21.15.173:0/3074712009 conn(0x55be15c2bd40 msgr2=0x55be15d1f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 -- 172.21.15.173:0/3074712009 shutdown_connections 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 -- 172.21.15.173:0/3074712009 wait complete. 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 Processor -- start 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 -- start start 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d2b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f126c375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55be15c39450 con 0x55be15c303d0 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d2b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d2b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43744/0 (socket says 172.21.15.173:43744) 2024-05-15T18:08:57.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.245+0000 7f1269e7b640 1 -- 172.21.15.173:0/4092511901 learned_addr learned my addr 172.21.15.173:0/4092511901 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.246+0000 7f1269e7b640 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be15d2b7e0 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.246+0000 7f1269e7b640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d2b2a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f125c000f80 tx=0x7f125c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.246+0000 7f1156604640 1 -- 172.21.15.173:0/4092511901 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c022020 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.246+0000 7f1156604640 1 -- 172.21.15.173:0/4092511901 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c014980 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.246+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be15d2ba70 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.246+0000 7f1156604640 1 -- 172.21.15.173:0/4092511901 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c014d00 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.246+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be15d2e720 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.247+0000 7f1156604640 1 -- 172.21.15.173:0/4092511901 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f125c025020 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.247+0000 7f1156604640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1150036950 0x7f1150038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.247+0000 7f1156604640 1 -- 172.21.15.173:0/4092511901 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f125c018030 con 0x55be15c303d0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.247+0000 7f126967a640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1150036950 0x7f1150038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.247+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15c365f0 0x55be15d324e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.247+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d32a20 con 0x55be15c365f0 2024-05-15T18:08:57.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.247+0000 7f126a67c640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15c365f0 0x55be15d324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f126967a640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1150036950 0x7f1150038e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1254054000 tx=0x7f125404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f126a67c640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15c365f0 0x55be15d324e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f126a67c640 1 -- 172.21.15.173:0/4092511901 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15c365f0 2024-05-15T18:08:57.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d2fa90 con 0x55be15c365f0 2024-05-15T18:08:57.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f126a67c640 1 -- 172.21.15.173:0/4092511901 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12640083e0 con 0x55be15c365f0 2024-05-15T18:08:57.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d34d10 0x55be15d37100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d377f0 con 0x55be15d34d10 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.248+0000 7f1269e7b640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d34d10 0x55be15d37100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.249+0000 7f1269e7b640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d34d10 0x55be15d37100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.249+0000 7f1269e7b640 1 -- 172.21.15.173:0/4092511901 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f125c01b070 con 0x55be15d34d10 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.249+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d33cc0 con 0x55be15c365f0 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.249+0000 7f126a67c640 1 -- 172.21.15.173:0/4092511901 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12640083e0 con 0x55be15c365f0 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.249+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55be15d38c50 0x55be15d3b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.249+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d3b820 con 0x55be15d38c50 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.249+0000 7f126967a640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55be15d38c50 0x55be15d3b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.250+0000 7f126967a640 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55be15d38c50 0x55be15d3b0c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.250+0000 7f126967a640 1 -- 172.21.15.173:0/4092511901 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f125405a040 con 0x55be15d38c50 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f126c375800 1 Processor -- start 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f126c375800 1 -- start start 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f126c375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d49c80 0x55be15d4a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f126c375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55be15b23cf0 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d49c80 0x55be15d4a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d49c80 0x55be15d4a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43760/0 (socket says 172.21.15.173:43760) 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f1269e7b640 1 -- 172.21.15.173:0/2738679371 learned_addr learned my addr 172.21.15.173:0/2738679371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f1269e7b640 1 -- 172.21.15.173:0/2738679371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be15d4a5e0 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.251+0000 7f1269e7b640 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d49c80 0x55be15d4a0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f125c02e4b0 tx=0x7f125c01dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f114f7fe640 1 -- 172.21.15.173:0/2738679371 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c01d490 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f114f7fe640 1 -- 172.21.15.173:0/2738679371 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c034070 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f114f7fe640 1 -- 172.21.15.173:0/2738679371 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c010880 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be15d4b050 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be15d4b550 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f114f7fe640 1 -- 172.21.15.173:0/2738679371 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f125c036020 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f114f7fe640 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1144036970 0x7f1144038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.252+0000 7f114f7fe640 1 -- 172.21.15.173:0/2738679371 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f125c003950 con 0x55be15d49c80 2024-05-15T18:08:57.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f126967a640 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1144036970 0x7f1144038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f126c375800 1 Processor -- start 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f126967a640 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1144036970 0x7f1144038e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55be15d332c0 tx=0x7f1254005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f126c375800 1 -- start start 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f126c375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15d57270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f126c375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55be15d240b0 con 0x55be15d56e50 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15d57270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15d57270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43776/0 (socket says 172.21.15.173:43776) 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f1269e7b640 1 -- 172.21.15.173:0/481269741 learned_addr learned my addr 172.21.15.173:0/481269741 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.253+0000 7f1269e7b640 1 -- 172.21.15.173:0/481269741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be15d57840 con 0x55be15d56e50 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f1269e7b640 1 --2- 172.21.15.173:0/481269741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15d57270 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f125c014450 tx=0x7f125c027c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb698097096890e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f114d7fa640 1 -- 172.21.15.173:0/481269741 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c027530 con 0x55be15d56e50 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f114d7fa640 1 -- 172.21.15.173:0/481269741 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c05c070 con 0x55be15d56e50 2024-05-15T18:08:57.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f114d7fa640 1 -- 172.21.15.173:0/481269741 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c032210 con 0x55be15d56e50 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f126c375800 1 -- 172.21.15.173:0/481269741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 msgr2=0x55be15d57270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f126c375800 1 --2- 172.21.15.173:0/481269741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15d57270 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f125c014450 tx=0x7f125c027c90 comp rx=0 tx=0).stop 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f126c375800 1 -- 172.21.15.173:0/481269741 shutdown_connections 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f126c375800 1 --2- 172.21.15.173:0/481269741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15d57270 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f126c375800 1 -- 172.21.15.173:0/481269741 >> 172.21.15.173:0/481269741 conn(0x55be15d530d0 msgr2=0x55be15d51130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f126c375800 1 -- 172.21.15.173:0/481269741 shutdown_connections 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.254+0000 7f126c375800 1 -- 172.21.15.173:0/481269741 wait complete. 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f126c375800 1 Processor -- start 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f126c375800 1 -- start start 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f126c375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15c32c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f126c375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55be15d57eb0 con 0x55be15d56e50 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15c32c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f1269e7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15c32c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43780/0 (socket says 172.21.15.173:43780) 2024-05-15T18:08:57.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 learned_addr learned my addr 172.21.15.173:0/2480283427 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be15c331a0 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.255+0000 7f1269e7b640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15c32c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f125c047010 tx=0x7f125c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.256+0000 7f113b7fe640 1 -- 172.21.15.173:0/2480283427 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c044390 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.256+0000 7f113b7fe640 1 -- 172.21.15.173:0/2480283427 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c044530 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.256+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be15c331a0 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.256+0000 7f113b7fe640 1 -- 172.21.15.173:0/2480283427 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c04c8c0 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.256+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be15c331a0 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.256+0000 7f113b7fe640 1 -- 172.21.15.173:0/2480283427 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f125c010070 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f113b7fe640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1134036950 0x7f1134038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f113b7fe640 1 -- 172.21.15.173:0/2480283427 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f125c06daf0 con 0x55be15d56e50 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f126967a640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1134036950 0x7f1134038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f126967a640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1134036950 0x7f1134038e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55be15d3bc20 tx=0x7f125404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15d6bb20 0x55be15d6dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6e730 con 0x55be15d6bb20 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.257+0000 7f126a67c640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15d6bb20 0x55be15d6dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126a67c640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15d6bb20 0x55be15d6dfe0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 20 realm 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6eb60 con 0x55be15d6bb20 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x55be15d6bb20 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.258+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f7d0 con 0x55be15d6bb20 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126c375800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d70190 0x55be15d72580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d72b90 con 0x55be15d70190 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f1269e7b640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d70190 0x55be15d72580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f1269e7b640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d70190 0x55be15d72580 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126c375800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:57.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126c375800 20 searching for the correct realm 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.259+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d744a0 con 0x55be15d70190 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f1269e7b640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f125c027020 0x7f125c005290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d744a0 con 0x7f125c027020 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f126967a640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f125c027020 0x7f125c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f126967a640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f125c027020 0x7f125c005290 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f126967a640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1254074040 0x7f1254081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.260+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d744a0 con 0x7f1254074040 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.261+0000 7f126a67c640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1254074040 0x7f1254081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.261+0000 7f126a67c640 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1254074040 0x7f1254081410 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.261+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.261+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x55be15d6bb20 2024-05-15T18:08:57.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.261+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.261+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x55be15d6bb20 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x7f1254074040 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x7f1254074040 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x7f125c027020 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.262+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x55be15d70190 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x55be15d6bb20 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x7f1254074040 2024-05-15T18:08:57.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x55be15d6bb20 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55be15d6f430 con 0x7f125c027020 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.263+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f125408e060 con 0x55be15d70190 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f125408e060 con 0x55be15d70190 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f125408e060 con 0x7f1254074040 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d70190 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.264+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d70190 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d6bb20 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d6bb20 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x7f1254074040 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.265+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d70190 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x7f125c027020 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d6bb20 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x7f1254074040 2024-05-15T18:08:57.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.266+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d70190 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x7f1254074040 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x7f125c027020 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d70190 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.267+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x7f1254074040 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x55be15d6bb20 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f1264026040 con 0x7f125c027020 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d72f30 con 0x55be15d6bb20 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.268+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d73320 con 0x55be15d6bb20 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d73320 con 0x7f1254074040 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 zone default found 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 4 Realm: () 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 zonegroup default 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d73fd0 con 0x7f1254074040 2024-05-15T18:08:57.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d76300 con 0x55be15d70190 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.269+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d766a0 con 0x55be15d70190 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.270+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.270+0000 7f126c375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.270+0000 7f126c375800 20 started sync module instance, tier type = 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.270+0000 7f126c375800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.270+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d757a0 con 0x7f125c027020 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.271+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.271+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94274898580208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d76a40 con 0x7f125c027020 2024-05-15T18:08:57.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.271+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d77400 con 0x55be15d6bb20 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.272+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94274898580208] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.272+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.272+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94274898587472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d77820 con 0x55be15d6bb20 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.272+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d781e0 con 0x55be15d70190 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.273+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.273+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94274898591024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d78a80 con 0x55be15d70190 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.273+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d79520 con 0x7f125c027020 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.274+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.274+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94274898595856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d79df0 con 0x7f125c027020 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.274+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7a8b0 con 0x55be15d6bb20 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.275+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94274898587472] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.275+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94274898591024] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.275+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.275+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94274898593232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7a870 con 0x55be15d6bb20 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.275+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7b150 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.275+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94274898595856] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.276+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.276+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94274898598208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7ad20 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.276+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7b7f0 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.277+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94274898593232] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.277+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.277+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94274898598208] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.277+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94274898604768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7a380 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.277+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7bc60 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94274898604768] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94274898602096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7bc60 con 0x7f1254074040 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 20 add_watcher() i=0 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 20 add_watcher() i=1 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 20 add_watcher() i=2 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 20 add_watcher() i=3 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 20 add_watcher() i=4 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 20 add_watcher() i=5 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.278+0000 7f126c375800 20 add_watcher() i=6 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.279+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94274898602096] v29'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.279+0000 7f126c375800 20 add_watcher() i=7 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.279+0000 7f126c375800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.279+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7f0f0 con 0x55be15d6bb20 2024-05-15T18:08:57.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.280+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.280+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94274898606672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7c4e0 con 0x55be15d6bb20 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94274898606672] v29'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f111b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 5 note: GC not initialized 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f111a7fc640 20 reqs_thread_entry: start 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 20 Filter name: none 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f108bfff640 20 reqs_thread_entry: start 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.281+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15db2580 con 0x55be15d6bb20 2024-05-15T18:08:57.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.282+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.282+0000 7f126c375800 20 rados_obj.operate() r=0 bl.length=502 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.282+0000 7f126c375800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.282+0000 7f126c375800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.282+0000 7f126c375800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.282+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15db8910 con 0x55be15d6bb20 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v29'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f126c375800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f126c375800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f126c375800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94274898854784 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15db4160 con 0x55be15d6bb20 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94274898593232 notify 124554051588 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1264010040 con 0x55be15d6bb20 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f114d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94274898593232 notifier 4350 bl.length()=567 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(64 notify.4 [notify cookie 94274898854784 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f114d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f114d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.283+0000 7f114d7fa640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f112c003ea0 con 0x55be15d6bb20 2024-05-15T18:08:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.284+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.284+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94274898854784 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f126400be20 con 0x55be15d6bb20 2024-05-15T18:08:57.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.284+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15db4160 con 0x7f1254074040 2024-05-15T18:08:57.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.285+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v29'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.285+0000 7f126c375800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:08:57.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.285+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94274898854784 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55be15db4160 con 0x55be15d70190 2024-05-15T18:08:57.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.285+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== watch-notify(notify (1) cookie 94274898591024 notify 124554051585 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55be15d4b050 con 0x55be15d70190 2024-05-15T18:08:57.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.285+0000 7f114d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051585 cookie 94274898591024 notifier 4350 bl.length()=170 2024-05-15T18:08:57.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.285+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 notify.2 [notify cookie 94274898854784 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.285+0000 7f114d7fa640 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f112c003ea0 con 0x55be15d70190 2024-05-15T18:08:57.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.286+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== watch-notify(notify_complete (2) cookie 94274898854784 notify 124554051585 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55be15d4a5e0 con 0x55be15d70190 2024-05-15T18:08:57.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.286+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.275 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:57.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.287+0000 7f111b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.287+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94274898606672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7e270 con 0x55be15d6bb20 2024-05-15T18:08:57.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.288+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94274898606672] v29'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.288+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94274898580208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7ba50 con 0x7f125c027020 2024-05-15T18:08:57.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.288+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94274898580208] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.288+0000 7f126c375800 20 remove_watcher() i=0 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.288+0000 7f126c375800 2 removed watcher, disabling cache 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.288+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94274898587472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7ba50 con 0x55be15d6bb20 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.289+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94274898587472] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.290+0000 7f126c375800 20 remove_watcher() i=1 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.290+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94274898591024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d76f50 con 0x55be15d70190 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.290+0000 7f1269e7b640 1 -- 172.21.15.173:0/2480283427 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94274898591024] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c072020 con 0x55be15d70190 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.290+0000 7f126c375800 20 remove_watcher() i=2 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.290+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94274898595856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7ba50 con 0x7f125c027020 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.291+0000 7f126967a640 1 -- 172.21.15.173:0/2480283427 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94274898595856] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125407f070 con 0x7f125c027020 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.291+0000 7f126c375800 20 remove_watcher() i=3 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.291+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94274898593232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d76f50 con 0x55be15d6bb20 2024-05-15T18:08:57.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.292+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94274898593232] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x55be15d6bb20 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.292+0000 7f126c375800 20 remove_watcher() i=4 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.292+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94274898598208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d7ba50 con 0x7f1254074040 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.293+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94274898598208] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.293+0000 7f126c375800 20 remove_watcher() i=5 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.293+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94274898604768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d785d0 con 0x7f1254074040 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.294+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94274898604768] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.295+0000 7f126c375800 20 remove_watcher() i=6 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.295+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94274898602096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55be15d76f50 con 0x7f1254074040 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.295+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94274898602096] v29'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12640083e0 con 0x7f1254074040 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.295+0000 7f126c375800 20 remove_watcher() i=7 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1254074040 msgr2=0x7f1254081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f1254074040 0x7f1254081410 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15d6bb20 msgr2=0x55be15d6dfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15d6bb20 0x55be15d6dfe0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f125c027020 msgr2=0x7f125c005290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f125c027020 0x7f125c005290 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d70190 msgr2=0x55be15d72580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d70190 0x55be15d72580 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1134036950 msgr2=0x7f1134038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1134036950 0x7f1134038e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55be15d3bc20 tx=0x7f125404f000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 msgr2=0x55be15c32c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2480283427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d56e50 0x55be15c32c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f125c047010 tx=0x7f125c0035f0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 reap_dead start 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126a67c640 1 -- 172.21.15.173:0/2480283427 reap_dead start 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 shutdown_connections 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 >> 172.21.15.173:0/2480283427 conn(0x55be15d530d0 msgr2=0x55be15d50730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 shutdown_connections 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2480283427 wait complete. 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1144036970 msgr2=0x7f1144038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1144036970 0x7f1144038e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55be15d332c0 tx=0x7f1254005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d49c80 msgr2=0x55be15d4a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d49c80 0x55be15d4a0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f125c02e4b0 tx=0x7f125c01dd20 comp rx=0 tx=0).stop 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 shutdown_connections 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1144036970 0x7f1144038e30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 --2- 172.21.15.173:0/2738679371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15d49c80 0x55be15d4a0a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 >> 172.21.15.173:0/2738679371 conn(0x55be15d3dd20 msgr2=0x55be15d3e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 shutdown_connections 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.296+0000 7f126c375800 1 -- 172.21.15.173:0/2738679371 wait complete. 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55be15d38c50 msgr2=0x55be15d3b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55be15d38c50 0x55be15d3b0c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15c365f0 msgr2=0x55be15d324e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55be15c365f0 0x55be15d324e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d34d10 msgr2=0x55be15d37100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55be15d34d10 0x55be15d37100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1150036950 msgr2=0x7f1150038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1150036950 0x7f1150038e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1254054000 tx=0x7f125404e000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 msgr2=0x55be15d2b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 --2- 172.21.15.173:0/4092511901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be15c303d0 0x55be15d2b2a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f125c000f80 tx=0x7f125c001250 comp rx=0 tx=0).stop 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126a67c640 1 -- 172.21.15.173:0/4092511901 reap_dead start 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 shutdown_connections 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 >> 172.21.15.173:0/4092511901 conn(0x55be15c2bd40 msgr2=0x55be15d1d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 shutdown_connections 2024-05-15T18:08:57.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.297+0000 7f126c375800 1 -- 172.21.15.173:0/4092511901 wait complete. 2024-05-15T18:08:57.286 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:57.286 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-15T18:08:57.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-15T18:08:57.287 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-05-15T18:08:57.333 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:57.333 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:57.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08dffdc800 1 Processor -- start 2024-05-15T18:08:57.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08dffdc800 1 -- start start 2024-05-15T18:08:57.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08dffdc800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557f102de470 0x557f102e0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08dffdc800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f102e0e30 con 0x557f102d9fe0 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08dffdc800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x557f1016c050 con 0x557f102de470 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08d7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557f102de470 0x557f102e0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08d7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557f102de470 0x557f102e0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43786/0 (socket says 172.21.15.173:43786) 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08d7fff640 1 -- 172.21.15.173:0/3541395983 learned_addr learned my addr 172.21.15.173:0/3541395983 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.357+0000 7f08ddadb640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x557f102d9fe0 0x557f102da400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35264/0 (socket says 172.21.15.173:35264) 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.358+0000 7f08d7fff640 1 -- 172.21.15.173:0/3541395983 >> v1:172.21.15.3:6789/0 conn(0x557f102d9fe0 legacy=0x557f102da400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.358+0000 7f08dd2da640 1 -- 172.21.15.173:0/3541395983 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711837777 0 0) 0x557f102e0e30 con 0x557f102d9fe0 2024-05-15T18:08:57.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.358+0000 7f08d7fff640 1 -- 172.21.15.173:0/3541395983 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f102e2060 con 0x557f102de470 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.359+0000 7f08d7fff640 1 --2- 172.21.15.173:0/3541395983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102de470 0x557f102e0860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f08c800a520 tx=0x7f08c801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905dcb8b3a4756ce server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dd2da640 1 -- 172.21.15.173:0/3541395983 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c8057070 con 0x557f102de470 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dd2da640 1 -- 172.21.15.173:0/3541395983 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c8052570 con 0x557f102de470 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dd2da640 1 -- 172.21.15.173:0/3541395983 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c804ae60 con 0x557f102de470 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dffdc800 1 -- 172.21.15.173:0/3541395983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102de470 msgr2=0x557f102e0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dffdc800 1 --2- 172.21.15.173:0/3541395983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102de470 0x557f102e0860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f08c800a520 tx=0x7f08c801d010 comp rx=0 tx=0).stop 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dffdc800 1 -- 172.21.15.173:0/3541395983 shutdown_connections 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dffdc800 1 --2- 172.21.15.173:0/3541395983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102de470 0x557f102e0860 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dffdc800 1 -- 172.21.15.173:0/3541395983 >> 172.21.15.173:0/3541395983 conn(0x557f102d55c0 msgr2=0x557f102d79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dffdc800 1 -- 172.21.15.173:0/3541395983 shutdown_connections 2024-05-15T18:08:57.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.360+0000 7f08dffdc800 1 -- 172.21.15.173:0/3541395983 wait complete. 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.373+0000 7f08dffdc800 1 Processor -- start 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.373+0000 7f08dffdc800 1 -- start start 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.374+0000 7f08dffdc800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f1024de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.374+0000 7f08dffdc800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557f102261c0 con 0x557f102d9fe0 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.374+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f1024de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.374+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f1024de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43792/0 (socket says 172.21.15.173:43792) 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.374+0000 7f08ddadb640 1 -- 172.21.15.173:0/378895366 learned_addr learned my addr 172.21.15.173:0/378895366 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.374+0000 7f08ddadb640 1 -- 172.21.15.173:0/378895366 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f103cf1b0 con 0x557f102d9fe0 2024-05-15T18:08:57.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.374+0000 7f08ddadb640 1 --2- 172.21.15.173:0/378895366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f1024de50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f08d000b240 tx=0x7f08d000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbeb865d97da633f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.376+0000 7f07cbe07640 1 -- 172.21.15.173:0/378895366 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d0008070 con 0x557f102d9fe0 2024-05-15T18:08:57.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.376+0000 7f07cbe07640 1 -- 172.21.15.173:0/378895366 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d000d500 con 0x557f102d9fe0 2024-05-15T18:08:57.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.376+0000 7f07cbe07640 1 -- 172.21.15.173:0/378895366 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d000d860 con 0x557f102d9fe0 2024-05-15T18:08:57.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 -- 172.21.15.173:0/378895366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 msgr2=0x557f1024de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 --2- 172.21.15.173:0/378895366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f1024de50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f08d000b240 tx=0x7f08d000b700 comp rx=0 tx=0).stop 2024-05-15T18:08:57.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 -- 172.21.15.173:0/378895366 shutdown_connections 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 --2- 172.21.15.173:0/378895366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f1024de50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 -- 172.21.15.173:0/378895366 >> 172.21.15.173:0/378895366 conn(0x557f102d55c0 msgr2=0x557f103c6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 -- 172.21.15.173:0/378895366 shutdown_connections 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 -- 172.21.15.173:0/378895366 wait complete. 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.377+0000 7f08dffdc800 1 Processor -- start 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08dffdc800 1 -- start start 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08dffdc800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f103ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08dffdc800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557f102e1300 con 0x557f102d9fe0 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f103ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f103ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43796/0 (socket says 172.21.15.173:43796) 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08ddadb640 1 -- 172.21.15.173:0/1799202765 learned_addr learned my addr 172.21.15.173:0/1799202765 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08ddadb640 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f103cb1d0 con 0x557f102d9fe0 2024-05-15T18:08:57.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f08ddadb640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f103ccae0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000f60 tx=0x7f08d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.378+0000 7f07ca604640 1 -- 172.21.15.173:0/1799202765 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d000f8b0 con 0x557f102d9fe0 2024-05-15T18:08:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.379+0000 7f07ca604640 1 -- 172.21.15.173:0/1799202765 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d000fa50 con 0x557f102d9fe0 2024-05-15T18:08:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.379+0000 7f07ca604640 1 -- 172.21.15.173:0/1799202765 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d000fd30 con 0x557f102d9fe0 2024-05-15T18:08:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.379+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f103cb460 con 0x557f102d9fe0 2024-05-15T18:08:57.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.379+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f103cb980 con 0x557f102d9fe0 2024-05-15T18:08:57.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.379+0000 7f07ca604640 1 -- 172.21.15.173:0/1799202765 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f08d0017040 con 0x557f102d9fe0 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f07ca604640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07c40369a0 0x7f07c4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f07ca604640 1 -- 172.21.15.173:0/1799202765 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f08d0015020 con 0x557f102d9fe0 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f08d7fff640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07c40369a0 0x7f07c4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f102de470 0x557f103dd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f103dd9e0 con 0x557f102de470 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f08de2dc640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f102de470 0x557f103dd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f08d7fff640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07c40369a0 0x7f07c4038e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08c8054000 tx=0x7f08c804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f08de2dc640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f102de470 0x557f103dd4a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.380+0000 7f08de2dc640 1 -- 172.21.15.173:0/1799202765 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f102de470 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.381+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f103de2a0 con 0x557f102de470 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.381+0000 7f08de2dc640 1 -- 172.21.15.173:0/1799202765 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f102de470 2024-05-15T18:08:57.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.381+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f103dfcd0 0x557f103e2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.381+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f103e2920 con 0x557f103dfcd0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.381+0000 7f08ddadb640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f103dfcd0 0x557f103e2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.381+0000 7f08ddadb640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f103dfcd0 0x557f103e2190 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.381+0000 7f08ddadb640 1 -- 172.21.15.173:0/1799202765 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08d002d070 con 0x557f103dfcd0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.382+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f103deb20 con 0x557f102de470 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.382+0000 7f08de2dc640 1 -- 172.21.15.173:0/1799202765 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f102de470 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.382+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557f103e3dd0 0x557f103e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.382+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f103e6a20 con 0x557f103e3dd0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.382+0000 7f08d7fff640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557f103e3dd0 0x557f103e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.382+0000 7f08d7fff640 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557f103e3dd0 0x557f103e6290 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08d7fff640 1 -- 172.21.15.173:0/1799202765 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08c805a040 con 0x557f103e3dd0 2024-05-15T18:08:57.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08dffdc800 1 Processor -- start 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08dffdc800 1 -- start start 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08dffdc800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f103f4e20 0x557f103f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08dffdc800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557f103cd020 con 0x557f103f4e20 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f103f4e20 0x557f103f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f103f4e20 0x557f103f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43804/0 (socket says 172.21.15.173:43804) 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.383+0000 7f08ddadb640 1 -- 172.21.15.173:0/828856602 learned_addr learned my addr 172.21.15.173:0/828856602 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.384+0000 7f08ddadb640 1 -- 172.21.15.173:0/828856602 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f103f5780 con 0x557f103f4e20 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.384+0000 7f08ddadb640 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f103f4e20 0x557f103f5240 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f08d000bca0 tx=0x7f08d001aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.384+0000 7f07c37fe640 1 -- 172.21.15.173:0/828856602 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d000ee50 con 0x557f103f4e20 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.384+0000 7f07c37fe640 1 -- 172.21.15.173:0/828856602 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d00441b0 con 0x557f103f4e20 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.384+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f103f61f0 con 0x557f103f4e20 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.384+0000 7f07c37fe640 1 -- 172.21.15.173:0/828856602 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d00444f0 con 0x557f103f4e20 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.384+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f103f66f0 con 0x557f103f4e20 2024-05-15T18:08:57.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f07c37fe640 1 -- 172.21.15.173:0/828856602 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f08d003f1b0 con 0x557f103f4e20 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f07c37fe640 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07b8036af0 0x7f07b8038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f07c37fe640 1 -- 172.21.15.173:0/828856602 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f08d003caa0 con 0x557f103f4e20 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f08d7fff640 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07b8036af0 0x7f07b8038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f08dffdc800 1 Processor -- start 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f08dffdc800 1 -- start start 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f08dffdc800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10402590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f08dffdc800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557f101cccf0 con 0x557f104021b0 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.385+0000 7f08d7fff640 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07b8036af0 0x7f07b8038fb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x557f103cbda0 tx=0x7f08c8005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10402590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10402590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43816/0 (socket says 172.21.15.173:43816) 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f08ddadb640 1 -- 172.21.15.173:0/1850646501 learned_addr learned my addr 172.21.15.173:0/1850646501 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f08ddadb640 1 -- 172.21.15.173:0/1850646501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f10402b60 con 0x557f104021b0 2024-05-15T18:08:57.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f08ddadb640 1 --2- 172.21.15.173:0/1850646501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10402590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f08d0018fd0 tx=0x7f08d0025950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a741b9167ab8bcc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f07c17fa640 1 -- 172.21.15.173:0/1850646501 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d001c440 con 0x557f104021b0 2024-05-15T18:08:57.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f07c17fa640 1 -- 172.21.15.173:0/1850646501 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d001c600 con 0x557f104021b0 2024-05-15T18:08:57.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.386+0000 7f07c17fa640 1 -- 172.21.15.173:0/1850646501 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d003cd40 con 0x557f104021b0 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 -- 172.21.15.173:0/1850646501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 msgr2=0x557f10402590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1850646501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10402590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f08d0018fd0 tx=0x7f08d0025950 comp rx=0 tx=0).stop 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 -- 172.21.15.173:0/1850646501 shutdown_connections 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1850646501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10402590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 -- 172.21.15.173:0/1850646501 >> 172.21.15.173:0/1850646501 conn(0x557f103fe480 msgr2=0x557f103fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 -- 172.21.15.173:0/1850646501 shutdown_connections 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 -- 172.21.15.173:0/1850646501 wait complete. 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 Processor -- start 2024-05-15T18:08:57.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 -- start start 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10409340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08dffdc800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557f104030f0 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10409340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08ddadb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10409340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43818/0 (socket says 172.21.15.173:43818) 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.387+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 learned_addr learned my addr 172.21.15.173:0/2937711733 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.388+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f10409880 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.388+0000 7f08ddadb640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10409340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08d0044870 tx=0x7f08d0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.388+0000 7f07af7fe640 1 -- 172.21.15.173:0/2937711733 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d001c440 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.388+0000 7f07af7fe640 1 -- 172.21.15.173:0/2937711733 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08d0030450 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.388+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f10409880 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.388+0000 7f07af7fe640 1 -- 172.21.15.173:0/2937711733 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08d001c8c0 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.388+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f10409880 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.389+0000 7f07af7fe640 1 -- 172.21.15.173:0/2937711733 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f08d0060070 con 0x557f104021b0 2024-05-15T18:08:57.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.389+0000 7f07af7fe640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07a8036950 0x7f07a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.389+0000 7f07af7fe640 1 -- 172.21.15.173:0/2937711733 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f08d005e020 con 0x557f104021b0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.389+0000 7f08d7fff640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07a8036950 0x7f07a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08d7fff640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07a8036950 0x7f07a8038e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005400 tx=0x7f08c804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f10414ac0 0x557f10416f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f104176d0 con 0x557f10414ac0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08de2dc640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f10414ac0 0x557f10416f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08de2dc640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f10414ac0 0x557f10416f80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08dffdc800 20 realm 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.390+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f10417ae0 con 0x557f10414ac0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f104183b0 con 0x557f10414ac0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f104194b0 0x557f1041b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1041beb0 con 0x557f104194b0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.391+0000 7f08ddadb640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f104194b0 0x557f1041b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08ddadb640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f104194b0 0x557f1041b8a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08dffdc800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08dffdc800 20 searching for the correct realm 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f1041d770 con 0x557f104194b0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08ddadb640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f08d0071b30 0x7f08d004b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f1041d770 con 0x7f08d0071b30 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.392+0000 7f08d7fff640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f08d0071b30 0x7f08d004b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.393+0000 7f08d7fff640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f08d0071b30 0x7f08d004b660 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.393+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.393+0000 7f08d7fff640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f08c8082040 0x7f08c8083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.393+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f1041d770 con 0x7f08c8082040 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.393+0000 7f08de2dc640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f08c8082040 0x7f08c8083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.394+0000 7f08de2dc640 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f08c8082040 0x7f08c8083430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.394+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f08d800a4a0 con 0x7f08c8082040 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.394+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.394+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.394+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.394+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.394+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.395+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x7f08c8082040 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.395+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.395+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x7f08c8082040 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.395+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08d0071b30 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.395+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.395+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x7f08c8082040 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.396+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08d0071b30 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.397+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.397+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.397+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.397+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.397+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.397+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x7f08c8082040 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f08d800a4a0 con 0x557f10414ac0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.398+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d8033040 con 0x7f08c8082040 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08d0071b30 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.399+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.400+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.400+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.400+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.400+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.400+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.400+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08d0071b30 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.401+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.401+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f104194b0 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.401+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.401+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08c8082040 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.401+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.401+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x557f10414ac0 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557f10418750 con 0x7f08d0071b30 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1041c700 con 0x557f10414ac0 2024-05-15T18:08:57.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.402+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1041caa0 con 0x557f10414ac0 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1041caa0 con 0x7f08c8082040 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 zone default found 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 4 Realm: () 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:57.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 zonegroup default 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1041d370 con 0x7f08c8082040 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1041d370 con 0x557f104194b0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.403+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1041f690 con 0x557f104194b0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.404+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.404+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.404+0000 7f08dffdc800 20 started sync module instance, tier type = 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.404+0000 7f08dffdc800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.404+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f1041ea70 con 0x7f08d0071b30 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.405+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.405+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94004221963872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f1041ffa0 con 0x7f08d0071b30 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.405+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104207f0 con 0x557f10414ac0 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.406+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94004221963872] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.406+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.406+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94004221967088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10420850 con 0x557f10414ac0 2024-05-15T18:08:57.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.406+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10421340 con 0x557f104194b0 2024-05-15T18:08:57.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.407+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94004221967088] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.407+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.407+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94004221971984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104216e0 con 0x557f104194b0 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.407+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10422180 con 0x7f08d0071b30 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.408+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94004221971984] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.408+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.408+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94004221969216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10422a20 con 0x7f08d0071b30 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.408+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104233e0 con 0x557f10414ac0 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.409+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.409+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94004221980976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10423c00 con 0x557f10414ac0 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.409+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94004221969216] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.409+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10424700 con 0x7f08c8082040 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.410+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.410+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94004221978048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104246c0 con 0x7f08c8082040 2024-05-15T18:08:57.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.410+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104250c0 con 0x7f08c8082040 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.410+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94004221980976] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.411+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.411+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94004221982288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10425080 con 0x7f08c8082040 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.411+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10425b50 con 0x7f08c8082040 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.411+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94004221978048] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94004221990464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10425b10 con 0x7f08c8082040 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 20 add_watcher() i=0 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 20 add_watcher() i=1 2024-05-15T18:08:57.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 20 add_watcher() i=2 2024-05-15T18:08:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 20 add_watcher() i=3 2024-05-15T18:08:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 20 add_watcher() i=4 2024-05-15T18:08:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 20 add_watcher() i=5 2024-05-15T18:08:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94004221982288] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.412+0000 7f08dffdc800 20 add_watcher() i=6 2024-05-15T18:08:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.413+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94004221990464] v29'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.413+0000 7f08dffdc800 20 add_watcher() i=7 2024-05-15T18:08:57.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.413+0000 7f08dffdc800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:57.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.413+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f10424bd0 con 0x557f10414ac0 2024-05-15T18:08:57.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.413+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.413+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94004221985264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10424bd0 con 0x557f10414ac0 2024-05-15T18:08:57.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.414+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94004221985264] v29'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.414+0000 7f078f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.414+0000 7f08dffdc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:57.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.414+0000 7f08dffdc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:57.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.414+0000 7f08dffdc800 5 note: GC not initialized 2024-05-15T18:08:57.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f078e7fc640 20 reqs_thread_entry: start 2024-05-15T18:08:57.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:57.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 20 Filter name: none 2024-05-15T18:08:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f06fffff640 20 reqs_thread_entry: start 2024-05-15T18:08:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1045bf90 con 0x557f10414ac0 2024-05-15T18:08:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.415+0000 7f08dffdc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f1045c8a0 con 0x557f10414ac0 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-05-15T18:08:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-15T18:08:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-05-15T18:08:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.416+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10462130 con 0x557f10414ac0 2024-05-15T18:08:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v29'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08dffdc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:57.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08dffdc800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08dffdc800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94004222237600 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f10460c80 con 0x557f10414ac0 2024-05-15T18:08:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify (1) cookie 94004221980976 notify 124554051589 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f08d801e040 con 0x557f10414ac0 2024-05-15T18:08:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f07c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94004221980976 notifier 4357 bl.length()=732 2024-05-15T18:08:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f07c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:57.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f07c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f07c17fa640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f07a0003ea0 con 0x557f10414ac0 2024-05-15T18:08:57.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(65 notify.4 [notify cookie 94004222237600 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.417+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.418+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== watch-notify(notify_complete (2) cookie 94004222237600 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f08d801e040 con 0x557f10414ac0 2024-05-15T18:08:57.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.418+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10461ba0 con 0x557f10414ac0 2024-05-15T18:08:57.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.418+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.418+0000 7f08dffdc800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-15T18:08:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.418+0000 7f08dffdc800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-15T18:08:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.418+0000 7f08dffdc800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-15T18:08:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94004222237600 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557f104607d0 con 0x7f08d0071b30 2024-05-15T18:08:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== watch-notify(notify (1) cookie 94004221963872 notify 124554051586 ret 0) ==== 208+0+0 (crc 0 0 0) 0x557f102e2060 con 0x7f08d0071b30 2024-05-15T18:08:57.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f07c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 94004221963872 notifier 4357 bl.length()=166 2024-05-15T18:08:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f07c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-15T18:08:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f07c0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-15T18:08:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f07c0ff9640 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0708003400 con 0x7f08d0071b30 2024-05-15T18:08:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(68 notify.0 [notify cookie 94004222237600 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.419+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== watch-notify(notify_complete (2) cookie 94004222237600 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f08c805d6b0 con 0x7f08d0071b30 2024-05-15T18:08:57.415 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"liB4kqc0yar8IenJTNMjhBVFtwcXgyB5QMVbzMk0","active":true,"create_date":"2024-05-15T18:08:57.416780Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.420+0000 7f078f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.420+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94004221985264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f1040e480 con 0x557f10414ac0 2024-05-15T18:08:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.421+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94004221985264] v29'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.421+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94004221963872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104241f0 con 0x7f08d0071b30 2024-05-15T18:08:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.422+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94004221963872] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.422+0000 7f08dffdc800 20 remove_watcher() i=0 2024-05-15T18:08:57.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.422+0000 7f08dffdc800 2 removed watcher, disabling cache 2024-05-15T18:08:57.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.422+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94004221967088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104241f0 con 0x557f10414ac0 2024-05-15T18:08:57.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.423+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94004221967088] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.423+0000 7f08dffdc800 20 remove_watcher() i=1 2024-05-15T18:08:57.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.423+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94004221971984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f1041faf0 con 0x557f104194b0 2024-05-15T18:08:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.424+0000 7f08ddadb640 1 -- 172.21.15.173:0/2937711733 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94004221971984] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d0077070 con 0x557f104194b0 2024-05-15T18:08:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.424+0000 7f08dffdc800 20 remove_watcher() i=2 2024-05-15T18:08:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.424+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94004221969216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104241f0 con 0x7f08d0071b30 2024-05-15T18:08:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.425+0000 7f08d7fff640 1 -- 172.21.15.173:0/2937711733 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94004221969216] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08c807f070 con 0x7f08d0071b30 2024-05-15T18:08:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.425+0000 7f08dffdc800 20 remove_watcher() i=3 2024-05-15T18:08:57.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.425+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94004221980976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10420340 con 0x557f10414ac0 2024-05-15T18:08:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.426+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94004221980976] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x557f10414ac0 2024-05-15T18:08:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.426+0000 7f08dffdc800 20 remove_watcher() i=4 2024-05-15T18:08:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.426+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94004221978048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104241f0 con 0x7f08c8082040 2024-05-15T18:08:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.427+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94004221978048] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.427+0000 7f08dffdc800 20 remove_watcher() i=5 2024-05-15T18:08:57.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.427+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94004221982288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f10420340 con 0x7f08c8082040 2024-05-15T18:08:57.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.429+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94004221982288] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.429+0000 7f08dffdc800 20 remove_watcher() i=6 2024-05-15T18:08:57.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.429+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94004221990464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557f104241f0 con 0x7f08c8082040 2024-05-15T18:08:57.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94004221990464] v29'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08d8031040 con 0x7f08c8082040 2024-05-15T18:08:57.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 20 remove_watcher() i=7 2024-05-15T18:08:57.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f08c8082040 msgr2=0x7f08c8083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f08c8082040 0x7f08c8083430 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f10414ac0 msgr2=0x557f10416f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f10414ac0 0x557f10416f80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f08d0071b30 msgr2=0x7f08d004b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f08d0071b30 0x7f08d004b660 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f104194b0 msgr2=0x557f1041b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f104194b0 0x557f1041b8a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07a8036950 msgr2=0x7f07a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07a8036950 0x7f07a8038e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005400 tx=0x7f08c804f000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 msgr2=0x557f10409340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10409340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08d0044870 tx=0x7f08d0005e70 comp rx=0 tx=0).stop 2024-05-15T18:08:57.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08de2dc640 1 -- 172.21.15.173:0/2937711733 reap_dead start 2024-05-15T18:08:57.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 shutdown_connections 2024-05-15T18:08:57.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/2937711733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f104021b0 0x557f10409340 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 >> 172.21.15.173:0/2937711733 conn(0x557f103fe480 msgr2=0x557f103fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 shutdown_connections 2024-05-15T18:08:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/2937711733 wait complete. 2024-05-15T18:08:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07b8036af0 msgr2=0x7f07b8038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07b8036af0 0x7f07b8038fb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x557f103cbda0 tx=0x7f08c8005ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f103f4e20 msgr2=0x557f103f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f103f4e20 0x557f103f5240 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f08d000bca0 tx=0x7f08d001aa10 comp rx=0 tx=0).stop 2024-05-15T18:08:57.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 shutdown_connections 2024-05-15T18:08:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07b8036af0 0x7f07b8038fb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 --2- 172.21.15.173:0/828856602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f103f4e20 0x557f103f5240 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 >> 172.21.15.173:0/828856602 conn(0x557f103e8ec0 msgr2=0x557f103e92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 shutdown_connections 2024-05-15T18:08:57.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.430+0000 7f08dffdc800 1 -- 172.21.15.173:0/828856602 wait complete. 2024-05-15T18:08:57.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557f103e3dd0 msgr2=0x557f103e6290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557f103e3dd0 0x557f103e6290 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f102de470 msgr2=0x557f103dd4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557f102de470 0x557f103dd4a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f103dfcd0 msgr2=0x557f103e2190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557f103dfcd0 0x557f103e2190 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07c40369a0 msgr2=0x7f07c4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f07c40369a0 0x7f07c4038e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08c8054000 tx=0x7f08c804e000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 msgr2=0x557f103ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 --2- 172.21.15.173:0/1799202765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557f102d9fe0 0x557f103ccae0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f08d0000f60 tx=0x7f08d0000ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08de2dc640 1 -- 172.21.15.173:0/1799202765 reap_dead start 2024-05-15T18:08:57.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 shutdown_connections 2024-05-15T18:08:57.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 >> 172.21.15.173:0/1799202765 conn(0x557f102d55c0 msgr2=0x557f103c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 shutdown_connections 2024-05-15T18:08:57.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.431+0000 7f08dffdc800 1 -- 172.21.15.173:0/1799202765 wait complete. 2024-05-15T18:08:57.441 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'liB4kqc0yar8IenJTNMjhBVFtwcXgyB5QMVbzMk0', 'active': True, 'create_date': '2024-05-15T18:08:57.416780Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:57.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-15T18:08:57.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-15T18:08:57.441 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-05-15T18:08:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:57.490 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.514+0000 7f8009ba2800 1 Processor -- start 2024-05-15T18:08:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.514+0000 7f8009ba2800 1 -- start start 2024-05-15T18:08:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.514+0000 7f8009ba2800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d4795f7540 0x55d479600040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.514+0000 7f8009ba2800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d47956a940 con 0x55d4795f5a00 2024-05-15T18:08:57.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.514+0000 7f8009ba2800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55d479488050 con 0x55d4795f7540 2024-05-15T18:08:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.515+0000 7f8006ea7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d4795f7540 0x55d479600040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.515+0000 7f80076a8640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55d4795f5a00 0x55d4795f5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35266/0 (socket says 172.21.15.173:35266) 2024-05-15T18:08:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.515+0000 7f80076a8640 1 -- 172.21.15.173:0/3816326523 learned_addr learned my addr 172.21.15.173:0/3816326523 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.515+0000 7f8006ea7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d4795f7540 0x55d479600040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43822/0 (socket says 172.21.15.173:43822) 2024-05-15T18:08:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.515+0000 7f8006ea7640 1 -- 172.21.15.173:0/3816326523 >> v1:172.21.15.3:6789/0 conn(0x55d4795f5a00 legacy=0x55d4795f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.515+0000 7f80066a6640 1 -- 172.21.15.173:0/3816326523 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384156963 0 0) 0x55d47956a940 con 0x55d4795f5a00 2024-05-15T18:08:57.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.515+0000 7f8006ea7640 1 -- 172.21.15.173:0/3816326523 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d479601590 con 0x55d4795f7540 2024-05-15T18:08:57.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8006ea7640 1 --2- 172.21.15.173:0/3816326523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f7540 0x55d479600040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a470 tx=0x7f7ffc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876c9bb9b9174693 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f80066a6640 1 -- 172.21.15.173:0/3816326523 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc057070 con 0x55d4795f7540 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f80066a6640 1 -- 172.21.15.173:0/3816326523 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ffc04adc0 con 0x55d4795f7540 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f80066a6640 1 -- 172.21.15.173:0/3816326523 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc052590 con 0x55d4795f7540 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8009ba2800 1 -- 172.21.15.173:0/3816326523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f7540 msgr2=0x55d479600040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8009ba2800 1 --2- 172.21.15.173:0/3816326523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f7540 0x55d479600040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a470 tx=0x7f7ffc01ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8009ba2800 1 -- 172.21.15.173:0/3816326523 shutdown_connections 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8009ba2800 1 --2- 172.21.15.173:0/3816326523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f7540 0x55d479600040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8009ba2800 1 -- 172.21.15.173:0/3816326523 >> 172.21.15.173:0/3816326523 conn(0x55d4795f15c0 msgr2=0x55d4795f39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8009ba2800 1 -- 172.21.15.173:0/3816326523 shutdown_connections 2024-05-15T18:08:57.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.517+0000 7f8009ba2800 1 -- 172.21.15.173:0/3816326523 wait complete. 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f8009ba2800 1 Processor -- start 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f8009ba2800 1 -- start start 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f8009ba2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f8009ba2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4795421f0 con 0x55d4795f5a00 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796ea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43826/0 (socket says 172.21.15.173:43826) 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f80076a8640 1 -- 172.21.15.173:0/2078814223 learned_addr learned my addr 172.21.15.173:0/2078814223 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.531+0000 7f80076a8640 1 -- 172.21.15.173:0/2078814223 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4796eae80 con 0x55d4795f5a00 2024-05-15T18:08:57.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f80076a8640 1 --2- 172.21.15.173:0/2078814223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796ea8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8001630 tx=0x7f7ff8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7166707db32e7957 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f7ef560a640 1 -- 172.21.15.173:0/2078814223 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff8003450 con 0x55d4795f5a00 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f7ef560a640 1 -- 172.21.15.173:0/2078814223 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff80035f0 con 0x55d4795f5a00 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f7ef560a640 1 -- 172.21.15.173:0/2078814223 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff8003990 con 0x55d4795f5a00 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f8009ba2800 1 -- 172.21.15.173:0/2078814223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 msgr2=0x55d4796ea8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2078814223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796ea8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8001630 tx=0x7f7ff8001af0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f8009ba2800 1 -- 172.21.15.173:0/2078814223 shutdown_connections 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2078814223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796ea8b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.532+0000 7f8009ba2800 1 -- 172.21.15.173:0/2078814223 >> 172.21.15.173:0/2078814223 conn(0x55d4795f15c0 msgr2=0x55d4796e61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f8009ba2800 1 -- 172.21.15.173:0/2078814223 shutdown_connections 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f8009ba2800 1 -- 172.21.15.173:0/2078814223 wait complete. 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f8009ba2800 1 Processor -- start 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f8009ba2800 1 -- start start 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f8009ba2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f8009ba2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d479600850 con 0x55d4795f5a00 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43838/0 (socket says 172.21.15.173:43838) 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.533+0000 7f80076a8640 1 -- 172.21.15.173:0/1045216126 learned_addr learned my addr 172.21.15.173:0/1045216126 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.534+0000 7f80076a8640 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4796f29c0 con 0x55d4795f5a00 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.534+0000 7f80076a8640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796f2480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8006fa0 tx=0x7f7ff8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.534+0000 7f7ef3e07640 1 -- 172.21.15.173:0/1045216126 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff8013820 con 0x55d4795f5a00 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.534+0000 7f7ef3e07640 1 -- 172.21.15.173:0/1045216126 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff8023070 con 0x55d4795f5a00 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.534+0000 7f7ef3e07640 1 -- 172.21.15.173:0/1045216126 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff8013af0 con 0x55d4795f5a00 2024-05-15T18:08:57.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.534+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4796f2c50 con 0x55d4795f5a00 2024-05-15T18:08:57.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.534+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4796f5900 con 0x55d4795f5a00 2024-05-15T18:08:57.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.535+0000 7f7ef3e07640 1 -- 172.21.15.173:0/1045216126 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7ff8010070 con 0x55d4795f5a00 2024-05-15T18:08:57.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.535+0000 7f7ef3e07640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.535+0000 7f7ef3e07640 1 -- 172.21.15.173:0/1045216126 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7ff8018070 con 0x55d4795f5a00 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.535+0000 7f8006ea7640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.535+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4795f7540 0x55d4796f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.535+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4796f9c00 con 0x55d4795f7540 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.535+0000 7f8007ea9640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4795f7540 0x55d4796f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f8006ea7640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc054000 tx=0x7f7ffc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f8007ea9640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4795f7540 0x55d4796f9590 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f8007ea9640 1 -- 172.21.15.173:0/1045216126 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d4795f7540 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4796f6c70 con 0x55d4795f7540 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f8007ea9640 1 -- 172.21.15.173:0/1045216126 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80000083e0 con 0x55d4795f7540 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4796fbf30 0x55d4796fe320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4796fea10 con 0x55d4796fbf30 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f80076a8640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4796fbf30 0x55d4796fe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.536+0000 7f80076a8640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4796fbf30 0x55d4796fe320 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.537+0000 7f80076a8640 1 -- 172.21.15.173:0/1045216126 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ff801b040 con 0x55d4796fbf30 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.537+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4796faeb0 con 0x55d4795f7540 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.537+0000 7f8007ea9640 1 -- 172.21.15.173:0/1045216126 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80000083e0 con 0x55d4795f7540 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.537+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4796ffe70 0x55d4797022c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.537+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d479702a50 con 0x55d4796ffe70 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.538+0000 7f8006ea7640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4796ffe70 0x55d4797022c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.538+0000 7f8006ea7640 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4796ffe70 0x55d4797022c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.538+0000 7f8006ea7640 1 -- 172.21.15.173:0/1045216126 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ffc05a040 con 0x55d4796ffe70 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f8009ba2800 1 Processor -- start 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f8009ba2800 1 -- start start 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f8009ba2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d479710e40 0x55d479711260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f8009ba2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4794e8cf0 con 0x55d479710e40 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d479710e40 0x55d479711260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d479710e40 0x55d479711260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43852/0 (socket says 172.21.15.173:43852) 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f80076a8640 1 -- 172.21.15.173:0/2444832404 learned_addr learned my addr 172.21.15.173:0/2444832404 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f80076a8640 1 -- 172.21.15.173:0/2444832404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4797117a0 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.539+0000 7f80076a8640 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d479710e40 0x55d479711260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000f80 tx=0x7f7ff801d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f7ef1602640 1 -- 172.21.15.173:0/2444832404 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff8036020 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f7ef1602640 1 -- 172.21.15.173:0/2444832404 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff8027e10 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d479712210 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f7ef1602640 1 -- 172.21.15.173:0/2444832404 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff80492d0 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d479712710 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f7ef1602640 1 -- 172.21.15.173:0/2444832404 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7ff8039020 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f7ef1602640 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ee0036900 0x7f7ee0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.540+0000 7f7ef1602640 1 -- 172.21.15.173:0/2444832404 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7ff803ee00 con 0x55d479710e40 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f8006ea7640 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ee0036900 0x7f7ee0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f8009ba2800 1 Processor -- start 2024-05-15T18:08:57.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f8009ba2800 1 -- start start 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f8006ea7640 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ee0036900 0x7f7ee0038dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x55d4796fa0d0 tx=0x7f7ffc005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f8009ba2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d47971e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f8009ba2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4796eb200 con 0x55d47971e1c0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d47971e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d47971e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43862/0 (socket says 172.21.15.173:43862) 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f80076a8640 1 -- 172.21.15.173:0/2331011366 learned_addr learned my addr 172.21.15.173:0/2331011366 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.541+0000 7f80076a8640 1 -- 172.21.15.173:0/2331011366 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47971ebb0 con 0x55d47971e1c0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f80076a8640 1 --2- 172.21.15.173:0/2331011366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d47971e5e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8047010 tx=0x7f7ff8048420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882621685e203742 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f7eeaffd640 1 -- 172.21.15.173:0/2331011366 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff8045d60 con 0x55d47971e1c0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f7eeaffd640 1 -- 172.21.15.173:0/2331011366 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff805d070 con 0x55d47971e1c0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f7eeaffd640 1 -- 172.21.15.173:0/2331011366 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff801d950 con 0x55d47971e1c0 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 -- 172.21.15.173:0/2331011366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 msgr2=0x55d47971e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2331011366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d47971e5e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8047010 tx=0x7f7ff8048420 comp rx=0 tx=0).stop 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 -- 172.21.15.173:0/2331011366 shutdown_connections 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2331011366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d47971e5e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 -- 172.21.15.173:0/2331011366 >> 172.21.15.173:0/2331011366 conn(0x55d47971a440 msgr2=0x55d4797184a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 -- 172.21.15.173:0/2331011366 shutdown_connections 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 -- 172.21.15.173:0/2331011366 wait complete. 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.542+0000 7f8009ba2800 1 Processor -- start 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f8009ba2800 1 -- start start 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f8009ba2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d479725560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f8009ba2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d47971f220 con 0x55d47971e1c0 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d479725560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f80076a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d479725560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43866/0 (socket says 172.21.15.173:43866) 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 learned_addr learned my addr 172.21.15.173:0/4251799777 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d479725aa0 con 0x55d47971e1c0 2024-05-15T18:08:57.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f80076a8640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d479725560 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8027000 tx=0x7f7ff80481f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f7ee97fa640 1 -- 172.21.15.173:0/4251799777 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff801da80 con 0x55d47971e1c0 2024-05-15T18:08:57.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f7ee97fa640 1 -- 172.21.15.173:0/4251799777 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff8032890 con 0x55d47971e1c0 2024-05-15T18:08:57.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f7ee97fa640 1 -- 172.21.15.173:0/4251799777 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ff8032bb0 con 0x55d47971e1c0 2024-05-15T18:08:57.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.543+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d479725aa0 con 0x55d47971e1c0 2024-05-15T18:08:57.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.544+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d479725aa0 con 0x55d47971e1c0 2024-05-15T18:08:57.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.544+0000 7f7ee97fa640 1 -- 172.21.15.173:0/4251799777 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7ff80265f0 con 0x55d47971e1c0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.544+0000 7f7ee97fa640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ed0036950 0x7f7ed0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.544+0000 7f7ee97fa640 1 -- 172.21.15.173:0/4251799777 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f7ff806eaf0 con 0x55d47971e1c0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.545+0000 7f8006ea7640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ed0036950 0x7f7ed0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.545+0000 7f8006ea7640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ed0036950 0x7f7ed0038e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc055040 tx=0x7f7ffc060040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.545+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.545+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d479730cb0 0x55d479733170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.545+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4797338c0 con 0x55d479730cb0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.545+0000 7f8007ea9640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d479730cb0 0x55d479733170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8007ea9640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d479730cb0 0x55d479733170 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 realm 2024-05-15T18:08:57.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d479733cd0 con 0x55d479730cb0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479730cb0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d479734940 con 0x55d479730cb0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d479735300 0x55d4797376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.546+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d479737d40 con 0x55d479735300 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.547+0000 7f80076a8640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d479735300 0x55d4797376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.547+0000 7f80076a8640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d479735300 0x55d4797376f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.547+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.547+0000 7f8009ba2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.547+0000 7f8009ba2800 20 searching for the correct realm 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.547+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d479739650 con 0x55d479735300 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f80076a8640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f7ff8045700 0x7f7ff8062900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d479739650 con 0x7f7ff8045700 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f8006ea7640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f7ff8045700 0x7f7ff8062900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f8006ea7640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f7ff8045700 0x7f7ff8062900 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f8006ea7640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7ffc080930 0x7f7ffc073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d479739650 con 0x7f7ffc080930 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.548+0000 7f8007ea9640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7ffc080930 0x7f7ffc073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.549+0000 7f8007ea9640 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7ffc080930 0x7f7ffc073420 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.549+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.549+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479730cb0 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.549+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.549+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479730cb0 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.549+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.549+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x7f7ffc080930 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x7f7ffc080930 2024-05-15T18:08:57.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x7f7ff8045700 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479735300 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.550+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479730cb0 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x7f7ffc080930 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479730cb0 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x7f7ff8045700 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.551+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x7f7ffc080930 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.552+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479730cb0 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479730cb0 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x7f7ffc080930 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.553+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479735300 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.554+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.554+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x7f7ff8045700 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.554+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.554+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479730cb0 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.554+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.554+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x7f7ffc080930 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.554+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.555+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479735300 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.555+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.555+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x7f7ffc080930 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.555+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.555+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x7f7ff8045700 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.555+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.555+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479735300 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x7f7ffc080930 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x55d479730cb0 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f8000026040 con 0x7f7ff8045700 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:57.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.556+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4797345a0 con 0x55d479730cb0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4797380e0 con 0x55d479730cb0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4797380e0 con 0x7f7ffc080930 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 zone default found 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 4 Realm: () 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 zonegroup default 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.557+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d479738a00 con 0x7f7ffc080930 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d479738a00 con 0x55d479735300 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d47973b4b0 con 0x55d479735300 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 20 started sync module instance, tier type = 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.558+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973a950 con 0x7f7ff8045700 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.559+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.559+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94371059049632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973b850 con 0x7f7ff8045700 2024-05-15T18:08:57.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.559+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973c0e0 con 0x55d479730cb0 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.560+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94371059049632] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.560+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.560+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94371059051840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973c4d0 con 0x55d479730cb0 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.560+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973cf30 con 0x55d479735300 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.561+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94371059051840] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.561+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.561+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94371059055600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973d320 con 0x55d479735300 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.561+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973dd80 con 0x7f7ff8045700 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.562+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.562+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94371059065200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973ea40 con 0x7f7ff8045700 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.562+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94371059055600] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.562+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973f4b0 con 0x55d479730cb0 2024-05-15T18:08:57.552 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.563+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.563+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94371059065200] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.563+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94371059068800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973f8a0 con 0x55d479730cb0 2024-05-15T18:08:57.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.563+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973e590 con 0x7f7ffc080930 2024-05-15T18:08:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.564+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.564+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94371059072432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973e590 con 0x7f7ffc080930 2024-05-15T18:08:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.564+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d479740ce0 con 0x7f7ffc080930 2024-05-15T18:08:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.565+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94371059068800] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.565+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94371059072432] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.566+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.566+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94371059073488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797407f0 con 0x7f7ffc080930 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.566+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d479741580 con 0x7f7ffc080930 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94371059077328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797407f0 con 0x7f7ffc080930 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 20 add_watcher() i=0 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 20 add_watcher() i=1 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 20 add_watcher() i=2 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 20 add_watcher() i=3 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 20 add_watcher() i=4 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 20 add_watcher() i=5 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94371059073488] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.567+0000 7f8009ba2800 20 add_watcher() i=6 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.568+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94371059077328] v29'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.568+0000 7f8009ba2800 20 add_watcher() i=7 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.568+0000 7f8009ba2800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.568+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d47973ca10 con 0x55d479730cb0 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.568+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.568+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94371059078384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973ca10 con 0x55d479730cb0 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94371059078384] v29'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f7ebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 5 note: GC not initialized 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f7ebcfe1640 20 reqs_thread_entry: start 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:57.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 20 Filter name: none 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f7e367fc640 20 reqs_thread_entry: start 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.569+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d479777b30 con 0x55d479730cb0 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.571+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.571+0000 7f8009ba2800 20 rados_obj.operate() r=0 bl.length=556 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.571+0000 7f8009ba2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.571+0000 7f8009ba2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.571+0000 7f8009ba2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.571+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47977dff0 con 0x55d479730cb0 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.572+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v29'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.572+0000 7f8009ba2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.572+0000 7f8009ba2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.572+0000 7f8009ba2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.572+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94371059325536 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d47977cb40 con 0x55d479730cb0 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94371059068800 notify 124554051590 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f8000010040 con 0x55d479730cb0 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f7eeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94371059068800 notifier 4364 bl.length()=732 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f7eeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f7eeaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f7eeaffd640 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7ecc003ea0 con 0x55d479730cb0 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(64 notify.4 [notify cookie 94371059325536 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.573+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94371059325536 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8000018780 con 0x55d479730cb0 2024-05-15T18:08:57.561 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.574+0000 7f7ebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.574+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94371059078384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47977cf70 con 0x55d479730cb0 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.575+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94371059078384] v29'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.575+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94371059049632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797414f0 con 0x7f7ff8045700 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.576+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94371059049632] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.576+0000 7f8009ba2800 20 remove_watcher() i=0 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.576+0000 7f8009ba2800 2 removed watcher, disabling cache 2024-05-15T18:08:57.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.576+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94371059051840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797414f0 con 0x55d479730cb0 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.577+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94371059051840] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.577+0000 7f8009ba2800 20 remove_watcher() i=1 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.577+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94371059055600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797414f0 con 0x55d479735300 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.578+0000 7f80076a8640 1 -- 172.21.15.173:0/4251799777 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94371059055600] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ff8073020 con 0x55d479735300 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.578+0000 7f8009ba2800 20 remove_watcher() i=2 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.578+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94371059065200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d47973bbf0 con 0x7f7ff8045700 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.579+0000 7f8006ea7640 1 -- 172.21.15.173:0/4251799777 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94371059065200] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc070070 con 0x7f7ff8045700 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.579+0000 7f8009ba2800 20 remove_watcher() i=3 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.579+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94371059068800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797414f0 con 0x55d479730cb0 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.580+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94371059068800] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x55d479730cb0 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.580+0000 7f8009ba2800 20 remove_watcher() i=4 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.580+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94371059072432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797414f0 con 0x7f7ffc080930 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.581+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94371059072432] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.581+0000 7f8009ba2800 20 remove_watcher() i=5 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.581+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94371059073488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797414f0 con 0x7f7ffc080930 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.582+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94371059073488] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.582+0000 7f8009ba2800 20 remove_watcher() i=6 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.582+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94371059077328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4797414f0 con 0x7f7ffc080930 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94371059077328] v29'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f80000083e0 con 0x7f7ffc080930 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 20 remove_watcher() i=7 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7ffc080930 msgr2=0x7f7ffc073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7ffc080930 0x7f7ffc073420 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d479730cb0 msgr2=0x55d479733170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d479730cb0 0x55d479733170 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f7ff8045700 msgr2=0x7f7ff8062900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f7ff8045700 0x7f7ff8062900 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d479735300 msgr2=0x55d4797376f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d479735300 0x55d4797376f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ed0036950 msgr2=0x7f7ed0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ed0036950 0x7f7ed0038e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc055040 tx=0x7f7ffc060040 comp rx=0 tx=0).stop 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 msgr2=0x55d479725560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8007ea9640 1 -- 172.21.15.173:0/4251799777 reap_dead start 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d479725560 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8027000 tx=0x7f7ff80481f0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 shutdown_connections 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/4251799777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d47971e1c0 0x55d479725560 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 >> 172.21.15.173:0/4251799777 conn(0x55d47971a440 msgr2=0x55d479717aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 shutdown_connections 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/4251799777 wait complete. 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ee0036900 msgr2=0x7f7ee0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ee0036900 0x7f7ee0038dc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x55d4796fa0d0 tx=0x7f7ffc005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:57.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d479710e40 msgr2=0x55d479711260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.583+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d479710e40 0x55d479711260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8000f80 tx=0x7f7ff801d620 comp rx=0 tx=0).stop 2024-05-15T18:08:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 shutdown_connections 2024-05-15T18:08:57.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7ee0036900 0x7f7ee0038dc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 --2- 172.21.15.173:0/2444832404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d479710e40 0x55d479711260 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 >> 172.21.15.173:0/2444832404 conn(0x55d479704ee0 msgr2=0x55d4797052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 shutdown_connections 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/2444832404 wait complete. 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4796ffe70 msgr2=0x55d4797022c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4796ffe70 0x55d4797022c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4795f7540 msgr2=0x55d4796f9590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4795f7540 0x55d4796f9590 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4796fbf30 msgr2=0x55d4796fe320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4796fbf30 0x55d4796fe320 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 msgr2=0x7f7eec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7eec036900 0x7f7eec038dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc054000 tx=0x7f7ffc04e000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 msgr2=0x55d4796f2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 --2- 172.21.15.173:0/1045216126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4795f5a00 0x55d4796f2480 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8006fa0 tx=0x7f7ff8001250 comp rx=0 tx=0).stop 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8007ea9640 1 -- 172.21.15.173:0/1045216126 reap_dead start 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 shutdown_connections 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 >> 172.21.15.173:0/1045216126 conn(0x55d4795f15c0 msgr2=0x55d4796e49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 shutdown_connections 2024-05-15T18:08:57.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.584+0000 7f8009ba2800 1 -- 172.21.15.173:0/1045216126 wait complete. 2024-05-15T18:08:57.575 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:57.575 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:57.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:57.576 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:57.620 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:57.620 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:57.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.644+0000 7f402ad3c800 1 Processor -- start 2024-05-15T18:08:57.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.644+0000 7f402ad3c800 1 -- start start 2024-05-15T18:08:57.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.644+0000 7f402ad3c800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5579b2a9e540 0x5579b2aa7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.644+0000 7f402ad3c800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579b2a11900 con 0x5579b2a9ca00 2024-05-15T18:08:57.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.644+0000 7f402ad3c800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5579b292f050 con 0x5579b2a9e540 2024-05-15T18:08:57.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.645+0000 7f4026239640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5579b2a9e540 0x5579b2aa7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.645+0000 7f4026a3a640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5579b2a9ca00 0x5579b2a9ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35270/0 (socket says 172.21.15.173:35270) 2024-05-15T18:08:57.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.645+0000 7f4026a3a640 1 -- 172.21.15.173:0/310409782 learned_addr learned my addr 172.21.15.173:0/310409782 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:57.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.645+0000 7f4026239640 1 -- 172.21.15.173:0/310409782 >> v1:172.21.15.3:6789/0 conn(0x5579b2a9ca00 legacy=0x5579b2a9ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.645+0000 7f4026239640 1 -- 172.21.15.173:0/310409782 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b2a11ad0 con 0x5579b2a9e540 2024-05-15T18:08:57.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f4026239640 1 --2- 172.21.15.173:0/310409782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9e540 0x5579b2aa7040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f401c00a470 tx=0x7f401c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1168e283b465266 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f4025a38640 1 -- 172.21.15.173:0/310409782 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401c057070 con 0x5579b2a9e540 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f4025a38640 1 -- 172.21.15.173:0/310409782 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401c052570 con 0x5579b2a9e540 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f4025a38640 1 -- 172.21.15.173:0/310409782 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401c052870 con 0x5579b2a9e540 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f402ad3c800 1 -- 172.21.15.173:0/310409782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9e540 msgr2=0x5579b2aa7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f402ad3c800 1 --2- 172.21.15.173:0/310409782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9e540 0x5579b2aa7040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f401c00a470 tx=0x7f401c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f402ad3c800 1 -- 172.21.15.173:0/310409782 shutdown_connections 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f402ad3c800 1 --2- 172.21.15.173:0/310409782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9e540 0x5579b2aa7040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f402ad3c800 1 -- 172.21.15.173:0/310409782 >> 172.21.15.173:0/310409782 conn(0x5579b2a985a0 msgr2=0x5579b2a9a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f402ad3c800 1 -- 172.21.15.173:0/310409782 shutdown_connections 2024-05-15T18:08:57.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.647+0000 7f402ad3c800 1 -- 172.21.15.173:0/310409782 wait complete. 2024-05-15T18:08:57.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.661+0000 7f402ad3c800 1 Processor -- start 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.661+0000 7f402ad3c800 1 -- start start 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.661+0000 7f402ad3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b918e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.661+0000 7f402ad3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579b29e91d0 con 0x5579b2a9ca00 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b918e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43890/0 (socket says 172.21.15.173:43890) 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f4026a3a640 1 -- 172.21.15.173:0/3784135738 learned_addr learned my addr 172.21.15.173:0/3784135738 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f4026a3a640 1 -- 172.21.15.173:0/3784135738 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b2b91eb0 con 0x5579b2a9ca00 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f4026a3a640 1 --2- 172.21.15.173:0/3784135738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b918e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4018001de0 tx=0x7f401800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbbc008618d4edd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f3f14e09640 1 -- 172.21.15.173:0/3784135738 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018012020 con 0x5579b2a9ca00 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f3f14e09640 1 -- 172.21.15.173:0/3784135738 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401800e5a0 con 0x5579b2a9ca00 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.662+0000 7f3f14e09640 1 -- 172.21.15.173:0/3784135738 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401800e8c0 con 0x5579b2a9ca00 2024-05-15T18:08:57.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 -- 172.21.15.173:0/3784135738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 msgr2=0x5579b2b918e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 --2- 172.21.15.173:0/3784135738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b918e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4018001de0 tx=0x7f401800b6c0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 -- 172.21.15.173:0/3784135738 shutdown_connections 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 --2- 172.21.15.173:0/3784135738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b918e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 -- 172.21.15.173:0/3784135738 >> 172.21.15.173:0/3784135738 conn(0x5579b2a985a0 msgr2=0x5579b2b8d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 -- 172.21.15.173:0/3784135738 shutdown_connections 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 -- 172.21.15.173:0/3784135738 wait complete. 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 Processor -- start 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 -- start start 2024-05-15T18:08:57.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b99450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.663+0000 7f402ad3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579b2aa7850 con 0x5579b2a9ca00 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b99450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b99450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43892/0 (socket says 172.21.15.173:43892) 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f4026a3a640 1 -- 172.21.15.173:0/493000611 learned_addr learned my addr 172.21.15.173:0/493000611 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f4026a3a640 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b2b99990 con 0x5579b2a9ca00 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f4026a3a640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b99450 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f401800c010 tx=0x7f4018000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f3f13606640 1 -- 172.21.15.173:0/493000611 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018012070 con 0x5579b2a9ca00 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f3f13606640 1 -- 172.21.15.173:0/493000611 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401801a7a0 con 0x5579b2a9ca00 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579b2b99c20 con 0x5579b2a9ca00 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f3f13606640 1 -- 172.21.15.173:0/493000611 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401801aa80 con 0x5579b2a9ca00 2024-05-15T18:08:57.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.664+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b2b9c8d0 con 0x5579b2a9ca00 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.665+0000 7f3f13606640 1 -- 172.21.15.173:0/493000611 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4018015020 con 0x5579b2a9ca00 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.665+0000 7f3f13606640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f0c036900 0x7f3f0c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.665+0000 7f3f13606640 1 -- 172.21.15.173:0/493000611 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f4018020070 con 0x5579b2a9ca00 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f4026239640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f0c036900 0x7f3f0c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2a9e540 0x5579b2ba0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2ba0bd0 con 0x5579b2a9e540 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f402723b640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2a9e540 0x5579b2ba0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f4026239640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f0c036900 0x7f3f0c038dc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f401c054000 tx=0x7f401c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f402723b640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2a9e540 0x5579b2ba0690 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f402723b640 1 -- 172.21.15.173:0/493000611 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2a9e540 2024-05-15T18:08:57.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.666+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2b9dc60 con 0x5579b2a9e540 2024-05-15T18:08:57.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.667+0000 7f402723b640 1 -- 172.21.15.173:0/493000611 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2a9e540 2024-05-15T18:08:57.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.667+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2ba2f70 0x5579b2ba5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.667+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2ba5a00 con 0x5579b2ba2f70 2024-05-15T18:08:57.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.667+0000 7f4026a3a640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2ba2f70 0x5579b2ba5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.667+0000 7f4026a3a640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2ba2f70 0x5579b2ba5360 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.667+0000 7f4026a3a640 1 -- 172.21.15.173:0/493000611 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f401802b070 con 0x5579b2ba2f70 2024-05-15T18:08:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.667+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2ba1f20 con 0x5579b2a9e540 2024-05-15T18:08:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.668+0000 7f402723b640 1 -- 172.21.15.173:0/493000611 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2a9e540 2024-05-15T18:08:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.668+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579b2ba6eb0 0x5579b2ba9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.668+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2ba9a60 con 0x5579b2ba6eb0 2024-05-15T18:08:57.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.668+0000 7f4026239640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579b2ba6eb0 0x5579b2ba9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.668+0000 7f4026239640 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579b2ba6eb0 0x5579b2ba9300 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f4026239640 1 -- 172.21.15.173:0/493000611 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f401c05a040 con 0x5579b2ba6eb0 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f402ad3c800 1 Processor -- start 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f402ad3c800 1 -- start start 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f402ad3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bb7e70 0x5579b2bb8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f402ad3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579b298fcf0 con 0x5579b2bb7e70 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bb7e70 0x5579b2bb8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bb7e70 0x5579b2bb8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43900/0 (socket says 172.21.15.173:43900) 2024-05-15T18:08:57.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f4026a3a640 1 -- 172.21.15.173:0/1586940238 learned_addr learned my addr 172.21.15.173:0/1586940238 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.669+0000 7f4026a3a640 1 -- 172.21.15.173:0/1586940238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b2bb87d0 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.670+0000 7f4026a3a640 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bb7e70 0x5579b2bb8290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f401804acf0 tx=0x7f401801af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.670+0000 7f3f10e01640 1 -- 172.21.15.173:0/1586940238 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018047260 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.670+0000 7f3f10e01640 1 -- 172.21.15.173:0/1586940238 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40180490e0 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.670+0000 7f3f10e01640 1 -- 172.21.15.173:0/1586940238 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40180493e0 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.670+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579b2bb9240 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.670+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b2bb9740 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.670+0000 7f3f10e01640 1 -- 172.21.15.173:0/1586940238 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4018044060 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f3f10e01640 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f00036970 0x7f3f00038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f3f10e01640 1 -- 172.21.15.173:0/1586940238 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f401804dcc0 con 0x5579b2bb7e70 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f4026239640 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f00036970 0x7f3f00038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f402ad3c800 1 Processor -- start 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f402ad3c800 1 -- start start 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f4026239640 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f00036970 0x7f3f00038e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5579b2b9db80 tx=0x7f401c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f402ad3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bc5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f402ad3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579b2b92230 con 0x5579b2bc4ff0 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bc5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bc5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43904/0 (socket says 172.21.15.173:43904) 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.671+0000 7f4026a3a640 1 -- 172.21.15.173:0/946476529 learned_addr learned my addr 172.21.15.173:0/946476529 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f4026a3a640 1 -- 172.21.15.173:0/946476529 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b2bc59e0 con 0x5579b2bc4ff0 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f4026a3a640 1 --2- 172.21.15.173:0/946476529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bc5410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f401803f080 tx=0x7f4018047ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0e0078e64dd23f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f3f0a7fc640 1 -- 172.21.15.173:0/946476529 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401805c070 con 0x5579b2bc4ff0 2024-05-15T18:08:57.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f3f0a7fc640 1 -- 172.21.15.173:0/946476529 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40180448b0 con 0x5579b2bc4ff0 2024-05-15T18:08:57.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f3f0a7fc640 1 -- 172.21.15.173:0/946476529 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401803d070 con 0x5579b2bc4ff0 2024-05-15T18:08:57.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f402ad3c800 1 -- 172.21.15.173:0/946476529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 msgr2=0x5579b2bc5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f402ad3c800 1 --2- 172.21.15.173:0/946476529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bc5410 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f401803f080 tx=0x7f4018047ca0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f402ad3c800 1 -- 172.21.15.173:0/946476529 shutdown_connections 2024-05-15T18:08:57.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f402ad3c800 1 --2- 172.21.15.173:0/946476529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bc5410 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f402ad3c800 1 -- 172.21.15.173:0/946476529 >> 172.21.15.173:0/946476529 conn(0x5579b2bc12c0 msgr2=0x5579b2bbf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f402ad3c800 1 -- 172.21.15.173:0/946476529 shutdown_connections 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.672+0000 7f402ad3c800 1 -- 172.21.15.173:0/946476529 wait complete. 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f402ad3c800 1 Processor -- start 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f402ad3c800 1 -- start start 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f402ad3c800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bcc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f402ad3c800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579b2bc6040 con 0x5579b2bc4ff0 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bcc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f4026a3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bcc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43916/0 (socket says 172.21.15.173:43916) 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 learned_addr learned my addr 172.21.15.173:0/2516952939 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.673+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b2bcc880 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.674+0000 7f4026a3a640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bcc340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f401803f080 tx=0x7f401803f0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.674+0000 7f3f08ff9640 1 -- 172.21.15.173:0/2516952939 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4018066070 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.674+0000 7f3f08ff9640 1 -- 172.21.15.173:0/2516952939 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018024670 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.674+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579b2bcc880 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.674+0000 7f3f08ff9640 1 -- 172.21.15.173:0/2516952939 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f401805c040 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.674+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b2bcc880 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f3f08ff9640 1 -- 172.21.15.173:0/2516952939 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4018069070 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f3f08ff9640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ef0036900 0x7f3ef0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f3f08ff9640 1 -- 172.21.15.173:0/2516952939 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f4018052030 con 0x5579b2bc4ff0 2024-05-15T18:08:57.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f4026239640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ef0036900 0x7f3ef0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2bd7a90 0x5579b2bd9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bda6a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.675+0000 7f402723b640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2bd7a90 0x5579b2bd9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f4026239640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ef0036900 0x7f3ef0038dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5579b2ba9e60 tx=0x7f401c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402723b640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2bd7a90 0x5579b2bd9f50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 20 realm 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdaab0 con 0x5579b2bd7a90 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb380 con 0x5579b2bd7a90 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.676+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x5579b2bd7a90 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402ad3c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2bdc210 0x5579b2bde600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bded60 con 0x5579b2bdc210 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f4026a3a640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2bdc210 0x5579b2bde600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f4026a3a640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2bdc210 0x5579b2bde600 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402ad3c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402ad3c800 20 searching for the correct realm 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.677+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be0740 con 0x5579b2bdc210 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026a3a640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f401806b070 0x7f4018022a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be0740 con 0x7f401806b070 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026239640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f401806b070 0x7f4018022a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026239640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f401806b070 0x7f4018022a80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026239640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f401c074040 0x7f401c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.678+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be0740 con 0x7f401c074040 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.679+0000 7f402723b640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f401c074040 0x7f401c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.679+0000 7f402723b640 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f401c074040 0x7f401c081410 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.679+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.679+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x5579b2bd7a90 2024-05-15T18:08:57.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x5579b2bd7a90 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x7f401c074040 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x7f401c074040 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.680+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x7f401806b070 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x5579b2bdc210 2024-05-15T18:08:57.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x5579b2bd7a90 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x7f401c074040 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.681+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x5579b2bd7a90 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdb720 con 0x7f401806b070 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bdc210 2024-05-15T18:08:57.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bdc210 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.682+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401c074040 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bdc210 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bdc210 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bd7a90 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bd7a90 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.683+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401c074040 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bdc210 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401806b070 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bd7a90 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.684+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401c074040 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.685+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.685+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bdc210 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.685+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.685+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401c074040 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401806b070 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bdc210 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401c074040 2024-05-15T18:08:57.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.686+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x5579b2bd7a90 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f401c08e060 con 0x7f401806b070 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:57.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdf710 con 0x5579b2bd7a90 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdfb00 con 0x5579b2bd7a90 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.687+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdfb00 con 0x7f401c074040 2024-05-15T18:08:57.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 zone default found 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 4 Realm: () 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 zonegroup default 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2bdff20 con 0x7f401c074040 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be0340 con 0x5579b2bdc210 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.688+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be25f0 con 0x5579b2bdc210 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.689+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.689+0000 7f402ad3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.689+0000 7f402ad3c800 20 started sync module instance, tier type = 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.689+0000 7f402ad3c800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.689+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be1a90 con 0x7f401806b070 2024-05-15T18:08:57.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.690+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.690+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981178207872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be16f0 con 0x7f401806b070 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.690+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be3460 con 0x5579b2bd7a90 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.691+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93981178207872] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.691+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.691+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981178212272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be3880 con 0x5579b2bd7a90 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.691+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be4240 con 0x5579b2bdc210 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.692+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93981178212272] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.692+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.692+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981178213328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be37f0 con 0x5579b2bdc210 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.692+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be5100 con 0x7f401806b070 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.693+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93981178213328] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.693+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.693+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981178218032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be59a0 con 0x7f401806b070 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.693+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be6360 con 0x5579b2bd7a90 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.694+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93981178218032] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.694+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.694+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981178224304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be6780 con 0x5579b2bd7a90 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.694+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be7140 con 0x7f401c074040 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.695+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.695+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981178227856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be7560 con 0x7f401c074040 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.695+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be8060 con 0x7f401c074040 2024-05-15T18:08:57.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.695+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93981178224304] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.696+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93981178227856] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.697+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.697+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981178231632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be70b0 con 0x7f401c074040 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.697+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be86f0 con 0x7f401c074040 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93981178231632] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981178225360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be86f0 con 0x7f401c074040 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 20 add_watcher() i=0 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 20 add_watcher() i=1 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 20 add_watcher() i=2 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 20 add_watcher() i=3 2024-05-15T18:08:57.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 20 add_watcher() i=4 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 20 add_watcher() i=5 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.698+0000 7f402ad3c800 20 add_watcher() i=6 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.699+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93981178225360] v29'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.699+0000 7f402ad3c800 20 add_watcher() i=7 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.699+0000 7f402ad3c800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.699+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2beb970 con 0x5579b2bd7a90 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.699+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.699+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981178245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be8720 con 0x5579b2bd7a90 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93981178245952] v29'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f3edd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f402ad3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:57.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f402ad3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:57.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f402ad3c800 5 note: GC not initialized 2024-05-15T18:08:57.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f3e57fff640 20 reqs_thread_entry: start 2024-05-15T18:08:57.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f402ad3c800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:57.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.700+0000 7f402ad3c800 20 Filter name: none 2024-05-15T18:08:57.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.701+0000 7f3e55ffb640 20 reqs_thread_entry: start 2024-05-15T18:08:57.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.701+0000 7f402ad3c800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.701+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5579b2c1e910 con 0x5579b2bd7a90 2024-05-15T18:08:57.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.704+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.704+0000 7f402ad3c800 20 rados_obj.operate() r=0 bl.length=556 2024-05-15T18:08:57.703 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.704+0000 7f3edd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.704+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981178245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2c1d4e0 con 0x5579b2bd7a90 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.705+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93981178245952] v29'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.705+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981178207872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2beb340 con 0x7f401806b070 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.706+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93981178207872] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.706+0000 7f402ad3c800 20 remove_watcher() i=0 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.706+0000 7f402ad3c800 2 removed watcher, disabling cache 2024-05-15T18:08:57.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.706+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981178212272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2beb340 con 0x5579b2bd7a90 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.708+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93981178212272] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.708+0000 7f402ad3c800 20 remove_watcher() i=1 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.708+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981178213328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be2fb0 con 0x5579b2bdc210 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.709+0000 7f4026a3a640 1 -- 172.21.15.173:0/2516952939 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93981178213328] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4018068030 con 0x5579b2bdc210 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.709+0000 7f402ad3c800 20 remove_watcher() i=2 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.709+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981178218032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2beb340 con 0x7f401806b070 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.710+0000 7f4026239640 1 -- 172.21.15.173:0/2516952939 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93981178218032] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f401c07f070 con 0x7f401806b070 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.710+0000 7f402ad3c800 20 remove_watcher() i=3 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.710+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981178224304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be4630 con 0x5579b2bd7a90 2024-05-15T18:08:57.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.710+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93981178224304] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x5579b2bd7a90 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.711+0000 7f402ad3c800 20 remove_watcher() i=4 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.711+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981178227856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2beb340 con 0x7f401c074040 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.712+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93981178227856] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.712+0000 7f402ad3c800 20 remove_watcher() i=5 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.712+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981178231632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be5eb0 con 0x7f401c074040 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.713+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93981178231632] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.713+0000 7f402ad3c800 20 remove_watcher() i=6 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.713+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981178225360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5579b2be6c90 con 0x7f401c074040 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.713+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93981178225360] v29'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f402000a4a0 con 0x7f401c074040 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.713+0000 7f402ad3c800 20 remove_watcher() i=7 2024-05-15T18:08:57.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f401c074040 msgr2=0x7f401c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f401c074040 0x7f401c081410 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2bd7a90 msgr2=0x5579b2bd9f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2bd7a90 0x5579b2bd9f50 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f401806b070 msgr2=0x7f4018022a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f401806b070 0x7f4018022a80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2bdc210 msgr2=0x5579b2bde600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2bdc210 0x5579b2bde600 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ef0036900 msgr2=0x7f3ef0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ef0036900 0x7f3ef0038dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5579b2ba9e60 tx=0x7f401c04f000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 msgr2=0x5579b2bcc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/2516952939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bc4ff0 0x5579b2bcc340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f401803f080 tx=0x7f401803f0b0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 reap_dead start 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402723b640 1 -- 172.21.15.173:0/2516952939 reap_dead start 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 shutdown_connections 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 >> 172.21.15.173:0/2516952939 conn(0x5579b2bc12c0 msgr2=0x5579b2bbe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 shutdown_connections 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/2516952939 wait complete. 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f00036970 msgr2=0x7f3f00038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f00036970 0x7f3f00038e30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5579b2b9db80 tx=0x7f401c005a00 comp rx=0 tx=0).stop 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bb7e70 msgr2=0x5579b2bb8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bb7e70 0x5579b2bb8290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f401804acf0 tx=0x7f401801af10 comp rx=0 tx=0).stop 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 shutdown_connections 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f00036970 0x7f3f00038e30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 --2- 172.21.15.173:0/1586940238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2bb7e70 0x5579b2bb8290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 >> 172.21.15.173:0/1586940238 conn(0x5579b2babf10 msgr2=0x5579b2bac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 shutdown_connections 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.714+0000 7f402ad3c800 1 -- 172.21.15.173:0/1586940238 wait complete. 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579b2ba6eb0 msgr2=0x5579b2ba9300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579b2ba6eb0 0x5579b2ba9300 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2a9e540 msgr2=0x5579b2ba0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579b2a9e540 0x5579b2ba0690 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2ba2f70 msgr2=0x5579b2ba5360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.716 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579b2ba2f70 0x5579b2ba5360 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f0c036900 msgr2=0x7f3f0c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3f0c036900 0x7f3f0c038dc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f401c054000 tx=0x7f401c04e000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 msgr2=0x5579b2b99450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 --2- 172.21.15.173:0/493000611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579b2a9ca00 0x5579b2b99450 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f401800c010 tx=0x7f4018000ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402723b640 1 -- 172.21.15.173:0/493000611 reap_dead start 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 shutdown_connections 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 >> 172.21.15.173:0/493000611 conn(0x5579b2a985a0 msgr2=0x5579b2b8ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 shutdown_connections 2024-05-15T18:08:57.717 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.715+0000 7f402ad3c800 1 -- 172.21.15.173:0/493000611 wait complete. 2024-05-15T18:08:57.718 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:57.718 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:57.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:57.718 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:57.772 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:57.772 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:57.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.796+0000 7f4db9f2b800 1 Processor -- start 2024-05-15T18:08:57.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.796+0000 7f4db9f2b800 1 -- start start 2024-05-15T18:08:57.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.796+0000 7f4db9f2b800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561d618f3a00 0x561d618f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.796+0000 7f4db9f2b800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d61868a40 con 0x561d618f4360 2024-05-15T18:08:57.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.796+0000 7f4db9f2b800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x561d61786050 con 0x561d618f3a00 2024-05-15T18:08:57.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.797+0000 7f4db5b59640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561d618f3a00 0x561d618f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.797+0000 7f4db5358640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x561d618f4360 0x561d618f4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35276/0 (socket says 172.21.15.173:35276) 2024-05-15T18:08:57.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.797+0000 7f4db5b59640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561d618f3a00 0x561d618f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43932/0 (socket says 172.21.15.173:43932) 2024-05-15T18:08:57.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.797+0000 7f4db5358640 1 -- 172.21.15.173:0/486128066 learned_addr learned my addr 172.21.15.173:0/486128066 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:57.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.797+0000 7f4db5b59640 1 -- 172.21.15.173:0/486128066 >> v1:172.21.15.3:6789/0 conn(0x561d618f4360 legacy=0x561d618f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.797+0000 7f4db5b59640 1 -- 172.21.15.173:0/486128066 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d618f4f20 con 0x561d618f3a00 2024-05-15T18:08:57.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.799+0000 7f4db5b59640 1 --2- 172.21.15.173:0/486128066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d618f3e20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4da8005fd0 tx=0x7f4da801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cb0d28a070f0f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.799+0000 7f4db4b57640 1 -- 172.21.15.173:0/486128066 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8052560 con 0x561d618f3a00 2024-05-15T18:08:57.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.799+0000 7f4db4b57640 1 -- 172.21.15.173:0/486128066 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8052700 con 0x561d618f3a00 2024-05-15T18:08:57.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.799+0000 7f4db4b57640 1 -- 172.21.15.173:0/486128066 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8052a60 con 0x561d618f3a00 2024-05-15T18:08:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.800+0000 7f4db9f2b800 1 -- 172.21.15.173:0/486128066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 msgr2=0x561d618f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.800+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/486128066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d618f3e20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4da8005fd0 tx=0x7f4da801ccc0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.800+0000 7f4db9f2b800 1 -- 172.21.15.173:0/486128066 shutdown_connections 2024-05-15T18:08:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.800+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/486128066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d618f3e20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.800+0000 7f4db9f2b800 1 -- 172.21.15.173:0/486128066 >> 172.21.15.173:0/486128066 conn(0x561d618ef5a0 msgr2=0x561d618f19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.800+0000 7f4db9f2b800 1 -- 172.21.15.173:0/486128066 shutdown_connections 2024-05-15T18:08:57.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.800+0000 7f4db9f2b800 1 -- 172.21.15.173:0/486128066 wait complete. 2024-05-15T18:08:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.813+0000 7f4db9f2b800 1 Processor -- start 2024-05-15T18:08:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.813+0000 7f4db9f2b800 1 -- start start 2024-05-15T18:08:57.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.813+0000 7f4db9f2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.813+0000 7f4db9f2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561d618401d0 con 0x561d618f3a00 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.813+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.813+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619e8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43940/0 (socket says 172.21.15.173:43940) 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.813+0000 7f4db5b59640 1 -- 172.21.15.173:0/1191289173 learned_addr learned my addr 172.21.15.173:0/1191289173 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.814+0000 7f4db5b59640 1 -- 172.21.15.173:0/1191289173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d619e9070 con 0x561d618f3a00 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.814+0000 7f4db5b59640 1 --2- 172.21.15.173:0/1191289173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619e8aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4da8007000 tx=0x7f4da804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174bccf305c9f0ca server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.814+0000 7f4ca3e07640 1 -- 172.21.15.173:0/1191289173 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da80529e0 con 0x561d618f3a00 2024-05-15T18:08:57.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.814+0000 7f4ca3e07640 1 -- 172.21.15.173:0/1191289173 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8052b80 con 0x561d618f3a00 2024-05-15T18:08:57.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.814+0000 7f4ca3e07640 1 -- 172.21.15.173:0/1191289173 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da805c430 con 0x561d618f3a00 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1191289173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 msgr2=0x561d619e8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1191289173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619e8aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4da8007000 tx=0x7f4da804c000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1191289173 shutdown_connections 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1191289173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619e8aa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1191289173 >> 172.21.15.173:0/1191289173 conn(0x561d618ef5a0 msgr2=0x561d619e43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1191289173 shutdown_connections 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1191289173 wait complete. 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 Processor -- start 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 -- start start 2024-05-15T18:08:57.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db9f2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561d618f5450 con 0x561d618f3a00 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619f0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43942/0 (socket says 172.21.15.173:43942) 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.815+0000 7f4db5b59640 1 -- 172.21.15.173:0/1747289693 learned_addr learned my addr 172.21.15.173:0/1747289693 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.816+0000 7f4db5b59640 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d619f0a40 con 0x561d618f3a00 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.816+0000 7f4db5b59640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619f0500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4da80526d0 tx=0x7f4da8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.816+0000 7f4ca2604640 1 -- 172.21.15.173:0/1747289693 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8075070 con 0x561d618f3a00 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.816+0000 7f4ca2604640 1 -- 172.21.15.173:0/1747289693 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8070540 con 0x561d618f3a00 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.816+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d619f0cd0 con 0x561d618f3a00 2024-05-15T18:08:57.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.816+0000 7f4ca2604640 1 -- 172.21.15.173:0/1747289693 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8070820 con 0x561d618f3a00 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.816+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d619f3980 con 0x561d618f3a00 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.817+0000 7f4ca2604640 1 -- 172.21.15.173:0/1747289693 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4da8078070 con 0x561d618f3a00 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.817+0000 7f4ca2604640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c9c036950 0x7f4c9c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.817+0000 7f4ca2604640 1 -- 172.21.15.173:0/1747289693 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f4da806d070 con 0x561d618f3a00 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.817+0000 7f4db5358640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c9c036950 0x7f4c9c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.817+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d618f4360 0x561d619f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.817+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d619f7d10 con 0x561d618f4360 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.817+0000 7f4db635a640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d618f4360 0x561d619f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db5358640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c9c036950 0x7f4c9c038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4dac000f60 tx=0x7f4dac0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db635a640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d618f4360 0x561d619f7740 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db635a640 1 -- 172.21.15.173:0/1747289693 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d618f4360 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d619f4cf0 con 0x561d618f4360 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db635a640 1 -- 172.21.15.173:0/1747289693 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4db00083e0 con 0x561d618f4360 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d619fa020 0x561d619fc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d619fcb00 con 0x561d619fa020 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.818+0000 7f4db5b59640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d619fa020 0x561d619fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.819+0000 7f4db5b59640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d619fa020 0x561d619fc410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.819+0000 7f4db5b59640 1 -- 172.21.15.173:0/1747289693 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4da8077030 con 0x561d619fa020 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.819+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d619f8fd0 con 0x561d618f4360 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.819+0000 7f4db635a640 1 -- 172.21.15.173:0/1747289693 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4db00083e0 con 0x561d618f4360 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.819+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561d619fdfb0 0x561d61a003e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.819+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a00b70 con 0x561d619fdfb0 2024-05-15T18:08:57.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.819+0000 7f4db5358640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561d619fdfb0 0x561d61a003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.820+0000 7f4db5358640 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561d619fdfb0 0x561d61a003e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.820+0000 7f4db5358640 1 -- 172.21.15.173:0/1747289693 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4dac009050 con 0x561d619fdfb0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.820+0000 7f4db9f2b800 1 Processor -- start 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.820+0000 7f4db9f2b800 1 -- start start 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db9f2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a0efd0 0x561d61a0f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db9f2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561d617e6cf0 con 0x561d61a0efd0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a0efd0 0x561d61a0f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a0efd0 0x561d61a0f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43944/0 (socket says 172.21.15.173:43944) 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db5b59640 1 -- 172.21.15.173:0/2010291762 learned_addr learned my addr 172.21.15.173:0/2010291762 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db5b59640 1 -- 172.21.15.173:0/2010291762 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d61a0f930 con 0x561d61a0efd0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db5b59640 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a0efd0 0x561d61a0f3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4da806fc00 tx=0x7f4da806f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4c9b7fe640 1 -- 172.21.15.173:0/2010291762 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8093070 con 0x561d61a0efd0 2024-05-15T18:08:57.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4c9b7fe640 1 -- 172.21.15.173:0/2010291762 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8070c70 con 0x561d61a0efd0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.821+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d61a103a0 con 0x561d61a0efd0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.822+0000 7f4c9b7fe640 1 -- 172.21.15.173:0/2010291762 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8051bc0 con 0x561d61a0efd0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.822+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d61a108a0 con 0x561d61a0efd0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.822+0000 7f4c9b7fe640 1 -- 172.21.15.173:0/2010291762 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4da8096070 con 0x561d61a0efd0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4c9b7fe640 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c90036950 0x7f4c90038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4c9b7fe640 1 -- 172.21.15.173:0/2010291762 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f4da808a030 con 0x561d61a0efd0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db5358640 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c90036950 0x7f4c90038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db9f2b800 1 Processor -- start 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db9f2b800 1 -- start start 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db5358640 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c90036950 0x7f4c90038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00bf50 tx=0x7f4dac00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db9f2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a1c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db9f2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561d619e9390 con 0x561d61a1c0c0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a1c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a1c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43952/0 (socket says 172.21.15.173:43952) 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db5b59640 1 -- 172.21.15.173:0/2192195139 learned_addr learned my addr 172.21.15.173:0/2192195139 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.823+0000 7f4db5b59640 1 -- 172.21.15.173:0/2192195139 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d61a1cab0 con 0x561d61a1c0c0 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db5b59640 1 --2- 172.21.15.173:0/2192195139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a1c4e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4da808e560 tx=0x7f4da8099f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec76bd111d4e47a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4c997fa640 1 -- 172.21.15.173:0/2192195139 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da808ed40 con 0x561d61a1c0c0 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4c997fa640 1 -- 172.21.15.173:0/2192195139 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da805b390 con 0x561d61a1c0c0 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4c997fa640 1 -- 172.21.15.173:0/2192195139 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da80793b0 con 0x561d61a1c0c0 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2192195139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 msgr2=0x561d61a1c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/2192195139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a1c4e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4da808e560 tx=0x7f4da8099f60 comp rx=0 tx=0).stop 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2192195139 shutdown_connections 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/2192195139 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a1c4e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2192195139 >> 172.21.15.173:0/2192195139 conn(0x561d61a18420 msgr2=0x561d61a16480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2192195139 shutdown_connections 2024-05-15T18:08:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.824+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2192195139 wait complete. 2024-05-15T18:08:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db9f2b800 1 Processor -- start 2024-05-15T18:08:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db9f2b800 1 -- start start 2024-05-15T18:08:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db9f2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db9f2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561d61a1d160 con 0x561d61a1c0c0 2024-05-15T18:08:57.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db5b59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a234b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43956/0 (socket says 172.21.15.173:43956) 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 learned_addr learned my addr 172.21.15.173:0/110949078 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.825+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d61a239f0 con 0x561d61a1c0c0 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.826+0000 7f4db5b59640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a234b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4da805cf10 tx=0x7f4da80071a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.826+0000 7f4c877fe640 1 -- 172.21.15.173:0/110949078 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8005530 con 0x561d61a1c0c0 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.826+0000 7f4c877fe640 1 -- 172.21.15.173:0/110949078 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da808eb40 con 0x561d61a1c0c0 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.826+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d61a239f0 con 0x561d61a1c0c0 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.826+0000 7f4c877fe640 1 -- 172.21.15.173:0/110949078 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8074ae0 con 0x561d61a1c0c0 2024-05-15T18:08:57.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.826+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d61a239f0 con 0x561d61a1c0c0 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.826+0000 7f4c877fe640 1 -- 172.21.15.173:0/110949078 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4da80bc020 con 0x561d61a1c0c0 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4c877fe640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c80036950 0x7f4c80038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4c877fe640 1 -- 172.21.15.173:0/110949078 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f4da80ba020 con 0x561d61a1c0c0 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4db5358640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c80036950 0x7f4c80038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d61a2ea30 0x561d61a30ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a31640 con 0x561d61a2ea30 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4db635a640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d61a2ea30 0x561d61a30ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4db5358640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c80036950 0x7f4c80038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4dac001b60 tx=0x7f4dac010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.827+0000 7f4db635a640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d61a2ea30 0x561d61a30ef0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 realm 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a31a50 con 0x561d61a2ea30 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:57.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x561d61a2ea30 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a326c0 con 0x561d61a2ea30 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d61a33080 0x561d61a35470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a359b0 con 0x561d61a33080 2024-05-15T18:08:57.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.828+0000 7f4db5b59640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d61a33080 0x561d61a35470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db5b59640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d61a33080 0x561d61a35470 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db9f2b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:57.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db9f2b800 20 searching for the correct realm 2024-05-15T18:08:57.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a373c0 con 0x561d61a33080 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db5b59640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f4da8098060 0x7f4da8058650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.829+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a373c0 con 0x7f4da8098060 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.830+0000 7f4db5358640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f4da8098060 0x7f4da8058650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.830+0000 7f4db5358640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f4da8098060 0x7f4da8058650 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.830+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac009050 con 0x7f4da8098060 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.830+0000 7f4db5358640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4dac038040 0x7f4dac01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.830+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a373c0 con 0x7f4dac038040 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.830+0000 7f4db635a640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4dac038040 0x7f4dac01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.831+0000 7f4db635a640 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4dac038040 0x7f4dac01bab0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.831+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.831+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x561d61a2ea30 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.831+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.831+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x561d61a2ea30 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.831+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x7f4dac038040 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x7f4dac038040 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x7f4da8098060 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac009050 con 0x7f4da8098060 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x561d61a33080 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.832+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.833+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x561d61a2ea30 2024-05-15T18:08:57.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.833+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.833+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4dac038040 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.833+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.833+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a2ea30 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.833+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.833+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4da8098060 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4dac009050 con 0x7f4da8098060 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a33080 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a33080 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4dac038040 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.834+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a33080 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a33080 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a2ea30 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a2ea30 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.835+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4dac038040 2024-05-15T18:08:57.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a33080 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4da8098060 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac009050 con 0x7f4da8098060 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a2ea30 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.836+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4dac038040 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.837+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.837+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a33080 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.837+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.837+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4dac038040 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.837+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.837+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4da8098060 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac009050 con 0x7f4da8098060 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a33080 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4dac038040 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x561d61a2ea30 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.838+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db0026040 con 0x7f4da8098060 2024-05-15T18:08:57.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac045040 con 0x7f4da8098060 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a32320 con 0x561d61a2ea30 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a36350 con 0x561d61a2ea30 2024-05-15T18:08:57.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a36350 con 0x7f4dac038040 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.839+0000 7f4db9f2b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 zone default found 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 4 Realm: () 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 zonegroup default 2024-05-15T18:08:57.847 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a36770 con 0x7f4dac038040 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a36b90 con 0x561d61a33080 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a39270 con 0x561d61a33080 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 started sync module instance, tier type = 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.840+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a38710 con 0x7f4da8098060 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.842+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac045040 con 0x7f4da8098060 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.842+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94684192146016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a39610 con 0x7f4da8098060 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.842+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a39e60 con 0x561d61a2ea30 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.843+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94684192146016] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac045040 con 0x7f4da8098060 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.843+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.843+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94684192151984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3a280 con 0x561d61a2ea30 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.843+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3ac40 con 0x561d61a33080 2024-05-15T18:08:57.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.844+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94684192151984] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.844+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.844+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94684192153520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3ac40 con 0x561d61a33080 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.844+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3b600 con 0x7f4da8098060 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.845+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94684192153520] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.846+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac045040 con 0x7f4da8098060 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.846+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94684192158032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3b9a0 con 0x7f4da8098060 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.846+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3c420 con 0x561d61a2ea30 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.847+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.847+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94684192161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3ccf0 con 0x561d61a2ea30 2024-05-15T18:08:57.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.847+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3d7c0 con 0x7f4dac038040 2024-05-15T18:08:57.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.847+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94684192158032] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac045040 con 0x7f4da8098060 2024-05-15T18:08:57.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.848+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94684192161552] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.848+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.848+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94684192166576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3c7f0 con 0x7f4dac038040 2024-05-15T18:08:57.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.848+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3e060 con 0x7f4dac038040 2024-05-15T18:08:57.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.849+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94684192166576] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.849+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.849+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94684192155536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3c7f0 con 0x7f4dac038040 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.849+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3e670 con 0x7f4dac038040 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94684192170320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3eb20 con 0x7f4dac038040 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 20 add_watcher() i=0 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 20 add_watcher() i=1 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 20 add_watcher() i=2 2024-05-15T18:08:57.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 20 add_watcher() i=3 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 20 add_watcher() i=4 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 20 add_watcher() i=5 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94684192155536] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.850+0000 7f4db9f2b800 20 add_watcher() i=6 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.851+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94684192170320] v29'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.851+0000 7f4db9f2b800 20 add_watcher() i=7 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.851+0000 7f4db9f2b800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.851+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3eb20 con 0x561d61a2ea30 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.851+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.851+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94684192171632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3ea90 con 0x561d61a2ea30 2024-05-15T18:08:57.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.852+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94684192171632] v29'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.852+0000 7f4c677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4db9f2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4db9f2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4db9f2b800 5 note: GC not initialized 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4c667fc640 20 reqs_thread_entry: start 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4db9f2b800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4db9f2b800 20 Filter name: none 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4bd7fff640 20 reqs_thread_entry: start 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4db9f2b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.853+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x561d61a74b30 con 0x561d61a2ea30 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.854+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.854+0000 7f4db9f2b800 20 rados_obj.operate() r=0 bl.length=556 2024-05-15T18:08:57.855 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:57.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.854+0000 7f4c677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.854+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94684192171632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a73700 con 0x561d61a2ea30 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.855+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94684192171632] v29'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.855+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94684192146016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3e670 con 0x7f4da8098060 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.856+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94684192146016] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac045040 con 0x7f4da8098060 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.856+0000 7f4db9f2b800 20 remove_watcher() i=0 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.856+0000 7f4db9f2b800 2 removed watcher, disabling cache 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.856+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94684192151984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a38260 con 0x561d61a2ea30 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.857+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94684192151984] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.858+0000 7f4db9f2b800 20 remove_watcher() i=1 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.858+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94684192153520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a38260 con 0x561d61a33080 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.859+0000 7f4db5b59640 1 -- 172.21.15.173:0/110949078 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94684192153520] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da80a4070 con 0x561d61a33080 2024-05-15T18:08:57.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.859+0000 7f4db9f2b800 20 remove_watcher() i=2 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.859+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94684192158032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a39fb0 con 0x7f4da8098060 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.860+0000 7f4db5358640 1 -- 172.21.15.173:0/110949078 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94684192158032] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac045040 con 0x7f4da8098060 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.860+0000 7f4db9f2b800 20 remove_watcher() i=3 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.860+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94684192161552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a38260 con 0x561d61a2ea30 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.861+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94684192161552] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x561d61a2ea30 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.861+0000 7f4db9f2b800 20 remove_watcher() i=4 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.861+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94684192166576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a38260 con 0x7f4dac038040 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.862+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94684192166576] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.862+0000 7f4db9f2b800 20 remove_watcher() i=5 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.862+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94684192155536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a3d2b0 con 0x7f4dac038040 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.863+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94684192155536] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.863+0000 7f4db9f2b800 20 remove_watcher() i=6 2024-05-15T18:08:57.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.863+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94684192170320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x561d61a38260 con 0x7f4dac038040 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94684192170320] v29'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db00083e0 con 0x7f4dac038040 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 20 remove_watcher() i=7 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4dac038040 msgr2=0x7f4dac01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4dac038040 0x7f4dac01bab0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d61a2ea30 msgr2=0x561d61a30ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d61a2ea30 0x561d61a30ef0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f4da8098060 msgr2=0x7f4da8058650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f4da8098060 0x7f4da8058650 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d61a33080 msgr2=0x561d61a35470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d61a33080 0x561d61a35470 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c80036950 msgr2=0x7f4c80038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c80036950 0x7f4c80038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4dac001b60 tx=0x7f4dac010000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 msgr2=0x561d61a234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a234b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4da805cf10 tx=0x7f4da80071a0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db635a640 1 -- 172.21.15.173:0/110949078 reap_dead start 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 shutdown_connections 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/110949078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a1c0c0 0x561d61a234b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 >> 172.21.15.173:0/110949078 conn(0x561d61a18420 msgr2=0x561d61a15a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 shutdown_connections 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.864+0000 7f4db9f2b800 1 -- 172.21.15.173:0/110949078 wait complete. 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c90036950 msgr2=0x7f4c90038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c90036950 0x7f4c90038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00bf50 tx=0x7f4dac00f000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a0efd0 msgr2=0x561d61a0f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a0efd0 0x561d61a0f3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4da806fc00 tx=0x7f4da806f740 comp rx=0 tx=0).stop 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 shutdown_connections 2024-05-15T18:08:57.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c90036950 0x7f4c90038e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/2010291762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d61a0efd0 0x561d61a0f3f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 >> 172.21.15.173:0/2010291762 conn(0x561d61a03070 msgr2=0x561d61a03470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 shutdown_connections 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/2010291762 wait complete. 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561d619fdfb0 msgr2=0x561d61a003e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561d619fdfb0 0x561d61a003e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d618f4360 msgr2=0x561d619f7740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561d618f4360 0x561d619f7740 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d619fa020 msgr2=0x561d619fc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561d619fa020 0x561d619fc410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c9c036950 msgr2=0x7f4c9c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4c9c036950 0x7f4c9c038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4dac000f60 tx=0x7f4dac0012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 msgr2=0x561d619f0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 --2- 172.21.15.173:0/1747289693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561d618f3a00 0x561d619f0500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4da80526d0 tx=0x7f4da8003330 comp rx=0 tx=0).stop 2024-05-15T18:08:57.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db635a640 1 -- 172.21.15.173:0/1747289693 reap_dead start 2024-05-15T18:08:57.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 shutdown_connections 2024-05-15T18:08:57.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 >> 172.21.15.173:0/1747289693 conn(0x561d618ef5a0 msgr2=0x561d619e2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 shutdown_connections 2024-05-15T18:08:57.867 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.865+0000 7f4db9f2b800 1 -- 172.21.15.173:0/1747289693 wait complete. 2024-05-15T18:08:57.867 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:57.867 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-15T18:08:57.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-15T18:08:57.868 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-05-15T18:08:57.958 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:57.958 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:57.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4e251f800 1 Processor -- start 2024-05-15T18:08:57.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4e251f800 1 -- start start 2024-05-15T18:08:57.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4e251f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55c7fb5bcff0 0x55c7fb5bd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4e251f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7fb5bda90 con 0x55c7fb5be250 2024-05-15T18:08:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4e251f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55c7fb44f050 con 0x55c7fb5bcff0 2024-05-15T18:08:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4de1ca640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55c7fb5bcff0 0x55c7fb5bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4de1ca640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55c7fb5bcff0 0x55c7fb5bd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43964/0 (socket says 172.21.15.173:43964) 2024-05-15T18:08:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4de1ca640 1 -- 172.21.15.173:0/1899717947 learned_addr learned my addr 172.21.15.173:0/1899717947 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.982+0000 7fc4d7fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55c7fb5be250 0x55c7fb5be6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35278/0 (socket says 172.21.15.173:35278) 2024-05-15T18:08:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.983+0000 7fc4de1ca640 1 -- 172.21.15.173:0/1899717947 >> v1:172.21.15.3:6789/0 conn(0x55c7fb5be250 legacy=0x55c7fb5be6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.983+0000 7fc4de1ca640 1 -- 172.21.15.173:0/1899717947 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fb5bee10 con 0x55c7fb5bcff0 2024-05-15T18:08:57.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.984+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/1899717947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb5bd410 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000a520 tx=0x7fc4d001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdc42dd0be6330e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4dd9c9640 1 -- 172.21.15.173:0/1899717947 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0057070 con 0x55c7fb5bcff0 2024-05-15T18:08:57.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4dd9c9640 1 -- 172.21.15.173:0/1899717947 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0052570 con 0x55c7fb5bcff0 2024-05-15T18:08:57.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4dd9c9640 1 -- 172.21.15.173:0/1899717947 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0052870 con 0x55c7fb5bcff0 2024-05-15T18:08:57.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4e251f800 1 -- 172.21.15.173:0/1899717947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 msgr2=0x55c7fb5bd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4e251f800 1 --2- 172.21.15.173:0/1899717947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb5bd410 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000a520 tx=0x7fc4d001d010 comp rx=0 tx=0).stop 2024-05-15T18:08:57.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4e251f800 1 -- 172.21.15.173:0/1899717947 shutdown_connections 2024-05-15T18:08:57.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4e251f800 1 --2- 172.21.15.173:0/1899717947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb5bd410 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4e251f800 1 -- 172.21.15.173:0/1899717947 >> 172.21.15.173:0/1899717947 conn(0x55c7fb5b85d0 msgr2=0x55c7fb5ba9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4e251f800 1 -- 172.21.15.173:0/1899717947 shutdown_connections 2024-05-15T18:08:57.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.985+0000 7fc4e251f800 1 -- 172.21.15.173:0/1899717947 wait complete. 2024-05-15T18:08:57.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.998+0000 7fc4e251f800 1 Processor -- start 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.999+0000 7fc4e251f800 1 -- start start 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.999+0000 7fc4e251f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb530e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.999+0000 7fc4e251f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c7fb5091f0 con 0x55c7fb5bcff0 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.999+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb530e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.999+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb530e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43978/0 (socket says 172.21.15.173:43978) 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.999+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2337626637 learned_addr learned my addr 172.21.15.173:0/2337626637 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:57.999+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2337626637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fb6b2590 con 0x55c7fb5bcff0 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.000+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2337626637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb530e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc4d001d050 tx=0x7fc4d004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d917c88eec849582 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.000+0000 7fc3cc608640 1 -- 172.21.15.173:0/2337626637 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0057040 con 0x55c7fb5bcff0 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.000+0000 7fc3cc608640 1 -- 172.21.15.173:0/2337626637 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0052850 con 0x55c7fb5bcff0 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.000+0000 7fc3cc608640 1 -- 172.21.15.173:0/2337626637 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0052b70 con 0x55c7fb5bcff0 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 -- 172.21.15.173:0/2337626637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 msgr2=0x55c7fb530e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2337626637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb530e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc4d001d050 tx=0x7fc4d004c000 comp rx=0 tx=0).stop 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 -- 172.21.15.173:0/2337626637 shutdown_connections 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2337626637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb530e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 -- 172.21.15.173:0/2337626637 >> 172.21.15.173:0/2337626637 conn(0x55c7fb5b85d0 msgr2=0x55c7fb6aa080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 -- 172.21.15.173:0/2337626637 shutdown_connections 2024-05-15T18:08:57.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 -- 172.21.15.173:0/2337626637 wait complete. 2024-05-15T18:08:57.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 Processor -- start 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 -- start start 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb6afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4e251f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c7fb5c6720 con 0x55c7fb5bcff0 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb6afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb6afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43986/0 (socket says 172.21.15.173:43986) 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2226614982 learned_addr learned my addr 172.21.15.173:0/2226614982 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.001+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fb6ae5b0 con 0x55c7fb5bcff0 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.002+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb6afec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0000c00 tx=0x7fc4d0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.002+0000 7fc3cae05640 1 -- 172.21.15.173:0/2226614982 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0073070 con 0x55c7fb5bcff0 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.002+0000 7fc3cae05640 1 -- 172.21.15.173:0/2226614982 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d005d650 con 0x55c7fb5bcff0 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.002+0000 7fc3cae05640 1 -- 172.21.15.173:0/2226614982 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0057070 con 0x55c7fb5bcff0 2024-05-15T18:08:57.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.002+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fb6ae840 con 0x55c7fb5bcff0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.002+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fb6aedc0 con 0x55c7fb5bcff0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc3cae05640 1 -- 172.21.15.173:0/2226614982 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc4d0076070 con 0x55c7fb5bcff0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc3cae05640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3c4036900 0x7fc3c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc3cae05640 1 -- 172.21.15.173:0/2226614982 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc4d008dd50 con 0x55c7fb5bcff0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3c4036900 0x7fc3c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb5be250 0x55c7fb6c0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6c0d80 con 0x55c7fb5be250 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc4de9cb640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb5be250 0x55c7fb6c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.003+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3c4036900 0x7fc3c4038dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000f60 tx=0x7fc4c8001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4de9cb640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb5be250 0x55c7fb6c0840 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2226614982 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb5be250 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6c1600 con 0x55c7fb5be250 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2226614982 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb5be250 2024-05-15T18:08:57.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6c3030 0x55c7fb6c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6c5c50 con 0x55c7fb6c3030 2024-05-15T18:08:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6c3030 0x55c7fb6c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.004+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6c3030 0x55c7fb6c54c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.005+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2226614982 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4d0075030 con 0x55c7fb6c3030 2024-05-15T18:08:57.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.005+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6c1e80 con 0x55c7fb5be250 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.005+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2226614982 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb5be250 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.005+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c7fb6c7100 0x55c7fb6c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.005+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6c9cd0 con 0x55c7fb6c7100 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.005+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c7fb6c7100 0x55c7fb6c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.006+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c7fb6c7100 0x55c7fb6c9570 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.006+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2226614982 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4c800f690 con 0x55c7fb6c7100 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.006+0000 7fc4e251f800 1 Processor -- start 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.006+0000 7fc4e251f800 1 -- start start 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.006+0000 7fc4e251f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6d8130 0x55c7fb6d8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.006+0000 7fc4e251f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c7fb6b0400 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6d8130 0x55c7fb6d8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6d8130 0x55c7fb6d8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:43996/0 (socket says 172.21.15.173:43996) 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc4de1ca640 1 -- 172.21.15.173:0/3364547599 learned_addr learned my addr 172.21.15.173:0/3364547599 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc4de1ca640 1 -- 172.21.15.173:0/3364547599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fb6d8a90 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6d8130 0x55c7fb6d8550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc4d008c320 tx=0x7fc4d005ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc3c3fff640 1 -- 172.21.15.173:0/3364547599 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0076360 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc3c3fff640 1 -- 172.21.15.173:0/3364547599 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0090030 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fb6d9500 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc3c3fff640 1 -- 172.21.15.173:0/3364547599 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0076630 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.007+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fb6d9a00 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.008+0000 7fc3c3fff640 1 -- 172.21.15.173:0/3364547599 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc4d00767d0 con 0x55c7fb6d8130 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.008+0000 7fc3c3fff640 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3b8036900 0x7fc3b8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.008+0000 7fc3c3fff640 1 -- 172.21.15.173:0/3364547599 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc4d009a850 con 0x55c7fb6d8130 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.008+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3b8036900 0x7fc3b8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.008+0000 7fc4e251f800 1 Processor -- start 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.008+0000 7fc4e251f800 1 -- start start 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3b8036900 0x7fc3b8038dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c7fb6af1e0 tx=0x7fc4c800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4e251f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6e5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4e251f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c7fb4afcf0 con 0x55c7fb6e5330 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6e5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44002/0 (socket says 172.21.15.173:44002) 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4de1ca640 1 -- 172.21.15.173:0/1852580922 learned_addr learned my addr 172.21.15.173:0/1852580922 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4de1ca640 1 -- 172.21.15.173:0/1852580922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fb6e5d20 con 0x55c7fb6e5330 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/1852580922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6e5750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0095fd0 tx=0x7fc4d0077df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ddbb007cc9fbd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc3c1ffb640 1 -- 172.21.15.173:0/1852580922 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d00a9020 con 0x55c7fb6e5330 2024-05-15T18:08:58.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc3c1ffb640 1 -- 172.21.15.173:0/1852580922 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d008a070 con 0x55c7fb6e5330 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.009+0000 7fc3c1ffb640 1 -- 172.21.15.173:0/1852580922 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d005b750 con 0x55c7fb6e5330 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 -- 172.21.15.173:0/1852580922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 msgr2=0x55c7fb6e5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 --2- 172.21.15.173:0/1852580922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6e5750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0095fd0 tx=0x7fc4d0077df0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 -- 172.21.15.173:0/1852580922 shutdown_connections 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 --2- 172.21.15.173:0/1852580922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6e5750 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 -- 172.21.15.173:0/1852580922 >> 172.21.15.173:0/1852580922 conn(0x55c7fb6e1600 msgr2=0x55c7fb6df660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 -- 172.21.15.173:0/1852580922 shutdown_connections 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 -- 172.21.15.173:0/1852580922 wait complete. 2024-05-15T18:08:58.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 Processor -- start 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 -- start start 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.010+0000 7fc4e251f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c7fb6e6200 con 0x55c7fb6e5330 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc4de1ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6ec4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44004/0 (socket says 172.21.15.173:44004) 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 learned_addr learned my addr 172.21.15.173:0/2466434749 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fb6ec9e0 con 0x55c7fb6e5330 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6ec4a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0085610 tx=0x7fc4d006df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc3affff640 1 -- 172.21.15.173:0/2466434749 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d005bc00 con 0x55c7fb6e5330 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc3affff640 1 -- 172.21.15.173:0/2466434749 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d004c0e0 con 0x55c7fb6e5330 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc3affff640 1 -- 172.21.15.173:0/2466434749 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d006c4e0 con 0x55c7fb6e5330 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fb6ec9e0 con 0x55c7fb6e5330 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.011+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fb6ec9e0 con 0x55c7fb6e5330 2024-05-15T18:08:58.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.012+0000 7fc3affff640 1 -- 172.21.15.173:0/2466434749 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc4d00ac020 con 0x55c7fb6e5330 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.012+0000 7fc3affff640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3a8036900 0x7fc3a8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.012+0000 7fc3affff640 1 -- 172.21.15.173:0/2466434749 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc4d00b7070 con 0x55c7fb6e5330 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.012+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3a8036900 0x7fc3a8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.013+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3a8036900 0x7fc3a8038dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55c7fb6ca0d0 tx=0x7fc4c8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.013+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.013+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb6f7c80 0x55c7fb6fa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.013+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fa890 con 0x55c7fb6f7c80 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.013+0000 7fc4de9cb640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb6f7c80 0x55c7fb6fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.013+0000 7fc4de9cb640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb6f7c80 0x55c7fb6fa140 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 realm 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6faca0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb570 con 0x55c7fb6f7c80 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6fc670 0x55c7fb6fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6ff070 con 0x55c7fb6fc670 2024-05-15T18:08:58.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.014+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6fc670 0x55c7fb6fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6fc670 0x55c7fb6fea60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4e251f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4e251f800 20 searching for the correct realm 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7009a0 con 0x55c7fb6fc670 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4de1ca640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4d00ae050 0x7fc4d0088540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7009a0 con 0x7fc4d00ae050 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.015+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4d00ae050 0x7fc4d0088540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.016+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4d00ae050 0x7fc4d0088540 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.016+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.016+0000 7fc4d7fff640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4c800f070 0x7fc4c802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.016+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7009a0 con 0x7fc4c800f070 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.016+0000 7fc4de9cb640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4c800f070 0x7fc4c802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.016+0000 7fc4de9cb640 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4c800f070 0x7fc4c802e910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.017+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4d800a4a0 con 0x7fc4c800f070 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.017+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.017+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.017+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.017+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.017+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x7fc4c800f070 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x7fc4c800f070 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4d00ae050 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.018+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.019+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.019+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x7fc4c800f070 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.019+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.019+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.019+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4d00ae050 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.019+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.019+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x7fc4c800f070 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.020+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4d800a4a0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d8033040 con 0x7fc4c800f070 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.021+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4d00ae050 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.022+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.023+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.023+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.023+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.023+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4d00ae050 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.023+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.023+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6fc670 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.024+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.024+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4c800f070 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.024+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.024+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x55c7fb6f7c80 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.024+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.024+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6fb910 con 0x7fc4d00ae050 2024-05-15T18:08:58.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6ff930 con 0x55c7fb6f7c80 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6ffd20 con 0x55c7fb6f7c80 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.025+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb6ffd20 con 0x7fc4c800f070 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 zone default found 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 4 Realm: () 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 zonegroup default 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb700e20 con 0x7fc4c800f070 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb702800 con 0x55c7fb6fc670 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb702ba0 con 0x55c7fb6fc670 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 started sync module instance, tier type = 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.026+0000 7fc4e251f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.027+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb701ca0 con 0x7fc4d00ae050 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.027+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.027+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94317405280240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb702f40 con 0x7fc4d00ae050 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.028+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb703830 con 0x55c7fb6f7c80 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.028+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94317405280240] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.029+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.029+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94317405287136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb703c20 con 0x55c7fb6f7c80 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.029+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb704640 con 0x55c7fb6fc670 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.030+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94317405287136] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.030+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.030+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94317405290800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb704600 con 0x55c7fb6fc670 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.030+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7050d0 con 0x7fc4d00ae050 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.031+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94317405290800] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.031+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.031+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94317405282496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7054c0 con 0x7fc4d00ae050 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.031+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb705f30 con 0x55c7fb6f7c80 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.032+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94317405282496] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.032+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.032+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94317405297152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb706320 con 0x55c7fb6f7c80 2024-05-15T18:08:58.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.032+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb706d60 con 0x7fc4c800f070 2024-05-15T18:08:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.033+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94317405297152] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.033+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.033+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94317405300784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb706d20 con 0x7fc4c800f070 2024-05-15T18:08:58.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.034+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb707770 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.035+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94317405300784] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.035+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.035+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94317405293520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb707770 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.035+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb708130 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94317405293520] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94317405303488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb708310 con 0x7fc4c800f070 2024-05-15T18:08:58.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 20 add_watcher() i=0 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 20 add_watcher() i=1 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 20 add_watcher() i=2 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 20 add_watcher() i=3 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 20 add_watcher() i=4 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 20 add_watcher() i=5 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.036+0000 7fc4e251f800 20 add_watcher() i=6 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.037+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94317405303488] v29'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.037+0000 7fc4e251f800 20 add_watcher() i=7 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.037+0000 7fc4e251f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.037+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb70b4c0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.037+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.037+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94317405318736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb708260 con 0x55c7fb6f7c80 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.038+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94317405318736] v29'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.038+0000 7fc394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.038+0000 7fc4e251f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.038+0000 7fc4e251f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.038+0000 7fc4e251f800 5 note: GC not initialized 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc30f7fe640 20 reqs_thread_entry: start 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 20 Filter name: none 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc30d7fa640 20 reqs_thread_entry: start 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb73eaf0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 20 rados_obj.operate() r=0 bl.length=556 2024-05-15T18:08:58.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.039+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb73f6d0 con 0x7fc4d00ae050 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.040+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.040+0000 7fc4e251f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.040+0000 7fc4e251f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.040+0000 7fc4e251f800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.040+0000 7fc4e251f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.040+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7452b0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v29'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4e251f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4e251f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4e251f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94317405556128 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb741f70 con 0x55c7fb6f7c80 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94317405297152 notify 124554051591 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7fc4d801e040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc3c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94317405297152 notifier 4385 bl.length()=849 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(65 notify.4 [notify cookie 94317405556128 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc3c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc3c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc3c1ffb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc3a4003ea0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.041+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.042+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94317405556128 notify 124554051591 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc4d8018dd0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.042+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb744da0 con 0x7fc4d00ae050 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4e251f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4e251f800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4e251f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94317405556128 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb73faa0 con 0x7fc4d00ae050 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== watch-notify(notify (1) cookie 94317405280240 notify 124554051587 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fc4c8018040 con 0x7fc4d00ae050 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc3c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94317405280240 notifier 4385 bl.length()=166 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc3c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc3c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(68 notify.0 [notify cookie 94317405556128 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc3c1ffb640 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc3a4003ea0 con 0x7fc4d00ae050 2024-05-15T18:08:58.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.043+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.044+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== watch-notify(notify_complete (2) cookie 94317405556128 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc4c8009050 con 0x7fc4d00ae050 2024-05-15T18:08:58.042 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-15T18:08:58.040722Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:58.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.044+0000 7fc394fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.044+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94317405318736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb73ded0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.045+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94317405318736] v29'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.045+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94317405280240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb744da0 con 0x7fc4d00ae050 2024-05-15T18:08:58.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.046+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94317405280240] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.046+0000 7fc4e251f800 20 remove_watcher() i=0 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.046+0000 7fc4e251f800 2 removed watcher, disabling cache 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.046+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94317405287136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb744da0 con 0x55c7fb6f7c80 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.047+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94317405287136] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.047+0000 7fc4e251f800 20 remove_watcher() i=1 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.047+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94317405290800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7032e0 con 0x55c7fb6fc670 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.048+0000 7fc4de1ca640 1 -- 172.21.15.173:0/2466434749 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94317405290800] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d00c1020 con 0x55c7fb6fc670 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.048+0000 7fc4e251f800 20 remove_watcher() i=2 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.048+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94317405282496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb744da0 con 0x7fc4d00ae050 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.049+0000 7fc4d7fff640 1 -- 172.21.15.173:0/2466434749 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94317405282496] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8037040 con 0x7fc4d00ae050 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.049+0000 7fc4e251f800 20 remove_watcher() i=3 2024-05-15T18:08:58.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.049+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94317405297152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb704130 con 0x55c7fb6f7c80 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.050+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94317405297152] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x55c7fb6f7c80 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.050+0000 7fc4e251f800 20 remove_watcher() i=4 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.050+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94317405300784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7032e0 con 0x7fc4c800f070 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.051+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94317405300784] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.051+0000 7fc4e251f800 20 remove_watcher() i=5 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.051+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94317405293520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb7020c0 con 0x7fc4c800f070 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.052+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94317405293520] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.052+0000 7fc4e251f800 20 remove_watcher() i=6 2024-05-15T18:08:58.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.052+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94317405303488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55c7fb744da0 con 0x7fc4c800f070 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94317405303488] v29'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4d8031040 con 0x7fc4c800f070 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 20 remove_watcher() i=7 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4c800f070 msgr2=0x7fc4c802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4c800f070 0x7fc4c802e910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb6f7c80 msgr2=0x55c7fb6fa140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb6f7c80 0x55c7fb6fa140 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4d00ae050 msgr2=0x7fc4d0088540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4d00ae050 0x7fc4d0088540 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6fc670 msgr2=0x55c7fb6fea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6fc670 0x55c7fb6fea60 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3a8036900 msgr2=0x7fc3a8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3a8036900 0x7fc3a8038dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55c7fb6ca0d0 tx=0x7fc4c8010000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 msgr2=0x55c7fb6ec4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2466434749 reap_dead start 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6ec4a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0085610 tx=0x7fc4d006df20 comp rx=0 tx=0).stop 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 shutdown_connections 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2466434749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6e5330 0x55c7fb6ec4a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 >> 172.21.15.173:0/2466434749 conn(0x55c7fb6e1600 msgr2=0x55c7fb6dec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 shutdown_connections 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/2466434749 wait complete. 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3b8036900 msgr2=0x7fc3b8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3b8036900 0x7fc3b8038dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c7fb6af1e0 tx=0x7fc4c800f000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6d8130 msgr2=0x55c7fb6d8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6d8130 0x55c7fb6d8550 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc4d008c320 tx=0x7fc4d005ccf0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 shutdown_connections 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3b8036900 0x7fc3b8038dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 --2- 172.21.15.173:0/3364547599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb6d8130 0x55c7fb6d8550 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 >> 172.21.15.173:0/3364547599 conn(0x55c7fb6cc1d0 msgr2=0x55c7fb6cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 shutdown_connections 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.054+0000 7fc4e251f800 1 -- 172.21.15.173:0/3364547599 wait complete. 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c7fb6c7100 msgr2=0x55c7fb6c9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c7fb6c7100 0x55c7fb6c9570 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb5be250 msgr2=0x55c7fb6c0840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c7fb5be250 0x55c7fb6c0840 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6c3030 msgr2=0x55c7fb6c54c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c7fb6c3030 0x55c7fb6c54c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3c4036900 msgr2=0x7fc3c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3c4036900 0x7fc3c4038dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000f60 tx=0x7fc4c8001370 comp rx=0 tx=0).stop 2024-05-15T18:08:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 msgr2=0x55c7fb6afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 --2- 172.21.15.173:0/2226614982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c7fb5bcff0 0x55c7fb6afec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0000c00 tx=0x7fc4d0003020 comp rx=0 tx=0).stop 2024-05-15T18:08:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4de9cb640 1 -- 172.21.15.173:0/2226614982 reap_dead start 2024-05-15T18:08:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 shutdown_connections 2024-05-15T18:08:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 >> 172.21.15.173:0/2226614982 conn(0x55c7fb5b85d0 msgr2=0x55c7fb6a8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 shutdown_connections 2024-05-15T18:08:58.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.055+0000 7fc4e251f800 1 -- 172.21.15.173:0/2226614982 wait complete. 2024-05-15T18:08:58.054 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-15T18:08:58.040722Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:58.054 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:08:58.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:08:58.055 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:08:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:58.101 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.125+0000 7f6ecc698800 1 Processor -- start 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.125+0000 7f6ecc698800 1 -- start start 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.125+0000 7f6ecc698800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5566021db3e0 0x5566021dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.125+0000 7f6ecc698800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566021ddf50 con 0x55660214a010 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.125+0000 7f6ecc698800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x556602068050 con 0x5566021db3e0 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.126+0000 7f6ec9996640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5566021db3e0 0x5566021dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.126+0000 7f6ec9996640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5566021db3e0 0x5566021dd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44014/0 (socket says 172.21.15.173:44014) 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.126+0000 7f6ec9996640 1 -- 172.21.15.173:0/1307897136 learned_addr learned my addr 172.21.15.173:0/1307897136 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.126+0000 7f6ec9996640 1 -- 172.21.15.173:0/1307897136 >> v1:172.21.15.3:6789/0 conn(0x55660214a010 legacy=0x5566021d9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.126+0000 7f6ec9996640 1 -- 172.21.15.173:0/1307897136 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566021df180 con 0x5566021db3e0 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.128+0000 7f6ec9996640 1 --2- 172.21.15.173:0/1307897136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566021db3e0 0x5566021dd8a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000a520 tx=0x7f6ec001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453f4a8b6771face server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.128+0000 7f6ec9195640 1 -- 172.21.15.173:0/1307897136 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec0057070 con 0x5566021db3e0 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.128+0000 7f6ec9195640 1 -- 172.21.15.173:0/1307897136 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0052570 con 0x5566021db3e0 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.128+0000 7f6ec9195640 1 -- 172.21.15.173:0/1307897136 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec004ae60 con 0x5566021db3e0 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.129+0000 7f6ecc698800 1 -- 172.21.15.173:0/1307897136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566021db3e0 msgr2=0x5566021dd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.129+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1307897136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566021db3e0 0x5566021dd8a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000a520 tx=0x7f6ec001d010 comp rx=0 tx=0).stop 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.129+0000 7f6ecc698800 1 -- 172.21.15.173:0/1307897136 shutdown_connections 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.129+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1307897136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566021db3e0 0x5566021dd8a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.129+0000 7f6ecc698800 1 -- 172.21.15.173:0/1307897136 >> 172.21.15.173:0/1307897136 conn(0x5566021d15b0 msgr2=0x5566021d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.129+0000 7f6ecc698800 1 -- 172.21.15.173:0/1307897136 shutdown_connections 2024-05-15T18:08:58.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.129+0000 7f6ecc698800 1 -- 172.21.15.173:0/1307897136 wait complete. 2024-05-15T18:08:58.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.142+0000 7f6ecc698800 1 Processor -- start 2024-05-15T18:08:58.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.142+0000 7f6ecc698800 1 -- start start 2024-05-15T18:08:58.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.143+0000 7f6ecc698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.143+0000 7f6ecc698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5566021221d0 con 0x55660214a010 2024-05-15T18:08:58.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.143+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.143+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44026/0 (socket says 172.21.15.173:44026) 2024-05-15T18:08:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.143+0000 7f6eca197640 1 -- 172.21.15.173:0/717325146 learned_addr learned my addr 172.21.15.173:0/717325146 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.143+0000 7f6eca197640 1 -- 172.21.15.173:0/717325146 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566022c8c50 con 0x55660214a010 2024-05-15T18:08:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.143+0000 7f6eca197640 1 --2- 172.21.15.173:0/717325146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022c8680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001610 tx=0x7f6ebc006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3ca8631db71b19 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6db8608640 1 -- 172.21.15.173:0/717325146 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc016070 con 0x55660214a010 2024-05-15T18:08:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6db8608640 1 -- 172.21.15.173:0/717325146 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00f660 con 0x55660214a010 2024-05-15T18:08:58.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6db8608640 1 -- 172.21.15.173:0/717325146 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc00f980 con 0x55660214a010 2024-05-15T18:08:58.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6ecc698800 1 -- 172.21.15.173:0/717325146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 msgr2=0x5566022c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6ecc698800 1 --2- 172.21.15.173:0/717325146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022c8680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc001610 tx=0x7f6ebc006f90 comp rx=0 tx=0).stop 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6ecc698800 1 -- 172.21.15.173:0/717325146 shutdown_connections 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6ecc698800 1 --2- 172.21.15.173:0/717325146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022c8680 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6ecc698800 1 -- 172.21.15.173:0/717325146 >> 172.21.15.173:0/717325146 conn(0x5566021d15b0 msgr2=0x5566022c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6ecc698800 1 -- 172.21.15.173:0/717325146 shutdown_connections 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.144+0000 7f6ecc698800 1 -- 172.21.15.173:0/717325146 wait complete. 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6ecc698800 1 Processor -- start 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6ecc698800 1 -- start start 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6ecc698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6ecc698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5566021de420 con 0x55660214a010 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44036/0 (socket says 172.21.15.173:44036) 2024-05-15T18:08:58.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6eca197640 1 -- 172.21.15.173:0/3362520914 learned_addr learned my addr 172.21.15.173:0/3362520914 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6eca197640 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566022d0730 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.145+0000 7f6eca197640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022d01f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc003000 tx=0x7f6ebc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.146+0000 7f6db6e05640 1 -- 172.21.15.173:0/3362520914 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc016070 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.146+0000 7f6db6e05640 1 -- 172.21.15.173:0/3362520914 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc022070 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.146+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566022d09c0 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.146+0000 7f6db6e05640 1 -- 172.21.15.173:0/3362520914 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc011780 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.146+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566022d3670 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.146+0000 7f6db6e05640 1 -- 172.21.15.173:0/3362520914 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6ebc011a30 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6db6e05640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6db0036900 0x7f6db0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6db6e05640 1 -- 172.21.15.173:0/3362520914 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6ebc04c1c0 con 0x55660214a010 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6ec9996640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6db0036900 0x7f6db0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5566021db3e0 0x5566022d7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566022d7970 con 0x5566021db3e0 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6eca998640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5566021db3e0 0x5566022d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6ec9996640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6db0036900 0x7f6db0038dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0054000 tx=0x7f6ec004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6eca998640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5566021db3e0 0x5566022d7430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6eca998640 1 -- 172.21.15.173:0/3362520914 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x5566021db3e0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.147+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566022d49e0 con 0x5566021db3e0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.148+0000 7f6eca998640 1 -- 172.21.15.173:0/3362520914 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ec40083e0 con 0x5566021db3e0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.148+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5566022d9c80 0x5566022dc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.148+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566022dc760 con 0x5566022d9c80 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.148+0000 7f6eca197640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5566022d9c80 0x5566022dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.148+0000 7f6eca197640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5566022d9c80 0x5566022dc070 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.148+0000 7f6eca197640 1 -- 172.21.15.173:0/3362520914 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6ebc00f070 con 0x5566022d9c80 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.148+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566022d8c30 con 0x5566021db3e0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.149+0000 7f6eca998640 1 -- 172.21.15.173:0/3362520914 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ec40083e0 con 0x5566021db3e0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.149+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5566022ddbc0 0x5566022e0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.149+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566022e0790 con 0x5566022ddbc0 2024-05-15T18:08:58.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.149+0000 7f6ec9996640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5566022ddbc0 0x5566022e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.149+0000 7f6ec9996640 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5566022ddbc0 0x5566022e0030 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6ec9996640 1 -- 172.21.15.173:0/3362520914 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ec005a040 con 0x5566022ddbc0 2024-05-15T18:08:58.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6ecc698800 1 Processor -- start 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6ecc698800 1 -- start start 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6ecc698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022eebd0 0x5566022eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6ecc698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5566020c8cf0 con 0x5566022eebd0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022eebd0 0x5566022eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022eebd0 0x5566022eeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44052/0 (socket says 172.21.15.173:44052) 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.150+0000 7f6eca197640 1 -- 172.21.15.173:0/2216274214 learned_addr learned my addr 172.21.15.173:0/2216274214 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.151+0000 7f6eca197640 1 -- 172.21.15.173:0/2216274214 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566022ef530 con 0x5566022eebd0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.151+0000 7f6eca197640 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022eebd0 0x5566022eeff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc005fd0 tx=0x7f6ebc01cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.151+0000 7f6daffff640 1 -- 172.21.15.173:0/2216274214 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc025bb0 con 0x5566022eebd0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.151+0000 7f6daffff640 1 -- 172.21.15.173:0/2216274214 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc01de50 con 0x5566022eebd0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.151+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566022effa0 con 0x5566022eebd0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.151+0000 7f6daffff640 1 -- 172.21.15.173:0/2216274214 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc025e80 con 0x5566022eebd0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.151+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566022f04a0 con 0x5566022eebd0 2024-05-15T18:08:58.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.152+0000 7f6daffff640 1 -- 172.21.15.173:0/2216274214 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6ebc043df0 con 0x5566022eebd0 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.152+0000 7f6daffff640 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6da4036b60 0x7f6da4039020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.152+0000 7f6daffff640 1 -- 172.21.15.173:0/2216274214 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6ebc04dc50 con 0x5566022eebd0 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.152+0000 7f6ec9996640 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6da4036b60 0x7f6da4039020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.152+0000 7f6ecc698800 1 Processor -- start 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.152+0000 7f6ecc698800 1 -- start start 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.152+0000 7f6ec9996640 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6da4036b60 0x7f6da4039020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5566022d8c00 tx=0x7f6ec0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6ecc698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566022fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6ecc698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5566022c8fd0 con 0x5566022fbd90 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566022fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566022fc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44062/0 (socket says 172.21.15.173:44062) 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6eca197640 1 -- 172.21.15.173:0/3741571544 learned_addr learned my addr 172.21.15.173:0/3741571544 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6eca197640 1 -- 172.21.15.173:0/3741571544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566022fc780 con 0x5566022fbd90 2024-05-15T18:08:58.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6eca197640 1 --2- 172.21.15.173:0/3741571544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566022fc1b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc024620 tx=0x7f6ebc0243d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9c23be9572206 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6dadffb640 1 -- 172.21.15.173:0/3741571544 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc05b070 con 0x5566022fbd90 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6dadffb640 1 -- 172.21.15.173:0/3741571544 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc026e20 con 0x5566022fbd90 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.153+0000 7f6dadffb640 1 -- 172.21.15.173:0/3741571544 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc03e070 con 0x5566022fbd90 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 -- 172.21.15.173:0/3741571544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 msgr2=0x5566022fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3741571544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566022fc1b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc024620 tx=0x7f6ebc0243d0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 -- 172.21.15.173:0/3741571544 shutdown_connections 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3741571544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566022fc1b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 -- 172.21.15.173:0/3741571544 >> 172.21.15.173:0/3741571544 conn(0x5566022f8060 msgr2=0x5566022f60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 -- 172.21.15.173:0/3741571544 shutdown_connections 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 -- 172.21.15.173:0/3741571544 wait complete. 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 Processor -- start 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 -- start start 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566023031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6ecc698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5566022fce50 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566023031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6eca197640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566023031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44074/0 (socket says 172.21.15.173:44074) 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.154+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 learned_addr learned my addr 172.21.15.173:0/1617209756 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.155+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556602303730 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.155+0000 7f6eca197640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566023031f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0444e0 tx=0x7f6ebc03eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.155+0000 7f6d9bfff640 1 -- 172.21.15.173:0/1617209756 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc066020 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.155+0000 7f6d9bfff640 1 -- 172.21.15.173:0/1617209756 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc01dbc0 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.155+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556602303730 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.155+0000 7f6d9bfff640 1 -- 172.21.15.173:0/1617209756 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ebc05b040 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.155+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556602303730 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.156+0000 7f6d9bfff640 1 -- 172.21.15.173:0/1617209756 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6ebc069020 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.156+0000 7f6d9bfff640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d94036900 0x7f6d94038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.156+0000 7f6d9bfff640 1 -- 172.21.15.173:0/1617209756 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f6ebc06cab0 con 0x5566022fbd90 2024-05-15T18:08:58.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.156+0000 7f6ec9996640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d94036900 0x7f6d94038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55660230e880 0x556602310d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602311490 con 0x55660230e880 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ec9996640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d94036900 0x7f6d94038dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0052fd0 tx=0x7f6ec004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6eca998640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55660230e880 0x556602310d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6eca998640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55660230e880 0x556602310d40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 20 realm 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566023118a0 con 0x55660230e880 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.157+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x55660230e880 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6ecc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602312510 con 0x55660230e880 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6ecc698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556602312ed0 0x5566023152c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602315800 con 0x556602312ed0 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6eca197640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556602312ed0 0x5566023152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.158+0000 7f6eca197640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556602312ed0 0x5566023152c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6ecc698800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6ecc698800 20 searching for the correct realm 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566023171e0 con 0x556602312ed0 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6eca197640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6ebc06b020 0x7f6ebc04ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566023171e0 con 0x7f6ebc06b020 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.159+0000 7f6ec9996640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6ebc06b020 0x7f6ebc04ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.160+0000 7f6ec9996640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6ebc06b020 0x7f6ebc04ca00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.160+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.160+0000 7f6ec9996640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6ec0074040 0x7f6ec0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.160+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5566023171e0 con 0x7f6ec0074040 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.160+0000 7f6eca998640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6ec0074040 0x7f6ec0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.161+0000 7f6eca998640 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6ec0074040 0x7f6ec0081410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.161+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.161+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x55660230e880 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.161+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.161+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x55660230e880 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.161+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.161+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x7f6ec0074040 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x7f6ec0074040 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x7f6ebc06b020 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x556602312ed0 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.162+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x55660230e880 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec4026040 con 0x7f6ec0074040 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec4026040 con 0x55660230e880 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec4026040 con 0x7f6ebc06b020 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.163+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x556602312ed0 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x556602312ed0 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ec0074040 2024-05-15T18:08:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x556602312ed0 2024-05-15T18:08:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.164+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x556602312ed0 2024-05-15T18:08:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x55660230e880 2024-05-15T18:08:58.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x55660230e880 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ec0074040 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.165+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x556602312ed0 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ebc06b020 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x55660230e880 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ec0074040 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.166+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x556602312ed0 2024-05-15T18:08:58.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ec0074040 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ebc06b020 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x556602312ed0 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.167+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ec0074040 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.168+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.168+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x55660230e880 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.168+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.168+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f6ec008e060 con 0x7f6ebc06b020 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602312170 con 0x55660230e880 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602316170 con 0x55660230e880 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602316170 con 0x7f6ec0074040 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 zone default found 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 4 Realm: () 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 zonegroup default 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.169+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602316590 con 0x7f6ec0074040 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5566023169b0 con 0x556602312ed0 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602319090 con 0x556602312ed0 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 20 started sync module instance, tier type = 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.170+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556602318530 con 0x7f6ebc06b020 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.171+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.171+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93896611823744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556602319430 con 0x7f6ebc06b020 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.171+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556602319c80 con 0x55660230e880 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.172+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93896611823744] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.172+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.173+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93896611829712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231a0a0 con 0x55660230e880 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.173+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231a970 con 0x556602312ed0 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.174+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.174+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93896611832480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231b210 con 0x556602312ed0 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.174+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231bd00 con 0x7f6ebc06b020 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.174+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93896611829712] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.175+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.175+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93896611837904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231c0f0 con 0x7f6ebc06b020 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.175+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231cb10 con 0x55660230e880 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.175+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93896611832480] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.176+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.176+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93896611841536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231cf00 con 0x55660230e880 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.176+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93896611837904] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.176+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556602319bf0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.177+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93896611841536] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.177+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.177+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93896611835232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556602319bf0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.177+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231ddf0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.178+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.178+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93896611846336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231e260 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.178+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231ed40 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.178+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93896611835232] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93896611846336] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93896611850320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231ddb0 con 0x7f6ec0074040 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 20 add_watcher() i=0 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 20 add_watcher() i=1 2024-05-15T18:08:58.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 20 add_watcher() i=2 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 20 add_watcher() i=3 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 20 add_watcher() i=4 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 20 add_watcher() i=5 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.179+0000 7f6ecc698800 20 add_watcher() i=6 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.180+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93896611850320] v29'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.180+0000 7f6ecc698800 20 add_watcher() i=7 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.180+0000 7f6ecc698800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.180+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55660231ddb0 con 0x55660230e880 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.180+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.180+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93896611845136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231ddb0 con 0x55660230e880 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.181+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93896611845136] v29'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.181+0000 7f6d80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.181+0000 7f6ecc698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6ecc698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6ecc698800 5 note: GC not initialized 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6cfb7fe640 20 reqs_thread_entry: start 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6ecc698800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6ecc698800 20 Filter name: none 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6cf97fa640 20 reqs_thread_entry: start 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6ecc698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556602354cc0 con 0x55660230e880 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.182+0000 7f6ecc698800 20 rados_obj.operate() r=0 bl.length=673 2024-05-15T18:08:58.169 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-15T18:08:58.040722Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.183+0000 7f6d80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.183+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93896611845136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566023550a0 con 0x55660230e880 2024-05-15T18:08:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.184+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93896611845136] v29'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.184+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93896611823744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231d410 con 0x7f6ebc06b020 2024-05-15T18:08:58.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.185+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93896611823744] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.185+0000 7f6ecc698800 20 remove_watcher() i=0 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.185+0000 7f6ecc698800 2 removed watcher, disabling cache 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.185+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93896611829712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231d410 con 0x55660230e880 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.186+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93896611829712] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.186+0000 7f6ecc698800 20 remove_watcher() i=1 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.186+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93896611832480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566023197d0 con 0x556602312ed0 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.187+0000 7f6eca197640 1 -- 172.21.15.173:0/1617209756 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93896611832480] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ebc05e040 con 0x556602312ed0 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.187+0000 7f6ecc698800 20 remove_watcher() i=2 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.187+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93896611837904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231d410 con 0x7f6ebc06b020 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.188+0000 7f6ec9996640 1 -- 172.21.15.173:0/1617209756 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93896611837904] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec007f070 con 0x7f6ebc06b020 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.188+0000 7f6ecc698800 20 remove_watcher() i=3 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.188+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93896611841536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566023197d0 con 0x55660230e880 2024-05-15T18:08:58.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.189+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93896611841536] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x55660230e880 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.189+0000 7f6ecc698800 20 remove_watcher() i=4 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.189+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93896611835232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231d410 con 0x7f6ec0074040 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.190+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93896611835232] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.190+0000 7f6ecc698800 20 remove_watcher() i=5 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.190+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93896611846336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5566023197d0 con 0x7f6ec0074040 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.191+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93896611846336] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.191+0000 7f6ecc698800 20 remove_watcher() i=6 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.191+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93896611850320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55660231ad60 con 0x7f6ec0074040 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93896611850320] v29'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ec40083e0 con 0x7f6ec0074040 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 20 remove_watcher() i=7 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6ec0074040 msgr2=0x7f6ec0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6ec0074040 0x7f6ec0081410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55660230e880 msgr2=0x556602310d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55660230e880 0x556602310d40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6ebc06b020 msgr2=0x7f6ebc04ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6ebc06b020 0x7f6ebc04ca00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556602312ed0 msgr2=0x5566023152c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.192+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556602312ed0 0x5566023152c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d94036900 msgr2=0x7f6d94038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d94036900 0x7f6d94038dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0052fd0 tx=0x7f6ec004f000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6eca998640 1 -- 172.21.15.173:0/1617209756 reap_dead start 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 msgr2=0x5566023031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566023031f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0444e0 tx=0x7f6ebc03eb60 comp rx=0 tx=0).stop 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 shutdown_connections 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/1617209756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022fbd90 0x5566023031f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 >> 172.21.15.173:0/1617209756 conn(0x5566022f8060 msgr2=0x5566022f56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 shutdown_connections 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/1617209756 wait complete. 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6da4036b60 msgr2=0x7f6da4039020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6da4036b60 0x7f6da4039020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5566022d8c00 tx=0x7f6ec0005ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022eebd0 msgr2=0x5566022eeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022eebd0 0x5566022eeff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc005fd0 tx=0x7f6ebc01cf90 comp rx=0 tx=0).stop 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 shutdown_connections 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6da4036b60 0x7f6da4039020 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/2216274214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5566022eebd0 0x5566022eeff0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 >> 172.21.15.173:0/2216274214 conn(0x5566022e2c70 msgr2=0x5566022e3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 shutdown_connections 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/2216274214 wait complete. 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5566022ddbc0 msgr2=0x5566022e0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5566022ddbc0 0x5566022e0030 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5566021db3e0 msgr2=0x5566022d7430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5566021db3e0 0x5566022d7430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5566022d9c80 msgr2=0x5566022dc070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5566022d9c80 0x5566022dc070 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.193+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6db0036900 msgr2=0x7f6db0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6db0036900 0x7f6db0038dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0054000 tx=0x7f6ec004e000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 msgr2=0x5566022d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6ecc698800 1 --2- 172.21.15.173:0/3362520914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55660214a010 0x5566022d01f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc003000 tx=0x7f6ebc000f40 comp rx=0 tx=0).stop 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6eca998640 1 -- 172.21.15.173:0/3362520914 reap_dead start 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 shutdown_connections 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 >> 172.21.15.173:0/3362520914 conn(0x5566021d15b0 msgr2=0x5566022c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 shutdown_connections 2024-05-15T18:08:58.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.194+0000 7f6ecc698800 1 -- 172.21.15.173:0/3362520914 wait complete. 2024-05-15T18:08:58.181 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-15T18:08:58.040722Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:58.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-15T18:08:58.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-15T18:08:58.182 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-05-15T18:08:58.228 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:58.228 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:58.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.252+0000 7f20b7546800 1 Processor -- start 2024-05-15T18:08:58.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.252+0000 7f20b7546800 1 -- start start 2024-05-15T18:08:58.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.252+0000 7f20b7546800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e4b2a60a10 0x55e4b2a60e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.252+0000 7f20b7546800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4b29d5a50 con 0x55e4b2a61370 2024-05-15T18:08:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.252+0000 7f20b7546800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55e4b28f3050 con 0x55e4b2a60a10 2024-05-15T18:08:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.253+0000 7f20b5045640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e4b2a60a10 0x55e4b2a60e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.253+0000 7f20b5045640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e4b2a60a10 0x55e4b2a60e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44080/0 (socket says 172.21.15.173:44080) 2024-05-15T18:08:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.253+0000 7f20b5045640 1 -- 172.21.15.173:0/1984298234 learned_addr learned my addr 172.21.15.173:0/1984298234 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.253+0000 7f20b5045640 1 -- 172.21.15.173:0/1984298234 >> v1:172.21.15.3:6789/0 conn(0x55e4b2a61370 legacy=0x55e4b2a61820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.253+0000 7f20b5045640 1 -- 172.21.15.173:0/1984298234 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b2a61f30 con 0x55e4b2a60a10 2024-05-15T18:08:58.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.255+0000 7f20b5045640 1 --2- 172.21.15.173:0/1984298234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2a60e30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20a8005fd0 tx=0x7f20a801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b0594dc4ae2660 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.255+0000 7f20a7fff640 1 -- 172.21.15.173:0/1984298234 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8052540 con 0x55e4b2a60a10 2024-05-15T18:08:58.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.255+0000 7f20a7fff640 1 -- 172.21.15.173:0/1984298234 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a804e070 con 0x55e4b2a60a10 2024-05-15T18:08:58.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.255+0000 7f20a7fff640 1 -- 172.21.15.173:0/1984298234 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8052890 con 0x55e4b2a60a10 2024-05-15T18:08:58.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.255+0000 7f20b7546800 1 -- 172.21.15.173:0/1984298234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 msgr2=0x55e4b2a60e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.255+0000 7f20b7546800 1 --2- 172.21.15.173:0/1984298234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2a60e30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f20a8005fd0 tx=0x7f20a801cd80 comp rx=0 tx=0).stop 2024-05-15T18:08:58.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.256+0000 7f20b7546800 1 -- 172.21.15.173:0/1984298234 shutdown_connections 2024-05-15T18:08:58.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.256+0000 7f20b7546800 1 --2- 172.21.15.173:0/1984298234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2a60e30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.256+0000 7f20b7546800 1 -- 172.21.15.173:0/1984298234 >> 172.21.15.173:0/1984298234 conn(0x55e4b2a5c5b0 msgr2=0x55e4b2a5e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.256+0000 7f20b7546800 1 -- 172.21.15.173:0/1984298234 shutdown_connections 2024-05-15T18:08:58.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.256+0000 7f20b7546800 1 -- 172.21.15.173:0/1984298234 wait complete. 2024-05-15T18:08:58.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.269+0000 7f20b7546800 1 Processor -- start 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.269+0000 7f20b7546800 1 -- start start 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.269+0000 7f20b7546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b55ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.269+0000 7f20b7546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4b29ad1c0 con 0x55e4b2a60a10 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b55ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b55ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44090/0 (socket says 172.21.15.173:44090) 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f20b5045640 1 -- 172.21.15.173:0/4018553498 learned_addr learned my addr 172.21.15.173:0/4018553498 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f20b5045640 1 -- 172.21.15.173:0/4018553498 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b2b56080 con 0x55e4b2a60a10 2024-05-15T18:08:58.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f20b5045640 1 --2- 172.21.15.173:0/4018553498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b55ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20a801ba70 tx=0x7f20a804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ee85571130d5e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f1fa3606640 1 -- 172.21.15.173:0/4018553498 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8052820 con 0x55e4b2a60a10 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f1fa3606640 1 -- 172.21.15.173:0/4018553498 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a8062070 con 0x55e4b2a60a10 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.270+0000 7f1fa3606640 1 -- 172.21.15.173:0/4018553498 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8052b10 con 0x55e4b2a60a10 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 -- 172.21.15.173:0/4018553498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 msgr2=0x55e4b2b55ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 --2- 172.21.15.173:0/4018553498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b55ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20a801ba70 tx=0x7f20a804c000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 -- 172.21.15.173:0/4018553498 shutdown_connections 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 --2- 172.21.15.173:0/4018553498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b55ab0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 -- 172.21.15.173:0/4018553498 >> 172.21.15.173:0/4018553498 conn(0x55e4b2a5c5b0 msgr2=0x55e4b2b513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 -- 172.21.15.173:0/4018553498 shutdown_connections 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 -- 172.21.15.173:0/4018553498 wait complete. 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 Processor -- start 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.271+0000 7f20b7546800 1 -- start start 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b7546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b5d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b7546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4b2a62460 con 0x55e4b2a60a10 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b5d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b5d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44092/0 (socket says 172.21.15.173:44092) 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b5045640 1 -- 172.21.15.173:0/649848466 learned_addr learned my addr 172.21.15.173:0/649848466 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b5045640 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b2b5da00 con 0x55e4b2a60a10 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b5045640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b5d4c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20a800a190 tx=0x7f20a8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f1fa1e03640 1 -- 172.21.15.173:0/649848466 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8071570 con 0x55e4b2a60a10 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f1fa1e03640 1 -- 172.21.15.173:0/649848466 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a8058040 con 0x55e4b2a60a10 2024-05-15T18:08:58.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.272+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4b2b5dc90 con 0x55e4b2a60a10 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.273+0000 7f1fa1e03640 1 -- 172.21.15.173:0/649848466 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8071840 con 0x55e4b2a60a10 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.273+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4b2b60940 con 0x55e4b2a60a10 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.273+0000 7f1fa1e03640 1 -- 172.21.15.173:0/649848466 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20a8050070 con 0x55e4b2a60a10 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f1fa1e03640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f9c036900 0x7f1f9c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f1fa1e03640 1 -- 172.21.15.173:0/649848466 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f20a808e520 con 0x55e4b2a60a10 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b4844640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f9c036900 0x7f1f9c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2a61370 0x55e4b2b64700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b64c80 con 0x55e4b2a61370 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b5846640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2a61370 0x55e4b2b64700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b4844640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f9c036900 0x7f1f9c038dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001e10 tx=0x7f20ac001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b5846640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2a61370 0x55e4b2b64700 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b5846640 1 -- 172.21.15.173:0/649848466 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2a61370 2024-05-15T18:08:58.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.274+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b61cd0 con 0x55e4b2a61370 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.275+0000 7f20b5846640 1 -- 172.21.15.173:0/649848466 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2a61370 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.275+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b66f90 0x55e4b2b69380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.275+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b69a70 con 0x55e4b2b66f90 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.275+0000 7f20b5045640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b66f90 0x55e4b2b69380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.275+0000 7f20b5045640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b66f90 0x55e4b2b69380 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.275+0000 7f20b5045640 1 -- 172.21.15.173:0/649848466 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b66f90 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.275+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b65f40 con 0x55e4b2a61370 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.276+0000 7f20b5846640 1 -- 172.21.15.173:0/649848466 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2a61370 2024-05-15T18:08:58.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.276+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4b2b6af20 0x55e4b2b6d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.276+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b6dae0 con 0x55e4b2b6af20 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.276+0000 7f20b4844640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4b2b6af20 0x55e4b2b6d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.276+0000 7f20b4844640 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4b2b6af20 0x55e4b2b6d350 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.277+0000 7f20b4844640 1 -- 172.21.15.173:0/649848466 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20ac0106a0 con 0x55e4b2b6af20 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.277+0000 7f20b7546800 1 Processor -- start 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.277+0000 7f20b7546800 1 -- start start 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b7546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b7bf40 0x55e4b2b7c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b7546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4b2953cf0 con 0x55e4b2b7bf40 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b7bf40 0x55e4b2b7c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b7bf40 0x55e4b2b7c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44108/0 (socket says 172.21.15.173:44108) 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b5045640 1 -- 172.21.15.173:0/3713923079 learned_addr learned my addr 172.21.15.173:0/3713923079 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b5045640 1 -- 172.21.15.173:0/3713923079 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b2b7c8a0 con 0x55e4b2b7bf40 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b5045640 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b7bf40 0x55e4b2b7c360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20a808caa0 tx=0x7f20a8070e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f1f9affd640 1 -- 172.21.15.173:0/3713923079 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8092020 con 0x55e4b2b7bf40 2024-05-15T18:08:58.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f1f9affd640 1 -- 172.21.15.173:0/3713923079 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a8070560 con 0x55e4b2b7bf40 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4b2b7d310 con 0x55e4b2b7bf40 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f1f9affd640 1 -- 172.21.15.173:0/3713923079 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a808e1c0 con 0x55e4b2b7bf40 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.278+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4b2b7d810 con 0x55e4b2b7bf40 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.279+0000 7f1f9affd640 1 -- 172.21.15.173:0/3713923079 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20a8095020 con 0x55e4b2b7bf40 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.279+0000 7f1f9affd640 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f8c036900 0x7f1f8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.279+0000 7f1f9affd640 1 -- 172.21.15.173:0/3713923079 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f20a808b050 con 0x55e4b2b7bf40 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.279+0000 7f20b4844640 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f8c036900 0x7f1f8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.279+0000 7f20b7546800 1 Processor -- start 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b7546800 1 -- start start 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b4844640 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f8c036900 0x7f1f8c038dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55e4b2b65110 tx=0x7f20ac006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b7546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b7546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4b2b56340 con 0x55e4b2b890a0 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b894c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44116/0 (socket says 172.21.15.173:44116) 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b5045640 1 -- 172.21.15.173:0/818803322 learned_addr learned my addr 172.21.15.173:0/818803322 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b5045640 1 -- 172.21.15.173:0/818803322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b2b89a90 con 0x55e4b2b890a0 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f20b5045640 1 --2- 172.21.15.173:0/818803322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b894c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20a80722c0 tx=0x7f20a8067800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffbdcc020c4b39b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.280+0000 7f1f98ff9640 1 -- 172.21.15.173:0/818803322 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80657d0 con 0x55e4b2b890a0 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f1f98ff9640 1 -- 172.21.15.173:0/818803322 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a8072840 con 0x55e4b2b890a0 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f1f98ff9640 1 -- 172.21.15.173:0/818803322 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8066ab0 con 0x55e4b2b890a0 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 -- 172.21.15.173:0/818803322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 msgr2=0x55e4b2b894c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 --2- 172.21.15.173:0/818803322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b894c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20a80722c0 tx=0x7f20a8067800 comp rx=0 tx=0).stop 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 -- 172.21.15.173:0/818803322 shutdown_connections 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 --2- 172.21.15.173:0/818803322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b894c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 -- 172.21.15.173:0/818803322 >> 172.21.15.173:0/818803322 conn(0x55e4b2b853c0 msgr2=0x55e4b2b83420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 -- 172.21.15.173:0/818803322 shutdown_connections 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 -- 172.21.15.173:0/818803322 wait complete. 2024-05-15T18:08:58.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 Processor -- start 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 -- start start 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b90350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.281+0000 7f20b7546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4b2b89a90 con 0x55e4b2b890a0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b90350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f20b5045640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b90350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44130/0 (socket says 172.21.15.173:44130) 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 learned_addr learned my addr 172.21.15.173:0/2530955985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b2b90890 con 0x55e4b2b890a0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f20b5045640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b90350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20a809a570 tx=0x7f20a8056fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f1f8affd640 1 -- 172.21.15.173:0/2530955985 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80657d0 con 0x55e4b2b890a0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f1f8affd640 1 -- 172.21.15.173:0/2530955985 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80bb070 con 0x55e4b2b890a0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4b2b90890 con 0x55e4b2b890a0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f1f8affd640 1 -- 172.21.15.173:0/2530955985 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a8071ab0 con 0x55e4b2b890a0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.282+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4b2b90890 con 0x55e4b2b890a0 2024-05-15T18:08:58.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.283+0000 7f1f8affd640 1 -- 172.21.15.173:0/2530955985 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20a8070950 con 0x55e4b2b890a0 2024-05-15T18:08:58.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.283+0000 7f1f8affd640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f80036900 0x7f1f80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.283+0000 7f1f8affd640 1 -- 172.21.15.173:0/2530955985 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f20a80c1b10 con 0x55e4b2b890a0 2024-05-15T18:08:58.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.284+0000 7f20b4844640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f80036900 0x7f1f80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.284+0000 7f20b4844640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f80036900 0x7f1f80038dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55e4b2b6dee0 tx=0x7f20ac011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.284+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.284+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2b9b8d0 0x55e4b2b9dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.284+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9e4e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.284+0000 7f20b5846640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2b9b8d0 0x55e4b2b9dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.284+0000 7f20b5846640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2b9b8d0 0x55e4b2b9dd90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 realm 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9e8f0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f560 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b9ff20 0x55e4b2ba2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba2960 con 0x55e4b2b9ff20 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.285+0000 7f20b5045640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b9ff20 0x55e4b2ba2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b5045640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b9ff20 0x55e4b2ba2310 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b7546800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b7546800 20 searching for the correct realm 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba4270 con 0x55e4b2b9ff20 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b5045640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f20a8097020 0x7f20a80ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.286+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba4270 con 0x7f20a8097020 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.287+0000 7f20b4844640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f20a8097020 0x7f20a80ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.287+0000 7f20b4844640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f20a8097020 0x7f20a80ab870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.287+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.287+0000 7f20b4844640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f20ac0393c0 0x7f20ac039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.287+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba4270 con 0x7f20ac0393c0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.287+0000 7f20b5846640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f20ac0393c0 0x7f20ac039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.288+0000 7f20b5846640 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f20ac0393c0 0x7f20ac039810 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.288+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.288+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.288+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.288+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.288+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.288+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x7f20ac0393c0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x7f20ac0393c0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x7f20a8097020 2024-05-15T18:08:58.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x55e4b2b9ff20 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.289+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20ac0393c0 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20a8097020 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.290+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9ff20 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9ff20 2024-05-15T18:08:58.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20ac0393c0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9ff20 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.291+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9ff20 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20ac0393c0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.292+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9ff20 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.293+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.293+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20a8097020 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.293+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.293+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.293+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.293+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20ac0393c0 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9ff20 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20ac0393c0 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20a8097020 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.294+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9ff20 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20ac0393c0 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f20b0026040 con 0x7f20a8097020 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.295+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2b9f1c0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba2d00 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba2d00 con 0x7f20ac0393c0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 zone default found 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 4 Realm: () 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 zonegroup default 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.296+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba3e00 con 0x7f20ac0393c0 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba3670 con 0x55e4b2b9ff20 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba60d0 con 0x55e4b2b9ff20 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 20 started sync module instance, tier type = 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.297+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba5570 con 0x7f20a8097020 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.298+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.298+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94440739459264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba6470 con 0x7f20a8097020 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.298+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba6d00 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.299+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94440739459264] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.300+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.300+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94440739461472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba70f0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.300+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba7b50 con 0x55e4b2b9ff20 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.301+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94440739461472] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.301+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.301+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94440739465232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba7f40 con 0x55e4b2b9ff20 2024-05-15T18:08:58.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.301+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba8960 con 0x7f20a8097020 2024-05-15T18:08:58.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.302+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94440739465232] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.302+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.302+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94440739468848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba9230 con 0x7f20a8097020 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.302+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba9bf0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.303+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94440739468848] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.303+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.303+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94440739475296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba9bf0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.303+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2baa5b0 con 0x7f20ac0393c0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.304+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.304+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94440739479808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2baa520 con 0x7f20ac0393c0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.304+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2bab560 con 0x7f20ac0393c0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.304+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94440739475296] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.305+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94440739479808] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.306+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.306+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94440739482016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2bab560 con 0x7f20ac0393c0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.306+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2bab9c0 con 0x7f20ac0393c0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94440739483712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2babe30 con 0x7f20ac0393c0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=1 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=2 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=3 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=4 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=5 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94440739482016] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=6 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94440739483712] v29'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 20 add_watcher() i=7 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.307+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba9740 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.308+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.308+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94440739486000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba9740 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94440739486000] v29'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f1f6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b7546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b7546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b7546800 5 note: GC not initialized 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f1f6a7e4640 20 reqs_thread_entry: start 2024-05-15T18:08:58.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b7546800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b7546800 20 Filter name: none 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f1edbfff640 20 reqs_thread_entry: start 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b7546800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.309+0000 7f20b7546800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.310+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2be2360 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.310+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.310+0000 7f20b7546800 20 rados_obj.operate() r=0 bl.length=673 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.310+0000 7f20b7546800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.310+0000 7f20b7546800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.310+0000 7f20b7546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.310+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2be8c00 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v29'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f20b7546800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f20b7546800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f20b7546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94440739735152 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2be7790 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94440739475296 notify 124554051592 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f20b002d040 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f1f98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94440739475296 notifier 4399 bl.length()=758 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(64 notify.4 [notify cookie 94440739735152 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f1f98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f1f98ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.311+0000 7f1f98ff9640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1f78003ea0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.312+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.312+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94440739735152 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f20b0010040 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.312+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2be8670 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(66 foo:foo1 [delete] v29'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f20b7546800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94440739735152 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2be72e0 con 0x7f20a8097020 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== watch-notify(notify (1) cookie 94440739459264 notify 124554051588 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55e4b29d5a50 con 0x7f20a8097020 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f1f98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94440739459264 notifier 4399 bl.length()=159 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [notify cookie 94440739735152 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f1f98ff9640 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1f78003ea0 con 0x7f20a8097020 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.313+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== watch-notify(notify_complete (2) cookie 94440739735152 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f20ac039e20 con 0x7f20a8097020 2024-05-15T18:08:58.300 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-15T18:08:58.040722Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:58.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.314+0000 7f1f6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.314+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94440739486000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2be2e20 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.315+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94440739486000] v29'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.315+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94440739459264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2bab910 con 0x7f20a8097020 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.316+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94440739459264] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.316+0000 7f20b7546800 20 remove_watcher() i=0 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.316+0000 7f20b7546800 2 removed watcher, disabling cache 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.316+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94440739461472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba50c0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.317+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94440739461472] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.317+0000 7f20b7546800 20 remove_watcher() i=1 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.317+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94440739465232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba50c0 con 0x55e4b2b9ff20 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.318+0000 7f20b5045640 1 -- 172.21.15.173:0/2530955985 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94440739465232] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a8077020 con 0x55e4b2b9ff20 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.318+0000 7f20b7546800 20 remove_watcher() i=2 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.318+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94440739468848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba6810 con 0x7f20a8097020 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.319+0000 7f20b4844640 1 -- 172.21.15.173:0/2530955985 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94440739468848] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac036040 con 0x7f20a8097020 2024-05-15T18:08:58.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.319+0000 7f20b7546800 20 remove_watcher() i=3 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.319+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94440739475296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba7630 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.320+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94440739475296] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x55e4b2b9b8d0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.320+0000 7f20b7546800 20 remove_watcher() i=4 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.320+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94440739479808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba7630 con 0x7f20ac0393c0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.321+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94440739479808] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.321+0000 7f20b7546800 20 remove_watcher() i=5 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.321+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94440739482016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2baa100 con 0x7f20ac0393c0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.322+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94440739482016] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.322+0000 7f20b7546800 20 remove_watcher() i=6 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.322+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94440739483712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4b2ba7630 con 0x7f20ac0393c0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94440739483712] v29'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b00083e0 con 0x7f20ac0393c0 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 20 remove_watcher() i=7 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f20ac0393c0 msgr2=0x7f20ac039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f20ac0393c0 0x7f20ac039810 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2b9b8d0 msgr2=0x55e4b2b9dd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2b9b8d0 0x55e4b2b9dd90 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f20a8097020 msgr2=0x7f20a80ab870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f20a8097020 0x7f20a80ab870 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b9ff20 msgr2=0x55e4b2ba2310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b9ff20 0x55e4b2ba2310 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f80036900 msgr2=0x7f1f80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f80036900 0x7f1f80038dc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55e4b2b6dee0 tx=0x7f20ac011000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 msgr2=0x55e4b2b90350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b5846640 1 -- 172.21.15.173:0/2530955985 reap_dead start 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.323+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b90350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20a809a570 tx=0x7f20a8056fb0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 shutdown_connections 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/2530955985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b890a0 0x55e4b2b90350 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 >> 172.21.15.173:0/2530955985 conn(0x55e4b2b853c0 msgr2=0x55e4b2b82a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 shutdown_connections 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/2530955985 wait complete. 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f8c036900 msgr2=0x7f1f8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f8c036900 0x7f1f8c038dc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55e4b2b65110 tx=0x7f20ac006000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b7bf40 msgr2=0x55e4b2b7c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b7bf40 0x55e4b2b7c360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20a808caa0 tx=0x7f20a8070e40 comp rx=0 tx=0).stop 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 shutdown_connections 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f8c036900 0x7f1f8c038dc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/3713923079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2b7bf40 0x55e4b2b7c360 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 >> 172.21.15.173:0/3713923079 conn(0x55e4b2b6ffe0 msgr2=0x55e4b2b703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 shutdown_connections 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/3713923079 wait complete. 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4b2b6af20 msgr2=0x55e4b2b6d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4b2b6af20 0x55e4b2b6d350 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2a61370 msgr2=0x55e4b2b64700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4b2a61370 0x55e4b2b64700 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b66f90 msgr2=0x55e4b2b69380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4b2b66f90 0x55e4b2b69380 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f9c036900 msgr2=0x7f1f9c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f9c036900 0x7f1f9c038dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001e10 tx=0x7f20ac001390 comp rx=0 tx=0).stop 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 msgr2=0x55e4b2b5d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b7546800 1 --2- 172.21.15.173:0/649848466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4b2a60a10 0x55e4b2b5d4c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20a800a190 tx=0x7f20a8003330 comp rx=0 tx=0).stop 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.324+0000 7f20b5846640 1 -- 172.21.15.173:0/649848466 reap_dead start 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.325+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 shutdown_connections 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.325+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 >> 172.21.15.173:0/649848466 conn(0x55e4b2a5c5b0 msgr2=0x55e4b2b4fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.325+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 shutdown_connections 2024-05-15T18:08:58.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.325+0000 7f20b7546800 1 -- 172.21.15.173:0/649848466 wait complete. 2024-05-15T18:08:58.311 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-15T18:08:58.040722Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:58.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-15T18:08:58.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-15T18:08:58.312 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-05-15T18:08:58.357 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:58.357 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:58.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f8090929800 1 Processor -- start 2024-05-15T18:08:58.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f8090929800 1 -- start start 2024-05-15T18:08:58.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f8090929800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5625a8f2b9d0 0x5625a8f29ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f8090929800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625a8f2a960 con 0x5625a8f2a420 2024-05-15T18:08:58.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f8090929800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5625a8e47050 con 0x5625a8f2b9d0 2024-05-15T18:08:58.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f808c5a7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5625a8f2b9d0 0x5625a8f29ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f808c5a7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5625a8f2b9d0 0x5625a8f29ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44136/0 (socket says 172.21.15.173:44136) 2024-05-15T18:08:58.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.382+0000 7f808c5a7640 1 -- 172.21.15.173:0/3990722802 learned_addr learned my addr 172.21.15.173:0/3990722802 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.381+0000 7f8083fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5625a8f2a420 0x5625a8fbdfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35298/0 (socket says 172.21.15.173:35298) 2024-05-15T18:08:58.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.382+0000 7f808c5a7640 1 -- 172.21.15.173:0/3990722802 >> v1:172.21.15.3:6789/0 conn(0x5625a8f2a420 legacy=0x5625a8fbdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.382+0000 7f808c5a7640 1 -- 172.21.15.173:0/3990722802 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a8f2ab80 con 0x5625a8f2b9d0 2024-05-15T18:08:58.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f808c5a7640 1 --2- 172.21.15.173:0/3990722802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2b9d0 0x5625a8f29ee0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f807c00a520 tx=0x7f807c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe0e7398d5856c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f808bda6640 1 -- 172.21.15.173:0/3990722802 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c057070 con 0x5625a8f2b9d0 2024-05-15T18:08:58.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f808bda6640 1 -- 172.21.15.173:0/3990722802 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c052570 con 0x5625a8f2b9d0 2024-05-15T18:08:58.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f808bda6640 1 -- 172.21.15.173:0/3990722802 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c04ae60 con 0x5625a8f2b9d0 2024-05-15T18:08:58.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f8090929800 1 -- 172.21.15.173:0/3990722802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2b9d0 msgr2=0x5625a8f29ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f8090929800 1 --2- 172.21.15.173:0/3990722802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2b9d0 0x5625a8f29ee0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f807c00a520 tx=0x7f807c01d010 comp rx=0 tx=0).stop 2024-05-15T18:08:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f8090929800 1 -- 172.21.15.173:0/3990722802 shutdown_connections 2024-05-15T18:08:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f8090929800 1 --2- 172.21.15.173:0/3990722802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2b9d0 0x5625a8f29ee0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f8090929800 1 -- 172.21.15.173:0/3990722802 >> 172.21.15.173:0/3990722802 conn(0x5625a8fb1780 msgr2=0x5625a8fb3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f8090929800 1 -- 172.21.15.173:0/3990722802 shutdown_connections 2024-05-15T18:08:58.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.384+0000 7f8090929800 1 -- 172.21.15.173:0/3990722802 wait complete. 2024-05-15T18:08:58.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.398+0000 7f8090929800 1 Processor -- start 2024-05-15T18:08:58.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.398+0000 7f8090929800 1 -- start start 2024-05-15T18:08:58.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.398+0000 7f8090929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90a9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.398+0000 7f8090929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625a8f011d0 con 0x5625a8f2a420 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.398+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.398+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90a9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44150/0 (socket says 172.21.15.173:44150) 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.398+0000 7f808c5a7640 1 -- 172.21.15.173:0/1184193815 learned_addr learned my addr 172.21.15.173:0/1184193815 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.399+0000 7f808c5a7640 1 -- 172.21.15.173:0/1184193815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a90a9de0 con 0x5625a8f2a420 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.399+0000 7f808c5a7640 1 --2- 172.21.15.173:0/1184193815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90a9810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f807c01d050 tx=0x7f807c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a16ed85262d0a0a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.399+0000 7f7f7a60c640 1 -- 172.21.15.173:0/1184193815 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c057040 con 0x5625a8f2a420 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.399+0000 7f7f7a60c640 1 -- 172.21.15.173:0/1184193815 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c052720 con 0x5625a8f2a420 2024-05-15T18:08:58.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.399+0000 7f7f7a60c640 1 -- 172.21.15.173:0/1184193815 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c052a40 con 0x5625a8f2a420 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 -- 172.21.15.173:0/1184193815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 msgr2=0x5625a90a9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 --2- 172.21.15.173:0/1184193815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90a9810 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f807c01d050 tx=0x7f807c04c000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 -- 172.21.15.173:0/1184193815 shutdown_connections 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 --2- 172.21.15.173:0/1184193815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90a9810 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 -- 172.21.15.173:0/1184193815 >> 172.21.15.173:0/1184193815 conn(0x5625a8fb1780 msgr2=0x5625a90a5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 -- 172.21.15.173:0/1184193815 shutdown_connections 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 -- 172.21.15.173:0/1184193815 wait complete. 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 Processor -- start 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 -- start start 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f8090929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625a8fc1920 con 0x5625a8f2a420 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.400+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44160/0 (socket says 172.21.15.173:44160) 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f808c5a7640 1 -- 172.21.15.173:0/3941069125 learned_addr learned my addr 172.21.15.173:0/3941069125 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f808c5a7640 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a90b1710 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f808c5a7640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90b11d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f807c000c00 tx=0x7f807c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f7f78e09640 1 -- 172.21.15.173:0/3941069125 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c073070 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f7f78e09640 1 -- 172.21.15.173:0/3941069125 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c05d440 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625a90b19a0 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f7f78e09640 1 -- 172.21.15.173:0/3941069125 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c057070 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.401+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a90b4650 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.402+0000 7f7f78e09640 1 -- 172.21.15.173:0/3941069125 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f807c076070 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.402+0000 7f7f78e09640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f74036950 0x7f7f74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.402+0000 7f7f78e09640 1 -- 172.21.15.173:0/3941069125 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f807c08db20 con 0x5625a8f2a420 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.402+0000 7f8083fff640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f74036950 0x7f7f74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a8f2b9d0 0x5625a90b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90b8950 con 0x5625a8f2b9d0 2024-05-15T18:08:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f808cda8640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a8f2b9d0 0x5625a90b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f8083fff640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f74036950 0x7f7f74038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8074000f60 tx=0x7f8074001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f808cda8640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a8f2b9d0 0x5625a90b8410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f808cda8640 1 -- 172.21.15.173:0/3941069125 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a8f2b9d0 2024-05-15T18:08:58.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90b59e0 con 0x5625a8f2b9d0 2024-05-15T18:08:58.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.403+0000 7f808cda8640 1 -- 172.21.15.173:0/3941069125 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a8f2b9d0 2024-05-15T18:08:58.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90bacd0 0x5625a90bd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90bd7b0 con 0x5625a90bacd0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f808c5a7640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90bacd0 0x5625a90bd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f808c5a7640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90bacd0 0x5625a90bd0c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f808c5a7640 1 -- 172.21.15.173:0/3941069125 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f807c075030 con 0x5625a90bacd0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90b9c50 con 0x5625a8f2b9d0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f808cda8640 1 -- 172.21.15.173:0/3941069125 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a8f2b9d0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625a90bec10 0x5625a90c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.404+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90c17e0 con 0x5625a90bec10 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.405+0000 7f8083fff640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625a90bec10 0x5625a90c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.405+0000 7f8083fff640 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625a90bec10 0x5625a90c1080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.405+0000 7f8083fff640 1 -- 172.21.15.173:0/3941069125 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f807400f690 con 0x5625a90bec10 2024-05-15T18:08:58.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f8090929800 1 Processor -- start 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f8090929800 1 -- start start 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f8090929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90cfc40 0x5625a90d0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f8090929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625a8ea7cf0 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90cfc40 0x5625a90d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90cfc40 0x5625a90d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44166/0 (socket says 172.21.15.173:44166) 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f808c5a7640 1 -- 172.21.15.173:0/1405405315 learned_addr learned my addr 172.21.15.173:0/1405405315 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.406+0000 7f808c5a7640 1 -- 172.21.15.173:0/1405405315 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a90d05a0 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.407+0000 7f808c5a7640 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90cfc40 0x5625a90d0060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f807c08c120 tx=0x7f807c07a3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.407+0000 7f7f71ffb640 1 -- 172.21.15.173:0/1405405315 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c092070 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.407+0000 7f7f71ffb640 1 -- 172.21.15.173:0/1405405315 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c089070 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.407+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625a90d1010 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.407+0000 7f7f71ffb640 1 -- 172.21.15.173:0/1405405315 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c0080d0 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.407+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a90d1510 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.407+0000 7f7f71ffb640 1 -- 172.21.15.173:0/1405405315 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f807c095070 con 0x5625a90cfc40 2024-05-15T18:08:58.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f7f71ffb640 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f64036900 0x7f7f64038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f7f71ffb640 1 -- 172.21.15.173:0/1405405315 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f807c098af0 con 0x5625a90cfc40 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f8083fff640 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f64036900 0x7f7f64038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f8090929800 1 Processor -- start 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f8090929800 1 -- start start 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f8083fff640 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f64036900 0x7f7f64038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5625a90b9280 tx=0x7f807400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f8090929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90dd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f8090929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625a90aa0a0 con 0x5625a90dce00 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90dd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44172/0 (socket says 172.21.15.173:44172) 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.408+0000 7f808c5a7640 1 -- 172.21.15.173:0/3411001187 learned_addr learned my addr 172.21.15.173:0/3411001187 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f808c5a7640 1 -- 172.21.15.173:0/3411001187 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a90dd7f0 con 0x5625a90dce00 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f808c5a7640 1 --2- 172.21.15.173:0/3411001187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90dd220 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f807c05df20 tx=0x7f807c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f3e83606562373 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f7f6b7fe640 1 -- 172.21.15.173:0/3411001187 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c071250 con 0x5625a90dce00 2024-05-15T18:08:58.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f7f6b7fe640 1 -- 172.21.15.173:0/3411001187 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c071c00 con 0x5625a90dce00 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f7f6b7fe640 1 -- 172.21.15.173:0/3411001187 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c056ae0 con 0x5625a90dce00 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f8090929800 1 -- 172.21.15.173:0/3411001187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 msgr2=0x5625a90dd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f8090929800 1 --2- 172.21.15.173:0/3411001187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90dd220 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f807c05df20 tx=0x7f807c0077e0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f8090929800 1 -- 172.21.15.173:0/3411001187 shutdown_connections 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f8090929800 1 --2- 172.21.15.173:0/3411001187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90dd220 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f8090929800 1 -- 172.21.15.173:0/3411001187 >> 172.21.15.173:0/3411001187 conn(0x5625a90d9110 msgr2=0x5625a90d7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f8090929800 1 -- 172.21.15.173:0/3411001187 shutdown_connections 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.409+0000 7f8090929800 1 -- 172.21.15.173:0/3411001187 wait complete. 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f8090929800 1 Processor -- start 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f8090929800 1 -- start start 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f8090929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f8090929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625a90dde80 con 0x5625a90dce00 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f808c5a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90e41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:44178/0 (socket says 172.21.15.173:44178) 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 learned_addr learned my addr 172.21.15.173:0/1238445133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.410+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a90e4700 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.411+0000 7f808c5a7640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90e41c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f807c07aff0 tx=0x7f807c064f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.411+0000 7f7f69ffb640 1 -- 172.21.15.173:0/1238445133 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c077ea0 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.411+0000 7f7f69ffb640 1 -- 172.21.15.173:0/1238445133 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c0b5070 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.411+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625a90e4700 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.411+0000 7f7f69ffb640 1 -- 172.21.15.173:0/1238445133 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c0562a0 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.411+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a90e4700 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f7f69ffb640 1 -- 172.21.15.173:0/1238445133 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f807c056440 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f7f69ffb640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f5c036950 0x7f7f5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f7f69ffb640 1 -- 172.21.15.173:0/1238445133 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f807c0a2070 con 0x5625a90dce00 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f8083fff640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f5c036950 0x7f7f5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f8083fff640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f5c036950 0x7f7f5c038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5625a90c1be0 tx=0x7f8074010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a90ef830 0x5625a90f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f2440 con 0x5625a90ef830 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.412+0000 7f808cda8640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a90ef830 0x5625a90f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f808cda8640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a90ef830 0x5625a90f1cf0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 20 realm 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f2850 con 0x5625a90ef830 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f3120 con 0x5625a90ef830 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.413+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f8090929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90f4220 0x5625a90f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f6c20 con 0x5625a90f4220 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f808c5a7640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90f4220 0x5625a90f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f808c5a7640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90f4220 0x5625a90f6610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f8090929800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f8090929800 20 searching for the correct realm 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.414+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f8550 con 0x5625a90f4220 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f808c5a7640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f807c0b0050 0x7f807c098050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f8550 con 0x7f807c0b0050 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f8083fff640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f807c0b0050 0x7f807c098050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f8083fff640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f807c0b0050 0x7f807c098050 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f8083fff640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f807400f070 0x7f807402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.415+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f8550 con 0x7f807400f070 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.416+0000 7f808cda8640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f807400f070 0x7f807402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.416+0000 7f808cda8640 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f807400f070 0x7f807402e910 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.416+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f808400a4a0 con 0x7f807400f070 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.416+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x7f807400f070 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x7f807400f070 2024-05-15T18:08:58.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.417+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807c0b0050 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x7f807400f070 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.418+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807c0b0050 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.419+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x7f807400f070 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.420+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f808400a4a0 con 0x5625a90ef830 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084033040 con 0x7f807400f070 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807c0b0050 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.421+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.422+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.422+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.422+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.422+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.422+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.422+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.423+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.423+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807c0b0050 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.423+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.423+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90f4220 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.423+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.423+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807400f070 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x5625a90ef830 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f34c0 con 0x7f807c0b0050 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f74e0 con 0x5625a90ef830 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.424+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f78d0 con 0x5625a90ef830 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f78d0 con 0x7f807400f070 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 20 zone default found 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 4 Realm: () 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 20 zonegroup default 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.425+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f89d0 con 0x7f807400f070 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fa3b0 con 0x5625a90f4220 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fa750 con 0x5625a90f4220 2024-05-15T18:08:58.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 20 started sync module instance, tier type = 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.426+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f9850 con 0x7f807c0b0050 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.427+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.427+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719750149024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90faaf0 con 0x7f807c0b0050 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.427+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fb3a0 con 0x5625a90ef830 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.428+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719750149024] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.428+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.428+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719750155920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fb790 con 0x5625a90ef830 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.428+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fc210 con 0x5625a90f4220 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.429+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719750155920] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.430+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.430+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719750159616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fc600 con 0x5625a90f4220 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.430+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fd040 con 0x7f807c0b0050 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.431+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719750159616] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.431+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.431+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719750163216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fd430 con 0x7f807c0b0050 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.431+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fde70 con 0x5625a90ef830 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.432+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.432+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719750166848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fe710 con 0x5625a90ef830 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.432+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90ff210 con 0x7f807400f070 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.432+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719750163216] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.433+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719750166848] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.433+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.433+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719750171904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fe210 con 0x7f807400f070 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.433+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90ffab0 con 0x7f807400f070 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.434+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.434+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719750174208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90fe210 con 0x7f807400f070 2024-05-15T18:08:58.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.434+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a9100580 con 0x7f807400f070 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.434+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719750171904] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719750174208] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719750175264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a90f9c70 con 0x7f807400f070 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 20 add_watcher() i=0 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 20 add_watcher() i=1 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 20 add_watcher() i=2 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 20 add_watcher() i=3 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 20 add_watcher() i=4 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 20 add_watcher() i=5 2024-05-15T18:08:58.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.435+0000 7f8090929800 20 add_watcher() i=6 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.436+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719750175264] v29'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.436+0000 7f8090929800 20 add_watcher() i=7 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.436+0000 7f8090929800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.436+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a9103570 con 0x5625a90ef830 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.436+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.436+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719750176880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a91009f0 con 0x5625a90ef830 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.437+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719750176880] v29'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.437+0000 7f7f427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 5 note: GC not initialized 2024-05-15T18:08:58.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f7f417e2640 20 reqs_thread_entry: start 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 20 Filter name: none 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f7eb2ffd640 20 reqs_thread_entry: start 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.438+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a9136870 con 0x5625a90ef830 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.439+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.439+0000 7f8090929800 20 rados_obj.operate() r=0 bl.length=582 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.439+0000 7f8090929800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.439+0000 7f8090929800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.439+0000 7f8090929800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.439+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913cc30 con 0x5625a90ef830 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v29'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f8090929800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f8090929800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f8090929800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94719750424224 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625a9138710 con 0x5625a90ef830 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94719750166848 notify 124554051593 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f808401e040 con 0x5625a90ef830 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f7f6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94719750166848 notifier 4406 bl.length()=732 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f7f6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f7f6b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f7f6b7fe640 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7f50003ea0 con 0x5625a90ef830 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(64 notify.4 [notify cookie 94719750424224 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.440+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== watch-notify(notify_complete (2) cookie 94719750424224 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8084018dd0 con 0x5625a90ef830 2024-05-15T18:08:58.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.441+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.428 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-15T18:08:58.040722Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.441+0000 7f7f427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.441+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719750176880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x5625a90ef830 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.442+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94719750176880] v29'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.442+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719750149024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x7f807c0b0050 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.443+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94719750149024] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.443+0000 7f8090929800 20 remove_watcher() i=0 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.443+0000 7f8090929800 2 removed watcher, disabling cache 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.443+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719750155920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x5625a90ef830 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.445+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94719750155920] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.445+0000 7f8090929800 20 remove_watcher() i=1 2024-05-15T18:08:58.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.445+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719750159616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x5625a90f4220 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.446+0000 7f808c5a7640 1 -- 172.21.15.173:0/1238445133 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94719750159616] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f807c094030 con 0x5625a90f4220 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.446+0000 7f8090929800 20 remove_watcher() i=2 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.446+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719750163216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x7f807c0b0050 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.447+0000 7f8083fff640 1 -- 172.21.15.173:0/1238445133 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94719750163216] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8074037040 con 0x7f807c0b0050 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.447+0000 7f8090929800 20 remove_watcher() i=3 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.447+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719750166848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x5625a90ef830 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.448+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94719750166848] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x5625a90ef830 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.448+0000 7f8090929800 20 remove_watcher() i=4 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.448+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719750171904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x7f807400f070 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.449+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94719750171904] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.449+0000 7f8090929800 20 remove_watcher() i=5 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.449+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719750174208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x7f807400f070 2024-05-15T18:08:58.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.450+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94719750174208] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.450+0000 7f8090929800 20 remove_watcher() i=6 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.450+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719750175264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625a913c1f0 con 0x7f807400f070 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94719750175264] v29'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084031040 con 0x7f807400f070 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 20 remove_watcher() i=7 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f807400f070 msgr2=0x7f807402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f807400f070 0x7f807402e910 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a90ef830 msgr2=0x5625a90f1cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a90ef830 0x5625a90f1cf0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f807c0b0050 msgr2=0x7f807c098050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f807c0b0050 0x7f807c098050 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90f4220 msgr2=0x5625a90f6610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90f4220 0x5625a90f6610 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f5c036950 msgr2=0x7f7f5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f5c036950 0x7f7f5c038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5625a90c1be0 tx=0x7f8074010000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 msgr2=0x5625a90e41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f808cda8640 1 -- 172.21.15.173:0/1238445133 reap_dead start 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90e41c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f807c07aff0 tx=0x7f807c064f70 comp rx=0 tx=0).stop 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 shutdown_connections 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1238445133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90dce00 0x5625a90e41c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 >> 172.21.15.173:0/1238445133 conn(0x5625a90d9110 msgr2=0x5625a90d6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 shutdown_connections 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1238445133 wait complete. 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f64036900 msgr2=0x7f7f64038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f64036900 0x7f7f64038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x5625a90b9280 tx=0x7f807400f000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90cfc40 msgr2=0x5625a90d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.451+0000 7f8090929800 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90cfc40 0x5625a90d0060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f807c08c120 tx=0x7f807c07a3a0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 shutdown_connections 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f64036900 0x7f7f64038dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 --2- 172.21.15.173:0/1405405315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a90cfc40 0x5625a90d0060 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 >> 172.21.15.173:0/1405405315 conn(0x5625a90c3ce0 msgr2=0x5625a90c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 shutdown_connections 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/1405405315 wait complete. 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625a90bec10 msgr2=0x5625a90c1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625a90bec10 0x5625a90c1080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a8f2b9d0 msgr2=0x5625a90b8410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625a8f2b9d0 0x5625a90b8410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90bacd0 msgr2=0x5625a90bd0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625a90bacd0 0x5625a90bd0c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f74036950 msgr2=0x7f7f74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7f74036950 0x7f7f74038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8074000f60 tx=0x7f8074001370 comp rx=0 tx=0).stop 2024-05-15T18:08:58.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 msgr2=0x5625a90b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 --2- 172.21.15.173:0/3941069125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625a8f2a420 0x5625a90b11d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f807c000c00 tx=0x7f807c003020 comp rx=0 tx=0).stop 2024-05-15T18:08:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f808cda8640 1 -- 172.21.15.173:0/3941069125 reap_dead start 2024-05-15T18:08:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 shutdown_connections 2024-05-15T18:08:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 >> 172.21.15.173:0/3941069125 conn(0x5625a8fb1780 msgr2=0x5625a90a3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 shutdown_connections 2024-05-15T18:08:58.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.452+0000 7f8090929800 1 -- 172.21.15.173:0/3941069125 wait complete. 2024-05-15T18:08:58.439 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-15T18:08:58.040722Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:58.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-15T18:08:58.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-15T18:08:58.439 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-05-15T18:08:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:58.487 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:58.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.511+0000 7f2c7512b800 1 Processor -- start 2024-05-15T18:08:58.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.511+0000 7f2c7512b800 1 -- start start 2024-05-15T18:08:58.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.511+0000 7f2c7512b800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5575ed3e9160 0x5575ed3e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.511+0000 7f2c7512b800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5575ed3e9c00 con 0x5575ed3ea370 2024-05-15T18:08:58.488 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.511+0000 7f2c7512b800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5575ed27a050 con 0x5575ed3e9160 2024-05-15T18:08:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.512+0000 7f2c70d52640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5575ed3e9160 0x5575ed3e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.512+0000 7f2c68551640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5575ed3ea370 0x5575ed3ea7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:56962/0 (socket says 172.21.15.173:56962) 2024-05-15T18:08:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.512+0000 7f2c68551640 1 -- 172.21.15.173:0/808811409 learned_addr learned my addr 172.21.15.173:0/808811409 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.512+0000 7f2c70d52640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5575ed3e9160 0x5575ed3e9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38060/0 (socket says 172.21.15.173:38060) 2024-05-15T18:08:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.512+0000 7f2c70d52640 1 -- 172.21.15.173:0/808811409 >> v1:172.21.15.3:6789/0 conn(0x5575ed3ea370 legacy=0x5575ed3ea7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.489 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.512+0000 7f2c70d52640 1 -- 172.21.15.173:0/808811409 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ed3eaf30 con 0x5575ed3e9160 2024-05-15T18:08:58.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c70d52640 1 --2- 172.21.15.173:0/808811409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed3e9580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000a470 tx=0x7f2c6001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9981fed4e4fd1193 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c6bfff640 1 -- 172.21.15.173:0/808811409 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60057070 con 0x5575ed3e9160 2024-05-15T18:08:58.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c6bfff640 1 -- 172.21.15.173:0/808811409 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6004adc0 con 0x5575ed3e9160 2024-05-15T18:08:58.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c6bfff640 1 -- 172.21.15.173:0/808811409 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60052590 con 0x5575ed3e9160 2024-05-15T18:08:58.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c7512b800 1 -- 172.21.15.173:0/808811409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 msgr2=0x5575ed3e9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c7512b800 1 --2- 172.21.15.173:0/808811409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed3e9580 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000a470 tx=0x7f2c6001ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:58.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c7512b800 1 -- 172.21.15.173:0/808811409 shutdown_connections 2024-05-15T18:08:58.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.514+0000 7f2c7512b800 1 --2- 172.21.15.173:0/808811409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed3e9580 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.515+0000 7f2c7512b800 1 -- 172.21.15.173:0/808811409 >> 172.21.15.173:0/808811409 conn(0x5575ed3e47a0 msgr2=0x5575ed3e6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.515+0000 7f2c7512b800 1 -- 172.21.15.173:0/808811409 shutdown_connections 2024-05-15T18:08:58.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.515+0000 7f2c7512b800 1 -- 172.21.15.173:0/808811409 wait complete. 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.528+0000 7f2c7512b800 1 Processor -- start 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.528+0000 7f2c7512b800 1 -- start start 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.528+0000 7f2c7512b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed35e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.528+0000 7f2c7512b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5575ed3341f0 con 0x5575ed3e9160 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed35e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed35e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38064/0 (socket says 172.21.15.173:38064) 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2c70d52640 1 -- 172.21.15.173:0/3204079755 learned_addr learned my addr 172.21.15.173:0/3204079755 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2c70d52640 1 -- 172.21.15.173:0/3204079755 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ed35cdd0 con 0x5575ed3e9160 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2c70d52640 1 --2- 172.21.15.173:0/3204079755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed35e810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2c6001ced0 tx=0x7f2c6004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c297c0a5e913df server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2b5ee0d640 1 -- 172.21.15.173:0/3204079755 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60057040 con 0x5575ed3e9160 2024-05-15T18:08:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2b5ee0d640 1 -- 172.21.15.173:0/3204079755 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60063070 con 0x5575ed3e9160 2024-05-15T18:08:58.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.529+0000 7f2b5ee0d640 1 -- 172.21.15.173:0/3204079755 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60052800 con 0x5575ed3e9160 2024-05-15T18:08:58.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 -- 172.21.15.173:0/3204079755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 msgr2=0x5575ed35e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 --2- 172.21.15.173:0/3204079755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed35e810 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2c6001ced0 tx=0x7f2c6004c000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 -- 172.21.15.173:0/3204079755 shutdown_connections 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 --2- 172.21.15.173:0/3204079755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed35e810 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 -- 172.21.15.173:0/3204079755 >> 172.21.15.173:0/3204079755 conn(0x5575ed3e47a0 msgr2=0x5575ed4d6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 -- 172.21.15.173:0/3204079755 shutdown_connections 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 -- 172.21.15.173:0/3204079755 wait complete. 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.530+0000 7f2c7512b800 1 Processor -- start 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c7512b800 1 -- start start 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c7512b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed4e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c7512b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5575ed3f2840 con 0x5575ed3e9160 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed4e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed4e43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38080/0 (socket says 172.21.15.173:38080) 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c70d52640 1 -- 172.21.15.173:0/2226690612 learned_addr learned my addr 172.21.15.173:0/2226690612 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c70d52640 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ed4e4910 con 0x5575ed3e9160 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c70d52640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed4e43d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2c6004ad90 tx=0x7f2c60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2b5d60a640 1 -- 172.21.15.173:0/2226690612 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6006d070 con 0x5575ed3e9160 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2b5d60a640 1 -- 172.21.15.173:0/2226690612 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60052d00 con 0x5575ed3e9160 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575ed4e4ba0 con 0x5575ed3e9160 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.531+0000 7f2b5d60a640 1 -- 172.21.15.173:0/2226690612 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60057050 con 0x5575ed3e9160 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.532+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ed4e7850 con 0x5575ed3e9160 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.532+0000 7f2b5d60a640 1 -- 172.21.15.173:0/2226690612 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c6005d470 con 0x5575ed3e9160 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.532+0000 7f2b5d60a640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b58036900 0x7f2b58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.532+0000 7f2b5d60a640 1 -- 172.21.15.173:0/2226690612 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2c6008d5f0 con 0x5575ed3e9160 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c68551640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b58036900 0x7f2b58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed3ea370 0x5575ed4eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed4ebbe0 con 0x5575ed3ea370 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c71553640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed3ea370 0x5575ed4eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c68551640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b58036900 0x7f2b58038dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c58001d90 tx=0x7f2c580012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c71553640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed3ea370 0x5575ed4eb610 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c71553640 1 -- 172.21.15.173:0/2226690612 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed3ea370 2024-05-15T18:08:58.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.533+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed4ec4d0 con 0x5575ed3ea370 2024-05-15T18:08:58.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.534+0000 7f2c71553640 1 -- 172.21.15.173:0/2226690612 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed3ea370 2024-05-15T18:08:58.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.534+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed4edde0 0x5575ed4f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.534+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed4f0a00 con 0x5575ed4edde0 2024-05-15T18:08:58.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.534+0000 7f2c70d52640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed4edde0 0x5575ed4f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.534+0000 7f2c70d52640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed4edde0 0x5575ed4f0270 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.534+0000 7f2c70d52640 1 -- 172.21.15.173:0/2226690612 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2c6005a040 con 0x5575ed4edde0 2024-05-15T18:08:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.534+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed4ecd50 con 0x5575ed3ea370 2024-05-15T18:08:58.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.535+0000 7f2c71553640 1 -- 172.21.15.173:0/2226690612 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed3ea370 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.535+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5575ed4f1eb0 0x5575ed4f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.535+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed4f4a80 con 0x5575ed4f1eb0 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.535+0000 7f2c68551640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5575ed4f1eb0 0x5575ed4f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.535+0000 7f2c68551640 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5575ed4f1eb0 0x5575ed4f4320 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.536+0000 7f2c68551640 1 -- 172.21.15.173:0/2226690612 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2c58009050 con 0x5575ed4f1eb0 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.536+0000 7f2c7512b800 1 Processor -- start 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.536+0000 7f2c7512b800 1 -- start start 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.536+0000 7f2c7512b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed502ee0 0x5575ed503300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.536+0000 7f2c7512b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5575ed2dacf0 con 0x5575ed502ee0 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed502ee0 0x5575ed503300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed502ee0 0x5575ed503300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38090/0 (socket says 172.21.15.173:38090) 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2c70d52640 1 -- 172.21.15.173:0/42259190 learned_addr learned my addr 172.21.15.173:0/42259190 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2c70d52640 1 -- 172.21.15.173:0/42259190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ed503840 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2c70d52640 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed502ee0 0x5575ed503300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2c6008d010 tx=0x7f2c6005b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2b567fc640 1 -- 172.21.15.173:0/42259190 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c6005ba40 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2b567fc640 1 -- 172.21.15.173:0/42259190 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60007e30 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2b567fc640 1 -- 172.21.15.173:0/42259190 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60008110 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575ed5042b0 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.537+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ed5047b0 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.538+0000 7f2b567fc640 1 -- 172.21.15.173:0/42259190 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c60066a20 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.538+0000 7f2b567fc640 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b48036900 0x7f2b48038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.538+0000 7f2b567fc640 1 -- 172.21.15.173:0/42259190 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2c60085070 con 0x5575ed502ee0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.538+0000 7f2c68551640 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b48036900 0x7f2b48038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.538+0000 7f2c7512b800 1 Processor -- start 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.538+0000 7f2c7512b800 1 -- start start 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c68551640 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b48036900 0x7f2b48038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5575ed4e8b00 tx=0x7f2c5800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c7512b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed510460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c7512b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5575ed35d090 con 0x5575ed510040 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed510460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed510460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38096/0 (socket says 172.21.15.173:38096) 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c70d52640 1 -- 172.21.15.173:0/161497708 learned_addr learned my addr 172.21.15.173:0/161497708 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c70d52640 1 -- 172.21.15.173:0/161497708 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ed510a30 con 0x5575ed510040 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2c70d52640 1 --2- 172.21.15.173:0/161497708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed510460 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2c6005c8c0 tx=0x7f2c6005ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8911457175b30a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2b47fff640 1 -- 172.21.15.173:0/161497708 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60088410 con 0x5575ed510040 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2b47fff640 1 -- 172.21.15.173:0/161497708 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60066380 con 0x5575ed510040 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.539+0000 7f2b47fff640 1 -- 172.21.15.173:0/161497708 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60066e40 con 0x5575ed510040 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 -- 172.21.15.173:0/161497708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 msgr2=0x5575ed510460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 --2- 172.21.15.173:0/161497708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed510460 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2c6005c8c0 tx=0x7f2c6005ab60 comp rx=0 tx=0).stop 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 -- 172.21.15.173:0/161497708 shutdown_connections 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 --2- 172.21.15.173:0/161497708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed510460 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 -- 172.21.15.173:0/161497708 >> 172.21.15.173:0/161497708 conn(0x5575ed50c360 msgr2=0x5575ed50a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 -- 172.21.15.173:0/161497708 shutdown_connections 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 -- 172.21.15.173:0/161497708 wait complete. 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 Processor -- start 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 -- start start 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed517570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.540+0000 7f2c7512b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5575ed511150 con 0x5575ed510040 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed517570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2c70d52640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed517570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38100/0 (socket says 172.21.15.173:38100) 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 learned_addr learned my addr 172.21.15.173:0/4051553241 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ed517ab0 con 0x5575ed510040 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2c70d52640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed517570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c60068d30 tx=0x7f2c60006fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2b467fc640 1 -- 172.21.15.173:0/4051553241 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60088410 con 0x5575ed510040 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2b467fc640 1 -- 172.21.15.173:0/4051553241 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60066660 con 0x5575ed510040 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2b467fc640 1 -- 172.21.15.173:0/4051553241 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c60066830 con 0x5575ed510040 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575ed517ab0 con 0x5575ed510040 2024-05-15T18:08:58.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.541+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ed517ab0 con 0x5575ed510040 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.542+0000 7f2b467fc640 1 -- 172.21.15.173:0/4051553241 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2c6008d950 con 0x5575ed510040 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.542+0000 7f2b467fc640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b3c036aa0 0x7f2b3c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.542+0000 7f2b467fc640 1 -- 172.21.15.173:0/4051553241 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2c600ae850 con 0x5575ed510040 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.542+0000 7f2c68551640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b3c036aa0 0x7f2b3c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.543+0000 7f2c68551640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b3c036aa0 0x7f2b3c038f60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5575ed4f4e80 tx=0x7f2c58010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.543+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.543+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed522bc0 0x5575ed525080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.543+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5257d0 con 0x5575ed522bc0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.543+0000 7f2c71553640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed522bc0 0x5575ed525080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.543+0000 7f2c71553640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed522bc0 0x5575ed525080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 realm 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed525be0 con 0x5575ed522bc0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5264b0 con 0x5575ed522bc0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed5275b0 0x5575ed5299a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.544+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed529fb0 con 0x5575ed5275b0 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.545+0000 7f2c70d52640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed5275b0 0x5575ed5299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.545+0000 7f2c70d52640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed5275b0 0x5575ed5299a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.545+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.545+0000 7f2c7512b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.545+0000 7f2c7512b800 20 searching for the correct realm 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.545+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52b8e0 con 0x5575ed5275b0 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c70d52640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2c600a1070 0x7f2c600814a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52b8e0 con 0x7f2c600a1070 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c68551640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2c600a1070 0x7f2c600814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c68551640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2c600a1070 0x7f2c600814a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c68551640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2c58037040 0x7f2c58036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.546+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52b8e0 con 0x7f2c58037040 2024-05-15T18:08:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.547+0000 7f2c71553640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2c58037040 0x7f2c58036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.547+0000 7f2c71553640 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2c58037040 0x7f2c58036410 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.547+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x7f2c58037040 2024-05-15T18:08:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.547+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.547+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.547+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x7f2c58037040 2024-05-15T18:08:58.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x7f2c58037040 2024-05-15T18:08:58.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c600a1070 2024-05-15T18:08:58.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.548+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.549+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.549+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.549+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.549+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.549+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x7f2c58037040 2024-05-15T18:08:58.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.549+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.550+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.550+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c600a1070 2024-05-15T18:08:58.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.550+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.550+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.550+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.550+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.550+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.551+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.551+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x7f2c58037040 2024-05-15T18:08:58.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.551+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.551+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.551+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.551+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.551+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.552+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.552+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.552+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2c6c00a4a0 con 0x5575ed522bc0 2024-05-15T18:08:58.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.552+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.552+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c033040 con 0x7f2c58037040 2024-05-15T18:08:58.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.552+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c600a1070 2024-05-15T18:08:58.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.553+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.554+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.554+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.554+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.554+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c600a1070 2024-05-15T18:08:58.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.554+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.554+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed5275b0 2024-05-15T18:08:58.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c58037040 2024-05-15T18:08:58.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x5575ed522bc0 2024-05-15T18:08:58.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5575ed526850 con 0x7f2c600a1070 2024-05-15T18:08:58.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.555+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52a870 con 0x5575ed522bc0 2024-05-15T18:08:58.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52ac60 con 0x5575ed522bc0 2024-05-15T18:08:58.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52ac60 con 0x7f2c58037040 2024-05-15T18:08:58.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 zone default found 2024-05-15T18:08:58.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 4 Realm: () 2024-05-15T18:08:58.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 zonegroup default 2024-05-15T18:08:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.556+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52bd60 con 0x7f2c58037040 2024-05-15T18:08:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52d740 con 0x5575ed5275b0 2024-05-15T18:08:58.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52dae0 con 0x5575ed5275b0 2024-05-15T18:08:58.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 20 started sync module instance, tier type = 2024-05-15T18:08:58.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.557+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52cbe0 con 0x7f2c600a1070 2024-05-15T18:08:58.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.558+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.558+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93964981159728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52de80 con 0x7f2c600a1070 2024-05-15T18:08:58.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.558+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52e730 con 0x5575ed522bc0 2024-05-15T18:08:58.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.559+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93964981159728] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.559+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.559+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93964981166624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52eb20 con 0x5575ed522bc0 2024-05-15T18:08:58.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.560+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52f580 con 0x5575ed5275b0 2024-05-15T18:08:58.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.560+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93964981166624] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.561+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.561+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93964981161984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52f9a0 con 0x5575ed5275b0 2024-05-15T18:08:58.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.561+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5303c0 con 0x7f2c600a1070 2024-05-15T18:08:58.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.562+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93964981161984] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.562+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.562+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93964981173936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed530760 con 0x7f2c600a1070 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.562+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed531250 con 0x5575ed522bc0 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.563+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.563+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93964981177632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed531af0 con 0x5575ed522bc0 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.563+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5325d0 con 0x7f2c58037040 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.563+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93964981173936] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.564+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93964981177632] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.564+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.564+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93964981170320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5315f0 con 0x7f2c58037040 2024-05-15T18:08:58.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.564+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed532ea0 con 0x7f2c58037040 2024-05-15T18:08:58.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.565+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93964981170320] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.565+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.565+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93964981182688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5315f0 con 0x7f2c58037040 2024-05-15T18:08:58.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.565+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed533470 con 0x7f2c58037040 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93964981182688] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93964981184928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed533470 con 0x7f2c58037040 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 20 add_watcher() i=0 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 20 add_watcher() i=1 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 20 add_watcher() i=2 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 20 add_watcher() i=3 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 20 add_watcher() i=4 2024-05-15T18:08:58.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 20 add_watcher() i=5 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.566+0000 7f2c7512b800 20 add_watcher() i=6 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.567+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93964981184928] v29'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.567+0000 7f2c7512b800 20 add_watcher() i=7 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.567+0000 7f2c7512b800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.567+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed536820 con 0x5575ed522bc0 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.567+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.567+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93964981199312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5335e0 con 0x5575ed522bc0 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.568+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93964981199312] v29'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.568+0000 7f2b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.568+0000 7f2c7512b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.568+0000 7f2c7512b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.568+0000 7f2c7512b800 5 note: GC not initialized 2024-05-15T18:08:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2b25fe3640 20 reqs_thread_entry: start 2024-05-15T18:08:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 20 Filter name: none 2024-05-15T18:08:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2a977fe640 20 reqs_thread_entry: start 2024-05-15T18:08:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:08:58.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed569d90 con 0x5575ed522bc0 2024-05-15T18:08:58.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 20 rados_obj.operate() r=0 bl.length=556 2024-05-15T18:08:58.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:08:58.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:08:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.569+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed570210 con 0x5575ed522bc0 2024-05-15T18:08:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v29'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c7512b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c7512b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c7512b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:08:58.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93964981435520 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed56eda0 con 0x5575ed522bc0 2024-05-15T18:08:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 93964981177632 notify 124554051594 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f2c6c01e040 con 0x5575ed522bc0 2024-05-15T18:08:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2b47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 93964981177632 notifier 4413 bl.length()=567 2024-05-15T18:08:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2b47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:08:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2b47fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:08:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(64 notify.4 [notify cookie 93964981435520 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2b47fff640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2b34003ea0 con 0x5575ed522bc0 2024-05-15T18:08:58.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 93964981435520 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2c6c018d70 con 0x5575ed522bc0 2024-05-15T18:08:58.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.571+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed56fc80 con 0x7f2c600a1070 2024-05-15T18:08:58.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 foo:foo2 [delete] v29'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2c7512b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-15T18:08:58.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93964981432784 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5575ed56eda0 con 0x7f2c600a1070 2024-05-15T18:08:58.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== watch-notify(notify (1) cookie 93964981159728 notify 124554051589 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f2c58041060 con 0x7f2c600a1070 2024-05-15T18:08:58.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2b47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 93964981159728 notifier 4413 bl.length()=159 2024-05-15T18:08:58.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2b47fff640 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f2b34003ea0 con 0x7f2c600a1070 2024-05-15T18:08:58.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(67 notify.0 [notify cookie 93964981432784 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.573+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== watch-notify(notify_complete (2) cookie 93964981432784 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5575ed3e9c00 con 0x7f2c600a1070 2024-05-15T18:08:58.590 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:08:58.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.574+0000 7f2b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.574+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93964981199312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed56eda0 con 0x5575ed522bc0 2024-05-15T18:08:58.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.575+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93964981199312] v29'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.575+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93964981159728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed56eda0 con 0x7f2c600a1070 2024-05-15T18:08:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.576+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93964981159728] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.576+0000 7f2c7512b800 20 remove_watcher() i=0 2024-05-15T18:08:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.576+0000 7f2c7512b800 2 removed watcher, disabling cache 2024-05-15T18:08:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.576+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93964981166624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed56eda0 con 0x5575ed522bc0 2024-05-15T18:08:58.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.577+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93964981166624] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.577+0000 7f2c7512b800 20 remove_watcher() i=1 2024-05-15T18:08:58.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.577+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93964981161984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5361d0 con 0x5575ed5275b0 2024-05-15T18:08:58.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.578+0000 7f2c70d52640 1 -- 172.21.15.173:0/4051553241 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93964981161984] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c60093020 con 0x5575ed5275b0 2024-05-15T18:08:58.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.578+0000 7f2c7512b800 20 remove_watcher() i=2 2024-05-15T18:08:58.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.578+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93964981173936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5361d0 con 0x7f2c600a1070 2024-05-15T18:08:58.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.579+0000 7f2c68551640 1 -- 172.21.15.173:0/4051553241 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93964981173936] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c58009050 con 0x7f2c600a1070 2024-05-15T18:08:58.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.579+0000 7f2c7512b800 20 remove_watcher() i=3 2024-05-15T18:08:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.579+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93964981177632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52feb0 con 0x5575ed522bc0 2024-05-15T18:08:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.580+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93964981177632] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x5575ed522bc0 2024-05-15T18:08:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.580+0000 7f2c7512b800 20 remove_watcher() i=4 2024-05-15T18:08:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.580+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93964981170320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5361d0 con 0x7f2c58037040 2024-05-15T18:08:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.581+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93964981170320] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.581+0000 7f2c7512b800 20 remove_watcher() i=5 2024-05-15T18:08:58.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.581+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93964981182688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed52f090 con 0x7f2c58037040 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.582+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93964981182688] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.582+0000 7f2c7512b800 20 remove_watcher() i=6 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.582+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93964981184928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5575ed5361d0 con 0x7f2c58037040 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93964981184928] v29'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2c6c031040 con 0x7f2c58037040 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 20 remove_watcher() i=7 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2c58037040 msgr2=0x7f2c58036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2c58037040 0x7f2c58036410 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed522bc0 msgr2=0x5575ed525080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed522bc0 0x5575ed525080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2c600a1070 msgr2=0x7f2c600814a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2c600a1070 0x7f2c600814a0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed5275b0 msgr2=0x5575ed5299a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed5275b0 0x5575ed5299a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b3c036aa0 msgr2=0x7f2b3c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b3c036aa0 0x7f2b3c038f60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5575ed4f4e80 tx=0x7f2c58010000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 msgr2=0x5575ed517570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c71553640 1 -- 172.21.15.173:0/4051553241 reap_dead start 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed517570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c60068d30 tx=0x7f2c60006fc0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 shutdown_connections 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 --2- 172.21.15.173:0/4051553241 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed510040 0x5575ed517570 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 >> 172.21.15.173:0/4051553241 conn(0x5575ed50c360 msgr2=0x5575ed5099c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 shutdown_connections 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.583+0000 7f2c7512b800 1 -- 172.21.15.173:0/4051553241 wait complete. 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b48036900 msgr2=0x7f2b48038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b48036900 0x7f2b48038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5575ed4e8b00 tx=0x7f2c5800f000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed502ee0 msgr2=0x5575ed503300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed502ee0 0x5575ed503300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2c6008d010 tx=0x7f2c6005b670 comp rx=0 tx=0).stop 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 shutdown_connections 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b48036900 0x7f2b48038dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/42259190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed502ee0 0x5575ed503300 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 >> 172.21.15.173:0/42259190 conn(0x5575ed4f6f80 msgr2=0x5575ed4f7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 shutdown_connections 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/42259190 wait complete. 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5575ed4f1eb0 msgr2=0x5575ed4f4320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5575ed4f1eb0 0x5575ed4f4320 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed3ea370 msgr2=0x5575ed4eb610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5575ed3ea370 0x5575ed4eb610 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed4edde0 msgr2=0x5575ed4f0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5575ed4edde0 0x5575ed4f0270 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b58036900 msgr2=0x7f2b58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2b58036900 0x7f2b58038dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c58001d90 tx=0x7f2c580012f0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 msgr2=0x5575ed4e43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 --2- 172.21.15.173:0/2226690612 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5575ed3e9160 0x5575ed4e43d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2c6004ad90 tx=0x7f2c60002fb0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c71553640 1 -- 172.21.15.173:0/2226690612 reap_dead start 2024-05-15T18:08:58.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 shutdown_connections 2024-05-15T18:08:58.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 >> 172.21.15.173:0/2226690612 conn(0x5575ed3e47a0 msgr2=0x5575ed35d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 shutdown_connections 2024-05-15T18:08:58.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.584+0000 7f2c7512b800 1 -- 172.21.15.173:0/2226690612 wait complete. 2024-05-15T18:08:58.608 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:08:58.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-15T18:08:58.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-15T18:08:58.609 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-15T18:08:58.653 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:58.653 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:58.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.677+0000 7f2070413800 1 Processor -- start 2024-05-15T18:08:58.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.677+0000 7f2070413800 1 -- start start 2024-05-15T18:08:58.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.677+0000 7f2070413800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5638a85a1a20 0x5638a85a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.677+0000 7f2070413800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638a8516a20 con 0x5638a85a2380 2024-05-15T18:08:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.677+0000 7f2070413800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5638a8434050 con 0x5638a85a1a20 2024-05-15T18:08:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.678+0000 7f206ba6e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5638a85a1a20 0x5638a85a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.678+0000 7f206ba6e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5638a85a1a20 0x5638a85a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38114/0 (socket says 172.21.15.173:38114) 2024-05-15T18:08:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.678+0000 7f206ba6e640 1 -- 172.21.15.173:0/924565479 learned_addr learned my addr 172.21.15.173:0/924565479 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.678+0000 7f206b26d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5638a85a2380 0x5638a85a2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:56978/0 (socket says 172.21.15.173:56978) 2024-05-15T18:08:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.678+0000 7f206ba6e640 1 -- 172.21.15.173:0/924565479 >> v1:172.21.15.3:6789/0 conn(0x5638a85a2380 legacy=0x5638a85a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.678+0000 7f206ba6e640 1 -- 172.21.15.173:0/924565479 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a85a2f40 con 0x5638a85a1a20 2024-05-15T18:08:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f206ba6e640 1 --2- 172.21.15.173:0/924565479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a85a1e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a520 tx=0x7f205c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8920f4a981fc5b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f206aa6c640 1 -- 172.21.15.173:0/924565479 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c057070 con 0x5638a85a1a20 2024-05-15T18:08:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f206aa6c640 1 -- 172.21.15.173:0/924565479 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c052570 con 0x5638a85a1a20 2024-05-15T18:08:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f206aa6c640 1 -- 172.21.15.173:0/924565479 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c04ae60 con 0x5638a85a1a20 2024-05-15T18:08:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f2070413800 1 -- 172.21.15.173:0/924565479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 msgr2=0x5638a85a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f2070413800 1 --2- 172.21.15.173:0/924565479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a85a1e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a520 tx=0x7f205c01d010 comp rx=0 tx=0).stop 2024-05-15T18:08:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f2070413800 1 -- 172.21.15.173:0/924565479 shutdown_connections 2024-05-15T18:08:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f2070413800 1 --2- 172.21.15.173:0/924565479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a85a1e40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f2070413800 1 -- 172.21.15.173:0/924565479 >> 172.21.15.173:0/924565479 conn(0x5638a859d5a0 msgr2=0x5638a859f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.680+0000 7f2070413800 1 -- 172.21.15.173:0/924565479 shutdown_connections 2024-05-15T18:08:58.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.681+0000 7f2070413800 1 -- 172.21.15.173:0/924565479 wait complete. 2024-05-15T18:08:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.694+0000 7f2070413800 1 Processor -- start 2024-05-15T18:08:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.694+0000 7f2070413800 1 -- start start 2024-05-15T18:08:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.694+0000 7f2070413800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a8696bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.694+0000 7f2070413800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5638a84ee1d0 con 0x5638a85a1a20 2024-05-15T18:08:58.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.694+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a8696bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.694+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a8696bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38128/0 (socket says 172.21.15.173:38128) 2024-05-15T18:08:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.694+0000 7f206ba6e640 1 -- 172.21.15.173:0/202179164 learned_addr learned my addr 172.21.15.173:0/202179164 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.695+0000 7f206ba6e640 1 -- 172.21.15.173:0/202179164 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a8697190 con 0x5638a85a1a20 2024-05-15T18:08:58.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.695+0000 7f206ba6e640 1 --2- 172.21.15.173:0/202179164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a8696bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f205c055040 tx=0x7f205c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b664eb23dd822cb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.695+0000 7f1f59e0b640 1 -- 172.21.15.173:0/202179164 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c057040 con 0x5638a85a1a20 2024-05-15T18:08:58.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.695+0000 7f1f59e0b640 1 -- 172.21.15.173:0/202179164 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c052720 con 0x5638a85a1a20 2024-05-15T18:08:58.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.695+0000 7f1f59e0b640 1 -- 172.21.15.173:0/202179164 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c052a40 con 0x5638a85a1a20 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 -- 172.21.15.173:0/202179164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 msgr2=0x5638a8696bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 --2- 172.21.15.173:0/202179164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a8696bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f205c055040 tx=0x7f205c04c000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 -- 172.21.15.173:0/202179164 shutdown_connections 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 --2- 172.21.15.173:0/202179164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a8696bc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 -- 172.21.15.173:0/202179164 >> 172.21.15.173:0/202179164 conn(0x5638a859d5a0 msgr2=0x5638a86924e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 -- 172.21.15.173:0/202179164 shutdown_connections 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 -- 172.21.15.173:0/202179164 wait complete. 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 Processor -- start 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.696+0000 7f2070413800 1 -- start start 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f2070413800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a869e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f2070413800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5638a85a3410 con 0x5638a85a1a20 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a869e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a869e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38144/0 (socket says 172.21.15.173:38144) 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f206ba6e640 1 -- 172.21.15.173:0/3863944228 learned_addr learned my addr 172.21.15.173:0/3863944228 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f206ba6e640 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a869eb10 con 0x5638a85a1a20 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f206ba6e640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a869e5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f205c0524f0 tx=0x7f205c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f1f53fff640 1 -- 172.21.15.173:0/3863944228 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c073070 con 0x5638a85a1a20 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f1f53fff640 1 -- 172.21.15.173:0/3863944228 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c05d440 con 0x5638a85a1a20 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a869eda0 con 0x5638a85a1a20 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.697+0000 7f1f53fff640 1 -- 172.21.15.173:0/3863944228 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c057070 con 0x5638a85a1a20 2024-05-15T18:08:58.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.698+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a86a1a50 con 0x5638a85a1a20 2024-05-15T18:08:58.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.698+0000 7f1f53fff640 1 -- 172.21.15.173:0/3863944228 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f205c076070 con 0x5638a85a1a20 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.698+0000 7f1f53fff640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036950 0x7f1f54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f1f53fff640 1 -- 172.21.15.173:0/3863944228 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f205c08db90 con 0x5638a85a1a20 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f206b26d640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036950 0x7f1f54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a85a2380 0x5638a86a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86a5d50 con 0x5638a85a2380 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f206c26f640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a85a2380 0x5638a86a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f206b26d640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036950 0x7f1f54038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2060000f60 tx=0x7f2060001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f206c26f640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a85a2380 0x5638a86a5810 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f206c26f640 1 -- 172.21.15.173:0/3863944228 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a85a2380 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.699+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86a2de0 con 0x5638a85a2380 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.700+0000 7f206c26f640 1 -- 172.21.15.173:0/3863944228 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a85a2380 2024-05-15T18:08:58.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.700+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86a80f0 0x5638a86aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.700+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86aab80 con 0x5638a86a80f0 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.700+0000 7f206ba6e640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86a80f0 0x5638a86aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.700+0000 7f206ba6e640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86a80f0 0x5638a86aa4e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.700+0000 7f206ba6e640 1 -- 172.21.15.173:0/3863944228 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f205c075030 con 0x5638a86a80f0 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.700+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86a70a0 con 0x5638a85a2380 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.701+0000 7f206c26f640 1 -- 172.21.15.173:0/3863944228 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a85a2380 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.701+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5638a86ac030 0x5638a86ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.701+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86aebe0 con 0x5638a86ac030 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.701+0000 7f206b26d640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5638a86ac030 0x5638a86ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.701+0000 7f206b26d640 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5638a86ac030 0x5638a86ae480 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.701+0000 7f206b26d640 1 -- 172.21.15.173:0/3863944228 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f206000f690 con 0x5638a86ac030 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f2070413800 1 Processor -- start 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f2070413800 1 -- start start 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f2070413800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86bd040 0x5638a86bd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f2070413800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5638a8494cf0 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86bd040 0x5638a86bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86bd040 0x5638a86bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38150/0 (socket says 172.21.15.173:38150) 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f206ba6e640 1 -- 172.21.15.173:0/2042528751 learned_addr learned my addr 172.21.15.173:0/2042528751 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.702+0000 7f206ba6e640 1 -- 172.21.15.173:0/2042528751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a86bd9a0 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.703+0000 7f206ba6e640 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86bd040 0x5638a86bd460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f205c08c0a0 tx=0x7f205c076f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.703+0000 7f1f517fa640 1 -- 172.21.15.173:0/2042528751 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c007e40 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.703+0000 7f1f517fa640 1 -- 172.21.15.173:0/2042528751 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c007fe0 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.703+0000 7f1f517fa640 1 -- 172.21.15.173:0/2042528751 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c077a50 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.703+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a86be410 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.703+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a86be910 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.703+0000 7f1f517fa640 1 -- 172.21.15.173:0/2042528751 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f205c077bf0 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f1f517fa640 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036900 0x7f1f44038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f1f517fa640 1 -- 172.21.15.173:0/2042528751 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f205c089070 con 0x5638a86bd040 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f206b26d640 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036900 0x7f1f44038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f2070413800 1 Processor -- start 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f2070413800 1 -- start start 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f206b26d640 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036900 0x7f1f44038dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5638a86a2d00 tx=0x7f206000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f2070413800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f2070413800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5638a8697450 con 0x5638a86ca250 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.704+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38160/0 (socket says 172.21.15.173:38160) 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f206ba6e640 1 -- 172.21.15.173:0/1460965879 learned_addr learned my addr 172.21.15.173:0/1460965879 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f206ba6e640 1 -- 172.21.15.173:0/1460965879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a86cac40 con 0x5638a86ca250 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f206ba6e640 1 --2- 172.21.15.173:0/1460965879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86ca670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f205c090000 tx=0x7f205c077470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f571171ad1874cb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f1f4affd640 1 -- 172.21.15.173:0/1460965879 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c0965e0 con 0x5638a86ca250 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f1f4affd640 1 -- 172.21.15.173:0/1460965879 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c078440 con 0x5638a86ca250 2024-05-15T18:08:58.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f1f4affd640 1 -- 172.21.15.173:0/1460965879 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c096400 con 0x5638a86ca250 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f2070413800 1 -- 172.21.15.173:0/1460965879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 msgr2=0x5638a86ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.705+0000 7f2070413800 1 --2- 172.21.15.173:0/1460965879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86ca670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f205c090000 tx=0x7f205c077470 comp rx=0 tx=0).stop 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 -- 172.21.15.173:0/1460965879 shutdown_connections 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 --2- 172.21.15.173:0/1460965879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86ca670 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 -- 172.21.15.173:0/1460965879 >> 172.21.15.173:0/1460965879 conn(0x5638a86c6560 msgr2=0x5638a86c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 -- 172.21.15.173:0/1460965879 shutdown_connections 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 -- 172.21.15.173:0/1460965879 wait complete. 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 Processor -- start 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 -- start start 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86d1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f2070413800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5638a86cb2d0 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f206ba6e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86d1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38164/0 (socket says 172.21.15.173:38164) 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 learned_addr learned my addr 172.21.15.173:0/4213662732 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.706+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a86d1b50 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.707+0000 7f206ba6e640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86d1610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f205c090000 tx=0x7f205c099ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.707+0000 7f1f497fa640 1 -- 172.21.15.173:0/4213662732 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c0965e0 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.707+0000 7f1f497fa640 1 -- 172.21.15.173:0/4213662732 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c0b0040 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.707+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a86d1b50 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.707+0000 7f1f497fa640 1 -- 172.21.15.173:0/4213662732 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c056ae0 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.707+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a86d2050 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.708+0000 7f1f497fa640 1 -- 172.21.15.173:0/4213662732 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f205c056c80 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.708+0000 7f1f497fa640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.708+0000 7f1f497fa640 1 -- 172.21.15.173:0/4213662732 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f205c0bb210 con 0x5638a86ca250 2024-05-15T18:08:58.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.708+0000 7f206b26d640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.708+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.708+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a86dcd40 0x5638a86df200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.708+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86df950 con 0x5638a86dcd40 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f206c26f640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a86dcd40 0x5638a86df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f206b26d640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5638a86aefe0 tx=0x7f2060010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f206c26f640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a86dcd40 0x5638a86df200 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 20 realm 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86dfd60 con 0x5638a86dcd40 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.709+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e0630 con 0x5638a86dcd40 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f2070413800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f2070413800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86e14c0 0x5638a86e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e4010 con 0x5638a86e14c0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f206ba6e640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86e14c0 0x5638a86e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.710+0000 7f206ba6e640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86e14c0 0x5638a86e38b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f2070413800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f2070413800 20 searching for the correct realm 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e59f0 con 0x5638a86e14c0 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f206ba6e640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f205c096c20 0x7f205c08d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e59f0 con 0x7f205c096c20 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f206b26d640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f205c096c20 0x7f205c08d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.711+0000 7f206b26d640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f205c096c20 0x7f205c08d500 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.712+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.712+0000 7f206b26d640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f206000f070 0x7f206002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.712+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e59f0 con 0x7f206000f070 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.712+0000 7f206c26f640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f206000f070 0x7f206002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.712+0000 7f206c26f640 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f206000f070 0x7f206002e910 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.713+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f205c096c20 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.714+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.715+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.715+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.715+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.715+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f205c096c20 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.715+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.715+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.716+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.717+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f205c096c20 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.718+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.719+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.719+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.719+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.719+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f205c096c20 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.719+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.719+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86e14c0 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f206000f070 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x5638a86dcd40 2024-05-15T18:08:58.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e09d0 con 0x7f205c096c20 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.720+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e49c0 con 0x5638a86dcd40 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e4db0 con 0x5638a86dcd40 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e4db0 con 0x7f206000f070 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 zone default found 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 4 Realm: () 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 zonegroup default 2024-05-15T18:08:58.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.721+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e51d0 con 0x7f206000f070 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e55f0 con 0x5638a86e14c0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e78a0 con 0x5638a86e14c0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 20 started sync module instance, tier type = 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.722+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e6d40 con 0x7f205c096c20 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.723+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.723+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801343967536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e69a0 con 0x7f205c096c20 2024-05-15T18:08:58.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.723+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e8710 con 0x5638a86dcd40 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.724+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801343967536] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.725+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.725+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801343971936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e8680 con 0x5638a86dcd40 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.725+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e95d0 con 0x5638a86e14c0 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.725+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801343971936] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.726+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.726+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801343975712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e99c0 con 0x5638a86e14c0 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.726+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ea3e0 con 0x7f205c096c20 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.727+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801343975712] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.727+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.727+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801343974144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86eac80 con 0x7f205c096c20 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.727+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86eb640 con 0x5638a86dcd40 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.728+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801343974144] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.728+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.728+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801343984016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86eba60 con 0x5638a86dcd40 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.728+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ec420 con 0x7f206000f070 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.729+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.729+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801343987568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ec840 con 0x7f206000f070 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.729+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ed340 con 0x7f206000f070 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.729+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801343984016] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.730+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801343987568] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.730+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.730+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801343985072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ec840 con 0x7f206000f070 2024-05-15T18:08:58.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.730+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ed7b0 con 0x7f206000f070 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801343985072] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801343988624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ed990 con 0x7f206000f070 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 20 add_watcher() i=0 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 20 add_watcher() i=1 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 20 add_watcher() i=2 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 20 add_watcher() i=3 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 20 add_watcher() i=4 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 20 add_watcher() i=5 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.731+0000 7f2070413800 20 add_watcher() i=6 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.732+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801343988624] v29'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.732+0000 7f2070413800 20 add_watcher() i=7 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.732+0000 7f2070413800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.732+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a86f0b40 con 0x5638a86dcd40 2024-05-15T18:08:58.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.733+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.733+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801343993152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86ede10 con 0x5638a86dcd40 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801343993152] v29'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f1f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f2070413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f2070413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f2070413800 5 note: GC not initialized 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f1f20fe1640 20 reqs_thread_entry: start 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f2070413800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f2070413800 20 Filter name: none 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f1e9a7fc640 20 reqs_thread_entry: start 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.734+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a8723bf0 con 0x5638a86dcd40 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f2070413800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:58.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f2070413800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a8723fd0 con 0x5638a86dcd40 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f2070413800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5638a8723fd0 con 0x7f205c096c20 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.735+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.736+0000 7f1f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.736+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801343993152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a8723fd0 con 0x5638a86dcd40 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.737+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94801343993152] v29'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.737+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801343967536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a8723fd0 con 0x7f205c096c20 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.738+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94801343967536] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.738+0000 7f2070413800 20 remove_watcher() i=0 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.738+0000 7f2070413800 2 removed watcher, disabling cache 2024-05-15T18:08:58.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.738+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801343971936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a8723fd0 con 0x5638a86dcd40 2024-05-15T18:08:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.740+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94801343971936] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.740+0000 7f2070413800 20 remove_watcher() i=1 2024-05-15T18:08:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.740+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801343975712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e7130 con 0x5638a86e14c0 2024-05-15T18:08:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.741+0000 7f206ba6e640 1 -- 172.21.15.173:0/4213662732 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94801343975712] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c075030 con 0x5638a86e14c0 2024-05-15T18:08:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.741+0000 7f2070413800 20 remove_watcher() i=2 2024-05-15T18:08:58.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.741+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801343974144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e8260 con 0x7f205c096c20 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.742+0000 7f206b26d640 1 -- 172.21.15.173:0/4213662732 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94801343974144] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2060037040 con 0x7f205c096c20 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.742+0000 7f2070413800 20 remove_watcher() i=3 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.742+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801343984016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e9120 con 0x5638a86dcd40 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.743+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94801343984016] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x5638a86dcd40 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.743+0000 7f2070413800 20 remove_watcher() i=4 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.743+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801343987568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e7130 con 0x7f206000f070 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.744+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94801343987568] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.744+0000 7f2070413800 20 remove_watcher() i=5 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.744+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801343985072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e8260 con 0x7f206000f070 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.745+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94801343985072] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.745+0000 7f2070413800 20 remove_watcher() i=6 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.745+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801343988624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5638a86e9120 con 0x7f206000f070 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94801343988624] v29'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206400a4a0 con 0x7f206000f070 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 20 remove_watcher() i=7 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f206000f070 msgr2=0x7f206002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f206000f070 0x7f206002e910 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a86dcd40 msgr2=0x5638a86df200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a86dcd40 0x5638a86df200 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f205c096c20 msgr2=0x7f205c08d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f205c096c20 0x7f205c08d500 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86e14c0 msgr2=0x5638a86e38b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86e14c0 0x5638a86e38b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 msgr2=0x7f1f34038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5638a86aefe0 tx=0x7f2060010000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 msgr2=0x5638a86d1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f206c26f640 1 -- 172.21.15.173:0/4213662732 reap_dead start 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86d1610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f205c090000 tx=0x7f205c099ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 shutdown_connections 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 --2- 172.21.15.173:0/4213662732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86ca250 0x5638a86d1610 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 >> 172.21.15.173:0/4213662732 conn(0x5638a86c6560 msgr2=0x5638a86c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 shutdown_connections 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.746+0000 7f2070413800 1 -- 172.21.15.173:0/4213662732 wait complete. 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036900 msgr2=0x7f1f44038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036900 0x7f1f44038dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x5638a86a2d00 tx=0x7f206000f000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86bd040 msgr2=0x5638a86bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86bd040 0x5638a86bd460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f205c08c0a0 tx=0x7f205c076f70 comp rx=0 tx=0).stop 2024-05-15T18:08:58.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 shutdown_connections 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036900 0x7f1f44038dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/2042528751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a86bd040 0x5638a86bd460 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 >> 172.21.15.173:0/2042528751 conn(0x5638a86b10e0 msgr2=0x5638a86b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 shutdown_connections 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/2042528751 wait complete. 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5638a86ac030 msgr2=0x5638a86ae480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5638a86ac030 0x5638a86ae480 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a85a2380 msgr2=0x5638a86a5810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5638a85a2380 0x5638a86a5810 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86a80f0 msgr2=0x5638a86aa4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5638a86a80f0 0x5638a86aa4e0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036950 msgr2=0x7f1f54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036950 0x7f1f54038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2060000f60 tx=0x7f2060001370 comp rx=0 tx=0).stop 2024-05-15T18:08:58.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 msgr2=0x5638a869e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 --2- 172.21.15.173:0/3863944228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5638a85a1a20 0x5638a869e5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f205c0524f0 tx=0x7f205c003020 comp rx=0 tx=0).stop 2024-05-15T18:08:58.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f206c26f640 1 -- 172.21.15.173:0/3863944228 reap_dead start 2024-05-15T18:08:58.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 shutdown_connections 2024-05-15T18:08:58.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 >> 172.21.15.173:0/3863944228 conn(0x5638a859d5a0 msgr2=0x5638a8690ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 shutdown_connections 2024-05-15T18:08:58.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.747+0000 7f2070413800 1 -- 172.21.15.173:0/3863944228 wait complete. 2024-05-15T18:08:58.733 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-05-15T18:08:58.733 DEBUG:tasks.util.rgw: json result: [] 2024-05-15T18:08:58.733 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-15T18:08:58.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-15T18:08:58.733 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-15T18:08:58.778 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:58.778 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:58.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.802+0000 7fb95172f800 1 Processor -- start 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.802+0000 7fb95172f800 1 -- start start 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.802+0000 7fb95172f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5630721b6520 0x5630721bf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.802+0000 7fb95172f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563072129920 con 0x5630721b49e0 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.802+0000 7fb95172f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x563072047050 con 0x5630721b6520 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.803+0000 7fb94cbad640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5630721b6520 0x5630721bf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.803+0000 7fb94cbad640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5630721b6520 0x5630721bf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38168/0 (socket says 172.21.15.173:38168) 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.803+0000 7fb94cbad640 1 -- 172.21.15.173:0/125306252 learned_addr learned my addr 172.21.15.173:0/125306252 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.803+0000 7fb94d3ae640 1 --1- 172.21.15.173:0/125306252 >> v1:172.21.15.3:6789/0 conn(0x5630721b49e0 0x5630721b4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:56990/0 (socket says 172.21.15.173:56990) 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.803+0000 7fb94cbad640 1 -- 172.21.15.173:0/125306252 >> v1:172.21.15.3:6789/0 conn(0x5630721b49e0 legacy=0x5630721b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.803+0000 7fb94cbad640 1 -- 172.21.15.173:0/125306252 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630721c0570 con 0x5630721b6520 2024-05-15T18:08:58.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.805+0000 7fb94cbad640 1 --2- 172.21.15.173:0/125306252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b6520 0x5630721bf020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb94400a520 tx=0x7fb94401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc6d376e5b2c962 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.805+0000 7fb93ffff640 1 -- 172.21.15.173:0/125306252 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb944057070 con 0x5630721b6520 2024-05-15T18:08:58.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.805+0000 7fb93ffff640 1 -- 172.21.15.173:0/125306252 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb944052570 con 0x5630721b6520 2024-05-15T18:08:58.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.805+0000 7fb93ffff640 1 -- 172.21.15.173:0/125306252 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb944052870 con 0x5630721b6520 2024-05-15T18:08:58.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.806+0000 7fb95172f800 1 -- 172.21.15.173:0/125306252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b6520 msgr2=0x5630721bf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.806+0000 7fb95172f800 1 --2- 172.21.15.173:0/125306252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b6520 0x5630721bf020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb94400a520 tx=0x7fb94401d010 comp rx=0 tx=0).stop 2024-05-15T18:08:58.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.806+0000 7fb95172f800 1 -- 172.21.15.173:0/125306252 shutdown_connections 2024-05-15T18:08:58.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.806+0000 7fb95172f800 1 --2- 172.21.15.173:0/125306252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b6520 0x5630721bf020 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.806+0000 7fb95172f800 1 -- 172.21.15.173:0/125306252 >> 172.21.15.173:0/125306252 conn(0x5630721b05a0 msgr2=0x5630721b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.806+0000 7fb95172f800 1 -- 172.21.15.173:0/125306252 shutdown_connections 2024-05-15T18:08:58.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.806+0000 7fb95172f800 1 -- 172.21.15.173:0/125306252 wait complete. 2024-05-15T18:08:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.819+0000 7fb95172f800 1 Processor -- start 2024-05-15T18:08:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.819+0000 7fb95172f800 1 -- start start 2024-05-15T18:08:58.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.819+0000 7fb95172f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722a9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.819+0000 7fb95172f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5630721011d0 con 0x5630721b49e0 2024-05-15T18:08:58.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38174/0 (socket says 172.21.15.173:38174) 2024-05-15T18:08:58.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb94d3ae640 1 -- 172.21.15.173:0/2442731335 learned_addr learned my addr 172.21.15.173:0/2442731335 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb94d3ae640 1 -- 172.21.15.173:0/2442731335 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630722a9f60 con 0x5630721b49e0 2024-05-15T18:08:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/2442731335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722a9990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb940001610 tx=0x7fb940006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db877bb2c979cc6a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb83b606640 1 -- 172.21.15.173:0/2442731335 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb940013420 con 0x5630721b49e0 2024-05-15T18:08:58.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb83b606640 1 -- 172.21.15.173:0/2442731335 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9400135e0 con 0x5630721b49e0 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.820+0000 7fb83b606640 1 -- 172.21.15.173:0/2442731335 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb940013940 con 0x5630721b49e0 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 -- 172.21.15.173:0/2442731335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 msgr2=0x5630722a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 --2- 172.21.15.173:0/2442731335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722a9990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb940001610 tx=0x7fb940006f90 comp rx=0 tx=0).stop 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 -- 172.21.15.173:0/2442731335 shutdown_connections 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 --2- 172.21.15.173:0/2442731335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722a9990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 -- 172.21.15.173:0/2442731335 >> 172.21.15.173:0/2442731335 conn(0x5630721b05a0 msgr2=0x5630722a52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 -- 172.21.15.173:0/2442731335 shutdown_connections 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 -- 172.21.15.173:0/2442731335 wait complete. 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 Processor -- start 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.821+0000 7fb95172f800 1 -- start start 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb95172f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb95172f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5630721bf830 con 0x5630721b49e0 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38180/0 (socket says 172.21.15.173:38180) 2024-05-15T18:08:58.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1900408600 learned_addr learned my addr 172.21.15.173:0/1900408600 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630722b1a40 con 0x5630721b49e0 2024-05-15T18:08:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722b1500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb94000f000 tx=0x7fb940000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb839e03640 1 -- 172.21.15.173:0/1900408600 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb940022020 con 0x5630721b49e0 2024-05-15T18:08:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb839e03640 1 -- 172.21.15.173:0/1900408600 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb940019040 con 0x5630721b49e0 2024-05-15T18:08:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630722b1cd0 con 0x5630721b49e0 2024-05-15T18:08:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.822+0000 7fb839e03640 1 -- 172.21.15.173:0/1900408600 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb940004b20 con 0x5630721b49e0 2024-05-15T18:08:58.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.823+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630722b4980 con 0x5630721b49e0 2024-05-15T18:08:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.823+0000 7fb839e03640 1 -- 172.21.15.173:0/1900408600 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb940025020 con 0x5630721b49e0 2024-05-15T18:08:58.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.823+0000 7fb839e03640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb834036900 0x7fb834038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.823+0000 7fb839e03640 1 -- 172.21.15.173:0/1900408600 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb94004c520 con 0x5630721b49e0 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb834036900 0x7fb834038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630721b6520 0x5630722b8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722b8d10 con 0x5630721b6520 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb94dbaf640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630721b6520 0x5630722b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb834036900 0x7fb834038dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb944054000 tx=0x7fb94404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb94dbaf640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630721b6520 0x5630722b8740 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1900408600 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630721b6520 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.824+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722b5cf0 con 0x5630721b6520 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.825+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1900408600 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9480083e0 con 0x5630721b6520 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.825+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722bb020 0x5630722bd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.825+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722bdb00 con 0x5630722bb020 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.825+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722bb020 0x5630722bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.825+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722bb020 0x5630722bd410 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.825+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1900408600 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb94000f030 con 0x5630722bb020 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.825+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722b9fa0 con 0x5630721b6520 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.826+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1900408600 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9480083e0 con 0x5630721b6520 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.826+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5630722bef60 0x5630722c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.826+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722c1b40 con 0x5630722bef60 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.826+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5630722bef60 0x5630722c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.827+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5630722bef60 0x5630722c13b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.827+0000 7fb94cbad640 1 -- 172.21.15.173:0/1900408600 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb94405a040 con 0x5630722bef60 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.827+0000 7fb95172f800 1 Processor -- start 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.827+0000 7fb95172f800 1 -- start start 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.827+0000 7fb95172f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722cffa0 0x5630722d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb95172f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5630720a7cf0 con 0x5630722cffa0 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722cffa0 0x5630722d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722cffa0 0x5630722d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38196/0 (socket says 172.21.15.173:38196) 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb94d3ae640 1 -- 172.21.15.173:0/100840408 learned_addr learned my addr 172.21.15.173:0/100840408 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb94d3ae640 1 -- 172.21.15.173:0/100840408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630722d0900 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722cffa0 0x5630722d03c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb940004fd0 tx=0x7fb94001eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb832ffd640 1 -- 172.21.15.173:0/100840408 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9400444d0 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb832ffd640 1 -- 172.21.15.173:0/100840408 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb940034070 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb832ffd640 1 -- 172.21.15.173:0/100840408 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9400490c0 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630722d1370 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.828+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630722d1870 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.829+0000 7fb832ffd640 1 -- 172.21.15.173:0/100840408 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb940036020 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.829+0000 7fb832ffd640 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb824036950 0x7fb824038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.829+0000 7fb832ffd640 1 -- 172.21.15.173:0/100840408 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb94004e080 con 0x5630722cffa0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.829+0000 7fb94cbad640 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb824036950 0x7fb824038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb95172f800 1 Processor -- start 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb95172f800 1 -- start start 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb94cbad640 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb824036950 0x7fb824038e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5630722b91c0 tx=0x7fb944005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb95172f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722dd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb95172f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5630722aa2e0 con 0x5630722dd030 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722dd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722dd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38208/0 (socket says 172.21.15.173:38208) 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb94d3ae640 1 -- 172.21.15.173:0/3914489116 learned_addr learned my addr 172.21.15.173:0/3914489116 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.830+0000 7fb94d3ae640 1 -- 172.21.15.173:0/3914489116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630722dda20 con 0x5630722dd030 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/3914489116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722dd450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb940011d40 tx=0x7fb94000ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda88fb534468cc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb830ff9640 1 -- 172.21.15.173:0/3914489116 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb940026c10 con 0x5630722dd030 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb830ff9640 1 -- 172.21.15.173:0/3914489116 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb940010590 con 0x5630722dd030 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb830ff9640 1 -- 172.21.15.173:0/3914489116 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9400494a0 con 0x5630722dd030 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 -- 172.21.15.173:0/3914489116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 msgr2=0x5630722dd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 --2- 172.21.15.173:0/3914489116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722dd450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb940011d40 tx=0x7fb94000ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 -- 172.21.15.173:0/3914489116 shutdown_connections 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 --2- 172.21.15.173:0/3914489116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722dd450 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 -- 172.21.15.173:0/3914489116 >> 172.21.15.173:0/3914489116 conn(0x5630722d9350 msgr2=0x5630722d73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 -- 172.21.15.173:0/3914489116 shutdown_connections 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 -- 172.21.15.173:0/3914489116 wait complete. 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.831+0000 7fb95172f800 1 Processor -- start 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb95172f800 1 -- start start 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb95172f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722e4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb95172f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5630722de140 con 0x5630722dd030 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb94d3ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38224/0 (socket says 172.21.15.173:38224) 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 learned_addr learned my addr 172.21.15.173:0/1362461647 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630722e49a0 con 0x5630722dd030 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.832+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722e4460 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb940011d40 tx=0x7fb940015fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.833+0000 7fb822ffd640 1 -- 172.21.15.173:0/1362461647 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9400494a0 con 0x5630722dd030 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.833+0000 7fb822ffd640 1 -- 172.21.15.173:0/1362461647 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94004c880 con 0x5630722dd030 2024-05-15T18:08:58.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.833+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630722e49a0 con 0x5630722dd030 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.833+0000 7fb822ffd640 1 -- 172.21.15.173:0/1362461647 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb940049640 con 0x5630722dd030 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.833+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630722e4e40 con 0x5630722dd030 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.833+0000 7fb822ffd640 1 -- 172.21.15.173:0/1362461647 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb940010070 con 0x5630722dd030 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb822ffd640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb818036950 0x7fb818038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb822ffd640 1 -- 172.21.15.173:0/1362461647 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb940057070 con 0x5630722dd030 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb818036950 0x7fb818038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630722efa40 0x5630722f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f2650 con 0x5630722efa40 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb94dbaf640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630722efa40 0x5630722f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb818036950 0x7fb818038e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb944052bb0 tx=0x7fb94404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.834+0000 7fb94dbaf640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630722efa40 0x5630722f1f00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 realm 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f2a60 con 0x5630722efa40 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x5630722efa40 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f36d0 con 0x5630722efa40 2024-05-15T18:08:58.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722f4090 0x5630722f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f69c0 con 0x5630722f4090 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.835+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722f4090 0x5630722f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722f4090 0x5630722f6480 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb95172f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb95172f800 20 searching for the correct realm 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f83d0 con 0x5630722f4090 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb94d3ae640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb940065040 0x7fb940065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f83d0 con 0x7fb940065040 2024-05-15T18:08:58.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.836+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb940065040 0x7fb940065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.837+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb940065040 0x7fb940065810 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.837+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.837+0000 7fb94cbad640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb944074040 0x7fb944081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.837+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f83d0 con 0x7fb944074040 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.837+0000 7fb94dbaf640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb944074040 0x7fb944081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.838+0000 7fb94dbaf640 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb944074040 0x7fb944081410 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.838+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.838+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x5630722efa40 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.838+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.838+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x5630722efa40 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.838+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.838+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x7fb944074040 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x7fb944074040 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x7fb940065040 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x5630722f4090 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.839+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x5630722efa40 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb948026040 con 0x7fb944074040 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb948026040 con 0x5630722efa40 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb948026040 con 0x7fb940065040 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.840+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722f4090 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722f4090 2024-05-15T18:08:58.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb944074040 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722f4090 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.841+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722f4090 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722efa40 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722efa40 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb944074040 2024-05-15T18:08:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.842+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722f4090 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb940065040 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722efa40 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb944074040 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722f4090 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.843+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb944074040 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.844+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.844+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb940065040 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.844+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.844+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722f4090 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.844+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.844+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb944074040 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x5630722efa40 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb94408e060 con 0x7fb940065040 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f3330 con 0x5630722efa40 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.845+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f7360 con 0x5630722efa40 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f7360 con 0x7fb944074040 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 zone default found 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 4 Realm: () 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 zonegroup default 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f7780 con 0x7fb944074040 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.846+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722f7ba0 con 0x5630722f4090 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb95172f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630722fa280 con 0x5630722f4090 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb95172f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb95172f800 20 started sync module instance, tier type = 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb95172f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.847+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722f9720 con 0x7fb940065040 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.848+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.848+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94766074139248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fa620 con 0x7fb940065040 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.848+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fae70 con 0x5630722efa40 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.849+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94766074139248] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.849+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.849+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94766074145216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fb290 con 0x5630722efa40 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.849+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fbae0 con 0x5630722f4090 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.850+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94766074145216] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.851+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.851+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94766074146784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fbed0 con 0x5630722f4090 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.851+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fc920 con 0x7fb940065040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.852+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94766074146784] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.852+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.852+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94766074151952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fcd10 con 0x7fb940065040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.852+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fd710 con 0x5630722efa40 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.853+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94766074151952] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.853+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.853+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94766074147936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fdb00 con 0x5630722efa40 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.853+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fe520 con 0x7fb944074040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.854+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.854+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94766074159120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fe4e0 con 0x7fb944074040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.854+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722ff4e0 con 0x7fb944074040 2024-05-15T18:08:58.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.854+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94766074147936] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.856+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94766074159120] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.856+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.856+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94766074161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fefe0 con 0x7fb944074040 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.856+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722ff990 con 0x7fb944074040 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94766074161472] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94766074155552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722ff990 con 0x7fb944074040 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 20 add_watcher() i=0 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 20 add_watcher() i=1 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 20 add_watcher() i=2 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 20 add_watcher() i=3 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 20 add_watcher() i=4 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 20 add_watcher() i=5 2024-05-15T18:08:58.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.857+0000 7fb95172f800 20 add_watcher() i=6 2024-05-15T18:08:58.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.858+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94766074155552] v29'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.858+0000 7fb95172f800 20 add_watcher() i=7 2024-05-15T18:08:58.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.858+0000 7fb95172f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.858+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563072302d90 con 0x5630722efa40 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.858+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.858+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94766074164912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630723002b0 con 0x5630722efa40 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.859+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94766074164912] v29'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.859+0000 7fb803fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.859+0000 7fb95172f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.859+0000 7fb95172f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.859+0000 7fb95172f800 5 note: GC not initialized 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.859+0000 7fb802fe5640 20 reqs_thread_entry: start 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb95172f800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb95172f800 20 Filter name: none 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb800fe1640 20 reqs_thread_entry: start 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563072335cf0 con 0x5630722efa40 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb95172f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb95172f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.860+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630723360d0 con 0x5630722efa40 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.861+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.861+0000 7fb95172f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.861+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630723370e0 con 0x7fb940065040 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.861+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.862+0000 7fb803fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.862+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94766074164912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563072302240 con 0x5630722efa40 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.862+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94766074164912] v29'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.863+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94766074139248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722ff680 con 0x7fb940065040 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.863+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94766074139248] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.863+0000 7fb95172f800 20 remove_watcher() i=0 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.863+0000 7fb95172f800 2 removed watcher, disabling cache 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.863+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94766074145216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722f9270 con 0x5630722efa40 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.865+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94766074145216] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.865+0000 7fb95172f800 20 remove_watcher() i=1 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.865+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94766074146784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fa9c0 con 0x5630722f4090 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.866+0000 7fb94d3ae640 1 -- 172.21.15.173:0/1362461647 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94766074146784] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb940074020 con 0x5630722f4090 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.866+0000 7fb95172f800 20 remove_watcher() i=2 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.866+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94766074151952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fa9c0 con 0x7fb940065040 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.867+0000 7fb94cbad640 1 -- 172.21.15.173:0/1362461647 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94766074151952] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb94407f070 con 0x7fb940065040 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.867+0000 7fb95172f800 20 remove_watcher() i=3 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.867+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94766074147936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fc410 con 0x5630722efa40 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.868+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94766074147936] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x5630722efa40 2024-05-15T18:08:58.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.868+0000 7fb95172f800 20 remove_watcher() i=4 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.868+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94766074159120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fa9c0 con 0x7fb944074040 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.869+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94766074159120] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.869+0000 7fb95172f800 20 remove_watcher() i=5 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.869+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94766074161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fa9c0 con 0x7fb944074040 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.870+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94766074161472] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.870+0000 7fb95172f800 20 remove_watcher() i=6 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.870+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94766074155552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630722fe940 con 0x7fb944074040 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94766074155552] v29'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9480083e0 con 0x7fb944074040 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 20 remove_watcher() i=7 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb944074040 msgr2=0x7fb944081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb944074040 0x7fb944081410 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630722efa40 msgr2=0x5630722f1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630722efa40 0x5630722f1f00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb940065040 msgr2=0x7fb940065810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb940065040 0x7fb940065810 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722f4090 msgr2=0x5630722f6480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722f4090 0x5630722f6480 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb818036950 msgr2=0x7fb818038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb818036950 0x7fb818038e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb944052bb0 tx=0x7fb94404f000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 msgr2=0x5630722e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1362461647 reap_dead start 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722e4460 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb940011d40 tx=0x7fb940015fa0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 shutdown_connections 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 --2- 172.21.15.173:0/1362461647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722dd030 0x5630722e4460 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 >> 172.21.15.173:0/1362461647 conn(0x5630722d9350 msgr2=0x5630722d69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 shutdown_connections 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.871+0000 7fb95172f800 1 -- 172.21.15.173:0/1362461647 wait complete. 2024-05-15T18:08:58.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb824036950 msgr2=0x7fb824038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb824036950 0x7fb824038e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5630722b91c0 tx=0x7fb944005ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722cffa0 msgr2=0x5630722d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722cffa0 0x5630722d03c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb940004fd0 tx=0x7fb94001eea0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 shutdown_connections 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb824036950 0x7fb824038e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/100840408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630722cffa0 0x5630722d03c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 >> 172.21.15.173:0/100840408 conn(0x5630722c4040 msgr2=0x5630722c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 shutdown_connections 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/100840408 wait complete. 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5630722bef60 msgr2=0x5630722c13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5630722bef60 0x5630722c13b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630721b6520 msgr2=0x5630722b8740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5630721b6520 0x5630722b8740 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722bb020 msgr2=0x5630722bd410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5630722bb020 0x5630722bd410 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb834036900 msgr2=0x7fb834038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb834036900 0x7fb834038dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb944054000 tx=0x7fb94404e000 comp rx=0 tx=0).stop 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 msgr2=0x5630722b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 --2- 172.21.15.173:0/1900408600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630721b49e0 0x5630722b1500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb94000f000 tx=0x7fb940000f40 comp rx=0 tx=0).stop 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb94dbaf640 1 -- 172.21.15.173:0/1900408600 reap_dead start 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 shutdown_connections 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 >> 172.21.15.173:0/1900408600 conn(0x5630721b05a0 msgr2=0x5630722a3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 shutdown_connections 2024-05-15T18:08:58.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.872+0000 7fb95172f800 1 -- 172.21.15.173:0/1900408600 wait complete. 2024-05-15T18:08:58.859 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-05-15T18:08:58.859 DEBUG:tasks.util.rgw: json result: [] 2024-05-15T18:08:58.875 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:58.875 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-15T18:08:58.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-15T18:08:58.876 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-15T18:08:58.920 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:58.921 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:58.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f095ce11800 1 Processor -- start 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f095ce11800 1 -- start start 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f095ce11800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5615bdaea480 0x5615bdaec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f095ce11800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5615bdaece40 con 0x5615bdae64d0 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f095ce11800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5615bd978050 con 0x5615bdaea480 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f0957bdb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5615bdaea480 0x5615bdaec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f0957bdb640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5615bdaea480 0x5615bdaec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38240/0 (socket says 172.21.15.173:38240) 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f09583dc640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5615bdae64d0 0x5615bdae68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:56994/0 (socket says 172.21.15.173:56994) 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.944+0000 7f0957bdb640 1 -- 172.21.15.173:0/1823525767 learned_addr learned my addr 172.21.15.173:0/1823525767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.945+0000 7f0957bdb640 1 -- 172.21.15.173:0/1823525767 >> v1:172.21.15.3:6789/0 conn(0x5615bdae64d0 legacy=0x5615bdae68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.945+0000 7f0957bdb640 1 -- 172.21.15.173:0/1823525767 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bdaee020 con 0x5615bdaea480 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f0957bdb640 1 --2- 172.21.15.173:0/1823525767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdaea480 0x5615bdaec870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f094c00a6b0 tx=0x7f094c01eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae41eb341a77a18 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f09573da640 1 -- 172.21.15.173:0/1823525767 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094c059070 con 0x5615bdaea480 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f09573da640 1 -- 172.21.15.173:0/1823525767 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094c050050 con 0x5615bdaea480 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f09573da640 1 -- 172.21.15.173:0/1823525767 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094c00a350 con 0x5615bdaea480 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f095ce11800 1 -- 172.21.15.173:0/1823525767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdaea480 msgr2=0x5615bdaec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f095ce11800 1 --2- 172.21.15.173:0/1823525767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdaea480 0x5615bdaec870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f094c00a6b0 tx=0x7f094c01eed0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f095ce11800 1 -- 172.21.15.173:0/1823525767 shutdown_connections 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f095ce11800 1 --2- 172.21.15.173:0/1823525767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdaea480 0x5615bdaec870 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f095ce11800 1 -- 172.21.15.173:0/1823525767 >> 172.21.15.173:0/1823525767 conn(0x5615bdae0d30 msgr2=0x5615bdae3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f095ce11800 1 -- 172.21.15.173:0/1823525767 shutdown_connections 2024-05-15T18:08:58.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.947+0000 7f095ce11800 1 -- 172.21.15.173:0/1823525767 wait complete. 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.961+0000 7f095ce11800 1 Processor -- start 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.961+0000 7f095ce11800 1 -- start start 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.961+0000 7f095ce11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbda890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.961+0000 7f095ce11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5615bda321d0 con 0x5615bdae64d0 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbda890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbda890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38254/0 (socket says 172.21.15.173:38254) 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f09583dc640 1 -- 172.21.15.173:0/2419152322 learned_addr learned my addr 172.21.15.173:0/2419152322 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f09583dc640 1 -- 172.21.15.173:0/2419152322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bdbdae60 con 0x5615bdae64d0 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f09583dc640 1 --2- 172.21.15.173:0/2419152322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbda890 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0948001e10 tx=0x7f094800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdcc39f05f0269 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f084660c640 1 -- 172.21.15.173:0/2419152322 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094800e5c0 con 0x5615bdae64d0 2024-05-15T18:08:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f084660c640 1 -- 172.21.15.173:0/2419152322 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0948006070 con 0x5615bdae64d0 2024-05-15T18:08:58.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.962+0000 7f084660c640 1 -- 172.21.15.173:0/2419152322 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094800e930 con 0x5615bdae64d0 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 -- 172.21.15.173:0/2419152322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 msgr2=0x5615bdbda890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 --2- 172.21.15.173:0/2419152322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbda890 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0948001e10 tx=0x7f094800b6c0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 -- 172.21.15.173:0/2419152322 shutdown_connections 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 --2- 172.21.15.173:0/2419152322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbda890 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 -- 172.21.15.173:0/2419152322 >> 172.21.15.173:0/2419152322 conn(0x5615bdae0d30 msgr2=0x5615bdbd1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 -- 172.21.15.173:0/2419152322 shutdown_connections 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 -- 172.21.15.173:0/2419152322 wait complete. 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 Processor -- start 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.963+0000 7f095ce11800 1 -- start start 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f095ce11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbe2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f095ce11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5615bdaed310 con 0x5615bdae64d0 2024-05-15T18:08:58.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbe2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbe2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38268/0 (socket says 172.21.15.173:38268) 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f09583dc640 1 -- 172.21.15.173:0/2416344860 learned_addr learned my addr 172.21.15.173:0/2416344860 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f09583dc640 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bdbe2940 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f09583dc640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbe2400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f094800b700 tx=0x7f0948000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f0844e09640 1 -- 172.21.15.173:0/2416344860 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094800f8d0 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f0844e09640 1 -- 172.21.15.173:0/2416344860 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094800fa70 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615bdbe2bd0 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f0844e09640 1 -- 172.21.15.173:0/2416344860 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094800fd50 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.964+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615bdbe5880 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.965+0000 7f0844e09640 1 -- 172.21.15.173:0/2416344860 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0948017070 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.965+0000 7f0844e09640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0840036900 0x7f0840038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.965+0000 7f0844e09640 1 -- 172.21.15.173:0/2416344860 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f0948015020 con 0x5615bdae64d0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.965+0000 7f0957bdb640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0840036900 0x7f0840038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.966+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdaea480 0x5615bdbe9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.966+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdbe9bc0 con 0x5615bdaea480 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.966+0000 7f0958bdd640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdaea480 0x5615bdbe9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.966+0000 7f0957bdb640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0840036900 0x7f0840038dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f094c056000 tx=0x7f094c00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.966+0000 7f0958bdd640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdaea480 0x5615bdbe9640 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.966+0000 7f0958bdd640 1 -- 172.21.15.173:0/2416344860 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdaea480 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.966+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdbe6c10 con 0x5615bdaea480 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.967+0000 7f0958bdd640 1 -- 172.21.15.173:0/2416344860 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdaea480 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.967+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdbebf10 0x5615bdbee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.967+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdbee9f0 con 0x5615bdbebf10 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.967+0000 7f09583dc640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdbebf10 0x5615bdbee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.967+0000 7f09583dc640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdbebf10 0x5615bdbee300 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.967+0000 7f09583dc640 1 -- 172.21.15.173:0/2416344860 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f094802e070 con 0x5615bdbebf10 2024-05-15T18:08:58.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.967+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdbeaec0 con 0x5615bdaea480 2024-05-15T18:08:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.968+0000 7f0958bdd640 1 -- 172.21.15.173:0/2416344860 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdaea480 2024-05-15T18:08:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.968+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5615bdbefea0 0x5615bdbf22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.968+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdbf2a50 con 0x5615bdbefea0 2024-05-15T18:08:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.968+0000 7f0957bdb640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5615bdbefea0 0x5615bdbf22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.968+0000 7f0957bdb640 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5615bdbefea0 0x5615bdbf22f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.968+0000 7f0957bdb640 1 -- 172.21.15.173:0/2416344860 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f094c054440 con 0x5615bdbefea0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f095ce11800 1 Processor -- start 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f095ce11800 1 -- start start 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f095ce11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc00eb0 0x5615bdc012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f095ce11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5615bd9d8cf0 con 0x5615bdc00eb0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc00eb0 0x5615bdc012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc00eb0 0x5615bdc012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38270/0 (socket says 172.21.15.173:38270) 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f09583dc640 1 -- 172.21.15.173:0/4216373298 learned_addr learned my addr 172.21.15.173:0/4216373298 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.969+0000 7f09583dc640 1 -- 172.21.15.173:0/4216373298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bdc01810 con 0x5615bdc00eb0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.970+0000 7f09583dc640 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc00eb0 0x5615bdc012d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09480174d0 tx=0x7f0948041dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.970+0000 7f083dffb640 1 -- 172.21.15.173:0/4216373298 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094801a480 con 0x5615bdc00eb0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.970+0000 7f083dffb640 1 -- 172.21.15.173:0/4216373298 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094801a620 con 0x5615bdc00eb0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.970+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615bdc02280 con 0x5615bdc00eb0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.970+0000 7f083dffb640 1 -- 172.21.15.173:0/4216373298 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094801a900 con 0x5615bdc00eb0 2024-05-15T18:08:58.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.970+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615bdc02780 con 0x5615bdc00eb0 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.970+0000 7f083dffb640 1 -- 172.21.15.173:0/4216373298 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f094804b8f0 con 0x5615bdc00eb0 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f083dffb640 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08300368b0 0x7f0830038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f083dffb640 1 -- 172.21.15.173:0/4216373298 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f094803cae0 con 0x5615bdc00eb0 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f0957bdb640 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08300368b0 0x7f0830038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f095ce11800 1 Processor -- start 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f095ce11800 1 -- start start 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f0957bdb640 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08300368b0 0x7f0830038d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5615bdbea4c0 tx=0x7f094c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f095ce11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc0e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f095ce11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5615bdbdb1e0 con 0x5615bdc0e060 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.971+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc0e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc0e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38278/0 (socket says 172.21.15.173:38278) 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f09583dc640 1 -- 172.21.15.173:0/4285829786 learned_addr learned my addr 172.21.15.173:0/4285829786 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f09583dc640 1 -- 172.21.15.173:0/4285829786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bdc0ea50 con 0x5615bdc0e060 2024-05-15T18:08:58.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f09583dc640 1 --2- 172.21.15.173:0/4285829786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc0e480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f094801bab0 tx=0x7f0948027560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01e9cf973308300 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f08377fe640 1 -- 172.21.15.173:0/4285829786 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0948032df0 con 0x5615bdc0e060 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f08377fe640 1 -- 172.21.15.173:0/4285829786 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094801da10 con 0x5615bdc0e060 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f08377fe640 1 -- 172.21.15.173:0/4285829786 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094803cd30 con 0x5615bdc0e060 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f095ce11800 1 -- 172.21.15.173:0/4285829786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 msgr2=0x5615bdc0e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.972+0000 7f095ce11800 1 --2- 172.21.15.173:0/4285829786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc0e480 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f094801bab0 tx=0x7f0948027560 comp rx=0 tx=0).stop 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 -- 172.21.15.173:0/4285829786 shutdown_connections 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 --2- 172.21.15.173:0/4285829786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc0e480 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 -- 172.21.15.173:0/4285829786 >> 172.21.15.173:0/4285829786 conn(0x5615bdc0a330 msgr2=0x5615bdc08390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 -- 172.21.15.173:0/4285829786 shutdown_connections 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 -- 172.21.15.173:0/4285829786 wait complete. 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 Processor -- start 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 -- start start 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc15360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f095ce11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5615bdc0f0b0 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc15360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f09583dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc15360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38288/0 (socket says 172.21.15.173:38288) 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.973+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 learned_addr learned my addr 172.21.15.173:0/646777021 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.974+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bdc158a0 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.974+0000 7f09583dc640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc15360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f094804bfd0 tx=0x7f0948017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.974+0000 7f0835ffb640 1 -- 172.21.15.173:0/646777021 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0948044ca0 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.974+0000 7f0835ffb640 1 -- 172.21.15.173:0/646777021 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0948069070 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.974+0000 7f0835ffb640 1 -- 172.21.15.173:0/646777021 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0948031c90 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.974+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615bdc158a0 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.974+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615bdc158a0 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f0835ffb640 1 -- 172.21.15.173:0/646777021 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0948026570 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f0835ffb640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0828036900 0x7f0828038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f0835ffb640 1 -- 172.21.15.173:0/646777021 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f094806fb20 con 0x5615bdc0e060 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f0957bdb640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0828036900 0x7f0828038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdc209d0 0x5615bdc22e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc235e0 con 0x5615bdc209d0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f0958bdd640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdc209d0 0x5615bdc22e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.975+0000 7f0957bdb640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0828036900 0x7f0828038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5615bdbf2e50 tx=0x7f094c061040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f0958bdd640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdc209d0 0x5615bdc22e90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 realm 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc239f0 con 0x5615bdc209d0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:58.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc242c0 con 0x5615bdc209d0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x5615bdc209d0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.976+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdc25150 0x5615bdc27540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc27ca0 con 0x5615bdc25150 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f09583dc640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdc25150 0x5615bdc27540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f09583dc640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdc25150 0x5615bdc27540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f095ce11800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f095ce11800 20 searching for the correct realm 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.977+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc29680 con 0x5615bdc25150 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f09583dc640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f094800f070 0x7f094803c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc29680 con 0x7f094800f070 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f0957bdb640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f094800f070 0x7f094803c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f0957bdb640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f094800f070 0x7f094803c050 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f0957bdb640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f094c075040 0x7f094c05f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc29680 con 0x7f094c075040 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.978+0000 7f0958bdd640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f094c075040 0x7f094c05f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.979+0000 7f0958bdd640 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f094c075040 0x7f094c05f930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:58.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.979+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.979+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x5615bdc209d0 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.979+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.979+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x5615bdc209d0 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.979+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.979+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x7f094c075040 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x7f094c075040 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x7f094800f070 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x5615bdc25150 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.980+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x5615bdc209d0 2024-05-15T18:08:58.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x7f094c075040 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x5615bdc209d0 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc24660 con 0x7f094800f070 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.981+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc25150 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc25150 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094c075040 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc25150 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.982+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc25150 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc209d0 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc209d0 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094c075040 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.983+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc25150 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094800f070 2024-05-15T18:08:58.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc209d0 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094c075040 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.984+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc25150 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.985+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.985+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094c075040 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.985+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.985+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094800f070 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.985+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.985+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc25150 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.985+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094c075040 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x5615bdc209d0 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f094c08f060 con 0x7f094800f070 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc28650 con 0x5615bdc209d0 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.986+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc28a40 con 0x5615bdc209d0 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc28a40 con 0x7f094c075040 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 zone default found 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 4 Realm: () 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:58.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 zonegroup default 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc28e60 con 0x7f094c075040 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.987+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc28e60 con 0x5615bdc25150 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f095ce11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2b530 con 0x5615bdc25150 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f095ce11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f095ce11800 20 started sync module instance, tier type = 2024-05-15T18:08:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f095ce11800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:58.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.988+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2a9d0 con 0x7f094800f070 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.989+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.989+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94651377954240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2a630 con 0x7f094800f070 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.989+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2c3a0 con 0x5615bdc209d0 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.990+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94651377954240] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.990+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.990+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94651377958640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2c7c0 con 0x5615bdc209d0 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.990+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2d180 con 0x5615bdc25150 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.991+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94651377958640] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.991+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.991+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94651377959696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2c730 con 0x5615bdc25150 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.991+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2dff0 con 0x7f094800f070 2024-05-15T18:08:58.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.992+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94651377959696] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.992+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.992+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94651377964320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2e890 con 0x7f094800f070 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.992+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2f250 con 0x5615bdc209d0 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.993+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.993+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94651377964320] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.993+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94651377970592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2f670 con 0x5615bdc209d0 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.993+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc30030 con 0x7f094c075040 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.994+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.994+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94651377974144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc30450 con 0x7f094c075040 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.994+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc30f50 con 0x7f094c075040 2024-05-15T18:08:58.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.994+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94651377970592] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.995+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94651377974144] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.996+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.996+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94651377977920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2ffa0 con 0x7f094c075040 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.996+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc315e0 con 0x7f094c075040 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.996+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94651377977920] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94651377971648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc315e0 con 0x7f094c075040 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 20 add_watcher() i=0 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 20 add_watcher() i=1 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 20 add_watcher() i=2 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 20 add_watcher() i=3 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 20 add_watcher() i=4 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 20 add_watcher() i=5 2024-05-15T18:08:58.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.997+0000 7f095ce11800 20 add_watcher() i=6 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.998+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94651377971648] v29'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.998+0000 7f095ce11800 20 add_watcher() i=7 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.998+0000 7f095ce11800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.998+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc34780 con 0x5615bdc209d0 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.998+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.998+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94651377979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc31a00 con 0x5615bdc209d0 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.999+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94651377979696] v29'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.999+0000 7f080efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.999+0000 7f095ce11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.999+0000 7f095ce11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:58.999+0000 7f095ce11800 5 note: GC not initialized 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f080dfe3640 20 reqs_thread_entry: start 2024-05-15T18:08:58.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f095ce11800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f095ce11800 20 Filter name: none 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f0806ffd640 20 reqs_thread_entry: start 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc67840 con 0x5615bdc209d0 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f095ce11800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f095ce11800 20 rados->read ofs=0 len=0 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.000+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc67c20 con 0x5615bdc209d0 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.001+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.001+0000 7f095ce11800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.001+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc67c20 con 0x7f094800f070 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.001+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.002+0000 7f080efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.002+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94651377979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc67c20 con 0x5615bdc209d0 2024-05-15T18:08:58.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.003+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94651377979696] v29'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.003+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94651377954240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc67c20 con 0x7f094800f070 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.004+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94651377954240] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.004+0000 7f095ce11800 20 remove_watcher() i=0 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.004+0000 7f095ce11800 2 removed watcher, disabling cache 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.004+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94651377958640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc67c20 con 0x5615bdc209d0 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.005+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94651377958640] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.005+0000 7f095ce11800 20 remove_watcher() i=1 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.005+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94651377959696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2adc0 con 0x5615bdc25150 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.006+0000 7f09583dc640 1 -- 172.21.15.173:0/646777021 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94651377959696] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094802e070 con 0x5615bdc25150 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.006+0000 7f095ce11800 20 remove_watcher() i=2 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.006+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94651377964320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2adc0 con 0x7f094800f070 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.007+0000 7f0957bdb640 1 -- 172.21.15.173:0/646777021 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94651377964320] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094c080070 con 0x7f094800f070 2024-05-15T18:08:58.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.007+0000 7f095ce11800 20 remove_watcher() i=3 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.007+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94651377970592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2adc0 con 0x5615bdc209d0 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.008+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94651377970592] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x5615bdc209d0 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.008+0000 7f095ce11800 20 remove_watcher() i=4 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.008+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94651377974144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2eda0 con 0x7f094c075040 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.009+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94651377974144] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.009+0000 7f095ce11800 20 remove_watcher() i=5 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.009+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94651377977920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2adc0 con 0x7f094c075040 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.009+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94651377977920] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.009+0000 7f095ce11800 20 remove_watcher() i=6 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.010+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94651377971648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5615bdc2fb80 con 0x7f094c075040 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.010+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94651377971648] v29'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f095000a4a0 con 0x7f094c075040 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.010+0000 7f095ce11800 20 remove_watcher() i=7 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f094c075040 msgr2=0x7f094c05f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f094c075040 0x7f094c05f930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdc209d0 msgr2=0x5615bdc22e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdc209d0 0x5615bdc22e90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f094800f070 msgr2=0x7f094803c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f094800f070 0x7f094803c050 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdc25150 msgr2=0x5615bdc27540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdc25150 0x5615bdc27540 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0828036900 msgr2=0x7f0828038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0828036900 0x7f0828038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5615bdbf2e50 tx=0x7f094c061040 comp rx=0 tx=0).stop 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 msgr2=0x5615bdc15360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f0958bdd640 1 -- 172.21.15.173:0/646777021 reap_dead start 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc15360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f094804bfd0 tx=0x7f0948017f90 comp rx=0 tx=0).stop 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 shutdown_connections 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/646777021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc0e060 0x5615bdc15360 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 >> 172.21.15.173:0/646777021 conn(0x5615bdc0a330 msgr2=0x5615bdc07990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 shutdown_connections 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/646777021 wait complete. 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08300368b0 msgr2=0x7f0830038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08300368b0 0x7f0830038d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5615bdbea4c0 tx=0x7f094c005ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc00eb0 msgr2=0x5615bdc012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc00eb0 0x5615bdc012d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09480174d0 tx=0x7f0948041dd0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 shutdown_connections 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f08300368b0 0x7f0830038d70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 --2- 172.21.15.173:0/4216373298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdc00eb0 0x5615bdc012d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 >> 172.21.15.173:0/4216373298 conn(0x5615bdbf4f50 msgr2=0x5615bdbf5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 shutdown_connections 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.011+0000 7f095ce11800 1 -- 172.21.15.173:0/4216373298 wait complete. 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5615bdbefea0 msgr2=0x5615bdbf22f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:58.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5615bdbefea0 0x5615bdbf22f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdaea480 msgr2=0x5615bdbe9640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5615bdaea480 0x5615bdbe9640 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdbebf10 msgr2=0x5615bdbee300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5615bdbebf10 0x5615bdbee300 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0840036900 msgr2=0x7f0840038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0840036900 0x7f0840038dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f094c056000 tx=0x7f094c00a000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 msgr2=0x5615bdbe2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 --2- 172.21.15.173:0/2416344860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5615bdae64d0 0x5615bdbe2400 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f094800b700 tx=0x7f0948000bc0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f0958bdd640 1 -- 172.21.15.173:0/2416344860 reap_dead start 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 shutdown_connections 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 >> 172.21.15.173:0/2416344860 conn(0x5615bdae0d30 msgr2=0x5615bdbd05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 shutdown_connections 2024-05-15T18:08:59.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.012+0000 7f095ce11800 1 -- 172.21.15.173:0/2416344860 wait complete. 2024-05-15T18:08:59.001 INFO:teuthology.orchestra.run.smithi173.stdout:["myfoo"] 2024-05-15T18:08:59.002 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-15T18:08:59.005 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-15T18:08:59.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-15T18:08:59.006 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-15T18:08:59.048 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:59.048 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:59.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83b8698800 1 Processor -- start 2024-05-15T18:08:59.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83b8698800 1 -- start start 2024-05-15T18:08:59.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83b8698800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x563d150266d0 0x563d15028ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83b8698800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d15029000 con 0x563d15022bc0 2024-05-15T18:08:59.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83b8698800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x563d14eb3050 con 0x563d150266d0 2024-05-15T18:08:59.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83affff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x563d150266d0 0x563d15028ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83affff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x563d150266d0 0x563d15028ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38290/0 (socket says 172.21.15.173:38290) 2024-05-15T18:08:59.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.072+0000 7f83affff640 1 -- 172.21.15.173:0/980032985 learned_addr learned my addr 172.21.15.173:0/980032985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.073+0000 7f83affff640 1 -- 172.21.15.173:0/980032985 >> v1:172.21.15.3:6789/0 conn(0x563d15022bc0 legacy=0x563d15024fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T18:08:59.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.073+0000 7f83affff640 1 -- 172.21.15.173:0/980032985 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1502a1e0 con 0x563d150266d0 2024-05-15T18:08:59.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83affff640 1 --2- 172.21.15.173:0/980032985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d150266d0 0x563d15028ac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f83a000a520 tx=0x7f83a001cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d25aad59350fe8a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b599d640 1 -- 172.21.15.173:0/980032985 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a0057070 con 0x563d150266d0 2024-05-15T18:08:59.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b599d640 1 -- 172.21.15.173:0/980032985 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a0052570 con 0x563d150266d0 2024-05-15T18:08:59.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b599d640 1 -- 172.21.15.173:0/980032985 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a0052870 con 0x563d150266d0 2024-05-15T18:08:59.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b8698800 1 -- 172.21.15.173:0/980032985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d150266d0 msgr2=0x563d15028ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b8698800 1 --2- 172.21.15.173:0/980032985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d150266d0 0x563d15028ac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f83a000a520 tx=0x7f83a001cf70 comp rx=0 tx=0).stop 2024-05-15T18:08:59.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b8698800 1 -- 172.21.15.173:0/980032985 shutdown_connections 2024-05-15T18:08:59.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b8698800 1 --2- 172.21.15.173:0/980032985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d150266d0 0x563d15028ac0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b8698800 1 -- 172.21.15.173:0/980032985 >> 172.21.15.173:0/980032985 conn(0x563d1501c590 msgr2=0x563d1501e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b8698800 1 -- 172.21.15.173:0/980032985 shutdown_connections 2024-05-15T18:08:59.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.075+0000 7f83b8698800 1 -- 172.21.15.173:0/980032985 wait complete. 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.089+0000 7f83b8698800 1 Processor -- start 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.089+0000 7f83b8698800 1 -- start start 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.089+0000 7f83b8698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d15022500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.089+0000 7f83b8698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563d14f6d1c0 con 0x563d15022bc0 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.089+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d15022500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.089+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d15022500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38304/0 (socket says 172.21.15.173:38304) 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.089+0000 7f83b619e640 1 -- 172.21.15.173:0/1796653429 learned_addr learned my addr 172.21.15.173:0/1796653429 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.090+0000 7f83b619e640 1 -- 172.21.15.173:0/1796653429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d15020ac0 con 0x563d15022bc0 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.090+0000 7f83b619e640 1 --2- 172.21.15.173:0/1796653429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d15022500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f83a8002d30 tx=0x7f83a800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d372035676c78a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.090+0000 7f82a4608640 1 -- 172.21.15.173:0/1796653429 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a800f400 con 0x563d15022bc0 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.090+0000 7f82a4608640 1 -- 172.21.15.173:0/1796653429 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a8014070 con 0x563d15022bc0 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.090+0000 7f82a4608640 1 -- 172.21.15.173:0/1796653429 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a800f5e0 con 0x563d15022bc0 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 -- 172.21.15.173:0/1796653429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 msgr2=0x563d15022500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 --2- 172.21.15.173:0/1796653429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d15022500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f83a8002d30 tx=0x7f83a800b5b0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 -- 172.21.15.173:0/1796653429 shutdown_connections 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 --2- 172.21.15.173:0/1796653429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d15022500 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 -- 172.21.15.173:0/1796653429 >> 172.21.15.173:0/1796653429 conn(0x563d1501c590 msgr2=0x563d1510f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 -- 172.21.15.173:0/1796653429 shutdown_connections 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 -- 172.21.15.173:0/1796653429 wait complete. 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 Processor -- start 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 -- start start 2024-05-15T18:08:59.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d1511d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.091+0000 7f83b8698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563d150294d0 con 0x563d15022bc0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d1511d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d1511d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38320/0 (socket says 172.21.15.173:38320) 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f83b619e640 1 -- 172.21.15.173:0/3824019220 learned_addr learned my addr 172.21.15.173:0/3824019220 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f83b619e640 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1511da20 con 0x563d15022bc0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f83b619e640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d1511d4e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f83a8002320 tx=0x7f83a8001fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f82a2e05640 1 -- 172.21.15.173:0/3824019220 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8025440 con 0x563d15022bc0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f82a2e05640 1 -- 172.21.15.173:0/3824019220 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a80255e0 con 0x563d15022bc0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d1511dcb0 con 0x563d15022bc0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f82a2e05640 1 -- 172.21.15.173:0/3824019220 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a80258c0 con 0x563d15022bc0 2024-05-15T18:08:59.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.092+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d15120960 con 0x563d15022bc0 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.093+0000 7f82a2e05640 1 -- 172.21.15.173:0/3824019220 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f83a800e070 con 0x563d15022bc0 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.093+0000 7f82a2e05640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f829c036900 0x7f829c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.093+0000 7f82a2e05640 1 -- 172.21.15.173:0/3824019220 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f83a804bec0 con 0x563d15022bc0 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.093+0000 7f83affff640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f829c036900 0x7f829c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.093+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d150266d0 0x563d15124720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15124ca0 con 0x563d150266d0 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83b699f640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d150266d0 0x563d15124720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83affff640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f829c036900 0x7f829c038dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f83a0054000 tx=0x7f83a004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83b699f640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d150266d0 0x563d15124720 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83b699f640 1 -- 172.21.15.173:0/3824019220 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d150266d0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15121cf0 con 0x563d150266d0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83b699f640 1 -- 172.21.15.173:0/3824019220 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d150266d0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.094+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d15126fd0 0x563d151293c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15129ab0 con 0x563d15126fd0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b619e640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d15126fd0 0x563d151293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b619e640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d15126fd0 0x563d151293c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b619e640 1 -- 172.21.15.173:0/3824019220 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83a8048040 con 0x563d15126fd0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15125f80 con 0x563d150266d0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b699f640 1 -- 172.21.15.173:0/3824019220 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d150266d0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563d1512af60 0x563d1512d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.095+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d1512db10 con 0x563d1512af60 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.096+0000 7f83affff640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563d1512af60 0x563d1512d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.096+0000 7f83affff640 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563d1512af60 0x563d1512d3b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.096+0000 7f83affff640 1 -- 172.21.15.173:0/3824019220 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83a005a040 con 0x563d1512af60 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b8698800 1 Processor -- start 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b8698800 1 -- start start 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b8698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d1513bf70 0x563d1513c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b8698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563d14f13cf0 con 0x563d1513bf70 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d1513bf70 0x563d1513c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d1513bf70 0x563d1513c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38334/0 (socket says 172.21.15.173:38334) 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b619e640 1 -- 172.21.15.173:0/3261732168 learned_addr learned my addr 172.21.15.173:0/3261732168 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b619e640 1 -- 172.21.15.173:0/3261732168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1513c8d0 con 0x563d1513bf70 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.097+0000 7f83b619e640 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d1513bf70 0x563d1513c390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f83a804a340 tx=0x7f83a80176a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f829bfff640 1 -- 172.21.15.173:0/3261732168 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a803b070 con 0x563d1513bf70 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f829bfff640 1 -- 172.21.15.173:0/3261732168 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a800ead0 con 0x563d1513bf70 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f829bfff640 1 -- 172.21.15.173:0/3261732168 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a800edf0 con 0x563d1513bf70 2024-05-15T18:08:59.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d1513d340 con 0x563d1513bf70 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d1513d840 con 0x563d1513bf70 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f829bfff640 1 -- 172.21.15.173:0/3261732168 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f83a803e070 con 0x563d1513bf70 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f829bfff640 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8290036900 0x7f8290038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.098+0000 7f829bfff640 1 -- 172.21.15.173:0/3261732168 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f83a8045040 con 0x563d1513bf70 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83affff640 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8290036900 0x7f8290038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b8698800 1 Processor -- start 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b8698800 1 -- start start 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83affff640 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8290036900 0x7f8290038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x563d15125580 tx=0x7f83a0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b8698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15149690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b8698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563d15020e40 con 0x563d15149270 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38350/0 (socket says 172.21.15.173:38350) 2024-05-15T18:08:59.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b619e640 1 -- 172.21.15.173:0/2861166655 learned_addr learned my addr 172.21.15.173:0/2861166655 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.099+0000 7f83b619e640 1 -- 172.21.15.173:0/2861166655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d15149c60 con 0x563d15149270 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b619e640 1 --2- 172.21.15.173:0/2861166655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15149690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f83a800fae0 tx=0x7f83a803e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04c7a12189647e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f8299ffb640 1 -- 172.21.15.173:0/2861166655 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8060020 con 0x563d15149270 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f8299ffb640 1 -- 172.21.15.173:0/2861166655 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a804b8c0 con 0x563d15149270 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f8299ffb640 1 -- 172.21.15.173:0/2861166655 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a801b730 con 0x563d15149270 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 -- 172.21.15.173:0/2861166655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 msgr2=0x563d15149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 --2- 172.21.15.173:0/2861166655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15149690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f83a800fae0 tx=0x7f83a803e730 comp rx=0 tx=0).stop 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 -- 172.21.15.173:0/2861166655 shutdown_connections 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 --2- 172.21.15.173:0/2861166655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15149690 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 -- 172.21.15.173:0/2861166655 >> 172.21.15.173:0/2861166655 conn(0x563d151455d0 msgr2=0x563d15143630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 -- 172.21.15.173:0/2861166655 shutdown_connections 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 -- 172.21.15.173:0/2861166655 wait complete. 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.100+0000 7f83b8698800 1 Processor -- start 2024-05-15T18:08:59.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b8698800 1 -- start start 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b8698800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b8698800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563d1514a310 con 0x563d15149270 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b619e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38362/0 (socket says 172.21.15.173:38362) 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 learned_addr learned my addr 172.21.15.173:0/4017685603 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d15150ba0 con 0x563d15149270 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.101+0000 7f83b619e640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15150660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f83a801dd40 tx=0x7f83a8020ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.102+0000 7f8287fff640 1 -- 172.21.15.173:0/4017685603 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a801b7a0 con 0x563d15149270 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.102+0000 7f8287fff640 1 -- 172.21.15.173:0/4017685603 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a80177d0 con 0x563d15149270 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.102+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d15150ba0 con 0x563d15149270 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.102+0000 7f8287fff640 1 -- 172.21.15.173:0/4017685603 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83a8017ad0 con 0x563d15149270 2024-05-15T18:08:59.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.102+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d15150ba0 con 0x563d15149270 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.102+0000 7f8287fff640 1 -- 172.21.15.173:0/4017685603 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f83a8076060 con 0x563d15149270 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f8287fff640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8280036950 0x7f8280038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f8287fff640 1 -- 172.21.15.173:0/4017685603 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f83a8070aa0 con 0x563d15149270 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f83affff640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8280036950 0x7f8280038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d1515bc40 0x563d1515e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d1515e850 con 0x563d1515bc40 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f83b699f640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d1515bc40 0x563d1515e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f83affff640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8280036950 0x7f8280038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x563d1512df10 tx=0x7f83a004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.103+0000 7f83b699f640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d1515bc40 0x563d1515e100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 realm 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d1515ec60 con 0x563d1515bc40 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f530 con 0x563d1515bc40 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x563d1515bc40 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d151603c0 0x563d151627b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.104+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15162f10 con 0x563d151603c0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.105+0000 7f83b619e640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d151603c0 0x563d151627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.105+0000 7f83b619e640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d151603c0 0x563d151627b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.105+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.105+0000 7f83b8698800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.105+0000 7f83b8698800 20 searching for the correct realm 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.105+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d151648e0 con 0x563d151603c0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83b619e640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f83a8078070 0x7f83a8056960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d151648e0 con 0x7f83a8078070 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83affff640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f83a8078070 0x7f83a8056960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83affff640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f83a8078070 0x7f83a8056960 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.091 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83affff640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f83a0074040 0x7f83a0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d151648e0 con 0x7f83a0074040 2024-05-15T18:08:59.092 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.106+0000 7f83b699f640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f83a0074040 0x7f83a0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.107+0000 7f83b699f640 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f83a0074040 0x7f83a0081410 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.107+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.107+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x563d1515bc40 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.107+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.107+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x563d1515bc40 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.107+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.107+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x7f83a0074040 2024-05-15T18:08:59.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x7f83a0074040 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x7f83a8078070 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x563d151603c0 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.108+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x563d1515bc40 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x7f83a0074040 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x563d1515bc40 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d1515f8d0 con 0x7f83a8078070 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.109+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d151603c0 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d151603c0 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a0074040 2024-05-15T18:08:59.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d151603c0 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.110+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d151603c0 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d1515bc40 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d1515bc40 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a0074040 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d151603c0 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.111+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a8078070 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d1515bc40 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a0074040 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d151603c0 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.112+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a0074040 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a8078070 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d151603c0 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a0074040 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.113+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x563d1515bc40 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f83a008e060 con 0x7f83a8078070 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d151638b0 con 0x563d1515bc40 2024-05-15T18:08:59.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15163ca0 con 0x563d1515bc40 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.114+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15163ca0 con 0x7f83a0074040 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 zone default found 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 4 Realm: () 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 zonegroup default 2024-05-15T18:08:59.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d151640c0 con 0x7f83a0074040 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d151644e0 con 0x563d151603c0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.115+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d15166790 con 0x563d151603c0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.116+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.116+0000 7f83b8698800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.116+0000 7f83b8698800 20 started sync module instance, tier type = 2024-05-15T18:08:59.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.116+0000 7f83b8698800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.116+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15165c30 con 0x7f83a8078070 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.117+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.117+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94820346781728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15166fe0 con 0x7f83a8078070 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.117+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15167830 con 0x563d1515bc40 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.118+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94820346781728] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.118+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.118+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94820346784560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15167830 con 0x563d1515bc40 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.118+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15168330 con 0x563d151603c0 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.119+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.119+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94820346789408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15168bd0 con 0x563d151603c0 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.119+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d151696a0 con 0x7f83a8078070 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.119+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94820346784560] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.120+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.120+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94820346794384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a8078070 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.120+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d1516a500 con 0x563d1515bc40 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.120+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94820346789408] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.121+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.121+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94820346791712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d1516a920 con 0x563d1515bc40 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.121+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94820346794384] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.121+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d151673a0 con 0x7f83a0074040 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.122+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.122+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94820346801712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d151673a0 con 0x7f83a0074040 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.122+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d1516bd20 con 0x7f83a0074040 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.122+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94820346791712] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.123+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94820346801712] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.123+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.123+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94820346802768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d1516b870 con 0x7f83a0074040 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.123+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d1516c230 con 0x7f83a0074040 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94820346802768] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94820346798080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d1516c230 con 0x7f83a0074040 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 20 add_watcher() i=0 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 20 add_watcher() i=1 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 20 add_watcher() i=2 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 20 add_watcher() i=3 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 20 add_watcher() i=4 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 20 add_watcher() i=5 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.124+0000 7f83b8698800 20 add_watcher() i=6 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.126+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94820346798080] v29'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.126+0000 7f83b8698800 20 add_watcher() i=7 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.126+0000 7f83b8698800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.126+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x563d1516f540 con 0x563d1515bc40 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.126+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.126+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94820346806000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d1516c7c0 con 0x563d1515bc40 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.127+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94820346806000] v29'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.127+0000 7f826cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.127+0000 7f83b8698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.127+0000 7f83b8698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.127+0000 7f83b8698800 5 note: GC not initialized 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.127+0000 7f81e77fe640 20 reqs_thread_entry: start 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.128+0000 7f83b8698800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.128+0000 7f83b8698800 20 Filter name: none 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.128+0000 7f81e57fa640 20 reqs_thread_entry: start 2024-05-15T18:08:59.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.128+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d151a22f0 con 0x563d151603c0 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.128+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(62 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.128+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15168330 con 0x563d151603c0 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(63 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15168330 con 0x563d1515bc40 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(64 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d151638b0 con 0x563d1515bc40 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 [pgnls start_epoch 29 out=49b] v29'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d151638b0 con 0x7f83a8078070 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(67 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.129+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d1515bc40 2024-05-15T18:08:59.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(69 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a8078070 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(71 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.130+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d1515bc40 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.131+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(72 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.131+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.131+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(73 [pgnls start_epoch 29 out=127b] v29'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.131+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.131+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(74 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.131+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(75 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(76 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(77 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(78 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.132+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(79 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a8078070 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(80 [pgnls start_epoch 29 out=70b] v29'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d1515bc40 2024-05-15T18:08:59.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(81 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d1515bc40 2024-05-15T18:08:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(82 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.133+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(83 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a8078070 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(84 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(85 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d1515bc40 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(86 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.134+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(87 [pgnls start_epoch 29 out=49b] v29'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(88 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a8078070 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(89 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a0074040 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(90 [pgnls start_epoch 29 out=49b] v29'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.135+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d1515bc40 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.136+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(91 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.136+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x563d151603c0 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.136+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(92 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.136+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x563d15169ac0 con 0x7f83a8078070 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.136+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(93 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.136+0000 7f83b8698800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.136+0000 7f83b8698800 20 RGWRados::pool_iterate: got myfoo 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.137+0000 7f826cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.137+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94820346806000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15168330 con 0x563d1515bc40 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.138+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94820346806000] v29'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.138+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94820346781728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15163890 con 0x7f83a8078070 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.139+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94820346781728] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.139+0000 7f83b8698800 20 remove_watcher() i=0 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.139+0000 7f83b8698800 2 removed watcher, disabling cache 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.139+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94820346784560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15163890 con 0x563d1515bc40 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.140+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94820346784560] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.140+0000 7f83b8698800 20 remove_watcher() i=1 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.140+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94820346789408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15163850 con 0x563d151603c0 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.141+0000 7f83b619e640 1 -- 172.21.15.173:0/4017685603 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94820346789408] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a803d030 con 0x563d151603c0 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.141+0000 7f83b8698800 20 remove_watcher() i=2 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.141+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94820346794384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15167e20 con 0x7f83a8078070 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.142+0000 7f83affff640 1 -- 172.21.15.173:0/4017685603 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94820346794384] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83a007f070 con 0x7f83a8078070 2024-05-15T18:08:59.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.142+0000 7f83b8698800 20 remove_watcher() i=3 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.142+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94820346791712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15169190 con 0x563d1515bc40 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.143+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94820346791712] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x563d1515bc40 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.143+0000 7f83b8698800 20 remove_watcher() i=4 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.143+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94820346801712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15167e20 con 0x7f83a0074040 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.144+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94820346801712] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.144+0000 7f83b8698800 20 remove_watcher() i=5 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.144+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94820346802768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15168720 con 0x7f83a0074040 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.145+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94820346802768] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.145+0000 7f83b8698800 20 remove_watcher() i=6 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.145+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94820346798080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x563d15169190 con 0x7f83a0074040 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94820346798080] v29'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83b000a4a0 con 0x7f83a0074040 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 20 remove_watcher() i=7 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f83a0074040 msgr2=0x7f83a0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f83a0074040 0x7f83a0081410 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d1515bc40 msgr2=0x563d1515e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d1515bc40 0x563d1515e100 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f83a8078070 msgr2=0x7f83a8056960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f83a8078070 0x7f83a8056960 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d151603c0 msgr2=0x563d151627b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d151603c0 0x563d151627b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8280036950 msgr2=0x7f8280038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8280036950 0x7f8280038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x563d1512df10 tx=0x7f83a004f000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 msgr2=0x563d15150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 --2- 172.21.15.173:0/4017685603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15149270 0x563d15150660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f83a801dd40 tx=0x7f83a8020ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 reap_dead start 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b699f640 1 -- 172.21.15.173:0/4017685603 reap_dead start 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 shutdown_connections 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.146+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 >> 172.21.15.173:0/4017685603 conn(0x563d151455d0 msgr2=0x563d15142c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 shutdown_connections 2024-05-15T18:08:59.136 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/4017685603 wait complete. 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8290036900 msgr2=0x7f8290038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8290036900 0x7f8290038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x563d15125580 tx=0x7f83a0005ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d1513bf70 msgr2=0x563d1513c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d1513bf70 0x563d1513c390 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f83a804a340 tx=0x7f83a80176a0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 shutdown_connections 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8290036900 0x7f8290038dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3261732168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d1513bf70 0x563d1513c390 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 >> 172.21.15.173:0/3261732168 conn(0x563d15130010 msgr2=0x563d15130410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 shutdown_connections 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3261732168 wait complete. 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563d1512af60 msgr2=0x563d1512d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563d1512af60 0x563d1512d3b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d150266d0 msgr2=0x563d15124720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563d150266d0 0x563d15124720 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d15126fd0 msgr2=0x563d151293c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563d15126fd0 0x563d151293c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f829c036900 msgr2=0x7f829c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f829c036900 0x7f829c038dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f83a0054000 tx=0x7f83a004e000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 msgr2=0x563d1511d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 --2- 172.21.15.173:0/3824019220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d15022bc0 0x563d1511d4e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f83a8002320 tx=0x7f83a8001fe0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b699f640 1 -- 172.21.15.173:0/3824019220 reap_dead start 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 shutdown_connections 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.147+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 >> 172.21.15.173:0/3824019220 conn(0x563d1501c590 msgr2=0x563d150213a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.148+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 shutdown_connections 2024-05-15T18:08:59.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.148+0000 7f83b8698800 1 -- 172.21.15.173:0/3824019220 wait complete. 2024-05-15T18:08:59.139 INFO:teuthology.orchestra.run.smithi173.stdout:["myfoo"] 2024-05-15T18:08:59.140 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-15T18:08:59.151 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.164 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.177 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.223 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-05-15T18:08:59.251 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.279 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.304 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.304 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-15T18:08:59.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-15T18:08:59.304 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-15T18:08:59.348 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:59.349 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:59.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f18814800 1 Processor -- start 2024-05-15T18:08:59.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f18814800 1 -- start start 2024-05-15T18:08:59.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f18814800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5572eea28fd0 0x5572eea293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f18814800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572eea29a70 con 0x5572eea2a230 2024-05-15T18:08:59.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f18814800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5572ee8bb050 con 0x5572eea28fd0 2024-05-15T18:08:59.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f13f5c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5572eea28fd0 0x5572eea293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f0b75b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5572eea2a230 0x5572eea2a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57006/0 (socket says 172.21.15.173:57006) 2024-05-15T18:08:59.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.373+0000 7f8f0b75b640 1 -- 172.21.15.173:0/1355701749 learned_addr learned my addr 172.21.15.173:0/1355701749 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:59.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.374+0000 7f8f13f5c640 1 -- 172.21.15.173:0/1355701749 >> v1:172.21.15.3:6789/0 conn(0x5572eea2a230 legacy=0x5572eea2a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.374+0000 7f8f13f5c640 1 -- 172.21.15.173:0/1355701749 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572eea2adf0 con 0x5572eea28fd0 2024-05-15T18:08:59.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.376+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/1355701749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eea293f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400a600 tx=0x7f8f0401ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b27d44c9b27d74d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.377+0000 7f8f1375b640 1 -- 172.21.15.173:0/1355701749 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f0400a200 con 0x5572eea28fd0 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f1375b640 1 -- 172.21.15.173:0/1355701749 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0400a3a0 con 0x5572eea28fd0 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f1375b640 1 -- 172.21.15.173:0/1355701749 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f040086e0 con 0x5572eea28fd0 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f18814800 1 -- 172.21.15.173:0/1355701749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 msgr2=0x5572eea293f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f18814800 1 --2- 172.21.15.173:0/1355701749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eea293f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400a600 tx=0x7f8f0401ed70 comp rx=0 tx=0).stop 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f18814800 1 -- 172.21.15.173:0/1355701749 shutdown_connections 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f18814800 1 --2- 172.21.15.173:0/1355701749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eea293f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f18814800 1 -- 172.21.15.173:0/1355701749 >> 172.21.15.173:0/1355701749 conn(0x5572eea245b0 msgr2=0x5572eea269d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f18814800 1 -- 172.21.15.173:0/1355701749 shutdown_connections 2024-05-15T18:08:59.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.378+0000 7f8f18814800 1 -- 172.21.15.173:0/1355701749 wait complete. 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.392+0000 7f8f18814800 1 Processor -- start 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.392+0000 7f8f18814800 1 -- start start 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.392+0000 7f8f18814800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.392+0000 7f8f18814800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5572ee9751d0 con 0x5572eea28fd0 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.392+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.392+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38392/0 (socket says 172.21.15.173:38392) 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.392+0000 7f8f13f5c640 1 -- 172.21.15.173:0/590645098 learned_addr learned my addr 172.21.15.173:0/590645098 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.393+0000 7f8f13f5c640 1 -- 172.21.15.173:0/590645098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572eeb19c70 con 0x5572eea28fd0 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.393+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/590645098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb196a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8f04000c00 tx=0x7f8f0404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2347317fa0ed0da server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.393+0000 7f8e01e0b640 1 -- 172.21.15.173:0/590645098 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f04065070 con 0x5572eea28fd0 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.393+0000 7f8e01e0b640 1 -- 172.21.15.173:0/590645098 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f040086c0 con 0x5572eea28fd0 2024-05-15T18:08:59.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.393+0000 7f8e01e0b640 1 -- 172.21.15.173:0/590645098 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f040089e0 con 0x5572eea28fd0 2024-05-15T18:08:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 -- 172.21.15.173:0/590645098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 msgr2=0x5572eeb196a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 --2- 172.21.15.173:0/590645098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb196a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8f04000c00 tx=0x7f8f0404e000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 -- 172.21.15.173:0/590645098 shutdown_connections 2024-05-15T18:08:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 --2- 172.21.15.173:0/590645098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb196a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 -- 172.21.15.173:0/590645098 >> 172.21.15.173:0/590645098 conn(0x5572eea245b0 msgr2=0x5572eeb14fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 -- 172.21.15.173:0/590645098 shutdown_connections 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 -- 172.21.15.173:0/590645098 wait complete. 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 Processor -- start 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 -- start start 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.394+0000 7f8f18814800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5572ee99c540 con 0x5572eea28fd0 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38400/0 (socket says 172.21.15.173:38400) 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8f13f5c640 1 -- 172.21.15.173:0/1716226766 learned_addr learned my addr 172.21.15.173:0/1716226766 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8f13f5c640 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572eeb21700 con 0x5572eea28fd0 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb211c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f0401edb0 tx=0x7f8f04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8dfbfff640 1 -- 172.21.15.173:0/1716226766 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f0406d020 con 0x5572eea28fd0 2024-05-15T18:08:59.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8dfbfff640 1 -- 172.21.15.173:0/1716226766 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f04060680 con 0x5572eea28fd0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572eeb21990 con 0x5572eea28fd0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8dfbfff640 1 -- 172.21.15.173:0/1716226766 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f04065040 con 0x5572eea28fd0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.395+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572eeb24640 con 0x5572eea28fd0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.396+0000 7f8dfbfff640 1 -- 172.21.15.173:0/1716226766 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f04070020 con 0x5572eea28fd0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.396+0000 7f8dfbfff640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dfc0369a0 0x7f8dfc038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.396+0000 7f8dfbfff640 1 -- 172.21.15.173:0/1716226766 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8f0408fa70 con 0x5572eea28fd0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.396+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dfc0369a0 0x7f8dfc038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.396+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eea2a230 0x5572eeb28400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.396+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb289d0 con 0x5572eea2a230 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f1475d640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eea2a230 0x5572eeb28400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dfc0369a0 0x7f8dfc038e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8efc000f60 tx=0x7f8efc0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f1475d640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eea2a230 0x5572eeb28400 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f1475d640 1 -- 172.21.15.173:0/1716226766 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eea2a230 2024-05-15T18:08:59.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb259d0 con 0x5572eea2a230 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f1475d640 1 -- 172.21.15.173:0/1716226766 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eea2a230 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb2ad20 0x5572eeb2d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.397+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb2d800 con 0x5572eeb2ad20 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.398+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb2ad20 0x5572eeb2d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.398+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb2ad20 0x5572eeb2d110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.398+0000 7f8f13f5c640 1 -- 172.21.15.173:0/1716226766 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f0405e9a0 con 0x5572eeb2ad20 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.398+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb29c10 con 0x5572eea2a230 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.398+0000 7f8f1475d640 1 -- 172.21.15.173:0/1716226766 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eea2a230 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.398+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5572eeb2ec60 0x5572eeb31050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.398+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb31790 con 0x5572eeb2ec60 2024-05-15T18:08:59.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.399+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5572eeb2ec60 0x5572eeb31050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.399+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5572eeb2ec60 0x5572eeb31050 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.399+0000 7f8f0b75b640 1 -- 172.21.15.173:0/1716226766 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8efc009050 con 0x5572eeb2ec60 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f18814800 1 Processor -- start 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f18814800 1 -- start start 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f18814800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb3fbf0 0x5572eeb40010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f18814800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5572ee91bcf0 con 0x5572eeb3fbf0 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb3fbf0 0x5572eeb40010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb3fbf0 0x5572eeb40010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38414/0 (socket says 172.21.15.173:38414) 2024-05-15T18:08:59.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f13f5c640 1 -- 172.21.15.173:0/4234750251 learned_addr learned my addr 172.21.15.173:0/4234750251 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f13f5c640 1 -- 172.21.15.173:0/4234750251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572eeb40550 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.400+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb3fbf0 0x5572eeb40010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8f0405ec50 tx=0x7f8f040813b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.401+0000 7f8df97fa640 1 -- 172.21.15.173:0/4234750251 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f04094070 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.401+0000 7f8df97fa640 1 -- 172.21.15.173:0/4234750251 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f040715b0 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.401+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572eeb40fc0 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.401+0000 7f8df97fa640 1 -- 172.21.15.173:0/4234750251 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f04071890 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.401+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572eeb414c0 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.401+0000 7f8df97fa640 1 -- 172.21.15.173:0/4234750251 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f04097070 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8df97fa640 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dec036900 0x7f8dec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8df97fa640 1 -- 172.21.15.173:0/4234750251 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8f0409aaf0 con 0x5572eeb3fbf0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dec036900 0x7f8dec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8f18814800 1 Processor -- start 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8f18814800 1 -- start start 2024-05-15T18:08:59.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dec036900 0x7f8dec038dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00bf50 tx=0x7f8efc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8f18814800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.402+0000 7f8f18814800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5572eeb19f90 con 0x5572eeb511c0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38416/0 (socket says 172.21.15.173:38416) 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8f13f5c640 1 -- 172.21.15.173:0/3865323565 learned_addr learned my addr 172.21.15.173:0/3865323565 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8f13f5c640 1 -- 172.21.15.173:0/3865323565 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572eeb51bb0 con 0x5572eeb511c0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/3865323565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb515e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8f0407e520 tx=0x7f8f04008510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812d14c068a88f8b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8df2ffd640 1 -- 172.21.15.173:0/3865323565 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f040ab070 con 0x5572eeb511c0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8df2ffd640 1 -- 172.21.15.173:0/3865323565 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f040548c0 con 0x5572eeb511c0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.403+0000 7f8df2ffd640 1 -- 172.21.15.173:0/3865323565 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f040543f0 con 0x5572eeb511c0 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 -- 172.21.15.173:0/3865323565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 msgr2=0x5572eeb515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 --2- 172.21.15.173:0/3865323565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb515e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8f0407e520 tx=0x7f8f04008510 comp rx=0 tx=0).stop 2024-05-15T18:08:59.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 -- 172.21.15.173:0/3865323565 shutdown_connections 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 --2- 172.21.15.173:0/3865323565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb515e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 -- 172.21.15.173:0/3865323565 >> 172.21.15.173:0/3865323565 conn(0x5572eeb49110 msgr2=0x5572eeb47170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 -- 172.21.15.173:0/3865323565 shutdown_connections 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 -- 172.21.15.173:0/3865323565 wait complete. 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 Processor -- start 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 -- start start 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f18814800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5572eeb52260 con 0x5572eeb511c0 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f13f5c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38432/0 (socket says 172.21.15.173:38432) 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.404+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 learned_addr learned my addr 172.21.15.173:0/828498394 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.405+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572eeb58b30 con 0x5572eeb511c0 2024-05-15T18:08:59.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.405+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb585f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8f0408d230 tx=0x7f8f0407af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.405+0000 7f8df17fa640 1 -- 172.21.15.173:0/828498394 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f040ab040 con 0x5572eeb511c0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.405+0000 7f8df17fa640 1 -- 172.21.15.173:0/828498394 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f04054520 con 0x5572eeb511c0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.405+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572eeb58b30 con 0x5572eeb511c0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.405+0000 7f8df17fa640 1 -- 172.21.15.173:0/828498394 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f0408f5e0 con 0x5572eeb511c0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.405+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572eeb58b30 con 0x5572eeb511c0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8df17fa640 1 -- 172.21.15.173:0/828498394 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8f04068070 con 0x5572eeb511c0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8df17fa640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ddc036950 0x7f8ddc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8df17fa640 1 -- 172.21.15.173:0/828498394 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f8f04058540 con 0x5572eeb511c0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ddc036950 0x7f8ddc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eeb63b60 0x5572eeb66020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb66770 con 0x5572eeb63b60 2024-05-15T18:08:59.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8f1475d640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eeb63b60 0x5572eeb66020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.406+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ddc036950 0x7f8ddc038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00efd0 tx=0x7f8efc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f1475d640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eeb63b60 0x5572eeb66020 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 realm 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb66b80 con 0x5572eeb63b60 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb67450 con 0x5572eeb63b60 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb682e0 0x5572eeb6a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.407+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6ae10 con 0x5572eeb682e0 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.408+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb682e0 0x5572eeb6a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.408+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb682e0 0x5572eeb6a6d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.408+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.408+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:59.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.408+0000 7f8f18814800 20 searching for the correct realm 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.408+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6c7e0 con 0x5572eeb682e0 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f13f5c640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f04099060 0x7f8f0406e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6c7e0 con 0x7f8f04099060 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f04099060 0x7f8f0406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f04099060 0x7f8f0406e220 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f0b75b640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8efc037040 0x7f8efc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6c7e0 con 0x7f8efc037040 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.409+0000 7f8f1475d640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8efc037040 0x7f8efc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.410+0000 7f8f1475d640 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8efc037040 0x7f8efc036410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.410+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.410+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.410+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.410+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.410+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8f04099060 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.411+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8f04099060 2024-05-15T18:08:59.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.412+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.413+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.413+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.413+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.413+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.413+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.413+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.413+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.414+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8f04099060 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.415+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.416+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.416+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.416+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.416+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8f04099060 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.416+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.416+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb682e0 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8efc037040 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x5572eeb63b60 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb677f0 con 0x7f8f04099060 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.417+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6b7b0 con 0x5572eeb63b60 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6bba0 con 0x5572eeb63b60 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6bba0 con 0x7f8efc037040 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 zone default found 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 4 Realm: () 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 zonegroup default 2024-05-15T18:08:59.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6bfc0 con 0x7f8efc037040 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.418+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6c3e0 con 0x5572eeb682e0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6e690 con 0x5572eeb682e0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 20 started sync module instance, tier type = 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:59.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.419+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6db30 con 0x7f8f04099060 2024-05-15T18:08:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.420+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.420+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93952119594784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6eee0 con 0x7f8f04099060 2024-05-15T18:08:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.420+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6f730 con 0x5572eeb63b60 2024-05-15T18:08:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.421+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93952119594784] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.421+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.421+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93952119597616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6f770 con 0x5572eeb63b60 2024-05-15T18:08:59.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.421+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb70270 con 0x5572eeb682e0 2024-05-15T18:08:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.422+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.422+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93952119602528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb70b10 con 0x5572eeb682e0 2024-05-15T18:08:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.422+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93952119597616] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.422+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb710d0 con 0x7f8f04099060 2024-05-15T18:08:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.423+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93952119602528] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.423+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.423+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93952119604832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb71970 con 0x7f8f04099060 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.423+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb72220 con 0x5572eeb63b60 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.424+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93952119604832] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.425+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.425+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93952119610640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb72610 con 0x5572eeb63b60 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.425+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb730b0 con 0x7f8efc037040 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.426+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93952119610640] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.426+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.426+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93952119614336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb73070 con 0x7f8efc037040 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.426+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb73ac0 con 0x7f8efc037040 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.427+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.427+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93952119617040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb73ee0 con 0x7f8efc037040 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.427+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb749e0 con 0x7f8efc037040 2024-05-15T18:08:59.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.427+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93952119614336] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93952119617040] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93952119620816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb73a30 con 0x7f8efc037040 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 20 add_watcher() i=0 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 20 add_watcher() i=1 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 20 add_watcher() i=2 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 20 add_watcher() i=3 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 20 add_watcher() i=4 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 20 add_watcher() i=5 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.428+0000 7f8f18814800 20 add_watcher() i=6 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.429+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93952119620816] v29'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.429+0000 7f8f18814800 20 add_watcher() i=7 2024-05-15T18:08:59.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.429+0000 7f8f18814800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.429+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb77ae0 con 0x5572eeb63b60 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.429+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.429+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93952119608512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb74f60 con 0x5572eeb63b60 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.430+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93952119608512] v29'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.430+0000 7f8dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.430+0000 7f8f18814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.430+0000 7f8f18814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.430+0000 7f8f18814800 5 note: GC not initialized 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8dc8fe1640 20 reqs_thread_entry: start 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f18814800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f18814800 20 Filter name: none 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8d427fc640 20 reqs_thread_entry: start 2024-05-15T18:08:59.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebaadb0 con 0x7f8f04099060 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.431+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebab930 con 0x7f8efc037040 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.432+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.432+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.432+0000 7f8f18814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.432+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.432+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebab970 con 0x7f8f04099060 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8efc009050 con 0x7f8f04099060 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:08:59.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebad140 con 0x7f8efc037040 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(65 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 4.20 4:0571a38c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebac630 con 0x5572eeb63b60 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 4.2 4:437c4f96:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb1980 con 0x5572eeb63b60 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 4.7 4:e385301a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb4460 con 0x7f8efc037040 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 4.28 4:16086eb9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb6cd0 con 0x5572eeb63b60 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 4.11 4:8b23f7bc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb91a0 con 0x7f8efc037040 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.433+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 4.25 4:a4f38253:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebbb940 con 0x5572eeb682e0 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 4.34 4:2d6893ae:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebbe800 con 0x7f8f04099060 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 4.34 4:2c099a43:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebc1160 con 0x7f8f04099060 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(68 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(66 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(69 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:74 4.16 4:6a82d888:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb3f30 con 0x5572eeb682e0 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(67 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(70 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:75 4.3e 4:7d40b125:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb1e10 con 0x7f8f04099060 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 4.11 4:8b3667c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb36b0 con 0x7f8efc037040 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(71 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8efc049040 con 0x7f8f04099060 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(76 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(73 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8efc049040 con 0x7f8f04099060 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(75 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8efc049040 con 0x7f8f04099060 2024-05-15T18:08:59.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.434+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(74 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.435+0000 7f8dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.435+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93952119608512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eebb1e10 con 0x5572eeb63b60 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.436+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93952119608512] v29'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.436+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93952119594784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb714c0 con 0x7f8f04099060 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.437+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93952119594784] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8efc049040 con 0x7f8f04099060 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.437+0000 7f8f18814800 20 remove_watcher() i=0 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.437+0000 7f8f18814800 2 removed watcher, disabling cache 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.437+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93952119597616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6df20 con 0x5572eeb63b60 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.438+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93952119597616] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.438+0000 7f8f18814800 20 remove_watcher() i=1 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.438+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93952119602528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb714c0 con 0x5572eeb682e0 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.439+0000 7f8f13f5c640 1 -- 172.21.15.173:0/828498394 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93952119602528] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f040ae050 con 0x5572eeb682e0 2024-05-15T18:08:59.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.439+0000 7f8f18814800 20 remove_watcher() i=2 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.439+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93952119604832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6ea30 con 0x7f8f04099060 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.440+0000 7f8f0b75b640 1 -- 172.21.15.173:0/828498394 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93952119604832] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8efc049040 con 0x7f8f04099060 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.440+0000 7f8f18814800 20 remove_watcher() i=3 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.440+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93952119610640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6df20 con 0x5572eeb63b60 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.441+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93952119610640] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x5572eeb63b60 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.441+0000 7f8f18814800 20 remove_watcher() i=4 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.441+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93952119614336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6fd60 con 0x7f8efc037040 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.442+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93952119614336] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.442+0000 7f8f18814800 20 remove_watcher() i=5 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.442+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93952119617040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb714c0 con 0x7f8efc037040 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.443+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93952119617040] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.443+0000 7f8f18814800 20 remove_watcher() i=6 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.443+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93952119620816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5572eeb6ea30 con 0x7f8efc037040 2024-05-15T18:08:59.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.444+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93952119620816] v29'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f0c00a4a0 con 0x7f8efc037040 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.444+0000 7f8f18814800 20 remove_watcher() i=7 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8efc037040 msgr2=0x7f8efc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8efc037040 0x7f8efc036410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eeb63b60 msgr2=0x5572eeb66020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eeb63b60 0x5572eeb66020 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f04099060 msgr2=0x7f8f0406e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8f04099060 0x7f8f0406e220 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb682e0 msgr2=0x5572eeb6a6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb682e0 0x5572eeb6a6d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ddc036950 msgr2=0x7f8ddc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ddc036950 0x7f8ddc038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00efd0 tx=0x7f8efc010000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 msgr2=0x5572eeb585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f1475d640 1 -- 172.21.15.173:0/828498394 reap_dead start 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb585f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8f0408d230 tx=0x7f8f0407af50 comp rx=0 tx=0).stop 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 shutdown_connections 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/828498394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb511c0 0x5572eeb585f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 >> 172.21.15.173:0/828498394 conn(0x5572eeb49110 msgr2=0x5572eeb46770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 shutdown_connections 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/828498394 wait complete. 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dec036900 msgr2=0x7f8dec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dec036900 0x7f8dec038dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00bf50 tx=0x7f8efc00f000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb3fbf0 msgr2=0x5572eeb40010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb3fbf0 0x5572eeb40010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8f0405ec50 tx=0x7f8f040813b0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 shutdown_connections 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dec036900 0x7f8dec038dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 --2- 172.21.15.173:0/4234750251 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eeb3fbf0 0x5572eeb40010 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 >> 172.21.15.173:0/4234750251 conn(0x5572eeb33c90 msgr2=0x5572eeb34090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 shutdown_connections 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.445+0000 7f8f18814800 1 -- 172.21.15.173:0/4234750251 wait complete. 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5572eeb2ec60 msgr2=0x5572eeb31050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5572eeb2ec60 0x5572eeb31050 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eea2a230 msgr2=0x5572eeb28400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5572eea2a230 0x5572eeb28400 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb2ad20 msgr2=0x5572eeb2d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5572eeb2ad20 0x5572eeb2d110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dfc0369a0 msgr2=0x7f8dfc038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8dfc0369a0 0x7f8dfc038e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8efc000f60 tx=0x7f8efc0012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 msgr2=0x5572eeb211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 --2- 172.21.15.173:0/1716226766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572eea28fd0 0x5572eeb211c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8f0401edb0 tx=0x7f8f04002fb0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f1475d640 1 -- 172.21.15.173:0/1716226766 reap_dead start 2024-05-15T18:08:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 shutdown_connections 2024-05-15T18:08:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 >> 172.21.15.173:0/1716226766 conn(0x5572eea245b0 msgr2=0x5572eeb137c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 shutdown_connections 2024-05-15T18:08:59.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.446+0000 7f8f18814800 1 -- 172.21.15.173:0/1716226766 wait complete. 2024-05-15T18:08:59.441 INFO:teuthology.orchestra.run.smithi173.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0a7d7418-39f7-493f-89f0-016c6637672d","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","marker":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-15T18:08:58.894064Z","creation_time":"2024-05-15T18:08:58.890026Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-15T18:08:59.441 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:08:58.894064Z', 'creation_time': '2024-05-15T18:08:58.890026Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-15T18:08:59.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-15T18:08:59.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-15T18:08:59.441 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-15T18:08:59.485 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:59.485 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:59.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.509+0000 7fbbb9b2f800 1 Processor -- start 2024-05-15T18:08:59.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.509+0000 7fbbb9b2f800 1 -- start start 2024-05-15T18:08:59.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.509+0000 7fbbb9b2f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5627464e48c0 0x562746573c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.509+0000 7fbbb9b2f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562746577f00 con 0x562746574200 2024-05-15T18:08:59.486 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.510+0000 7fbbb9b2f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x562746402050 con 0x5627464e48c0 2024-05-15T18:08:59.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.510+0000 7fbbb57ae640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5627464e48c0 0x562746573c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.510+0000 7fbbaffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x562746574200 0x5627465766a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57022/0 (socket says 172.21.15.173:57022) 2024-05-15T18:08:59.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.510+0000 7fbbaffff640 1 -- 172.21.15.173:0/3285418086 learned_addr learned my addr 172.21.15.173:0/3285418086 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:59.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.510+0000 7fbbb57ae640 1 -- 172.21.15.173:0/3285418086 >> v1:172.21.15.3:6789/0 conn(0x562746574200 legacy=0x5627465766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.510+0000 7fbbb57ae640 1 -- 172.21.15.173:0/3285418086 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562746579130 con 0x5627464e48c0 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.512+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/3285418086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746573c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbba800a470 tx=0x7fbba801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a315036ce4db16b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.512+0000 7fbbb4fad640 1 -- 172.21.15.173:0/3285418086 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8057070 con 0x5627464e48c0 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.512+0000 7fbbb4fad640 1 -- 172.21.15.173:0/3285418086 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8052570 con 0x5627464e48c0 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.512+0000 7fbbb4fad640 1 -- 172.21.15.173:0/3285418086 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8052870 con 0x5627464e48c0 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.513+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3285418086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 msgr2=0x562746573c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.513+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/3285418086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746573c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbba800a470 tx=0x7fbba801ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.513+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3285418086 shutdown_connections 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.513+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/3285418086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746573c60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.513+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3285418086 >> 172.21.15.173:0/3285418086 conn(0x56274656b5a0 msgr2=0x56274656d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.513+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3285418086 shutdown_connections 2024-05-15T18:08:59.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.513+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3285418086 wait complete. 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.527+0000 7fbbb9b2f800 1 Processor -- start 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.527+0000 7fbbb9b2f800 1 -- start start 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.527+0000 7fbbb9b2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x5627466626d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.527+0000 7fbbb9b2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5627464bc1d0 con 0x5627464e48c0 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.527+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x5627466626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.527+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x5627466626d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38444/0 (socket says 172.21.15.173:38444) 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.527+0000 7fbbb57ae640 1 -- 172.21.15.173:0/275269030 learned_addr learned my addr 172.21.15.173:0/275269030 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.528+0000 7fbbb57ae640 1 -- 172.21.15.173:0/275269030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562746662ca0 con 0x5627464e48c0 2024-05-15T18:08:59.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.528+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/275269030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x5627466626d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbba8055040 tx=0x7fbba804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712d0ab7c382fd86 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.528+0000 7fbaa3606640 1 -- 172.21.15.173:0/275269030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8057040 con 0x5627464e48c0 2024-05-15T18:08:59.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.528+0000 7fbaa3606640 1 -- 172.21.15.173:0/275269030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8052990 con 0x5627464e48c0 2024-05-15T18:08:59.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.528+0000 7fbaa3606640 1 -- 172.21.15.173:0/275269030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8052c70 con 0x5627464e48c0 2024-05-15T18:08:59.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/275269030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 msgr2=0x5627466626d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/275269030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x5627466626d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbba8055040 tx=0x7fbba804c000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/275269030 shutdown_connections 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/275269030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x5627466626d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/275269030 >> 172.21.15.173:0/275269030 conn(0x56274656b5a0 msgr2=0x56274665dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/275269030 shutdown_connections 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/275269030 wait complete. 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 Processor -- start 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 -- start start 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746571590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb9b2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562746578370 con 0x5627464e48c0 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746571590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746571590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38452/0 (socket says 172.21.15.173:38452) 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.529+0000 7fbbb57ae640 1 -- 172.21.15.173:0/698872058 learned_addr learned my addr 172.21.15.173:0/698872058 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.530+0000 7fbbb57ae640 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274656fc80 con 0x5627464e48c0 2024-05-15T18:08:59.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.530+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746571590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbba800a470 tx=0x7fbba8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.530+0000 7fbaa1e03640 1 -- 172.21.15.173:0/698872058 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8073070 con 0x5627464e48c0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.530+0000 7fbaa1e03640 1 -- 172.21.15.173:0/698872058 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba805d650 con 0x5627464e48c0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.530+0000 7fbaa1e03640 1 -- 172.21.15.173:0/698872058 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8057070 con 0x5627464e48c0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.530+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56274656ff10 con 0x5627464e48c0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.530+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562746570430 con 0x5627464e48c0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.531+0000 7fbaa1e03640 1 -- 172.21.15.173:0/698872058 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbba8076070 con 0x5627464e48c0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.531+0000 7fbaa1e03640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba9c036950 0x7fba9c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.531+0000 7fbaa1e03640 1 -- 172.21.15.173:0/698872058 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbba808ddd0 con 0x5627464e48c0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.531+0000 7fbbaffff640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba9c036950 0x7fba9c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.531+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562746574200 0x562746673550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.531+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746673b20 con 0x562746574200 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.531+0000 7fbbb5faf640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562746574200 0x562746673550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbaffff640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba9c036950 0x7fba9c038e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbb5faf640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562746574200 0x562746673550 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbb5faf640 1 -- 172.21.15.173:0/698872058 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x562746574200 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466743c0 con 0x562746574200 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbb5faf640 1 -- 172.21.15.173:0/698872058 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbb000a4a0 con 0x562746574200 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562746675e40 0x562746678300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746678a90 con 0x562746675e40 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.532+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562746675e40 0x562746678300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.533+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562746675e40 0x562746678300 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.533+0000 7fbbb57ae640 1 -- 172.21.15.173:0/698872058 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbba8075030 con 0x562746675e40 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.533+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746674c40 con 0x562746574200 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.533+0000 7fbbb5faf640 1 -- 172.21.15.173:0/698872058 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbb000a4a0 con 0x562746574200 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.533+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562746679f40 0x56274667c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.533+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56274667cb10 con 0x562746679f40 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.533+0000 7fbbaffff640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562746679f40 0x56274667c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.534+0000 7fbbaffff640 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562746679f40 0x56274667c3b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.534+0000 7fbbaffff640 1 -- 172.21.15.173:0/698872058 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbba0009050 con 0x562746679f40 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.534+0000 7fbbb9b2f800 1 Processor -- start 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb9b2f800 1 -- start start 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb9b2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56274668af70 0x56274668b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb9b2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562746571ad0 con 0x56274668af70 2024-05-15T18:08:59.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56274668af70 0x56274668b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56274668af70 0x56274668b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38460/0 (socket says 172.21.15.173:38460) 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb57ae640 1 -- 172.21.15.173:0/3726585848 learned_addr learned my addr 172.21.15.173:0/3726585848 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb57ae640 1 -- 172.21.15.173:0/3726585848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274668b8d0 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.535+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56274668af70 0x56274668b390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbba805b4b0 tx=0x7fbba805cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.536+0000 7fba9affd640 1 -- 172.21.15.173:0/3726585848 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba80773b0 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.536+0000 7fba9affd640 1 -- 172.21.15.173:0/3726585848 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8089070 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.536+0000 7fba9affd640 1 -- 172.21.15.173:0/3726585848 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba80776c0 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.536+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56274668c340 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.536+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274668c840 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.536+0000 7fba9affd640 1 -- 172.21.15.173:0/3726585848 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbba8077860 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fba9affd640 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba90036950 0x7fba90038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fba9affd640 1 -- 172.21.15.173:0/3726585848 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbba804b100 con 0x56274668af70 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbaffff640 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba90036950 0x7fba90038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbb9b2f800 1 Processor -- start 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbb9b2f800 1 -- start start 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbaffff640 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba90036950 0x7fba90038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbba000bf50 tx=0x7fbba000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbb9b2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x5627466984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbb9b2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562746462cf0 con 0x562746698090 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x5627466984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x5627466984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38476/0 (socket says 172.21.15.173:38476) 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.537+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2053226440 learned_addr learned my addr 172.21.15.173:0/2053226440 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2053226440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562746698a80 con 0x562746698090 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/2053226440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x5627466984b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbba8066700 tx=0x7fbba806e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739791d779732d9b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fba98ff9640 1 -- 172.21.15.173:0/2053226440 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8096c40 con 0x562746698090 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fba98ff9640 1 -- 172.21.15.173:0/2053226440 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8076540 con 0x562746698090 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fba98ff9640 1 -- 172.21.15.173:0/2053226440 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba808c6b0 con 0x562746698090 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2053226440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 msgr2=0x5627466984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2053226440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x5627466984b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbba8066700 tx=0x7fbba806e4c0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2053226440 shutdown_connections 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2053226440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x5627466984b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.538+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2053226440 >> 172.21.15.173:0/2053226440 conn(0x5627466943f0 msgr2=0x562746692450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2053226440 shutdown_connections 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2053226440 wait complete. 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb9b2f800 1 Processor -- start 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb9b2f800 1 -- start start 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb9b2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x56274669f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb9b2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562746698fb0 con 0x562746698090 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x56274669f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb57ae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x56274669f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38490/0 (socket says 172.21.15.173:38490) 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.539+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 learned_addr learned my addr 172.21.15.173:0/2484824454 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.540+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56274669f8a0 con 0x562746698090 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.540+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x56274669f360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbba8060560 tx=0x7fbba8069f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.540+0000 7fba86ffd640 1 -- 172.21.15.173:0/2484824454 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba80bb070 con 0x562746698090 2024-05-15T18:08:59.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.540+0000 7fba86ffd640 1 -- 172.21.15.173:0/2484824454 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba806c300 con 0x562746698090 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.540+0000 7fba86ffd640 1 -- 172.21.15.173:0/2484824454 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbba8060110 con 0x562746698090 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.540+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56274669f8a0 con 0x562746698090 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.540+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274669f8a0 con 0x562746698090 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.541+0000 7fba86ffd640 1 -- 172.21.15.173:0/2484824454 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbba80be070 con 0x562746698090 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.541+0000 7fba86ffd640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba80036950 0x7fba80038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.541+0000 7fba86ffd640 1 -- 172.21.15.173:0/2484824454 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbba80b2030 con 0x562746698090 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.541+0000 7fbbaffff640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba80036950 0x7fba80038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.541+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5627466aaa60 0x5627466acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466ad670 con 0x5627466aaa60 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb5faf640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5627466aaa60 0x5627466acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbaffff640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba80036950 0x7fba80038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbba0001b60 tx=0x7fbba0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb5faf640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5627466aaa60 0x5627466acf20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 20 realm 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466ada80 con 0x5627466aaa60 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.542+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae350 con 0x5627466aaa60 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb9b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5627466af1e0 0x5627466b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466b1d30 con 0x5627466af1e0 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5627466af1e0 0x5627466b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.543+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5627466af1e0 0x5627466b15d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbb9b2f800 20 searching for the correct realm 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466b3710 con 0x5627466af1e0 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbb57ae640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbba80c0060 0x7fbba80846b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466b3710 con 0x7fbba80c0060 2024-05-15T18:08:59.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.544+0000 7fbbaffff640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbba80c0060 0x7fbba80846b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.545+0000 7fbbaffff640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbba80c0060 0x7fbba80846b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.545+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba0009050 con 0x7fbba80c0060 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.545+0000 7fbbaffff640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbba0038040 0x7fbba001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.545+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466b3710 con 0x7fbba0038040 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.545+0000 7fbbb5faf640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbba0038040 0x7fbba001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.545+0000 7fbbb5faf640 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbba0038040 0x7fbba001bab0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.546+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.546+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.546+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.546+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.546+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.546+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba80c0060 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba0009050 con 0x7fbba80c0060 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.547+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.548+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.548+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.548+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.548+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.548+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.548+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba80c0060 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbba0009050 con 0x7fbba80c0060 2024-05-15T18:08:59.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.549+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.550+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba80c0060 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba0009050 con 0x7fbba80c0060 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.551+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba80c0060 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba0009050 con 0x7fbba80c0060 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466af1e0 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.552+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba0038040 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x5627466aaa60 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5627466ae6f0 con 0x7fbba80c0060 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:59.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466b26e0 con 0x5627466aaa60 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.553+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466b2ad0 con 0x5627466aaa60 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466b2ad0 con 0x7fbba0038040 2024-05-15T18:08:59.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 20 zone default found 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 4 Realm: () 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 20 zonegroup default 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.554+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466b2ef0 con 0x7fbba0038040 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.547 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466b2ef0 con 0x5627466af1e0 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466b55c0 con 0x5627466af1e0 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 20 started sync module instance, tier type = 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.555+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b22d0 con 0x7fbba80c0060 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.556+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.556+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94726685149968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b59c0 con 0x7fbba80c0060 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.556+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b64e0 con 0x5627466aaa60 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.557+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94726685149968] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.548 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.557+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.557+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94726685155248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b68d0 con 0x5627466aaa60 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.557+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b7330 con 0x5627466af1e0 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.559+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94726685155248] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.559+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.559+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94726685151344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b7330 con 0x5627466af1e0 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.559+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b7da0 con 0x7fbba80c0060 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.560+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94726685151344] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.560+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.560+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94726685161616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b8190 con 0x7fbba80c0060 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.560+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b8bd0 con 0x5627466aaa60 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.561+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.561+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94726685165216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b9470 con 0x5627466aaa60 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.561+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b9f70 con 0x7fbba0038040 2024-05-15T18:08:59.549 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.561+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94726685161616] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.562+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.562+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94726685170272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b9f30 con 0x7fbba0038040 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.562+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466ba980 con 0x7fbba0038040 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.562+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94726685165216] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.563+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94726685170272] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.563+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.563+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94726685167552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466ba4d0 con 0x7fbba0038040 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.563+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466bae90 con 0x7fbba0038040 2024-05-15T18:08:59.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.564+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94726685167552] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94726685158928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466bae90 con 0x7fbba0038040 2024-05-15T18:08:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 20 add_watcher() i=0 2024-05-15T18:08:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 20 add_watcher() i=1 2024-05-15T18:08:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 20 add_watcher() i=2 2024-05-15T18:08:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 20 add_watcher() i=3 2024-05-15T18:08:59.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 20 add_watcher() i=4 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 20 add_watcher() i=5 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.565+0000 7fbbb9b2f800 20 add_watcher() i=6 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.566+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94726685158928] v29'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.566+0000 7fbbb9b2f800 20 add_watcher() i=7 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.566+0000 7fbbb9b2f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.566+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466be1a0 con 0x5627466aaa60 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.566+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.566+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94726685174608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466bb420 con 0x5627466aaa60 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.567+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94726685174608] v29'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.567+0000 7fba6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.567+0000 7fbbb9b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.567+0000 7fbbb9b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.567+0000 7fbbb9b2f800 5 note: GC not initialized 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fba6a7e4640 20 reqs_thread_entry: start 2024-05-15T18:08:59.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb9b2f800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb9b2f800 20 Filter name: none 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fb9dbfff640 20 reqs_thread_entry: start 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f1290 con 0x5627466aaa60 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.568+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f1670 con 0x5627466aaa60 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f1670 con 0x7fbba80c0060 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f0110 con 0x7fbba80c0060 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb9b2f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.569+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f2a70 con 0x7fbba0038040 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.570+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(66 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.570+0000 7fbbb9b2f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.570+0000 7fbbb9b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.570+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 4.20 4:0571a38c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f2460 con 0x5627466aaa60 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.570+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 4.2 4:437c4f96:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f7300 con 0x5627466aaa60 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.570+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 4.7 4:e385301a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466f9d20 con 0x7fbba0038040 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.570+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 4.28 4:16086eb9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466fc590 con 0x5627466aaa60 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 4.11 4:8b23f7bc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627466fee00 con 0x7fbba0038040 2024-05-15T18:08:59.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:72 4.25 4:a4f38253:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746701670 con 0x5627466af1e0 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 4.34 4:2d6893ae:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746704110 con 0x7fbba80c0060 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 4.34 4:2c099a43:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746706d90 con 0x7fbba80c0060 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 4.16 4:6a82d888:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5627467099c0 con 0x5627466af1e0 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:76 4.3e 4:7d40b125:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746706d90 con 0x7fbba80c0060 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(67 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 4.11 4:8b3667c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562746706d90 con 0x7fbba0038040 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(73 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(75 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(76 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(70 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(72 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.571+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(77 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.573+0000 7fba6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.573+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94726685174608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466d9d90 con 0x5627466aaa60 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.574+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94726685174608] v29'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.574+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94726685149968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466d9d90 con 0x7fbba80c0060 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.575+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94726685149968] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.575+0000 7fbbb9b2f800 20 remove_watcher() i=0 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.575+0000 7fbbb9b2f800 2 removed watcher, disabling cache 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.575+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94726685155248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466d9d90 con 0x5627466aaa60 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.576+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94726685155248] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.576+0000 7fbbb9b2f800 20 remove_watcher() i=1 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.576+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94726685151344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b5fb0 con 0x5627466af1e0 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.577+0000 7fbbb57ae640 1 -- 172.21.15.173:0/2484824454 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94726685151344] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba80bd030 con 0x5627466af1e0 2024-05-15T18:08:59.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.577+0000 7fbbb9b2f800 20 remove_watcher() i=2 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.577+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94726685161616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466d9d90 con 0x7fbba80c0060 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.578+0000 7fbbaffff640 1 -- 172.21.15.173:0/2484824454 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94726685161616] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbba0045040 con 0x7fbba80c0060 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.578+0000 7fbbb9b2f800 20 remove_watcher() i=3 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.578+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94726685165216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b5fb0 con 0x5627466aaa60 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.579+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94726685165216] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x5627466aaa60 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.579+0000 7fbbb9b2f800 20 remove_watcher() i=4 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.579+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94726685170272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b7890 con 0x7fbba0038040 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.580+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94726685170272] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.580+0000 7fbbb9b2f800 20 remove_watcher() i=5 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.580+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94726685167552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466d9d90 con 0x7fbba0038040 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.581+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94726685167552] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.581+0000 7fbbb9b2f800 20 remove_watcher() i=6 2024-05-15T18:08:59.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.581+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94726685158928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5627466b5fb0 con 0x7fbba0038040 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94726685158928] v29'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb000a4a0 con 0x7fbba0038040 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 20 remove_watcher() i=7 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbba0038040 msgr2=0x7fbba001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbba0038040 0x7fbba001bab0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5627466aaa60 msgr2=0x5627466acf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5627466aaa60 0x5627466acf20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbba80c0060 msgr2=0x7fbba80846b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbba80c0060 0x7fbba80846b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5627466af1e0 msgr2=0x5627466b15d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.582+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5627466af1e0 0x5627466b15d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba80036950 msgr2=0x7fba80038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba80036950 0x7fba80038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbba0001b60 tx=0x7fbba0010000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 msgr2=0x56274669f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb5faf640 1 -- 172.21.15.173:0/2484824454 reap_dead start 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x56274669f360 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbba8060560 tx=0x7fbba8069f00 comp rx=0 tx=0).stop 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 shutdown_connections 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/2484824454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562746698090 0x56274669f360 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 >> 172.21.15.173:0/2484824454 conn(0x5627466943f0 msgr2=0x562746691a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 shutdown_connections 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/2484824454 wait complete. 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba90036950 msgr2=0x7fba90038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba90036950 0x7fba90038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbba000bf50 tx=0x7fbba000f000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56274668af70 msgr2=0x56274668b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56274668af70 0x56274668b390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbba805b4b0 tx=0x7fbba805cef0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 shutdown_connections 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba90036950 0x7fba90038e10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/3726585848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56274668af70 0x56274668b390 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 >> 172.21.15.173:0/3726585848 conn(0x56274667f010 msgr2=0x56274667f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 shutdown_connections 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.583+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/3726585848 wait complete. 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562746679f40 msgr2=0x56274667c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562746679f40 0x56274667c3b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562746574200 msgr2=0x562746673550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562746574200 0x562746673550 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562746675e40 msgr2=0x562746678300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562746675e40 0x562746678300 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba9c036950 msgr2=0x7fba9c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba9c036950 0x7fba9c038e10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000f60 tx=0x7fbba00012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 msgr2=0x562746571590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 --2- 172.21.15.173:0/698872058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5627464e48c0 0x562746571590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbba800a470 tx=0x7fbba8003020 comp rx=0 tx=0).stop 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb5faf640 1 -- 172.21.15.173:0/698872058 reap_dead start 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 shutdown_connections 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 >> 172.21.15.173:0/698872058 conn(0x56274656b5a0 msgr2=0x56274665c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 shutdown_connections 2024-05-15T18:08:59.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.584+0000 7fbbb9b2f800 1 -- 172.21.15.173:0/698872058 wait complete. 2024-05-15T18:08:59.572 INFO:teuthology.orchestra.run.smithi173.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0a7d7418-39f7-493f-89f0-016c6637672d","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","marker":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-15T18:08:58.894064Z","creation_time":"2024-05-15T18:08:58.890026Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-05-15T18:08:59.572 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:08:58.894064Z', 'creation_time': '2024-05-15T18:08:58.890026Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-15T18:08:59.578 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-15T18:08:59.578 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-15T18:08:59.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-15T18:08:59.579 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-15T18:08:59.657 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:59.657 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdf536800 1 Processor -- start 2024-05-15T18:08:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdf536800 1 -- start start 2024-05-15T18:08:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdf536800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56391c0e4fd0 0x56391c0e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdf536800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56391c0e5a70 con 0x56391c0e6230 2024-05-15T18:08:59.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdf536800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56391bf77050 con 0x56391c0e4fd0 2024-05-15T18:08:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdb2cc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56391c0e4fd0 0x56391c0e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdaacb640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x56391c0e6230 0x56391c0e66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57034/0 (socket says 172.21.15.173:57034) 2024-05-15T18:08:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdb2cc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56391c0e4fd0 0x56391c0e53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38492/0 (socket says 172.21.15.173:38492) 2024-05-15T18:08:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.681+0000 7fbfdaacb640 1 -- 172.21.15.173:0/1627550420 learned_addr learned my addr 172.21.15.173:0/1627550420 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:08:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.682+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/1627550420 >> v1:172.21.15.3:6789/0 conn(0x56391c0e6230 legacy=0x56391c0e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.682+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/1627550420 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391c0e6df0 con 0x56391c0e4fd0 2024-05-15T18:08:59.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/1627550420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c0e53f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a470 tx=0x7fbfcc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ad4f33dda1f0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfda2ca640 1 -- 172.21.15.173:0/1627550420 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc057070 con 0x56391c0e4fd0 2024-05-15T18:08:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfda2ca640 1 -- 172.21.15.173:0/1627550420 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc04adc0 con 0x56391c0e4fd0 2024-05-15T18:08:59.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfda2ca640 1 -- 172.21.15.173:0/1627550420 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc052590 con 0x56391c0e4fd0 2024-05-15T18:08:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfdf536800 1 -- 172.21.15.173:0/1627550420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 msgr2=0x56391c0e53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfdf536800 1 --2- 172.21.15.173:0/1627550420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c0e53f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a470 tx=0x7fbfcc01ce90 comp rx=0 tx=0).stop 2024-05-15T18:08:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfdf536800 1 -- 172.21.15.173:0/1627550420 shutdown_connections 2024-05-15T18:08:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfdf536800 1 --2- 172.21.15.173:0/1627550420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c0e53f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfdf536800 1 -- 172.21.15.173:0/1627550420 >> 172.21.15.173:0/1627550420 conn(0x56391c0e05b0 msgr2=0x56391c0e29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.684+0000 7fbfdf536800 1 -- 172.21.15.173:0/1627550420 shutdown_connections 2024-05-15T18:08:59.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.685+0000 7fbfdf536800 1 -- 172.21.15.173:0/1627550420 wait complete. 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.698+0000 7fbfdf536800 1 Processor -- start 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.698+0000 7fbfdf536800 1 -- start start 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.698+0000 7fbfdf536800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1d66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.698+0000 7fbfdf536800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56391c0311d0 con 0x56391c0e4fd0 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.698+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1d66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.698+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1d66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38508/0 (socket says 172.21.15.173:38508) 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.698+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2536399609 learned_addr learned my addr 172.21.15.173:0/2536399609 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.699+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2536399609 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391c1d6c90 con 0x56391c0e4fd0 2024-05-15T18:08:59.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.699+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/2536399609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1d66c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc01ced0 tx=0x7fbfcc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbfa8dca2d1af17 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.699+0000 7fbec960a640 1 -- 172.21.15.173:0/2536399609 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc057040 con 0x56391c0e4fd0 2024-05-15T18:08:59.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.699+0000 7fbec960a640 1 -- 172.21.15.173:0/2536399609 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc063070 con 0x56391c0e4fd0 2024-05-15T18:08:59.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.699+0000 7fbec960a640 1 -- 172.21.15.173:0/2536399609 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc052800 con 0x56391c0e4fd0 2024-05-15T18:08:59.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 -- 172.21.15.173:0/2536399609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 msgr2=0x56391c1d66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2536399609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1d66c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc01ced0 tx=0x7fbfcc04c000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 -- 172.21.15.173:0/2536399609 shutdown_connections 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2536399609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1d66c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 -- 172.21.15.173:0/2536399609 >> 172.21.15.173:0/2536399609 conn(0x56391c0e05b0 msgr2=0x56391c1d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 -- 172.21.15.173:0/2536399609 shutdown_connections 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 -- 172.21.15.173:0/2536399609 wait complete. 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 Processor -- start 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 -- start start 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1de140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.700+0000 7fbfdf536800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56391c0ee700 con 0x56391c0e4fd0 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1de140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38520/0 (socket says 172.21.15.173:38520) 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/563909151 learned_addr learned my addr 172.21.15.173:0/563909151 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391c1de680 con 0x56391c0e4fd0 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1de140 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc005870 tx=0x7fbfcc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbec7e07640 1 -- 172.21.15.173:0/563909151 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc057050 con 0x56391c0e4fd0 2024-05-15T18:08:59.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbec7e07640 1 -- 172.21.15.173:0/563909151 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc052d60 con 0x56391c0e4fd0 2024-05-15T18:08:59.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56391c1de910 con 0x56391c0e4fd0 2024-05-15T18:08:59.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbec7e07640 1 -- 172.21.15.173:0/563909151 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc067670 con 0x56391c0e4fd0 2024-05-15T18:08:59.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.701+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391c058300 con 0x56391c0e4fd0 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.702+0000 7fbec7e07640 1 -- 172.21.15.173:0/563909151 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbfcc067810 con 0x56391c0e4fd0 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.702+0000 7fbec7e07640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbec0036950 0x7fbec0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.702+0000 7fbec7e07640 1 -- 172.21.15.173:0/563909151 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbfcc08fa70 con 0x56391c0e4fd0 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.702+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbec0036950 0x7fbec0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.702+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c0e6230 0x56391c1e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.702+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c1e4a50 con 0x56391c0e6230 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.703+0000 7fbfdbacd640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c0e6230 0x56391c1e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.703+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbec0036950 0x7fbec0038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0000f60 tx=0x7fbfd00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.703+0000 7fbfdbacd640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c0e6230 0x56391c1e4510 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.703+0000 7fbfdbacd640 1 -- 172.21.15.173:0/563909151 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c0e6230 2024-05-15T18:08:59.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.703+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c1e4df0 con 0x56391c0e6230 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.703+0000 7fbfdbacd640 1 -- 172.21.15.173:0/563909151 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c0e6230 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c1e6b60 0x56391c1e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c1e95f0 con 0x56391c1e6b60 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c1e6b60 0x56391c1e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c1e6b60 0x56391c1e8f50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/563909151 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbfcc05a040 con 0x56391c1e6b60 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c1e5b40 con 0x56391c0e6230 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdbacd640 1 -- 172.21.15.173:0/563909151 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c0e6230 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56391c1eaa30 0x56391c1ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.704+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c1ed590 con 0x56391c1eaa30 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.705+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56391c1eaa30 0x56391c1ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.705+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56391c1eaa30 0x56391c1ece40 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.705+0000 7fbfdaacb640 1 -- 172.21.15.173:0/563909151 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbfd0009050 con 0x56391c1eaa30 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.706+0000 7fbfdf536800 1 Processor -- start 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.706+0000 7fbfdf536800 1 -- start start 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.706+0000 7fbfdf536800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c1fb9f0 0x56391c1fbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.706+0000 7fbfdf536800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56391bfd7cf0 con 0x56391c1fb9f0 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.706+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c1fb9f0 0x56391c1fbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.706+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c1fb9f0 0x56391c1fbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38532/0 (socket says 172.21.15.173:38532) 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.706+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/325575999 learned_addr learned my addr 172.21.15.173:0/325575999 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.707+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/325575999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391c1fc350 con 0x56391c1fb9f0 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.707+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c1fb9f0 0x56391c1fbe10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc052fd0 tx=0x7fbfcc05cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.707+0000 7fbec5602640 1 -- 172.21.15.173:0/325575999 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc05db10 con 0x56391c1fb9f0 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.707+0000 7fbec5602640 1 -- 172.21.15.173:0/325575999 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc05b370 con 0x56391c1fb9f0 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.707+0000 7fbec5602640 1 -- 172.21.15.173:0/325575999 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc05b6f0 con 0x56391c1fb9f0 2024-05-15T18:08:59.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.707+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56391c1fcdc0 con 0x56391c1fb9f0 2024-05-15T18:08:59.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.707+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391c1fd2c0 con 0x56391c1fb9f0 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbec5602640 1 -- 172.21.15.173:0/325575999 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbfcc05b890 con 0x56391c1fb9f0 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbec5602640 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbeb4036950 0x7fbeb4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbec5602640 1 -- 172.21.15.173:0/325575999 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbfcc08a070 con 0x56391c1fb9f0 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbeb4036950 0x7fbeb4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbfdf536800 1 Processor -- start 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbfdf536800 1 -- start start 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbeb4036950 0x7fbeb4038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000bf50 tx=0x7fbfd000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbfdf536800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c20d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.708+0000 7fbfdf536800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56391c1d6f50 con 0x56391c20cfb0 2024-05-15T18:08:59.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c20d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c20d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38540/0 (socket says 172.21.15.173:38540) 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/3866534926 learned_addr learned my addr 172.21.15.173:0/3866534926 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/3866534926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391c20d9a0 con 0x56391c20cfb0 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/3866534926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c20d3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a310 tx=0x7fbfcc072a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdadb5e3385aa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbebeffd640 1 -- 172.21.15.173:0/3866534926 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc072440 con 0x56391c20cfb0 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbebeffd640 1 -- 172.21.15.173:0/3866534926 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc08c370 con 0x56391c20cfb0 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.709+0000 7fbebeffd640 1 -- 172.21.15.173:0/3866534926 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc006380 con 0x56391c20cfb0 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 -- 172.21.15.173:0/3866534926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 msgr2=0x56391c20d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 --2- 172.21.15.173:0/3866534926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c20d3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a310 tx=0x7fbfcc072a30 comp rx=0 tx=0).stop 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 -- 172.21.15.173:0/3866534926 shutdown_connections 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 --2- 172.21.15.173:0/3866534926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c20d3d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 -- 172.21.15.173:0/3866534926 >> 172.21.15.173:0/3866534926 conn(0x56391c204f00 msgr2=0x56391c202f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 -- 172.21.15.173:0/3866534926 shutdown_connections 2024-05-15T18:08:59.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 -- 172.21.15.173:0/3866534926 wait complete. 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 Processor -- start 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 -- start start 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c2143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdf536800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56391c20e050 con 0x56391c20cfb0 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c2143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdb2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c2143d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38548/0 (socket says 172.21.15.173:38548) 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.710+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 learned_addr learned my addr 172.21.15.173:0/2109957963 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.711+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391c214910 con 0x56391c20cfb0 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.711+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c2143d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc05cc00 tx=0x7fbfcc092ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.711+0000 7fbebd7fa640 1 -- 172.21.15.173:0/2109957963 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc0bd070 con 0x56391c20cfb0 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.711+0000 7fbebd7fa640 1 -- 172.21.15.173:0/2109957963 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0730c0 con 0x56391c20cfb0 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.711+0000 7fbebd7fa640 1 -- 172.21.15.173:0/2109957963 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc072440 con 0x56391c20cfb0 2024-05-15T18:08:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.711+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56391c214910 con 0x56391c20cfb0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.711+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391c214910 con 0x56391c20cfb0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.712+0000 7fbebd7fa640 1 -- 172.21.15.173:0/2109957963 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbfcc0c0070 con 0x56391c20cfb0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.712+0000 7fbebd7fa640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbea4036900 0x7fbea4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.712+0000 7fbebd7fa640 1 -- 172.21.15.173:0/2109957963 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fbfcc0b3030 con 0x56391c20cfb0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.712+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbea4036900 0x7fbea4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.712+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.712+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c21fb20 0x56391c221fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.712+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c2226e0 con 0x56391c21fb20 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdbacd640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c21fb20 0x56391c221fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbea4036900 0x7fbea4038dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0001b60 tx=0x7fbfd0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdbacd640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c21fb20 0x56391c221fe0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 20 realm 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c222af0 con 0x56391c21fb20 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.713+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c2233c0 con 0x56391c21fb20 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdf536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c224250 0x56391c226640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c226d80 con 0x56391c224250 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c224250 0x56391c226640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.714+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c224250 0x56391c226640 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdf536800 20 searching for the correct realm 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c228750 con 0x56391c224250 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdb2cc640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbfcc0c2060 0x7fbfcc0a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c228750 con 0x7fbfcc0c2060 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.715+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbfcc0c2060 0x7fbfcc0a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.716+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbfcc0c2060 0x7fbfcc0a3440 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.716+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.716+0000 7fbfdaacb640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbfd0037040 0x7fbfd0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.716+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c228750 con 0x7fbfd0037040 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.716+0000 7fbfdbacd640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbfd0037040 0x7fbfd0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.716+0000 7fbfdbacd640 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbfd0037040 0x7fbfd0036410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.717+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfcc0c2060 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.718+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfcc0c2060 2024-05-15T18:08:59.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.719+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.720+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.721+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfcc0c2060 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.722+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.722+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.722+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.722+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.722+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.722+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfcc0c2060 2024-05-15T18:08:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c224250 2024-05-15T18:08:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.723+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfd0037040 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.724+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.724+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x56391c21fb20 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.724+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.724+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56391c223760 con 0x7fbfcc0c2060 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.724+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:59.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c227720 con 0x56391c21fb20 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c227b10 con 0x56391c21fb20 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.725+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c227b10 con 0x7fbfd0037040 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:59.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 20 zone default found 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 4 Realm: () 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 20 zonegroup default 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c227f30 con 0x7fbfd0037040 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.726+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c228350 con 0x56391c224250 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdf536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c22a600 con 0x56391c224250 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdf536800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdf536800 20 started sync module instance, tier type = 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdf536800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.727+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c229aa0 con 0x7fbfcc0c2060 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.728+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.728+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94803285155472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22ae50 con 0x7fbfcc0c2060 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.728+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22b6a0 con 0x56391c21fb20 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.729+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94803285155472] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.729+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.729+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94803285160432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22bac0 con 0x56391c21fb20 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.729+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22c310 con 0x56391c224250 2024-05-15T18:08:59.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.730+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94803285160432] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.730+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.730+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94803285161968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22c700 con 0x56391c224250 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.730+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22d100 con 0x7fbfcc0c2060 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.731+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94803285161968] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.731+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.731+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94803285163088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22d9a0 con 0x7fbfcc0c2060 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.732+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22e360 con 0x56391c21fb20 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.733+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.733+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94803285172368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22eb40 con 0x56391c21fb20 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.733+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22f640 con 0x7fbfd0037040 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.733+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94803285163088] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.734+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.734+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94803285176624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22f600 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.734+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c230080 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.734+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94803285172368] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.734+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94803285176624] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.735+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.735+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94803285169392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c22fbd0 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.735+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c230590 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94803285180640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c2309b0 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94803285169392] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 20 add_watcher() i=0 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 20 add_watcher() i=1 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 20 add_watcher() i=2 2024-05-15T18:08:59.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 20 add_watcher() i=3 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 20 add_watcher() i=4 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 20 add_watcher() i=5 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.736+0000 7fbfdf536800 20 add_watcher() i=6 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.737+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94803285180640] v29'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.737+0000 7fbfdf536800 20 add_watcher() i=7 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.737+0000 7fbfdf536800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.737+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c2339e0 con 0x56391c21fb20 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.737+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.737+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94803285181696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c230dd0 con 0x56391c21fb20 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.738+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94803285181696] v29'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.738+0000 7fbe91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:59.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 5 note: GC not initialized 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbe90fe1640 20 reqs_thread_entry: start 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 20 Filter name: none 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbe0a7fc640 20 reqs_thread_entry: start 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c266e50 con 0x7fbfcc0c2060 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.739+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c267a30 con 0x7fbfd0037040 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c267a70 con 0x7fbfcc0c2060 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.740+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c269210 con 0x7fbfd0037040 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(65 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 4.20 4:0571a38c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c268830 con 0x56391c21fb20 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 4.2 4:437c4f96:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c26dd80 con 0x56391c21fb20 2024-05-15T18:08:59.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 4.7 4:e385301a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c2705f0 con 0x7fbfd0037040 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 4.28 4:16086eb9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c272e60 con 0x56391c21fb20 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 4.11 4:8b23f7bc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c2756d0 con 0x7fbfd0037040 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 4.25 4:a4f38253:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c2756d0 con 0x56391c224250 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 4.34 4:2d6893ae:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c27a9d0 con 0x7fbfcc0c2060 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 4.34 4:2c099a43:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c27d7f0 con 0x7fbfcc0c2060 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:74 4.16 4:6a82d888:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c280260 con 0x56391c224250 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:75 4.3e 4:7d40b125:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c27d7f0 con 0x7fbfcc0c2060 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 4.11 4:8b3667c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56391c285190 con 0x7fbfd0037040 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(68 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(70 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(71 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(66 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(67 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(74 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.741+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(69 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.742+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(75 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.742+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(73 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.742+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(76 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.743+0000 7fbe91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.743+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94803285181696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c285190 con 0x56391c21fb20 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.744+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94803285181696] v29'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.744+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94803285155472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c24f3b0 con 0x7fbfcc0c2060 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.745+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94803285155472] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.745+0000 7fbfdf536800 20 remove_watcher() i=0 2024-05-15T18:08:59.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.745+0000 7fbfdf536800 2 removed watcher, disabling cache 2024-05-15T18:08:59.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.745+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94803285160432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c24f3b0 con 0x56391c21fb20 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.746+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94803285160432] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.746+0000 7fbfdf536800 20 remove_watcher() i=1 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.746+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94803285161968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c24f3b0 con 0x56391c224250 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.747+0000 7fbfdb2cc640 1 -- 172.21.15.173:0/2109957963 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94803285161968] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfcc0bf030 con 0x56391c224250 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.747+0000 7fbfdf536800 20 remove_watcher() i=2 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.747+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94803285163088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c24f3b0 con 0x7fbfcc0c2060 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.748+0000 7fbfdaacb640 1 -- 172.21.15.173:0/2109957963 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94803285163088] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd0009050 con 0x7fbfcc0c2060 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.748+0000 7fbfdf536800 20 remove_watcher() i=3 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.748+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94803285172368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c24f3b0 con 0x56391c21fb20 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.749+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94803285172368] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x56391c21fb20 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.749+0000 7fbfdf536800 20 remove_watcher() i=4 2024-05-15T18:08:59.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.749+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94803285176624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c269100 con 0x7fbfd0037040 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.749+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94803285176624] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.749+0000 7fbfdf536800 20 remove_watcher() i=5 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.749+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94803285169392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c24f3b0 con 0x7fbfd0037040 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.750+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94803285169392] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.750+0000 7fbfdf536800 20 remove_watcher() i=6 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.751+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94803285180640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56391c24f3b0 con 0x7fbfd0037040 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.751+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94803285180640] v29'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfd400a4a0 con 0x7fbfd0037040 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.751+0000 7fbfdf536800 20 remove_watcher() i=7 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbfd0037040 msgr2=0x7fbfd0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbfd0037040 0x7fbfd0036410 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c21fb20 msgr2=0x56391c221fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c21fb20 0x56391c221fe0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbfcc0c2060 msgr2=0x7fbfcc0a3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbfcc0c2060 0x7fbfcc0a3440 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c224250 msgr2=0x56391c226640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c224250 0x56391c226640 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbea4036900 msgr2=0x7fbea4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbea4036900 0x7fbea4038dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0001b60 tx=0x7fbfd0010000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 msgr2=0x56391c2143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdbacd640 1 -- 172.21.15.173:0/2109957963 reap_dead start 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c2143d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc05cc00 tx=0x7fbfcc092ef0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 shutdown_connections 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/2109957963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c20cfb0 0x56391c2143d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 >> 172.21.15.173:0/2109957963 conn(0x56391c204f00 msgr2=0x56391c202560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 shutdown_connections 2024-05-15T18:08:59.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/2109957963 wait complete. 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbeb4036950 msgr2=0x7fbeb4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbeb4036950 0x7fbeb4038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000bf50 tx=0x7fbfd000f000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c1fb9f0 msgr2=0x56391c1fbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c1fb9f0 0x56391c1fbe10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc052fd0 tx=0x7fbfcc05cfd0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 shutdown_connections 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbeb4036950 0x7fbeb4038e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 --2- 172.21.15.173:0/325575999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c1fb9f0 0x56391c1fbe10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 >> 172.21.15.173:0/325575999 conn(0x56391c1efa90 msgr2=0x56391c1efe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 shutdown_connections 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.752+0000 7fbfdf536800 1 -- 172.21.15.173:0/325575999 wait complete. 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56391c1eaa30 msgr2=0x56391c1ece40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56391c1eaa30 0x56391c1ece40 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c0e6230 msgr2=0x56391c1e4510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56391c0e6230 0x56391c1e4510 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c1e6b60 msgr2=0x56391c1e8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56391c1e6b60 0x56391c1e8f50 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbec0036950 msgr2=0x7fbec0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbec0036950 0x7fbec0038e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0000f60 tx=0x7fbfd00012b0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 msgr2=0x56391c1de140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 --2- 172.21.15.173:0/563909151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56391c0e4fd0 0x56391c1de140 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc005870 tx=0x7fbfcc002fb0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdbacd640 1 -- 172.21.15.173:0/563909151 reap_dead start 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 shutdown_connections 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 >> 172.21.15.173:0/563909151 conn(0x56391c0e05b0 msgr2=0x56391c1d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 shutdown_connections 2024-05-15T18:08:59.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.753+0000 7fbfdf536800 1 -- 172.21.15.173:0/563909151 wait complete. 2024-05-15T18:08:59.743 INFO:teuthology.orchestra.run.smithi173.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0a7d7418-39f7-493f-89f0-016c6637672d","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","marker":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-15T18:08:58.894064Z","creation_time":"2024-05-15T18:08:58.890026Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-15T18:08:59.743 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:08:58.894064Z', 'creation_time': '2024-05-15T18:08:58.890026Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-15T18:08:59.744 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-15T18:08:59.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-15T18:08:59.744 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-05-15T18:08:59.789 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:59.789 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:59.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.813+0000 7fc9ba63f800 1 Processor -- start 2024-05-15T18:08:59.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.813+0000 7fc9ba63f800 1 -- start start 2024-05-15T18:08:59.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.813+0000 7fc9ba63f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5647f63e8470 0x5647f63ea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.813+0000 7fc9ba63f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647f63eae30 con 0x5647f63e3fe0 2024-05-15T18:08:59.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.813+0000 7fc9ba63f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5647f6276050 con 0x5647f63e8470 2024-05-15T18:08:59.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.814+0000 7fc9af944640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5647f63e8470 0x5647f63ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.814+0000 7fc9af944640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5647f63e8470 0x5647f63ea860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38554/0 (socket says 172.21.15.173:38554) 2024-05-15T18:08:59.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.814+0000 7fc9b8145640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5647f63e3fe0 0x5647f63e4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57044/0 (socket says 172.21.15.173:57044) 2024-05-15T18:08:59.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.814+0000 7fc9af944640 1 -- 172.21.15.173:0/2325378988 learned_addr learned my addr 172.21.15.173:0/2325378988 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.814+0000 7fc9af944640 1 -- 172.21.15.173:0/2325378988 >> v1:172.21.15.3:6789/0 conn(0x5647f63e3fe0 legacy=0x5647f63e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.814+0000 7fc9af944640 1 -- 172.21.15.173:0/2325378988 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f63ec060 con 0x5647f63e8470 2024-05-15T18:08:59.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.816+0000 7fc9af944640 1 --2- 172.21.15.173:0/2325378988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e8470 0x5647f63ea860 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000a6b0 tx=0x7fc9a001eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a0f4323b7d2b7c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.816+0000 7fc9b7944640 1 -- 172.21.15.173:0/2325378988 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a0059070 con 0x5647f63e8470 2024-05-15T18:08:59.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.816+0000 7fc9b7944640 1 -- 172.21.15.173:0/2325378988 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a0050050 con 0x5647f63e8470 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.816+0000 7fc9b7944640 1 -- 172.21.15.173:0/2325378988 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a000a350 con 0x5647f63e8470 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.817+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2325378988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e8470 msgr2=0x5647f63ea860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.817+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2325378988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e8470 0x5647f63ea860 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000a6b0 tx=0x7fc9a001eed0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.817+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2325378988 shutdown_connections 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.817+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2325378988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e8470 0x5647f63ea860 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.817+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2325378988 >> 172.21.15.173:0/2325378988 conn(0x5647f63df5c0 msgr2=0x5647f63e19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.817+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2325378988 shutdown_connections 2024-05-15T18:08:59.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.817+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2325378988 wait complete. 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.830+0000 7fc9ba63f800 1 Processor -- start 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.830+0000 7fc9ba63f800 1 -- start start 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.830+0000 7fc9ba63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64d8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.830+0000 7fc9ba63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647f63301c0 con 0x5647f63e3fe0 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.830+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.830+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64d8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38558/0 (socket says 172.21.15.173:38558) 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.830+0000 7fc9b8145640 1 -- 172.21.15.173:0/352322716 learned_addr learned my addr 172.21.15.173:0/352322716 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.831+0000 7fc9b8145640 1 -- 172.21.15.173:0/352322716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f64d8f00 con 0x5647f63e3fe0 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.831+0000 7fc9b8145640 1 --2- 172.21.15.173:0/352322716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64d8930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800b230 tx=0x7fc9a800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42c8589dd38047d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.831+0000 7fc8a660c640 1 -- 172.21.15.173:0/352322716 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a800e5c0 con 0x5647f63e3fe0 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.831+0000 7fc8a660c640 1 -- 172.21.15.173:0/352322716 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a8006070 con 0x5647f63e3fe0 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.831+0000 7fc8a660c640 1 -- 172.21.15.173:0/352322716 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a800e890 con 0x5647f63e3fe0 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 -- 172.21.15.173:0/352322716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 msgr2=0x5647f64d8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/352322716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64d8930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800b230 tx=0x7fc9a800b6f0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 -- 172.21.15.173:0/352322716 shutdown_connections 2024-05-15T18:08:59.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/352322716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64d8930 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 -- 172.21.15.173:0/352322716 >> 172.21.15.173:0/352322716 conn(0x5647f63df5c0 msgr2=0x5647f64cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 -- 172.21.15.173:0/352322716 shutdown_connections 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 -- 172.21.15.173:0/352322716 wait complete. 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 Processor -- start 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 -- start start 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64e0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9ba63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647f63eb300 con 0x5647f63e3fe0 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64e0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38568/0 (socket says 172.21.15.173:38568) 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.832+0000 7fc9b8145640 1 -- 172.21.15.173:0/1254568252 learned_addr learned my addr 172.21.15.173:0/1254568252 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.833+0000 7fc9b8145640 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f64e0a80 con 0x5647f63e3fe0 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.833+0000 7fc9b8145640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64e0540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8000fd0 tx=0x7fc9a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.833+0000 7fc8a4e09640 1 -- 172.21.15.173:0/1254568252 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a800f8d0 con 0x5647f63e3fe0 2024-05-15T18:08:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.833+0000 7fc8a4e09640 1 -- 172.21.15.173:0/1254568252 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a800fa90 con 0x5647f63e3fe0 2024-05-15T18:08:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.833+0000 7fc8a4e09640 1 -- 172.21.15.173:0/1254568252 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a800fdb0 con 0x5647f63e3fe0 2024-05-15T18:08:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.833+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647f64e0d10 con 0x5647f63e3fe0 2024-05-15T18:08:59.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.833+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f64e3970 con 0x5647f63e3fe0 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.834+0000 7fc8a4e09640 1 -- 172.21.15.173:0/1254568252 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9a8017070 con 0x5647f63e3fe0 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.834+0000 7fc8a4e09640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc8a0036950 0x7fc8a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.834+0000 7fc8a4e09640 1 -- 172.21.15.173:0/1254568252 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc9a8015020 con 0x5647f63e3fe0 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.834+0000 7fc9af944640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc8a0036950 0x7fc8a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.834+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f63e8470 0x5647f64e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.834+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f64e7cb0 con 0x5647f63e8470 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.834+0000 7fc9b8946640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f63e8470 0x5647f64e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9af944640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc8a0036950 0x7fc8a0038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0056000 tx=0x7fc9a000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9b8946640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f63e8470 0x5647f64e7730 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9b8946640 1 -- 172.21.15.173:0/1254568252 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f63e8470 2024-05-15T18:08:59.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f64e4d00 con 0x5647f63e8470 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9b8946640 1 -- 172.21.15.173:0/1254568252 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f63e8470 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f64ea000 0x5647f64ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f64eca90 con 0x5647f64ea000 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.835+0000 7fc9b8145640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f64ea000 0x5647f64ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.836+0000 7fc9b8145640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f64ea000 0x5647f64ec3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.836+0000 7fc9b8145640 1 -- 172.21.15.173:0/1254568252 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9a802e070 con 0x5647f64ea000 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.836+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f64e8f80 con 0x5647f63e8470 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.836+0000 7fc9b8946640 1 -- 172.21.15.173:0/1254568252 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f63e8470 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.836+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5647f64edef0 0x5647f64f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.836+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f64f0ac0 con 0x5647f64edef0 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.836+0000 7fc9af944640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5647f64edef0 0x5647f64f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.837+0000 7fc9af944640 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5647f64edef0 0x5647f64f0360 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.837+0000 7fc9af944640 1 -- 172.21.15.173:0/1254568252 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9a000a320 con 0x5647f64edef0 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.837+0000 7fc9ba63f800 1 Processor -- start 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.837+0000 7fc9ba63f800 1 -- start start 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.837+0000 7fc9ba63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f64feeb0 0x5647f64ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.837+0000 7fc9ba63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647f62d6cf0 con 0x5647f64feeb0 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f64feeb0 0x5647f64ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f64feeb0 0x5647f64ff2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38570/0 (socket says 172.21.15.173:38570) 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc9b8145640 1 -- 172.21.15.173:0/2501286808 learned_addr learned my addr 172.21.15.173:0/2501286808 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc9b8145640 1 -- 172.21.15.173:0/2501286808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f64ff810 con 0x5647f64feeb0 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc9b8145640 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f64feeb0 0x5647f64ff2d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800ff70 tx=0x7fc9a8017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc89dffb640 1 -- 172.21.15.173:0/2501286808 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a8044b80 con 0x5647f64feeb0 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc89dffb640 1 -- 172.21.15.173:0/2501286808 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a8044d20 con 0x5647f64feeb0 2024-05-15T18:08:59.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647f6500280 con 0x5647f64feeb0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc89dffb640 1 -- 172.21.15.173:0/2501286808 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a8019860 con 0x5647f64feeb0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.838+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f6500780 con 0x5647f64feeb0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.839+0000 7fc89dffb640 1 -- 172.21.15.173:0/2501286808 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9a8019a00 con 0x5647f64feeb0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.839+0000 7fc89dffb640 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc890036950 0x7fc890038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.839+0000 7fc89dffb640 1 -- 172.21.15.173:0/2501286808 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc9a8037020 con 0x5647f64feeb0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.839+0000 7fc9af944640 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc890036950 0x7fc890038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9ba63f800 1 Processor -- start 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9af944640 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc890036950 0x7fc890038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5647f64e4c20 tx=0x7fc9a0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9ba63f800 1 -- start start 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9ba63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f650c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9ba63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647f64d9280 con 0x5647f650bfa0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f650c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f650c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38582/0 (socket says 172.21.15.173:38582) 2024-05-15T18:08:59.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9b8145640 1 -- 172.21.15.173:0/2468248288 learned_addr learned my addr 172.21.15.173:0/2468248288 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9b8145640 1 -- 172.21.15.173:0/2468248288 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f650c990 con 0x5647f650bfa0 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.840+0000 7fc9b8145640 1 --2- 172.21.15.173:0/2468248288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f650c3c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80015e0 tx=0x7fc9a8031d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848ab85b4c722ecd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc8977fe640 1 -- 172.21.15.173:0/2468248288 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a803f9f0 con 0x5647f650bfa0 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc8977fe640 1 -- 172.21.15.173:0/2468248288 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a803f400 con 0x5647f650bfa0 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc8977fe640 1 -- 172.21.15.173:0/2468248288 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a8026390 con 0x5647f650bfa0 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2468248288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 msgr2=0x5647f650c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2468248288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f650c3c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80015e0 tx=0x7fc9a8031d80 comp rx=0 tx=0).stop 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2468248288 shutdown_connections 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2468248288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f650c3c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2468248288 >> 172.21.15.173:0/2468248288 conn(0x5647f6508300 msgr2=0x5647f6506360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2468248288 shutdown_connections 2024-05-15T18:08:59.828 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2468248288 wait complete. 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.841+0000 7fc9ba63f800 1 Processor -- start 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9ba63f800 1 -- start start 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9ba63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f65133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9ba63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647f650d040 con 0x5647f650bfa0 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f65133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9b8145640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f65133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38598/0 (socket says 172.21.15.173:38598) 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 learned_addr learned my addr 172.21.15.173:0/1813153308 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f6513910 con 0x5647f650bfa0 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9b8145640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f65133d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8005790 tx=0x7fc9a805a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc895ffb640 1 -- 172.21.15.173:0/1813153308 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a8026ad0 con 0x5647f650bfa0 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc895ffb640 1 -- 172.21.15.173:0/1813153308 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a8026c70 con 0x5647f650bfa0 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647f6513910 con 0x5647f650bfa0 2024-05-15T18:08:59.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.842+0000 7fc895ffb640 1 -- 172.21.15.173:0/1813153308 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9a8028c60 con 0x5647f650bfa0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.843+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f6513910 con 0x5647f650bfa0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.843+0000 7fc895ffb640 1 -- 172.21.15.173:0/1813153308 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc9a806c070 con 0x5647f650bfa0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.843+0000 7fc895ffb640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc888036950 0x7fc888038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.843+0000 7fc895ffb640 1 -- 172.21.15.173:0/1813153308 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc9a8070ad0 con 0x5647f650bfa0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9af944640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc888036950 0x7fc888038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f651ead0 0x5647f6520f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f65216e0 con 0x5647f651ead0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9b8946640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f651ead0 0x5647f6520f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9af944640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc888036950 0x7fc888038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0054fd0 tx=0x7fc9a0061040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9b8946640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f651ead0 0x5647f6520f90 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9ba63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9ba63f800 20 realm 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.844+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6521af0 con 0x5647f651ead0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f65223c0 con 0x5647f651ead0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x5647f651ead0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f6523250 0x5647f6525640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6525da0 con 0x5647f6523250 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9b8145640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f6523250 0x5647f6525640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.845+0000 7fc9b8145640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f6523250 0x5647f6525640 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9ba63f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9ba63f800 20 searching for the correct realm 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6527770 con 0x5647f6523250 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9b8145640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc9a800f070 0x7fc9a8031620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6527770 con 0x7fc9a800f070 2024-05-15T18:08:59.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.846+0000 7fc9af944640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc9a800f070 0x7fc9a8031620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.847+0000 7fc9af944640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc9a800f070 0x7fc9a8031620 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.847+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.847+0000 7fc9af944640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc9a0075040 0x7fc9a005f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.847+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6527770 con 0x7fc9a0075040 2024-05-15T18:08:59.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.847+0000 7fc9b8946640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc9a0075040 0x7fc9a005f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.847+0000 7fc9b8946640 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc9a0075040 0x7fc9a005f930 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x5647f651ead0 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x5647f651ead0 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x7fc9a0075040 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.848+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x7fc9a0075040 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x7fc9a800f070 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x5647f6523250 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x5647f651ead0 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.849+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x7fc9a0075040 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x5647f651ead0 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5647f6522760 con 0x7fc9a800f070 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f6523250 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.850+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f6523250 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a0075040 2024-05-15T18:08:59.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f6523250 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f6523250 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.851+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f651ead0 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f651ead0 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a0075040 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f6523250 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.852+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a800f070 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f651ead0 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a0075040 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f6523250 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.853+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a0075040 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a800f070 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f6523250 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a0075040 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.854+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x5647f651ead0 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fc9a008f060 con 0x7fc9a800f070 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:59.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6526740 con 0x5647f651ead0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.855+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6526b30 con 0x5647f651ead0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6526b30 con 0x7fc9a0075040 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 zone default found 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 4 Realm: () 2024-05-15T18:08:59.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 zonegroup default 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6526f50 con 0x7fc9a0075040 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6526f50 con 0x5647f6523250 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.856+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6529620 con 0x5647f6523250 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.857+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.857+0000 7fc9ba63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.857+0000 7fc9ba63f800 20 started sync module instance, tier type = 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.857+0000 7fc9ba63f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.857+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f6528ac0 con 0x7fc9a800f070 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.858+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.858+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867075272368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f6529e70 con 0x7fc9a800f070 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.858+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652a6c0 con 0x5647f651ead0 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.859+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94867075272368] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.859+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.859+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867075275200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652a700 con 0x5647f651ead0 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.859+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652b210 con 0x5647f6523250 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.860+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94867075275200] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.860+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.860+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867075280064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652b600 con 0x5647f6523250 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.860+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652c040 con 0x7fc9a800f070 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.861+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.861+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94867075280064] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8081040 con 0x5647f6523250 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.861+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867075286064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652c850 con 0x7fc9a800f070 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.862+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652d250 con 0x5647f651ead0 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.863+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94867075286064] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.863+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.863+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867075277328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652d640 con 0x5647f651ead0 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.863+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652e080 con 0x7fc9a0075040 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.864+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.864+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867075291984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652e040 con 0x7fc9a0075040 2024-05-15T18:08:59.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.864+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652f060 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.864+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94867075277328] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.865+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94867075291984] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.865+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.865+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867075296112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652f060 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.865+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652f4b0 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94867075296112] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867075288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652f060 con 0x7fc9a0075040 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 20 add_watcher() i=0 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 20 add_watcher() i=1 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 20 add_watcher() i=2 2024-05-15T18:08:59.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 20 add_watcher() i=3 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 20 add_watcher() i=4 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 20 add_watcher() i=5 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.866+0000 7fc9ba63f800 20 add_watcher() i=6 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.867+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94867075288416] v29'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.867+0000 7fc9ba63f800 20 add_watcher() i=7 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.867+0000 7fc9ba63f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.867+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6532950 con 0x5647f651ead0 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.867+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.867+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867075298416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f652fe10 con 0x5647f651ead0 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.868+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94867075298416] v29'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.868+0000 7fc86e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.868+0000 7fc9ba63f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.868+0000 7fc9ba63f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9ba63f800 5 note: GC not initialized 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc86d7e2640 20 reqs_thread_entry: start 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9ba63f800 20 init_complete bucket index max shards: 11 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9ba63f800 20 Filter name: none 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc7deffd640 20 reqs_thread_entry: start 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f65658f0 con 0x5647f651ead0 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9ba63f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.869+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6566ce0 con 0x7fc9a800f070 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6566ce0 con 0x7fc9a0075040 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 4.20 4:0571a38c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6568610 con 0x5647f651ead0 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 4.2 4:437c4f96:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f656b2a0 con 0x5647f651ead0 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 4.7 4:e385301a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f656dff0 con 0x7fc9a0075040 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 4.28 4:16086eb9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6570a10 con 0x5647f651ead0 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 4.11 4:8b23f7bc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f65734f0 con 0x7fc9a0075040 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.870+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 4.25 4:a4f38253:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f6575f50 con 0x5647f6523250 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 4.34 4:2d6893ae:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f65734f0 con 0x7fc9a800f070 2024-05-15T18:08:59.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 4.34 4:2c099a43:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f657a8f0 con 0x7fc9a800f070 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 4.16 4:6a82d888:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f657d580 con 0x5647f6523250 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(67 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(69 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 4.3e 4:7d40b125:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f657a8f0 con 0x7fc9a800f070 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(66 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(70 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc9a8093090 con 0x5647f6523250 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(71 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(73 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9a8093090 con 0x5647f6523250 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 4.11 4:8b3667c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f657a8f0 con 0x7fc9a0075040 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(74 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.871+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.872+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.872+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f656d9c0 con 0x7fc9a800f070 2024-05-15T18:08:59.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.873+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(76 foo.buckets [call] v29'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.873+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f6573000 con 0x7fc9a800f070 2024-05-15T18:08:59.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.874+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(77 foo.buckets [call] v29'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.874+0000 7fc9ba63f800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.874+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f65759c0 con 0x5647f651ead0 2024-05-15T18:08:59.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.874+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.874+0000 7fc9ba63f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.874+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647f65759c0 con 0x7fc9a800f070 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.874+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.875+0000 7fc86e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.875+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867075298416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f6572fe0 con 0x5647f651ead0 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.876+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94867075298416] v29'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.876+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867075272368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x7fc9a800f070 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.877+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94867075272368] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.877+0000 7fc9ba63f800 20 remove_watcher() i=0 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.877+0000 7fc9ba63f800 2 removed watcher, disabling cache 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.877+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867075275200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x5647f651ead0 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.878+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94867075275200] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.878+0000 7fc9ba63f800 20 remove_watcher() i=1 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.878+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867075280064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x5647f6523250 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.879+0000 7fc9b8145640 1 -- 172.21.15.173:0/1813153308 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94867075280064] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a8093090 con 0x5647f6523250 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.879+0000 7fc9ba63f800 20 remove_watcher() i=2 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.879+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867075286064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x7fc9a800f070 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.880+0000 7fc9af944640 1 -- 172.21.15.173:0/1813153308 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94867075286064] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9a0080070 con 0x7fc9a800f070 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.880+0000 7fc9ba63f800 20 remove_watcher() i=3 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.880+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867075277328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x5647f651ead0 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.882+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94867075277328] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x5647f651ead0 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.882+0000 7fc9ba63f800 20 remove_watcher() i=4 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.882+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867075291984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x7fc9a0075040 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.882+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94867075291984] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.882+0000 7fc9ba63f800 20 remove_watcher() i=5 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.882+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867075296112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x7fc9a0075040 2024-05-15T18:08:59.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.883+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94867075296112] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.883+0000 7fc9ba63f800 20 remove_watcher() i=6 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.883+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867075288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647f654e3a0 con 0x7fc9a0075040 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.884+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94867075288416] v29'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9b000a4a0 con 0x7fc9a0075040 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.884+0000 7fc9ba63f800 20 remove_watcher() i=7 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc9a0075040 msgr2=0x7fc9a005f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc9a0075040 0x7fc9a005f930 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f651ead0 msgr2=0x5647f6520f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f651ead0 0x5647f6520f90 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc9a800f070 msgr2=0x7fc9a8031620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc9a800f070 0x7fc9a8031620 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f6523250 msgr2=0x5647f6525640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f6523250 0x5647f6525640 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc888036950 msgr2=0x7fc888038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc888036950 0x7fc888038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0054fd0 tx=0x7fc9a0061040 comp rx=0 tx=0).stop 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 msgr2=0x5647f65133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9b8946640 1 -- 172.21.15.173:0/1813153308 reap_dead start 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f65133d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8005790 tx=0x7fc9a805a070 comp rx=0 tx=0).stop 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 shutdown_connections 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1813153308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f650bfa0 0x5647f65133d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 >> 172.21.15.173:0/1813153308 conn(0x5647f6508300 msgr2=0x5647f6505960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 shutdown_connections 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1813153308 wait complete. 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc890036950 msgr2=0x7fc890038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc890036950 0x7fc890038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5647f64e4c20 tx=0x7fc9a0005ac0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f64feeb0 msgr2=0x5647f64ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f64feeb0 0x5647f64ff2d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc9a800ff70 tx=0x7fc9a8017d50 comp rx=0 tx=0).stop 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 shutdown_connections 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc890036950 0x7fc890038e10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/2501286808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f64feeb0 0x5647f64ff2d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 >> 172.21.15.173:0/2501286808 conn(0x5647f64f2f50 msgr2=0x5647f64f3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 shutdown_connections 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.885+0000 7fc9ba63f800 1 -- 172.21.15.173:0/2501286808 wait complete. 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5647f64edef0 msgr2=0x5647f64f0360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5647f64edef0 0x5647f64f0360 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f63e8470 msgr2=0x5647f64e7730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5647f63e8470 0x5647f64e7730 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f64ea000 msgr2=0x5647f64ec3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5647f64ea000 0x5647f64ec3f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc8a0036950 msgr2=0x7fc8a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc8a0036950 0x7fc8a0038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0056000 tx=0x7fc9a000a000 comp rx=0 tx=0).stop 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 msgr2=0x5647f64e0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 --2- 172.21.15.173:0/1254568252 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f63e3fe0 0x5647f64e0540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8000fd0 tx=0x7fc9a8000ed0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9b8946640 1 -- 172.21.15.173:0/1254568252 reap_dead start 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 shutdown_connections 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 >> 172.21.15.173:0/1254568252 conn(0x5647f63df5c0 msgr2=0x5647f64ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 shutdown_connections 2024-05-15T18:08:59.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.886+0000 7fc9ba63f800 1 -- 172.21.15.173:0/1254568252 wait complete. 2024-05-15T18:08:59.877 INFO:teuthology.orchestra.run.smithi173.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-05-15T18:08:59.873779Z","last_stats_update":"2024-05-15T18:08:59.872717Z"} 2024-05-15T18:08:59.877 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-05-15T18:08:59.873779Z', 'last_stats_update': '2024-05-15T18:08:59.872717Z'} 2024-05-15T18:08:59.883 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:08:59.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-15T18:08:59.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-15T18:08:59.883 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-05-15T18:08:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:08:59.930 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:08:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6c892d800 1 Processor -- start 2024-05-15T18:08:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6c892d800 1 -- start start 2024-05-15T18:08:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6c892d800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55591561c470 0x55591561e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6c892d800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55591561ee30 con 0x555915617fe0 2024-05-15T18:08:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6c892d800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5559154aa050 con 0x55591561c470 2024-05-15T18:08:59.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6bbfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55591561c470 0x55591561e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6bbfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55591561c470 0x55591561e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38604/0 (socket says 172.21.15.173:38604) 2024-05-15T18:08:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6c457f640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x555915617fe0 0x555915618400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57050/0 (socket says 172.21.15.173:57050) 2024-05-15T18:08:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.954+0000 7fe6bbfff640 1 -- 172.21.15.173:0/3595451569 learned_addr learned my addr 172.21.15.173:0/3595451569 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.955+0000 7fe6bbfff640 1 -- 172.21.15.173:0/3595451569 >> v1:172.21.15.3:6789/0 conn(0x555915617fe0 legacy=0x555915618400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.955+0000 7fe6bbfff640 1 -- 172.21.15.173:0/3595451569 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555915620060 con 0x55591561c470 2024-05-15T18:08:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.956+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/3595451569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591561c470 0x55591561e860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00a520 tx=0x7fe6ac01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b0b570e7efa9ba server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c3d7e640 1 -- 172.21.15.173:0/3595451569 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ac057070 con 0x55591561c470 2024-05-15T18:08:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c3d7e640 1 -- 172.21.15.173:0/3595451569 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac052570 con 0x55591561c470 2024-05-15T18:08:59.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c3d7e640 1 -- 172.21.15.173:0/3595451569 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ac04ae60 con 0x55591561c470 2024-05-15T18:08:59.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c892d800 1 -- 172.21.15.173:0/3595451569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591561c470 msgr2=0x55591561e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c892d800 1 --2- 172.21.15.173:0/3595451569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591561c470 0x55591561e860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00a520 tx=0x7fe6ac01d010 comp rx=0 tx=0).stop 2024-05-15T18:08:59.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c892d800 1 -- 172.21.15.173:0/3595451569 shutdown_connections 2024-05-15T18:08:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c892d800 1 --2- 172.21.15.173:0/3595451569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591561c470 0x55591561e860 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c892d800 1 -- 172.21.15.173:0/3595451569 >> 172.21.15.173:0/3595451569 conn(0x5559156135c0 msgr2=0x5559156159e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c892d800 1 -- 172.21.15.173:0/3595451569 shutdown_connections 2024-05-15T18:08:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.957+0000 7fe6c892d800 1 -- 172.21.15.173:0/3595451569 wait complete. 2024-05-15T18:08:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.971+0000 7fe6c892d800 1 Processor -- start 2024-05-15T18:08:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.971+0000 7fe6c892d800 1 -- start start 2024-05-15T18:08:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.971+0000 7fe6c892d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x55591558be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.971+0000 7fe6c892d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5559155641c0 con 0x555915617fe0 2024-05-15T18:08:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.971+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x55591558be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.971+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x55591558be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38620/0 (socket says 172.21.15.173:38620) 2024-05-15T18:08:59.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.971+0000 7fe6c457f640 1 -- 172.21.15.173:0/1925869593 learned_addr learned my addr 172.21.15.173:0/1925869593 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.972+0000 7fe6c457f640 1 -- 172.21.15.173:0/1925869593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55591570d3a0 con 0x555915617fe0 2024-05-15T18:08:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.972+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1925869593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x55591558be50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4001e40 tx=0x7fe6b4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66dda57927c2c0a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.972+0000 7fe5b260c640 1 -- 172.21.15.173:0/1925869593 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b400e5c0 con 0x555915617fe0 2024-05-15T18:08:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.972+0000 7fe5b260c640 1 -- 172.21.15.173:0/1925869593 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b4006070 con 0x555915617fe0 2024-05-15T18:08:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.972+0000 7fe5b260c640 1 -- 172.21.15.173:0/1925869593 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b400e910 con 0x555915617fe0 2024-05-15T18:08:59.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 -- 172.21.15.173:0/1925869593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 msgr2=0x55591558be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1925869593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x55591558be50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4001e40 tx=0x7fe6b4001e70 comp rx=0 tx=0).stop 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 -- 172.21.15.173:0/1925869593 shutdown_connections 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1925869593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x55591558be50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 -- 172.21.15.173:0/1925869593 >> 172.21.15.173:0/1925869593 conn(0x5559156135c0 msgr2=0x555915704e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 -- 172.21.15.173:0/1925869593 shutdown_connections 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 -- 172.21.15.173:0/1925869593 wait complete. 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 Processor -- start 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 -- start start 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x555915712270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.973+0000 7fe6c892d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55591561f300 con 0x555915617fe0 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x555915712270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x555915712270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38628/0 (socket says 172.21.15.173:38628) 2024-05-15T18:08:59.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe6c457f640 1 -- 172.21.15.173:0/1601825232 learned_addr learned my addr 172.21.15.173:0/1601825232 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe6c457f640 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559157127b0 con 0x555915617fe0 2024-05-15T18:08:59.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x555915712270 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4004000 tx=0x7fe6b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe5b0e09640 1 -- 172.21.15.173:0/1601825232 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b401a7c0 con 0x555915617fe0 2024-05-15T18:08:59.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe5b0e09640 1 -- 172.21.15.173:0/1601825232 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b401a960 con 0x555915617fe0 2024-05-15T18:08:59.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe5b0e09640 1 -- 172.21.15.173:0/1601825232 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b401acc0 con 0x555915617fe0 2024-05-15T18:08:59.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555915712a40 con 0x555915617fe0 2024-05-15T18:08:59.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.974+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559157156f0 con 0x555915617fe0 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.975+0000 7fe5b0e09640 1 -- 172.21.15.173:0/1601825232 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe6b4017070 con 0x555915617fe0 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.975+0000 7fe5b0e09640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe5ac036900 0x7fe5ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.975+0000 7fe5b0e09640 1 -- 172.21.15.173:0/1601825232 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe6b4015020 con 0x555915617fe0 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.975+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe5ac036900 0x7fe5ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.976+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55591561c470 0x5559157194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.976+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915719a40 con 0x55591561c470 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.976+0000 7fe6c4d80640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55591561c470 0x5559157194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.976+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe5ac036900 0x7fe5ac038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac054000 tx=0x7fe6ac04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.976+0000 7fe6c4d80640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55591561c470 0x5559157194b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.976+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1601825232 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x55591561c470 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.976+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915716a80 con 0x55591561c470 2024-05-15T18:08:59.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1601825232 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x55591561c470 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55591571bd90 0x55591571e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55591571e820 con 0x55591571bd90 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55591571bd90 0x55591571e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55591571bd90 0x55591571e180 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c457f640 1 -- 172.21.15.173:0/1601825232 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6b402e070 con 0x55591571bd90 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55591571ad40 con 0x55591561c470 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1601825232 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x55591561c470 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.977+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55591571fcd0 0x555915722120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.978+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915722880 con 0x55591571fcd0 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.978+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55591571fcd0 0x555915722120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.978+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55591571fcd0 0x555915722120 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1601825232 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6ac05a040 con 0x55591571fcd0 2024-05-15T18:08:59.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c892d800 1 Processor -- start 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c892d800 1 -- start start 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c892d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915730c70 0x555915731090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c892d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55591550acf0 con 0x555915730c70 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915730c70 0x555915731090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915730c70 0x555915731090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38636/0 (socket says 172.21.15.173:38636) 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c457f640 1 -- 172.21.15.173:0/4277490906 learned_addr learned my addr 172.21.15.173:0/4277490906 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.979+0000 7fe6c457f640 1 -- 172.21.15.173:0/4277490906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559157315d0 con 0x555915730c70 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.980+0000 7fe6c457f640 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915730c70 0x555915731090 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe6b401dfb0 tx=0x7fe6b4013130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.980+0000 7fe5aa7fc640 1 -- 172.21.15.173:0/4277490906 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4044f40 con 0x555915730c70 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.980+0000 7fe5aa7fc640 1 -- 172.21.15.173:0/4277490906 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b404b890 con 0x555915730c70 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.980+0000 7fe5aa7fc640 1 -- 172.21.15.173:0/4277490906 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b404bb90 con 0x555915730c70 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.980+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555915732040 con 0x555915730c70 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.980+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555915732540 con 0x555915730c70 2024-05-15T18:08:59.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe5aa7fc640 1 -- 172.21.15.173:0/4277490906 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe6b40138a0 con 0x555915730c70 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe5aa7fc640 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe59c036950 0x7fe59c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe5aa7fc640 1 -- 172.21.15.173:0/4277490906 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe6b403cae0 con 0x555915730c70 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe59c036950 0x7fe59c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6c892d800 1 Processor -- start 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6c892d800 1 -- start start 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe59c036950 0x7fe59c038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5559157169a0 tx=0x7fe6ac005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6c892d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x55591573e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6c892d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55591570d6f0 con 0x55591573de90 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x55591573e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x55591573e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38648/0 (socket says 172.21.15.173:38648) 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.981+0000 7fe6c457f640 1 -- 172.21.15.173:0/267940321 learned_addr learned my addr 172.21.15.173:0/267940321 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c457f640 1 -- 172.21.15.173:0/267940321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55591573e860 con 0x55591573de90 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c457f640 1 --2- 172.21.15.173:0/267940321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x55591573e290 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c010 tx=0x7fe6b403f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64045623218902c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe5a37fe640 1 -- 172.21.15.173:0/267940321 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4005dd0 con 0x55591573de90 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe5a37fe640 1 -- 172.21.15.173:0/267940321 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b403cdc0 con 0x55591573de90 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe5a37fe640 1 -- 172.21.15.173:0/267940321 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4013cc0 con 0x55591573de90 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c892d800 1 -- 172.21.15.173:0/267940321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 msgr2=0x55591573e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c892d800 1 --2- 172.21.15.173:0/267940321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x55591573e290 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c010 tx=0x7fe6b403f8c0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c892d800 1 -- 172.21.15.173:0/267940321 shutdown_connections 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c892d800 1 --2- 172.21.15.173:0/267940321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x55591573e290 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c892d800 1 -- 172.21.15.173:0/267940321 >> 172.21.15.173:0/267940321 conn(0x55591573a110 msgr2=0x555915738170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.982+0000 7fe6c892d800 1 -- 172.21.15.173:0/267940321 shutdown_connections 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c892d800 1 -- 172.21.15.173:0/267940321 wait complete. 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c892d800 1 Processor -- start 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c892d800 1 -- start start 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c892d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x5559157451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c892d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55591573eef0 con 0x55591573de90 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x5559157451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c457f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x5559157451c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38652/0 (socket says 172.21.15.173:38652) 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 learned_addr learned my addr 172.21.15.173:0/1718457267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.983+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555915745700 con 0x55591573de90 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.984+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x5559157451c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c010 tx=0x7fe6b4006f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.984+0000 7fe5a1ffb640 1 -- 172.21.15.173:0/1718457267 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40441f0 con 0x55591573de90 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.984+0000 7fe5a1ffb640 1 -- 172.21.15.173:0/1718457267 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b406e070 con 0x55591573de90 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.984+0000 7fe5a1ffb640 1 -- 172.21.15.173:0/1718457267 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4020a30 con 0x55591573de90 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.984+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555915745700 con 0x55591573de90 2024-05-15T18:08:59.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.984+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555915745700 con 0x55591573de90 2024-05-15T18:08:59.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.984+0000 7fe5a1ffb640 1 -- 172.21.15.173:0/1718457267 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe6b4020bd0 con 0x55591573de90 2024-05-15T18:08:59.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe5a1ffb640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe58c036900 0x7fe58c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe5a1ffb640 1 -- 172.21.15.173:0/1718457267 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fe6b40643c0 con 0x55591573de90 2024-05-15T18:08:59.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe58c036900 0x7fe58c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe58c036900 0x7fe58c038dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x555915722c80 tx=0x7fe6ac04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555915750770 0x555915752c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915753380 con 0x555915750770 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.985+0000 7fe6c4d80640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555915750770 0x555915752c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c4d80640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555915750770 0x555915752c30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 20 realm 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915753790 con 0x555915750770 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915754060 con 0x555915750770 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.986+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x555915750770 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555915755160 0x555915757550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915757b60 con 0x555915755160 2024-05-15T18:08:59.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555915755160 0x555915757550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555915755160 0x555915757550 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c892d800 20 searching for the correct realm 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.987+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915759490 con 0x555915755160 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6c457f640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe6b4055040 0x7fe6b4027650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915759490 con 0x7fe6b4055040 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe6b4055040 0x7fe6b4027650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe6b4055040 0x7fe6b4027650 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6bbfff640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe6ac074040 0x7fe6ac081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:08:59.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.988+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915759490 con 0x7fe6ac074040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.989+0000 7fe6c4d80640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe6ac074040 0x7fe6ac081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.989+0000 7fe6c4d80640 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe6ac074040 0x7fe6ac081410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.989+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x7fe6ac074040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.989+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x555915750770 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x555915750770 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x7fe6ac074040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x7fe6ac074040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x7fe6ac074040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x7fe6ac074040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.990+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x7fe6b4055040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x555915755160 2024-05-15T18:08:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x555915750770 2024-05-15T18:08:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x7fe6ac074040 2024-05-15T18:08:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x7fe6ac074040 2024-05-15T18:08:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x555915750770 2024-05-15T18:08:59.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.991+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555915754400 con 0x7fe6b4055040 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915755160 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915755160 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6ac074040 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x7fe6ac074040 2024-05-15T18:08:59.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.992+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915755160 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915755160 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915750770 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915750770 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6bc00a4a0 con 0x555915750770 2024-05-15T18:08:59.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.993+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6ac074040 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.994+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc033040 con 0x7fe6ac074040 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.994+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915755160 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.994+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.994+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6b4055040 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.994+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.994+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915750770 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.995+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:08:59.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.995+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6ac074040 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.995+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.995+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915755160 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.995+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.995+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6ac074040 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.996+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.996+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6b4055040 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.996+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.996+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915755160 2024-05-15T18:08:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.996+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.996+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6ac074040 2024-05-15T18:08:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:08:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x555915750770 2024-05-15T18:08:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:08:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fe6ac08e060 con 0x7fe6b4055040 2024-05-15T18:08:59.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915758420 con 0x555915750770 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.997+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915758810 con 0x555915750770 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915758810 con 0x7fe6ac074040 2024-05-15T18:08:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:08:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:08:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 zone default found 2024-05-15T18:08:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 4 Realm: () 2024-05-15T18:08:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:08:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:08:59.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:08:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 zonegroup default 2024-05-15T18:08:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915758080 con 0x7fe6ac074040 2024-05-15T18:08:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:08:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915758080 con 0x555915755160 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.998+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c892d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55591575b3b0 con 0x555915755160 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c892d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c892d800 20 started sync module instance, tier type = 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c892d800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:08:59.999+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575a790 con 0x7fe6b4055040 2024-05-15T18:08:59.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.000+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.000+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93841100483456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575bcc0 con 0x7fe6b4055040 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.000+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575c510 con 0x555915750770 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.001+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93841100483456] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.001+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.001+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93841100486672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575c550 con 0x555915750770 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.001+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575d040 con 0x555915755160 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.002+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93841100486672] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.002+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.002+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93841100491536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575d3e0 con 0x555915755160 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.002+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575def0 con 0x7fe6b4055040 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.003+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93841100491536] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.003+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.004+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93841100488800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575e790 con 0x7fe6b4055040 2024-05-15T18:08:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.004+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575f150 con 0x555915750770 2024-05-15T18:08:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.005+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93841100488800] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:08:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.005+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:08:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.005+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93841100500128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575f570 con 0x555915750770 2024-05-15T18:08:59.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.005+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575ff70 con 0x7fe6ac074040 2024-05-15T18:09:00.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.006+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.006+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93841100503680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575fea0 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.006+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555915760ea0 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.006+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93841100500128] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.006+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93841100503680] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.007+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.007+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93841100501184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559157609b0 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.007+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555915761370 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93841100508864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555915761790 con 0x7fe6ac074040 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 20 add_watcher() i=0 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 20 add_watcher() i=1 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 20 add_watcher() i=2 2024-05-15T18:09:00.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 20 add_watcher() i=3 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 20 add_watcher() i=4 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 20 add_watcher() i=5 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93841100501184] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.008+0000 7fe6c892d800 20 add_watcher() i=6 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.009+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93841100508864] v29'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.009+0000 7fe6c892d800 20 add_watcher() i=7 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.009+0000 7fe6c892d800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.009+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915761790 con 0x555915750770 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.009+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.009+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93841100509920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555915761700 con 0x555915750770 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.010+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93841100509920] v29'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.010+0000 7fe57afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.010+0000 7fe6c892d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:00.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.010+0000 7fe6c892d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.010+0000 7fe6c892d800 5 note: GC not initialized 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe579fdb640 20 reqs_thread_entry: start 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 20 Filter name: none 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe4eb7fe640 20 reqs_thread_entry: start 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915797d20 con 0x555915750770 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:00.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.011+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555915797800 con 0x7fe6b4055040 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55591579b350 con 0x7fe6ac074040 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:00.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.012+0000 7fe6c892d800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.013+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591579eab0 con 0x7fe6b4055040 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 foo.buckets [call] v29'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55591579dc10 con 0x7fe6b4055040 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-15T18:09:00.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.014+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591579e630 con 0x7fe6b4055040 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.015+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v29'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.015+0000 7fe6c892d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.015+0000 7fe6c892d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.015+0000 7fe6c892d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.015+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93841100759232 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55591579e620 con 0x7fe6ac074040 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== watch-notify(notify (1) cookie 93841100501184 notify 124554051586 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55591579b740 con 0x7fe6ac074040 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe5a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051586 cookie 93841100501184 notifier 4475 bl.length()=338 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe5a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe5a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(68 notify.6 [notify cookie 93841100759232 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe5a37fe640 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fe590003ea0 con 0x7fe6ac074040 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.016+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== watch-notify(notify_complete (2) cookie 93841100759232 notify 124554051586 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555915799810 con 0x7fe6ac074040 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.017+0000 7fe57afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.017+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93841100509920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591574d3c0 con 0x555915750770 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.018+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93841100509920] v29'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.018+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93841100483456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559157612e0 con 0x7fe6b4055040 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.019+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93841100483456] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.019+0000 7fe6c892d800 20 remove_watcher() i=0 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.019+0000 7fe6c892d800 2 removed watcher, disabling cache 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.019+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93841100486672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559157612e0 con 0x555915750770 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.020+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93841100486672] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.020+0000 7fe6c892d800 20 remove_watcher() i=1 2024-05-15T18:09:00.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.020+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93841100491536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5559157612e0 con 0x555915755160 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.021+0000 7fe6c457f640 1 -- 172.21.15.173:0/1718457267 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93841100491536] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b402e070 con 0x555915755160 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.021+0000 7fe6c892d800 20 remove_watcher() i=2 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.021+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93841100488800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575cb10 con 0x7fe6b4055040 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.022+0000 7fe6bbfff640 1 -- 172.21.15.173:0/1718457267 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93841100488800] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ac07f070 con 0x7fe6b4055040 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.022+0000 7fe6c892d800 20 remove_watcher() i=3 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.022+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93841100500128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575c060 con 0x555915750770 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.023+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93841100500128] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x555915750770 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.023+0000 7fe6c892d800 20 remove_watcher() i=4 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.023+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93841100503680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575cb10 con 0x7fe6ac074040 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.024+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93841100503680] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.024+0000 7fe6c892d800 20 remove_watcher() i=5 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.024+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93841100501184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575eca0 con 0x7fe6ac074040 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.025+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93841100501184] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.025+0000 7fe6c892d800 20 remove_watcher() i=6 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.025+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93841100508864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55591575cb10 con 0x7fe6ac074040 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93841100508864] v29'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6bc031040 con 0x7fe6ac074040 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 20 remove_watcher() i=7 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe6ac074040 msgr2=0x7fe6ac081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe6ac074040 0x7fe6ac081410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555915750770 msgr2=0x555915752c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555915750770 0x555915752c30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe6b4055040 msgr2=0x7fe6b4027650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe6b4055040 0x7fe6b4027650 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555915755160 msgr2=0x555915757550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555915755160 0x555915757550 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe58c036900 msgr2=0x7fe58c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe58c036900 0x7fe58c038dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x555915722c80 tx=0x7fe6ac04f000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 msgr2=0x5559157451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1718457267 reap_dead start 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x5559157451c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400c010 tx=0x7fe6b4006f20 comp rx=0 tx=0).stop 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 shutdown_connections 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1718457267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55591573de90 0x5559157451c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 >> 172.21.15.173:0/1718457267 conn(0x55591573a110 msgr2=0x55591573f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 shutdown_connections 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/1718457267 wait complete. 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe59c036950 msgr2=0x7fe59c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe59c036950 0x7fe59c038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5559157169a0 tx=0x7fe6ac005ac0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915730c70 msgr2=0x555915731090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.026+0000 7fe6c892d800 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915730c70 0x555915731090 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe6b401dfb0 tx=0x7fe6b4013130 comp rx=0 tx=0).stop 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 shutdown_connections 2024-05-15T18:09:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe59c036950 0x7fe59c038e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 --2- 172.21.15.173:0/4277490906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915730c70 0x555915731090 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 >> 172.21.15.173:0/4277490906 conn(0x555915724d10 msgr2=0x555915725110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 shutdown_connections 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/4277490906 wait complete. 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55591571fcd0 msgr2=0x555915722120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55591571fcd0 0x555915722120 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55591561c470 msgr2=0x5559157194b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55591561c470 0x5559157194b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55591571bd90 msgr2=0x55591571e180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55591571bd90 0x55591571e180 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe5ac036900 msgr2=0x7fe5ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe5ac036900 0x7fe5ac038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac054000 tx=0x7fe6ac04e000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 msgr2=0x555915712270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 --2- 172.21.15.173:0/1601825232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555915617fe0 0x555915712270 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4004000 tx=0x7fe6b4000bc0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c4d80640 1 -- 172.21.15.173:0/1601825232 reap_dead start 2024-05-15T18:09:00.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 shutdown_connections 2024-05-15T18:09:00.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 >> 172.21.15.173:0/1601825232 conn(0x5559156135c0 msgr2=0x555915703690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 shutdown_connections 2024-05-15T18:09:00.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.027+0000 7fe6c892d800 1 -- 172.21.15.173:0/1601825232 wait complete. 2024-05-15T18:09:00.023 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-15T18:09:00.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-15T18:09:00.023 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-15T18:09:00.075 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:00.076 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee8434800 1 Processor -- start 2024-05-15T18:09:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee8434800 1 -- start start 2024-05-15T18:09:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee8434800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55fe575e3010 0x55fe575e3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee8434800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fe575e3ab0 con 0x55fe575e4270 2024-05-15T18:09:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee8434800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55fe57475050 con 0x55fe575e3010 2024-05-15T18:09:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee37c0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55fe575e3010 0x55fe575e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3edafbf640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55fe575e4270 0x55fe575e46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57066/0 (socket says 172.21.15.173:57066) 2024-05-15T18:09:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee37c0640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55fe575e3010 0x55fe575e3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38662/0 (socket says 172.21.15.173:38662) 2024-05-15T18:09:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3edafbf640 1 -- 172.21.15.173:0/3874287918 learned_addr learned my addr 172.21.15.173:0/3874287918 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee37c0640 1 -- 172.21.15.173:0/3874287918 >> v1:172.21.15.3:6789/0 conn(0x55fe575e4270 legacy=0x55fe575e46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.100+0000 7f3ee37c0640 1 -- 172.21.15.173:0/3874287918 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe575e4e30 con 0x55fe575e3010 2024-05-15T18:09:00.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.102+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/3874287918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe575e3430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400a470 tx=0x7f3ed401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecc196db805c6c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.102+0000 7f3ee2fbf640 1 -- 172.21.15.173:0/3874287918 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4057070 con 0x55fe575e3010 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.102+0000 7f3ee2fbf640 1 -- 172.21.15.173:0/3874287918 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed404adc0 con 0x55fe575e3010 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.102+0000 7f3ee2fbf640 1 -- 172.21.15.173:0/3874287918 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4052590 con 0x55fe575e3010 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.103+0000 7f3ee8434800 1 -- 172.21.15.173:0/3874287918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 msgr2=0x55fe575e3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.103+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3874287918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe575e3430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400a470 tx=0x7f3ed401ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.103+0000 7f3ee8434800 1 -- 172.21.15.173:0/3874287918 shutdown_connections 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.103+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3874287918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe575e3430 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.103+0000 7f3ee8434800 1 -- 172.21.15.173:0/3874287918 >> 172.21.15.173:0/3874287918 conn(0x55fe575de5f0 msgr2=0x55fe575e0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.103+0000 7f3ee8434800 1 -- 172.21.15.173:0/3874287918 shutdown_connections 2024-05-15T18:09:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.103+0000 7f3ee8434800 1 -- 172.21.15.173:0/3874287918 wait complete. 2024-05-15T18:09:00.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.117+0000 7f3ee8434800 1 Processor -- start 2024-05-15T18:09:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.117+0000 7f3ee8434800 1 -- start start 2024-05-15T18:09:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.117+0000 7f3ee8434800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576d7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.117+0000 7f3ee8434800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fe5752f1f0 con 0x55fe575e3010 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.117+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576d7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.117+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576d7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38668/0 (socket says 172.21.15.173:38668) 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.117+0000 7f3ee37c0640 1 -- 172.21.15.173:0/622552308 learned_addr learned my addr 172.21.15.173:0/622552308 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.118+0000 7f3ee37c0640 1 -- 172.21.15.173:0/622552308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe576d8100 con 0x55fe575e3010 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.118+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/622552308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576d7b30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4055040 tx=0x7f3ed404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e235f077fda8a4dc server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.118+0000 7f3dd160a640 1 -- 172.21.15.173:0/622552308 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4057040 con 0x55fe575e3010 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.118+0000 7f3dd160a640 1 -- 172.21.15.173:0/622552308 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4063070 con 0x55fe575e3010 2024-05-15T18:09:00.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.118+0000 7f3dd160a640 1 -- 172.21.15.173:0/622552308 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed405d790 con 0x55fe575e3010 2024-05-15T18:09:00.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 -- 172.21.15.173:0/622552308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 msgr2=0x55fe576d7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 --2- 172.21.15.173:0/622552308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576d7b30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4055040 tx=0x7f3ed404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 -- 172.21.15.173:0/622552308 shutdown_connections 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 --2- 172.21.15.173:0/622552308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576d7b30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 -- 172.21.15.173:0/622552308 >> 172.21.15.173:0/622552308 conn(0x55fe575de5f0 msgr2=0x55fe576cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 -- 172.21.15.173:0/622552308 shutdown_connections 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 -- 172.21.15.173:0/622552308 wait complete. 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 Processor -- start 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 -- start start 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576df550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.119+0000 7f3ee8434800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fe575565b0 con 0x55fe575e3010 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576df550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576df550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38676/0 (socket says 172.21.15.173:38676) 2024-05-15T18:09:00.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3ee37c0640 1 -- 172.21.15.173:0/3154983470 learned_addr learned my addr 172.21.15.173:0/3154983470 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3ee37c0640 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe576dfa90 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576df550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400a470 tx=0x7f3ed4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3dcfe07640 1 -- 172.21.15.173:0/3154983470 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4057050 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3dcfe07640 1 -- 172.21.15.173:0/3154983470 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed405dd40 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe576dfd20 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3dcfe07640 1 -- 172.21.15.173:0/3154983470 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4052570 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.120+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe576e29d0 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.121+0000 7f3dcfe07640 1 -- 172.21.15.173:0/3154983470 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ed4052820 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.121+0000 7f3dcfe07640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dc8036900 0x7f3dc8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.121+0000 7f3dcfe07640 1 -- 172.21.15.173:0/3154983470 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3ed408dbc0 con 0x55fe575e3010 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.121+0000 7f3edafbf640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dc8036900 0x7f3dc8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe575e4270 0x55fe576e6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe576e6d60 con 0x55fe575e4270 2024-05-15T18:09:00.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee3fc1640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe575e4270 0x55fe576e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3edafbf640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dc8036900 0x7f3dc8038dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc000f60 tx=0x7f3ecc0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee3fc1640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe575e4270 0x55fe576e6790 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/3154983470 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe575e4270 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe576e3d60 con 0x55fe575e4270 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/3154983470 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe575e4270 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe576e9090 0x55fe576eb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.122+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe576ebb70 con 0x55fe576e9090 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.123+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe576e9090 0x55fe576eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.123+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe576e9090 0x55fe576eb480 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.123+0000 7f3ee37c0640 1 -- 172.21.15.173:0/3154983470 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ed4078070 con 0x55fe576e9090 2024-05-15T18:09:00.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.123+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe576e8040 con 0x55fe575e4270 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.123+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/3154983470 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe575e4270 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.123+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fe576ed020 0x55fe576ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.123+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe576efbd0 con 0x55fe576ed020 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.124+0000 7f3edafbf640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fe576ed020 0x55fe576ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.124+0000 7f3edafbf640 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fe576ed020 0x55fe576ef470 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.124+0000 7f3edafbf640 1 -- 172.21.15.173:0/3154983470 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ecc009050 con 0x55fe576ed020 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee8434800 1 Processor -- start 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee8434800 1 -- start start 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee8434800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe576fe030 0x55fe576fe450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee8434800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fe574d5cf0 con 0x55fe576fe030 2024-05-15T18:09:00.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe576fe030 0x55fe576fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe576fe030 0x55fe576fe450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38690/0 (socket says 172.21.15.173:38690) 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1794699371 learned_addr learned my addr 172.21.15.173:0/1794699371 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.125+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1794699371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe576fe990 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.126+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe576fe030 0x55fe576fe450 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ed408c150 tx=0x7f3ed405c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.126+0000 7f3dcd602640 1 -- 172.21.15.173:0/1794699371 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4080790 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.126+0000 7f3dcd602640 1 -- 172.21.15.173:0/1794699371 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4080930 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.126+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe576ff400 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.126+0000 7f3dcd602640 1 -- 172.21.15.173:0/1794699371 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4080c30 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.126+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe576ff900 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.126+0000 7f3dcd602640 1 -- 172.21.15.173:0/1794699371 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ed408a400 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3dcd602640 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dbc036950 0x7f3dbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3dcd602640 1 -- 172.21.15.173:0/1794699371 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3ed4087070 con 0x55fe576fe030 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3edafbf640 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dbc036950 0x7f3dbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3ee8434800 1 Processor -- start 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3edafbf640 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dbc036950 0x7f3dbc038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00bf50 tx=0x7f3ecc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3ee8434800 1 -- start start 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3ee8434800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe5770b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3ee8434800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fe576d83c0 con 0x55fe5770b120 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe5770b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe5770b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38694/0 (socket says 172.21.15.173:38694) 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.127+0000 7f3ee37c0640 1 -- 172.21.15.173:0/335050250 learned_addr learned my addr 172.21.15.173:0/335050250 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3ee37c0640 1 -- 172.21.15.173:0/335050250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe5770bb10 con 0x55fe5770b120 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/335050250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe5770b540 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4072730 tx=0x7f3ed4072880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1dbce6ee44236c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3dc6ffd640 1 -- 172.21.15.173:0/335050250 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed408ac10 con 0x55fe5770b120 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3dc6ffd640 1 -- 172.21.15.173:0/335050250 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed407bd00 con 0x55fe5770b120 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3dc6ffd640 1 -- 172.21.15.173:0/335050250 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed408a6f0 con 0x55fe5770b120 2024-05-15T18:09:00.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3ee8434800 1 -- 172.21.15.173:0/335050250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 msgr2=0x55fe5770b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3ee8434800 1 --2- 172.21.15.173:0/335050250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe5770b540 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4072730 tx=0x7f3ed4072880 comp rx=0 tx=0).stop 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3ee8434800 1 -- 172.21.15.173:0/335050250 shutdown_connections 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3ee8434800 1 --2- 172.21.15.173:0/335050250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe5770b540 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.128+0000 7f3ee8434800 1 -- 172.21.15.173:0/335050250 >> 172.21.15.173:0/335050250 conn(0x55fe57707480 msgr2=0x55fe577054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee8434800 1 -- 172.21.15.173:0/335050250 shutdown_connections 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee8434800 1 -- 172.21.15.173:0/335050250 wait complete. 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee8434800 1 Processor -- start 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee8434800 1 -- start start 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee8434800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe57712470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee8434800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fe5770c1c0 con 0x55fe5770b120 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe57712470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee37c0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe57712470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38706/0 (socket says 172.21.15.173:38706) 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 learned_addr learned my addr 172.21.15.173:0/1222228509 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.129+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe577129b0 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.130+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe57712470 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4080fd0 tx=0x7f3ed407fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.130+0000 7f3dc57fa640 1 -- 172.21.15.173:0/1222228509 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed40b1070 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.130+0000 7f3dc57fa640 1 -- 172.21.15.173:0/1222228509 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed4097b30 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.130+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fe577129b0 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.130+0000 7f3dc57fa640 1 -- 172.21.15.173:0/1222228509 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed4097e10 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.130+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe577129b0 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.130+0000 7f3dc57fa640 1 -- 172.21.15.173:0/1222228509 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3ed40b4070 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.131+0000 7f3dc57fa640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dac036900 0x7f3dac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.131+0000 7f3dc57fa640 1 -- 172.21.15.173:0/1222228509 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3ed40a8040 con 0x55fe5770b120 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.131+0000 7f3edafbf640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dac036900 0x7f3dac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.131+0000 7f3edafbf640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dac036900 0x7f3dac038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc001b60 tx=0x7f3ecc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.131+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.131+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe5771dbf0 0x55fe577200b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.131+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57720800 con 0x55fe5771dbf0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee3fc1640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe5771dbf0 0x55fe577200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee3fc1640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe5771dbf0 0x55fe577200b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 20 realm 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57720c10 con 0x55fe5771dbf0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe577214e0 con 0x55fe5771dbf0 2024-05-15T18:09:00.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.132+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee8434800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe577225e0 0x55fe577249d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57724fe0 con 0x55fe577225e0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe577225e0 0x55fe577249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe577225e0 0x55fe577249d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee8434800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee8434800 20 searching for the correct realm 2024-05-15T18:09:00.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.133+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57726910 con 0x55fe577225e0 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3ee37c0640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3ed40b6070 0x7f3ed40ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57726910 con 0x7f3ed40b6070 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3edafbf640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3ed40b6070 0x7f3ed40ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3edafbf640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3ed40b6070 0x7f3ed40ad430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc009050 con 0x7f3ed40b6070 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3edafbf640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3ecc038040 0x7f3ecc01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.134+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57726910 con 0x7f3ecc038040 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.135+0000 7f3ee3fc1640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3ecc038040 0x7f3ecc01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.135+0000 7f3ee3fc1640 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3ecc038040 0x7f3ecc01bab0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.135+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3edc00a4a0 con 0x7f3ecc038040 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.135+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x7f3ecc038040 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x7f3ecc038040 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ed40b6070 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc009050 con 0x7f3ed40b6070 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.136+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x7f3ecc038040 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.137+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ed40b6070 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ecc009050 con 0x7f3ed40b6070 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x7f3ecc038040 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.138+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3edc00a4a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.139+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc033040 con 0x7f3ecc038040 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ed40b6070 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc009050 con 0x7f3ed40b6070 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.140+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ed40b6070 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc009050 con 0x7f3ed40b6070 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.141+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe577225e0 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ecc038040 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x55fe5771dbf0 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fe57721880 con 0x7f3ed40b6070 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ecc045040 con 0x7f3ed40b6070 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:00.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.142+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe577258a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57725c90 con 0x55fe5771dbf0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.141 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57725c90 con 0x7f3ecc038040 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 zone default found 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 4 Realm: () 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 zonegroup default 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.143+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57726d90 con 0x7f3ecc038040 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57728770 con 0x55fe577225e0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57728b10 con 0x55fe577225e0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 20 started sync module instance, tier type = 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.144+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57727c10 con 0x7f3ed40b6070 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.145+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc045040 con 0x7f3ed40b6070 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.145+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94550877173600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57728eb0 con 0x7f3ed40b6070 2024-05-15T18:09:00.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.145+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57729740 con 0x55fe5771dbf0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.146+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94550877173600] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc045040 con 0x7f3ed40b6070 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.146+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.146+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94550877175856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57729b30 con 0x55fe5771dbf0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.146+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772a560 con 0x55fe577225e0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.147+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.147+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94550877184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772ae30 con 0x55fe577225e0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.147+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772b930 con 0x7f3ed40b6070 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.148+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94550877175856] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.148+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94550877184112] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.148+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc045040 con 0x7f3ed40b6070 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.149+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94550877189152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772bd20 con 0x7f3ed40b6070 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.149+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772c5b0 con 0x55fe5771dbf0 2024-05-15T18:09:00.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.149+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94550877189152] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc045040 con 0x7f3ed40b6070 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.149+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.150+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94550877180496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772c9a0 con 0x55fe5771dbf0 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.150+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772d3c0 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.150+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.151+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94550877195952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772d380 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.151+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772e3a0 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.151+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94550877180496] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.151+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.151+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94550877192384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772e3a0 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.152+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772eda0 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.152+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94550877195952] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.152+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94550877192384] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94550877200000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772e8b0 con 0x7f3ecc038040 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 20 add_watcher() i=0 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 20 add_watcher() i=1 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 20 add_watcher() i=2 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 20 add_watcher() i=3 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 20 add_watcher() i=4 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 20 add_watcher() i=5 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee8434800 20 add_watcher() i=6 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.153+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94550877200000] v29'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.154+0000 7f3ee8434800 20 add_watcher() i=7 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.154+0000 7f3ee8434800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.154+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57731d90 con 0x55fe5771dbf0 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.154+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.154+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94550877202608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772f180 con 0x55fe5771dbf0 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94550877202608] v29'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3d99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3ee8434800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3ee8434800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3ee8434800 5 note: GC not initialized 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3d98fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3ee8434800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.155+0000 7f3ee8434800 20 Filter name: none 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3d127fc640 20 reqs_thread_entry: start 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe577651d0 con 0x7f3ecc038040 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57763970 con 0x7f3ecc038040 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.156+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57764260 con 0x7f3ecc038040 2024-05-15T18:09:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v29'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee8434800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee8434800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee8434800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94550877420976 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57768b10 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== watch-notify(notify (1) cookie 94550877195952 notify 124554051587 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55fe57764600 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3dc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051587 cookie 94550877195952 notifier 4482 bl.length()=556 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3dc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3dc6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(65 notify.5 [notify cookie 94550877420976 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3dc6ffd640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3da8003ea0 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== watch-notify(notify_complete (2) cookie 94550877420976 notify 124554051587 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fe57763a70 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.158+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57766640 con 0x7f3ecc038040 2024-05-15T18:09:00.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.159+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.159+0000 7f3ee8434800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.159+0000 7f3ee8434800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.159+0000 7f3ee8434800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.159+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94550877420896 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fe57768b10 con 0x55fe577225e0 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.159+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== watch-notify(notify (1) cookie 94550877184112 notify 124554051592 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55fe576ff400 con 0x55fe577225e0 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.160+0000 7f3dc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94550877184112 notifier 4482 bl.length()=177 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.160+0000 7f3dc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.160+0000 7f3dc6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.160+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 notify.2 [notify cookie 94550877420896 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.160+0000 7f3dc6ffd640 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3da8003ea0 con 0x55fe577225e0 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.160+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.160+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== watch-notify(notify_complete (2) cookie 94550877420896 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fe576fe990 con 0x55fe577225e0 2024-05-15T18:09:00.151 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-15T18:09:00.157358Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:09:00.157342Z","tags":[],"group_ids":[]} 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.161+0000 7f3d99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.161+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94550877202608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57717640 con 0x55fe5771dbf0 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.162+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94550877202608] v29'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.162+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94550877173600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772e8b0 con 0x7f3ed40b6070 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.163+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94550877173600] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc045040 con 0x7f3ed40b6070 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.163+0000 7f3ee8434800 20 remove_watcher() i=0 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.163+0000 7f3ee8434800 2 removed watcher, disabling cache 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.163+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94550877175856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57727760 con 0x55fe5771dbf0 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.164+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94550877175856] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.164+0000 7f3ee8434800 20 remove_watcher() i=1 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.164+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94550877184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57727760 con 0x55fe577225e0 2024-05-15T18:09:00.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.165+0000 7f3ee37c0640 1 -- 172.21.15.173:0/1222228509 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94550877184112] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ed40bd070 con 0x55fe577225e0 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.165+0000 7f3ee8434800 20 remove_watcher() i=2 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.165+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94550877189152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57727760 con 0x7f3ed40b6070 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.166+0000 7f3edafbf640 1 -- 172.21.15.173:0/1222228509 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94550877189152] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ecc045040 con 0x7f3ed40b6070 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.166+0000 7f3ee8434800 20 remove_watcher() i=3 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.166+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94550877180496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57727760 con 0x55fe5771dbf0 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.167+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94550877180496] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x55fe5771dbf0 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.167+0000 7f3ee8434800 20 remove_watcher() i=4 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.167+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94550877195952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57729250 con 0x7f3ecc038040 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.168+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94550877195952] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.168+0000 7f3ee8434800 20 remove_watcher() i=5 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.168+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94550877192384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe57727760 con 0x7f3ecc038040 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.169+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94550877192384] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.169+0000 7f3ee8434800 20 remove_watcher() i=6 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.169+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94550877200000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fe5772c0c0 con 0x7f3ecc038040 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94550877200000] v29'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3edc031040 con 0x7f3ecc038040 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 20 remove_watcher() i=7 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3ecc038040 msgr2=0x7f3ecc01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3ecc038040 0x7f3ecc01bab0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe5771dbf0 msgr2=0x55fe577200b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe5771dbf0 0x55fe577200b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3ed40b6070 msgr2=0x7f3ed40ad430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3ed40b6070 0x7f3ed40ad430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe577225e0 msgr2=0x55fe577249d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe577225e0 0x55fe577249d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dac036900 msgr2=0x7f3dac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dac036900 0x7f3dac038dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc001b60 tx=0x7f3ecc010000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 msgr2=0x55fe57712470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1222228509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe5770b120 0x55fe57712470 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4080fd0 tx=0x7f3ed407fe70 comp rx=0 tx=0).stop 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 reap_dead start 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/1222228509 reap_dead start 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 shutdown_connections 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.170+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 >> 172.21.15.173:0/1222228509 conn(0x55fe57707480 msgr2=0x55fe57704ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 shutdown_connections 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1222228509 wait complete. 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dbc036950 msgr2=0x7f3dbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dbc036950 0x7f3dbc038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00bf50 tx=0x7f3ecc00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe576fe030 msgr2=0x55fe576fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe576fe030 0x55fe576fe450 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3ed408c150 tx=0x7f3ed405c670 comp rx=0 tx=0).stop 2024-05-15T18:09:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 shutdown_connections 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dbc036950 0x7f3dbc038e10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/1794699371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe576fe030 0x55fe576fe450 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 >> 172.21.15.173:0/1794699371 conn(0x55fe576f20d0 msgr2=0x55fe576f24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 shutdown_connections 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/1794699371 wait complete. 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fe576ed020 msgr2=0x55fe576ef470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55fe576ed020 0x55fe576ef470 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe575e4270 msgr2=0x55fe576e6790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55fe575e4270 0x55fe576e6790 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe576e9090 msgr2=0x55fe576eb480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55fe576e9090 0x55fe576eb480 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dc8036900 msgr2=0x7f3dc8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3dc8036900 0x7f3dc8038dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc000f60 tx=0x7f3ecc0012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 msgr2=0x55fe576df550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 --2- 172.21.15.173:0/3154983470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe575e3010 0x55fe576df550 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400a470 tx=0x7f3ed4002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee3fc1640 1 -- 172.21.15.173:0/3154983470 reap_dead start 2024-05-15T18:09:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 shutdown_connections 2024-05-15T18:09:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 >> 172.21.15.173:0/3154983470 conn(0x55fe575de5f0 msgr2=0x55fe576cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 shutdown_connections 2024-05-15T18:09:00.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.171+0000 7f3ee8434800 1 -- 172.21.15.173:0/3154983470 wait complete. 2024-05-15T18:09:00.162 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-15T18:09:00.157358Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:09:00.157342Z', 'tags': [], 'group_ids': []} 2024-05-15T18:09:00.167 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-15T18:09:00.171 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:00.171 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-05-15T18:09:00.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-05-15T18:09:00.172 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-05-15T18:09:00.215 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:00.215 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:00.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f4931d2d800 1 Processor -- start 2024-05-15T18:09:00.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f4931d2d800 1 -- start start 2024-05-15T18:09:00.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f4931d2d800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bd82935140 0x55bd82935560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f4931d2d800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd82935be0 con 0x55bd82936350 2024-05-15T18:09:00.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f4931d2d800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55bd827c6050 con 0x55bd82935140 2024-05-15T18:09:00.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f492d978640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bd82935140 0x55bd82935560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f492d177640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55bd82936350 0x55bd829367d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57082/0 (socket says 172.21.15.173:57082) 2024-05-15T18:09:00.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.239+0000 7f492d177640 1 -- 172.21.15.173:0/3172748278 learned_addr learned my addr 172.21.15.173:0/3172748278 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:00.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.240+0000 7f492d978640 1 -- 172.21.15.173:0/3172748278 >> v1:172.21.15.3:6789/0 conn(0x55bd82936350 legacy=0x55bd829367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.240+0000 7f492c976640 1 -- 172.21.15.173:0/3172748278 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43146633 0 0) 0x55bd82935be0 con 0x55bd82936350 2024-05-15T18:09:00.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.240+0000 7f492d978640 1 -- 172.21.15.173:0/3172748278 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd82936f10 con 0x55bd82935140 2024-05-15T18:09:00.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.241+0000 7f492d978640 1 --2- 172.21.15.173:0/3172748278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82935560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f492000a470 tx=0x7f492001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cdb7684654fbf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f492c976640 1 -- 172.21.15.173:0/3172748278 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920057070 con 0x55bd82935140 2024-05-15T18:09:00.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f492c976640 1 -- 172.21.15.173:0/3172748278 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492004adc0 con 0x55bd82935140 2024-05-15T18:09:00.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f492c976640 1 -- 172.21.15.173:0/3172748278 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920052590 con 0x55bd82935140 2024-05-15T18:09:00.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f4931d2d800 1 -- 172.21.15.173:0/3172748278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 msgr2=0x55bd82935560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3172748278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82935560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f492000a470 tx=0x7f492001ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:00.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f4931d2d800 1 -- 172.21.15.173:0/3172748278 shutdown_connections 2024-05-15T18:09:00.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3172748278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82935560 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f4931d2d800 1 -- 172.21.15.173:0/3172748278 >> 172.21.15.173:0/3172748278 conn(0x55bd82930780 msgr2=0x55bd82932ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f4931d2d800 1 -- 172.21.15.173:0/3172748278 shutdown_connections 2024-05-15T18:09:00.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.242+0000 7f4931d2d800 1 -- 172.21.15.173:0/3172748278 wait complete. 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f4931d2d800 1 Processor -- start 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f4931d2d800 1 -- start start 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f4931d2d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd828aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f4931d2d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd828801d0 con 0x55bd82935140 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd828aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd828aa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38726/0 (socket says 172.21.15.173:38726) 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f492d978640 1 -- 172.21.15.173:0/3334375524 learned_addr learned my addr 172.21.15.173:0/3334375524 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.256+0000 7f492d978640 1 -- 172.21.15.173:0/3334375524 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd828a8db0 con 0x55bd82935140 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.257+0000 7f492d978640 1 --2- 172.21.15.173:0/3334375524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd828aa7f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4920055040 tx=0x7f492004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03cf67f43c59363 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.257+0000 7f481be07640 1 -- 172.21.15.173:0/3334375524 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920063070 con 0x55bd82935140 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.257+0000 7f481be07640 1 -- 172.21.15.173:0/3334375524 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492005d5a0 con 0x55bd82935140 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.257+0000 7f481be07640 1 -- 172.21.15.173:0/3334375524 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920057040 con 0x55bd82935140 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.257+0000 7f4931d2d800 1 -- 172.21.15.173:0/3334375524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 msgr2=0x55bd828aa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.257+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3334375524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd828aa7f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4920055040 tx=0x7f492004c000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 -- 172.21.15.173:0/3334375524 shutdown_connections 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3334375524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd828aa7f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 -- 172.21.15.173:0/3334375524 >> 172.21.15.173:0/3334375524 conn(0x55bd82930780 msgr2=0x55bd82a21e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 -- 172.21.15.173:0/3334375524 shutdown_connections 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 -- 172.21.15.173:0/3334375524 wait complete. 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 Processor -- start 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 -- start start 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82a30210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f4931d2d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd8293e820 con 0x55bd82935140 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82a30210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82a30210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38742/0 (socket says 172.21.15.173:38742) 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.258+0000 7f492d978640 1 -- 172.21.15.173:0/3955698152 learned_addr learned my addr 172.21.15.173:0/3955698152 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.259+0000 7f492d978640 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd82a30750 con 0x55bd82935140 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.259+0000 7f492d978640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82a30210 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f492004ad90 tx=0x7f4920002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.259+0000 7f481a604640 1 -- 172.21.15.173:0/3955698152 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492006b070 con 0x55bd82935140 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.259+0000 7f481a604640 1 -- 172.21.15.173:0/3955698152 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492005dcc0 con 0x55bd82935140 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.259+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd82a309e0 con 0x55bd82935140 2024-05-15T18:09:00.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.259+0000 7f481a604640 1 -- 172.21.15.173:0/3955698152 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920057050 con 0x55bd82935140 2024-05-15T18:09:00.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.259+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd82a33690 con 0x55bd82935140 2024-05-15T18:09:00.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f481a604640 1 -- 172.21.15.173:0/3955698152 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f492006e070 con 0x55bd82935140 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f481a604640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4814036900 0x7f4814038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f481a604640 1 -- 172.21.15.173:0/3955698152 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f492008ca30 con 0x55bd82935140 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f492d177640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4814036900 0x7f4814038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82936350 0x55bd82a37450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a37990 con 0x55bd82936350 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f492e179640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82936350 0x55bd82a37450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.260+0000 7f492d177640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4814036900 0x7f4814038dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4924000c00 tx=0x7f49240013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f492e179640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82936350 0x55bd82a37450 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f492e179640 1 -- 172.21.15.173:0/3955698152 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82936350 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a34a00 con 0x55bd82936350 2024-05-15T18:09:00.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f492e179640 1 -- 172.21.15.173:0/3955698152 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82936350 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a39d10 0x55bd82a3c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a3c7a0 con 0x55bd82a39d10 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f492d978640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a39d10 0x55bd82a3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.261+0000 7f492d978640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a39d10 0x55bd82a3c100 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.262+0000 7f492d978640 1 -- 172.21.15.173:0/3955698152 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a39d10 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.262+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a38cc0 con 0x55bd82936350 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.262+0000 7f492e179640 1 -- 172.21.15.173:0/3955698152 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82936350 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.262+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd82a3dc50 0x55bd82a400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.262+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a40800 con 0x55bd82a3dc50 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.262+0000 7f492d177640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd82a3dc50 0x55bd82a400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.263+0000 7f492d177640 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd82a3dc50 0x55bd82a400a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.263+0000 7f492d177640 1 -- 172.21.15.173:0/3955698152 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f492400f670 con 0x55bd82a3dc50 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f4931d2d800 1 Processor -- start 2024-05-15T18:09:00.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f4931d2d800 1 -- start start 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f4931d2d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a4ec60 0x55bd82a4f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f4931d2d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd82826cf0 con 0x55bd82a4ec60 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a4ec60 0x55bd82a4f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a4ec60 0x55bd82a4f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38744/0 (socket says 172.21.15.173:38744) 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f492d978640 1 -- 172.21.15.173:0/2393640235 learned_addr learned my addr 172.21.15.173:0/2393640235 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f492d978640 1 -- 172.21.15.173:0/2393640235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd82a4f5c0 con 0x55bd82a4ec60 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.264+0000 7f492d978640 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a4ec60 0x55bd82a4f080 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f492008b030 tx=0x7f4920067e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.265+0000 7f48137fe640 1 -- 172.21.15.173:0/2393640235 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920063040 con 0x55bd82a4ec60 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.265+0000 7f48137fe640 1 -- 172.21.15.173:0/2393640235 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492008c640 con 0x55bd82a4ec60 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.265+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd82a50030 con 0x55bd82a4ec60 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.265+0000 7f48137fe640 1 -- 172.21.15.173:0/2393640235 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920089570 con 0x55bd82a4ec60 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.265+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd82a50530 con 0x55bd82a4ec60 2024-05-15T18:09:00.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.265+0000 7f48137fe640 1 -- 172.21.15.173:0/2393640235 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4920089710 con 0x55bd82a4ec60 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f48137fe640 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4808036950 0x7f4808038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f48137fe640 1 -- 172.21.15.173:0/2393640235 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f492007b070 con 0x55bd82a4ec60 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f492d177640 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4808036950 0x7f4808038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f4931d2d800 1 Processor -- start 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f4931d2d800 1 -- start start 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f492d177640 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4808036950 0x7f4808038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55bd82a34940 tx=0x7f4924006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f4931d2d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a5c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f4931d2d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd828a9070 con 0x55bd82a5bda0 2024-05-15T18:09:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a5c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a5c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38760/0 (socket says 172.21.15.173:38760) 2024-05-15T18:09:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.266+0000 7f492d978640 1 -- 172.21.15.173:0/3023003153 learned_addr learned my addr 172.21.15.173:0/3023003153 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f492d978640 1 -- 172.21.15.173:0/3023003153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd82a5c790 con 0x55bd82a5bda0 2024-05-15T18:09:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f492d978640 1 --2- 172.21.15.173:0/3023003153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a5c1c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4920044700 tx=0x7f4920075880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4366d84b1c6a326a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f48117fa640 1 -- 172.21.15.173:0/3023003153 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920091040 con 0x55bd82a5bda0 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f48117fa640 1 -- 172.21.15.173:0/3023003153 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4920070570 con 0x55bd82a5bda0 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f48117fa640 1 -- 172.21.15.173:0/3023003153 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492006fa00 con 0x55bd82a5bda0 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f4931d2d800 1 -- 172.21.15.173:0/3023003153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 msgr2=0x55bd82a5c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3023003153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a5c1c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4920044700 tx=0x7f4920075880 comp rx=0 tx=0).stop 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f4931d2d800 1 -- 172.21.15.173:0/3023003153 shutdown_connections 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3023003153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a5c1c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.267+0000 7f4931d2d800 1 -- 172.21.15.173:0/3023003153 >> 172.21.15.173:0/3023003153 conn(0x55bd82a580b0 msgr2=0x55bd82a56110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f4931d2d800 1 -- 172.21.15.173:0/3023003153 shutdown_connections 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f4931d2d800 1 -- 172.21.15.173:0/3023003153 wait complete. 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f4931d2d800 1 Processor -- start 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f4931d2d800 1 -- start start 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f4931d2d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f4931d2d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd82a5ce20 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f492d978640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38774/0 (socket says 172.21.15.173:38774) 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 learned_addr learned my addr 172.21.15.173:0/327169920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.268+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd82a63630 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.269+0000 7f492d978640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a630f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4920044700 tx=0x7f4920075620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.269+0000 7f47ff7fe640 1 -- 172.21.15.173:0/327169920 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49200ad020 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.269+0000 7f47ff7fe640 1 -- 172.21.15.173:0/327169920 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492005ecf0 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.269+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd82a63630 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.269+0000 7f47ff7fe640 1 -- 172.21.15.173:0/327169920 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4920091040 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.269+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd82a63630 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f47ff7fe640 1 -- 172.21.15.173:0/327169920 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f49200b0020 con 0x55bd82a5bda0 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f47ff7fe640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f47f8036950 0x7f47f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f47ff7fe640 1 -- 172.21.15.173:0/327169920 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f49200b3ab0 con 0x55bd82a5bda0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f492d177640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f47f8036950 0x7f47f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82a6e830 0x55bd82a70cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a71440 con 0x55bd82a6e830 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f492e179640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82a6e830 0x55bd82a70cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.270+0000 7f492d177640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f47f8036950 0x7f47f8038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55bd82a40c00 tx=0x7f4924023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f492e179640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82a6e830 0x55bd82a70cf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 20 realm 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a71850 con 0x55bd82a6e830 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a72120 con 0x55bd82a6e830 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.271+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f4931d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a72fb0 0x55bd82a753a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a75b00 con 0x55bd82a72fb0 2024-05-15T18:09:00.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f492d978640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a72fb0 0x55bd82a753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f492d978640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a72fb0 0x55bd82a753a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f4931d2d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f4931d2d800 20 searching for the correct realm 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.272+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a774d0 con 0x55bd82a72fb0 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d978640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f49200b2020 0x7f49200a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a774d0 con 0x7f49200b2020 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d177640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f49200b2020 0x7f49200a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d177640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f49200b2020 0x7f49200a1800 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d177640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f492403a3c0 0x7f492403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.273+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a774d0 con 0x7f492403a3c0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.274+0000 7f492e179640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f492403a3c0 0x7f492403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.274+0000 7f492e179640 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f492403a3c0 0x7f492403a810 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.274+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.274+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.275+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f49200b2020 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.276+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f49200b2020 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.277+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.278+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.279+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.279+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.279+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.279+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.279+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.279+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f49200b2020 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.280+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.280+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.280+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.280+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.280+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.280+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f49200b2020 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a72fb0 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.281+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f492403a3c0 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x55bd82a6e830 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a724c0 con 0x7f49200b2020 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:00.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a764a0 con 0x55bd82a6e830 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.282+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a76890 con 0x55bd82a6e830 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a76890 con 0x7f492403a3c0 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:00.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 20 zone default found 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 4 Realm: () 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 20 zonegroup default 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a76cb0 con 0x7f492403a3c0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.283+0000 7f4931d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a76cb0 con 0x55bd82a72fb0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a79380 con 0x55bd82a72fb0 2024-05-15T18:09:00.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 20 started sync module instance, tier type = 2024-05-15T18:09:00.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:00.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.284+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a78820 con 0x7f49200b2020 2024-05-15T18:09:00.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.285+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.285+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94272429198352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a78480 con 0x7f49200b2020 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.285+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7a1f0 con 0x55bd82a6e830 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.286+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94272429198352] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.287+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.287+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94272429202752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7a160 con 0x55bd82a6e830 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.287+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7b0b0 con 0x55bd82a72fb0 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.287+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.288+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94272429206528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7b950 con 0x55bd82a72fb0 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.288+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7c440 con 0x7f49200b2020 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.288+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94272429202752] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.289+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.289+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94272429211408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7c830 con 0x7f49200b2020 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.289+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94272429206528] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.289+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7d290 con 0x55bd82a6e830 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.290+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.290+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94272429215088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7d740 con 0x55bd82a6e830 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.290+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94272429211408] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.290+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7a5e0 con 0x7f492403a3c0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.292+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94272429215088] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.292+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.292+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94272429216400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7d6b0 con 0x7f492403a3c0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.292+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7e5b0 con 0x7f492403a3c0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.293+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94272429216400] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.293+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.293+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94272429218896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7e520 con 0x7f492403a3c0 2024-05-15T18:09:00.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.293+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7ef40 con 0x7f492403a3c0 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94272429218896] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94272429222448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7f120 con 0x7f492403a3c0 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 20 add_watcher() i=0 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 20 add_watcher() i=1 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 20 add_watcher() i=2 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 20 add_watcher() i=3 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 20 add_watcher() i=4 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 20 add_watcher() i=5 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.294+0000 7f4931d2d800 20 add_watcher() i=6 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.295+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94272429222448] v29'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.295+0000 7f4931d2d800 20 add_watcher() i=7 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.295+0000 7f4931d2d800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:00.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.295+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a824f0 con 0x55bd82a6e830 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.296+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.296+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94272429223952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a7f8e0 con 0x55bd82a6e830 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94272429223952] v29'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f47d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f4931d2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f4931d2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f4931d2d800 5 note: GC not initialized 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f47d67fc640 20 reqs_thread_entry: start 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f4931d2d800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f4931d2d800 20 Filter name: none 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f474ffff640 20 reqs_thread_entry: start 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f4931d2d800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.297+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd82ab52f0 con 0x7f49200b2020 2024-05-15T18:09:00.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.298+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.298+0000 7f4931d2d800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.299+0000 7f47d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.299+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94272429223952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82ab3290 con 0x55bd82a6e830 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.300+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94272429223952] v29'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.300+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94272429198352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82ab3290 con 0x7f49200b2020 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.301+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94272429198352] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.301+0000 7f4931d2d800 20 remove_watcher() i=0 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.301+0000 7f4931d2d800 2 removed watcher, disabling cache 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.301+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94272429202752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a78c10 con 0x55bd82a6e830 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.302+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94272429202752] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.302+0000 7f4931d2d800 20 remove_watcher() i=1 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.302+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94272429206528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82ab3290 con 0x55bd82a72fb0 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.303+0000 7f492d978640 1 -- 172.21.15.173:0/327169920 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94272429206528] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492006d030 con 0x55bd82a72fb0 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.303+0000 7f4931d2d800 20 remove_watcher() i=2 2024-05-15T18:09:00.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.303+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94272429211408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a79d40 con 0x7f49200b2020 2024-05-15T18:09:00.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.304+0000 7f492d177640 1 -- 172.21.15.173:0/327169920 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94272429211408] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4924037040 con 0x7f49200b2020 2024-05-15T18:09:00.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.304+0000 7f4931d2d800 20 remove_watcher() i=3 2024-05-15T18:09:00.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.304+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94272429215088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a78c10 con 0x55bd82a6e830 2024-05-15T18:09:00.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.305+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94272429215088] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x55bd82a6e830 2024-05-15T18:09:00.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.305+0000 7f4931d2d800 20 remove_watcher() i=4 2024-05-15T18:09:00.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.305+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94272429216400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82ab3290 con 0x7f492403a3c0 2024-05-15T18:09:00.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.306+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94272429216400] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.306+0000 7f4931d2d800 20 remove_watcher() i=5 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.306+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94272429218896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a79d40 con 0x7f492403a3c0 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.307+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94272429218896] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.307+0000 7f4931d2d800 20 remove_watcher() i=6 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.307+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94272429222448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd82a79d40 con 0x7f492403a3c0 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94272429222448] v29'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f492800a4a0 con 0x7f492403a3c0 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 20 remove_watcher() i=7 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f492403a3c0 msgr2=0x7f492403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f492403a3c0 0x7f492403a810 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82a6e830 msgr2=0x55bd82a70cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82a6e830 0x55bd82a70cf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f49200b2020 msgr2=0x7f49200a1800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f49200b2020 0x7f49200a1800 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a72fb0 msgr2=0x55bd82a753a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a72fb0 0x55bd82a753a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.308+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f47f8036950 msgr2=0x7f47f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f47f8036950 0x7f47f8038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55bd82a40c00 tx=0x7f4924023040 comp rx=0 tx=0).stop 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 msgr2=0x55bd82a630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f492e179640 1 -- 172.21.15.173:0/327169920 reap_dead start 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a630f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4920044700 tx=0x7f4920075620 comp rx=0 tx=0).stop 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 shutdown_connections 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/327169920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a5bda0 0x55bd82a630f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 >> 172.21.15.173:0/327169920 conn(0x55bd82a580b0 msgr2=0x55bd82a55710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 shutdown_connections 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/327169920 wait complete. 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4808036950 msgr2=0x7f4808038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4808036950 0x7f4808038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55bd82a34940 tx=0x7f4924006000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a4ec60 msgr2=0x55bd82a4f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a4ec60 0x55bd82a4f080 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f492008b030 tx=0x7f4920067e80 comp rx=0 tx=0).stop 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 shutdown_connections 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4808036950 0x7f4808038e10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/2393640235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82a4ec60 0x55bd82a4f080 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 >> 172.21.15.173:0/2393640235 conn(0x55bd82a42d00 msgr2=0x55bd82a43100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 shutdown_connections 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/2393640235 wait complete. 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd82a3dc50 msgr2=0x55bd82a400a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd82a3dc50 0x55bd82a400a0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82936350 msgr2=0x55bd82a37450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd82936350 0x55bd82a37450 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a39d10 msgr2=0x55bd82a3c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd82a39d10 0x55bd82a3c100 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4814036900 msgr2=0x7f4814038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4814036900 0x7f4814038dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4924000c00 tx=0x7f49240013b0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 msgr2=0x55bd82a30210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f4931d2d800 1 --2- 172.21.15.173:0/3955698152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd82935140 0x55bd82a30210 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f492004ad90 tx=0x7f4920002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.309+0000 7f492e179640 1 -- 172.21.15.173:0/3955698152 reap_dead start 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.310+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 shutdown_connections 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.310+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 >> 172.21.15.173:0/3955698152 conn(0x55bd82930780 msgr2=0x55bd828a95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.310+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 shutdown_connections 2024-05-15T18:09:00.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.310+0000 7f4931d2d800 1 -- 172.21.15.173:0/3955698152 wait complete. 2024-05-15T18:09:00.295 INFO:teuthology.orchestra.run.smithi173.stdout:{"key":"bucket:myfoo","ver":{"tag":"_z-7yJTC7gMQxsWZWH_C0xvp","ver":2},"mtime":"2024-05-15T18:09:00.015084Z","data":{"bucket":{"name":"myfoo","marker":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","bucket_id":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-05-15T18:08:58.890026Z","linked":false,"has_bucket_info":false}} 2024-05-15T18:09:00.295 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_z-7yJTC7gMQxsWZWH_C0xvp', 'ver': 2}, 'mtime': '2024-05-15T18:09:00.015084Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'bucket_id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-05-15T18:08:58.890026Z', 'linked': False, 'has_bucket_info': False}} 2024-05-15T18:09:00.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1'] 2024-05-15T18:09:00.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1'] 2024-05-15T18:09:00.296 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:00.385 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:00.386 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:00.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f2070a34800 1 Processor -- start 2024-05-15T18:09:00.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f2070a34800 1 -- start start 2024-05-15T18:09:00.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f2070a34800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bd300c1540 0x55bd300ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f2070a34800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd30034940 con 0x55bd300bfa00 2024-05-15T18:09:00.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f2070a34800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55bd2ff52050 con 0x55bd300c1540 2024-05-15T18:09:00.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f206b5bf640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bd300c1540 0x55bd300ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f206b5bf640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55bd300c1540 0x55bd300ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38778/0 (socket says 172.21.15.173:38778) 2024-05-15T18:09:00.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f206b5bf640 1 -- 172.21.15.173:0/2858510333 learned_addr learned my addr 172.21.15.173:0/2858510333 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.410+0000 7f206bdc0640 1 --1- 172.21.15.173:0/2858510333 >> v1:172.21.15.3:6789/0 conn(0x55bd300bfa00 0x55bd300bfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57092/0 (socket says 172.21.15.173:57092) 2024-05-15T18:09:00.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.411+0000 7f206b5bf640 1 -- 172.21.15.173:0/2858510333 >> v1:172.21.15.3:6789/0 conn(0x55bd300bfa00 legacy=0x55bd300bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.411+0000 7f206b5bf640 1 -- 172.21.15.173:0/2858510333 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd300cb590 con 0x55bd300c1540 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.412+0000 7f206b5bf640 1 --2- 172.21.15.173:0/2858510333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300c1540 0x55bd300ca040 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f205400a520 tx=0x7f205401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bfd39334b90f07 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f206adbe640 1 -- 172.21.15.173:0/2858510333 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2054057070 con 0x55bd300c1540 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f206adbe640 1 -- 172.21.15.173:0/2858510333 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2054052570 con 0x55bd300c1540 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f206adbe640 1 -- 172.21.15.173:0/2858510333 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2054052870 con 0x55bd300c1540 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f2070a34800 1 -- 172.21.15.173:0/2858510333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300c1540 msgr2=0x55bd300ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f2070a34800 1 --2- 172.21.15.173:0/2858510333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300c1540 0x55bd300ca040 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f205400a520 tx=0x7f205401d010 comp rx=0 tx=0).stop 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f2070a34800 1 -- 172.21.15.173:0/2858510333 shutdown_connections 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f2070a34800 1 --2- 172.21.15.173:0/2858510333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300c1540 0x55bd300ca040 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f2070a34800 1 -- 172.21.15.173:0/2858510333 >> 172.21.15.173:0/2858510333 conn(0x55bd300bb5c0 msgr2=0x55bd300bd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f2070a34800 1 -- 172.21.15.173:0/2858510333 shutdown_connections 2024-05-15T18:09:00.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.413+0000 7f2070a34800 1 -- 172.21.15.173:0/2858510333 wait complete. 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.427+0000 7f2070a34800 1 Processor -- start 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.427+0000 7f2070a34800 1 -- start start 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.427+0000 7f2070a34800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.427+0000 7f2070a34800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd3000c1f0 con 0x55bd300bfa00 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.427+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.427+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38790/0 (socket says 172.21.15.173:38790) 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.427+0000 7f206bdc0640 1 -- 172.21.15.173:0/3496636365 learned_addr learned my addr 172.21.15.173:0/3496636365 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.428+0000 7f206bdc0640 1 -- 172.21.15.173:0/3496636365 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd301b50a0 con 0x55bd300bfa00 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.428+0000 7f206bdc0640 1 --2- 172.21.15.173:0/3496636365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301b4ad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2064001e90 tx=0x7f206400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a01987b758b4a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.428+0000 7f1f59e0b640 1 -- 172.21.15.173:0/3496636365 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206400e5c0 con 0x55bd300bfa00 2024-05-15T18:09:00.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.428+0000 7f1f59e0b640 1 -- 172.21.15.173:0/3496636365 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2064006070 con 0x55bd300bfa00 2024-05-15T18:09:00.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.428+0000 7f1f59e0b640 1 -- 172.21.15.173:0/3496636365 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206400e890 con 0x55bd300bfa00 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 -- 172.21.15.173:0/3496636365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 msgr2=0x55bd301b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 --2- 172.21.15.173:0/3496636365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301b4ad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2064001e90 tx=0x7f206400b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 -- 172.21.15.173:0/3496636365 shutdown_connections 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 --2- 172.21.15.173:0/3496636365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301b4ad0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 -- 172.21.15.173:0/3496636365 >> 172.21.15.173:0/3496636365 conn(0x55bd300bb5c0 msgr2=0x55bd301b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 -- 172.21.15.173:0/3496636365 shutdown_connections 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 -- 172.21.15.173:0/3496636365 wait complete. 2024-05-15T18:09:00.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 Processor -- start 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 -- start start 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301bc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f2070a34800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd300ca850 con 0x55bd300bfa00 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301bc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301bc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38794/0 (socket says 172.21.15.173:38794) 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.429+0000 7f206bdc0640 1 -- 172.21.15.173:0/1805206911 learned_addr learned my addr 172.21.15.173:0/1805206911 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.430+0000 7f206bdc0640 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd301bcb90 con 0x55bd300bfa00 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.430+0000 7f206bdc0640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301bc650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f206400c010 tx=0x7f2064000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.430+0000 7f1f53fff640 1 -- 172.21.15.173:0/1805206911 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206400f8d0 con 0x55bd300bfa00 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.430+0000 7f1f53fff640 1 -- 172.21.15.173:0/1805206911 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206400fa90 con 0x55bd300bfa00 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.430+0000 7f1f53fff640 1 -- 172.21.15.173:0/1805206911 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206400fdb0 con 0x55bd300bfa00 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.430+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd301bce20 con 0x55bd300bfa00 2024-05-15T18:09:00.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.430+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd301bfad0 con 0x55bd300bfa00 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.431+0000 7f1f53fff640 1 -- 172.21.15.173:0/1805206911 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2064017070 con 0x55bd300bfa00 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.431+0000 7f1f53fff640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036900 0x7f1f54038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.431+0000 7f1f53fff640 1 -- 172.21.15.173:0/1805206911 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2064015020 con 0x55bd300bfa00 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.431+0000 7f206b5bf640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036900 0x7f1f54038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.431+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd300c1540 0x55bd301c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.431+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301c3e20 con 0x55bd300c1540 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.431+0000 7f206c5c1640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd300c1540 0x55bd301c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f206b5bf640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036900 0x7f1f54038dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2054054000 tx=0x7f205404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f206c5c1640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd300c1540 0x55bd301c3890 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f206c5c1640 1 -- 172.21.15.173:0/1805206911 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd300c1540 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301c0e60 con 0x55bd300c1540 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f206c5c1640 1 -- 172.21.15.173:0/1805206911 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd300c1540 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301c6170 0x55bd301c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301c8c50 con 0x55bd301c6170 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.432+0000 7f206bdc0640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301c6170 0x55bd301c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.433+0000 7f206bdc0640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301c6170 0x55bd301c8560 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.433+0000 7f206bdc0640 1 -- 172.21.15.173:0/1805206911 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f206402e070 con 0x55bd301c6170 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.433+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301c5120 con 0x55bd300c1540 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.433+0000 7f206c5c1640 1 -- 172.21.15.173:0/1805206911 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd300c1540 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.433+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd301ca100 0x55bd301cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.433+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301cccb0 con 0x55bd301ca100 2024-05-15T18:09:00.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.433+0000 7f206b5bf640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd301ca100 0x55bd301cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.434+0000 7f206b5bf640 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd301ca100 0x55bd301cc550 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.434+0000 7f206b5bf640 1 -- 172.21.15.173:0/1805206911 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f205405a040 con 0x55bd301ca100 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.434+0000 7f2070a34800 1 Processor -- start 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f2070a34800 1 -- start start 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f2070a34800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301db110 0x55bd301db530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f2070a34800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd2ffb2cf0 con 0x55bd301db110 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301db110 0x55bd301db530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301db110 0x55bd301db530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38796/0 (socket says 172.21.15.173:38796) 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f206bdc0640 1 -- 172.21.15.173:0/174426655 learned_addr learned my addr 172.21.15.173:0/174426655 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f206bdc0640 1 -- 172.21.15.173:0/174426655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd301dba70 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f206bdc0640 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301db110 0x55bd301db530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f206401cfd0 tx=0x7f2064041d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f1f517fa640 1 -- 172.21.15.173:0/174426655 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206401a690 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f1f517fa640 1 -- 172.21.15.173:0/174426655 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206401a830 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.435+0000 7f1f517fa640 1 -- 172.21.15.173:0/174426655 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064044b10 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.436+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd301dc4e0 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.436+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd301dc9e0 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.436+0000 7f1f517fa640 1 -- 172.21.15.173:0/174426655 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2064044cb0 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.436+0000 7f1f517fa640 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036950 0x7f1f44038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.436+0000 7f1f517fa640 1 -- 172.21.15.173:0/174426655 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f206403cae0 con 0x55bd301db110 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f206b5bf640 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036950 0x7f1f44038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f2070a34800 1 Processor -- start 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f2070a34800 1 -- start start 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f206b5bf640 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036950 0x7f1f44038e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55bd301c4720 tx=0x7f2054005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f2070a34800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301e8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f2070a34800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd301b5420 con 0x55bd301e8260 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301e8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38808/0 (socket says 172.21.15.173:38808) 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f206bdc0640 1 -- 172.21.15.173:0/2303498978 learned_addr learned my addr 172.21.15.173:0/2303498978 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.437+0000 7f206bdc0640 1 -- 172.21.15.173:0/2303498978 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd301e8c50 con 0x55bd301e8260 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f206bdc0640 1 --2- 172.21.15.173:0/2303498978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301e8680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f20640178a0 tx=0x7f206403a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ade33a778ab08b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f1f4affd640 1 -- 172.21.15.173:0/2303498978 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206403cd80 con 0x55bd301e8260 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f1f4affd640 1 -- 172.21.15.173:0/2303498978 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206405b030 con 0x55bd301e8260 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f1f4affd640 1 -- 172.21.15.173:0/2303498978 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064044fa0 con 0x55bd301e8260 2024-05-15T18:09:00.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f2070a34800 1 -- 172.21.15.173:0/2303498978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 msgr2=0x55bd301e8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f2070a34800 1 --2- 172.21.15.173:0/2303498978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301e8680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f20640178a0 tx=0x7f206403a3e0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f2070a34800 1 -- 172.21.15.173:0/2303498978 shutdown_connections 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f2070a34800 1 --2- 172.21.15.173:0/2303498978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301e8680 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f2070a34800 1 -- 172.21.15.173:0/2303498978 >> 172.21.15.173:0/2303498978 conn(0x55bd301e4530 msgr2=0x55bd301e2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f2070a34800 1 -- 172.21.15.173:0/2303498978 shutdown_connections 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.438+0000 7f2070a34800 1 -- 172.21.15.173:0/2303498978 wait complete. 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f2070a34800 1 Processor -- start 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f2070a34800 1 -- start start 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f2070a34800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301ef590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f2070a34800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd301e92b0 con 0x55bd301e8260 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f206bdc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301ef590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38820/0 (socket says 172.21.15.173:38820) 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 learned_addr learned my addr 172.21.15.173:0/768658703 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.439+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd301efad0 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.440+0000 7f206bdc0640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301ef590 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f206403a590 tx=0x7f2064011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.440+0000 7f1f497fa640 1 -- 172.21.15.173:0/768658703 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064070070 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.440+0000 7f1f497fa640 1 -- 172.21.15.173:0/768658703 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2064031d50 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.440+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd301efad0 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.440+0000 7f1f497fa640 1 -- 172.21.15.173:0/768658703 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206403cd30 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.440+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd301efad0 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.440+0000 7f1f497fa640 1 -- 172.21.15.173:0/768658703 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2064073070 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f1f497fa640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f1f497fa640 1 -- 172.21.15.173:0/768658703 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f2064076af0 con 0x55bd301e8260 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f206b5bf640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f206b5bf640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55bd301cd0b0 tx=0x7f205404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd301fabf0 0x55bd301fd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fd800 con 0x55bd301fabf0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.441+0000 7f206c5c1640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd301fabf0 0x55bd301fd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f206c5c1640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd301fabf0 0x55bd301fd0b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 20 realm 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fdc10 con 0x55bd301fabf0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe4e0 con 0x55bd301fabf0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.442+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x55bd301fabf0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f2070a34800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301ff5e0 0x55bd302019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd30201fe0 con 0x55bd301ff5e0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f206bdc0640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301ff5e0 0x55bd302019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f206bdc0640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301ff5e0 0x55bd302019d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2064072030 con 0x55bd301ff5e0 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f2070a34800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:00.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f2070a34800 20 searching for the correct realm 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.443+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd30203910 con 0x55bd301ff5e0 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064072030 con 0x55bd301ff5e0 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206bdc0640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2064075060 0x7f206403c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd30203910 con 0x7f2064075060 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206b5bf640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2064075060 0x7f206403c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206b5bf640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2064075060 0x7f206403c270 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206b5bf640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2054074040 0x7f2054081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.444+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd30203910 con 0x7f2054074040 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.445+0000 7f206c5c1640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2054074040 0x7f2054081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.445+0000 7f206c5c1640 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2054074040 0x7f2054081410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.445+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f205c00a4a0 con 0x7f2054074040 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.445+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x55bd301fabf0 2024-05-15T18:09:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x55bd301fabf0 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x7f2054074040 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x7f2054074040 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x7f2054074040 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x7f2054074040 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.446+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x7f2064075060 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x55bd301ff5e0 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x55bd301fabf0 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x7f2054074040 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x7f2054074040 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.447+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x55bd301fabf0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55bd301fe880 con 0x7f2064075060 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301ff5e0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301ff5e0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.448+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2054074040 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x7f2054074040 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301ff5e0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301ff5e0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301fabf0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301fabf0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.449+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f205c00a4a0 con 0x55bd301fabf0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.450+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2054074040 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.450+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c033040 con 0x7f2054074040 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.450+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301ff5e0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.450+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.450+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2064075060 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.450+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.450+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301fabf0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2054074040 2024-05-15T18:09:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301ff5e0 2024-05-15T18:09:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2054074040 2024-05-15T18:09:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.451+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2064075060 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301ff5e0 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2054074040 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x55bd301fabf0 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.452+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f205408e060 con 0x7f2064075060 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:00.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd302028a0 con 0x55bd301fabf0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd30202c90 con 0x55bd301fabf0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.453+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd30202c90 con 0x7f2054074040 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 zone default found 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 4 Realm: () 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 zonegroup default 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd30203140 con 0x7f2054074040 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd30203140 con 0x55bd301ff5e0 2024-05-15T18:09:00.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.454+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.455+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd30205810 con 0x55bd301ff5e0 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.455+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.455+0000 7f2070a34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.455+0000 7f2070a34800 20 started sync module instance, tier type = 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.455+0000 7f2070a34800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.455+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30204c10 con 0x7f2064075060 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.456+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.456+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94271044603904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30204870 con 0x7f2064075060 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.456+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30206740 con 0x55bd301fabf0 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.457+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94271044603904] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.457+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.457+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94271044608656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30206b60 con 0x55bd301fabf0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.457+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30207520 con 0x55bd301ff5e0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.458+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94271044608656] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.458+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.458+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94271044612208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd302078c0 con 0x55bd301ff5e0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.458+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30208300 con 0x7f2064075060 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.459+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.459+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94271044618016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30208ff0 con 0x7f2064075060 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.459+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30209ae0 con 0x55bd301fabf0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.459+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94271044612208] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.461+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.461+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94271044621744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30209ed0 con 0x55bd301fabf0 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.461+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020a910 con 0x7f2054074040 2024-05-15T18:09:00.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.461+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94271044618016] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.462+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.462+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94271044625376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020a8d0 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.462+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020b340 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.462+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94271044621744] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.462+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94271044625376] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.463+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.463+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94271044619072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020b340 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.463+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020b7b0 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94271044609712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020bc20 con 0x7f2054074040 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f2070a34800 20 add_watcher() i=0 2024-05-15T18:09:00.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f2070a34800 20 add_watcher() i=1 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f2070a34800 20 add_watcher() i=2 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f2070a34800 20 add_watcher() i=3 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f2070a34800 20 add_watcher() i=4 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.464+0000 7f2070a34800 20 add_watcher() i=5 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94271044619072] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f2070a34800 20 add_watcher() i=6 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94271044609712] v29'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f2070a34800 20 add_watcher() i=7 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f2070a34800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020bc20 con 0x55bd301fabf0 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.465+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94271044630384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020bb90 con 0x55bd301fabf0 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.466+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94271044630384] v29'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f1f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 5 note: GC not initialized 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f1f20fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 20 Filter name: none 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f1e9a7fc640 20 reqs_thread_entry: start 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.467+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd30242120 con 0x7f2054074040 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-15T18:09:00.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd302440a0 con 0x7f2064075060 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd302459e0 con 0x7f2054074040 2024-05-15T18:09:00.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(64 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.468+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30249f90 con 0x7f2064075060 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.469+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 foo.buckets [call] v29'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.469+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3024fef0 con 0x7f2054074040 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(66 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94271044866704 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd3024a3c0 con 0x7f2054074040 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== watch-notify(notify (1) cookie 94271044609712 notify 124554051588 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55bd30245dd0 con 0x7f2054074040 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f1f4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051588 cookie 94271044609712 notifier 4496 bl.length()=752 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(67 notify.7 [notify cookie 94271044866704 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f1f4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f1f4affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f1f4affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f1f4affd640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1f30003ea0 con 0x7f2054074040 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== watch-notify(notify_complete (2) cookie 94271044866704 notify 124554051588 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bd30244f00 con 0x7f2054074040 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_sources= new_sources= 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential sources added=[] removed=[] 2024-05-15T18:09:00.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_dests= new_dests= 2024-05-15T18:09:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential dests added=[] removed=[] 2024-05-15T18:09:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.471+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3024e6b0 con 0x7f2054074040 2024-05-15T18:09:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.472+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(69 fud.buckets [call] v29'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.472+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3024f6c0 con 0x7f2064075060 2024-05-15T18:09:00.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.473+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f2070a34800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-15T18:09:00.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f2070a34800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f2070a34800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:09:00.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94271044866704 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55bd3024eb60 con 0x7f2054074040 2024-05-15T18:09:00.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== watch-notify(notify (1) cookie 94271044619072 notify 124554051589 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f205c01e040 con 0x7f2054074040 2024-05-15T18:09:00.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f1f4affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051589 cookie 94271044619072 notifier 4496 bl.length()=314 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f1f4affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f1f4affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(71 notify.6 [notify cookie 94271044866704 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f1f4affd640 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f1f30003ea0 con 0x7f2054074040 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== watch-notify(notify_complete (2) cookie 94271044866704 notify 124554051589 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f205c03d5e0 con 0x7f2054074040 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.474+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.475+0000 7f1f21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.475+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94271044630384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd301f66c0 con 0x55bd301fabf0 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.476+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94271044630384] v29'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.476+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94271044603904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020b770 con 0x7f2064075060 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.477+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94271044603904] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.477+0000 7f2070a34800 20 remove_watcher() i=0 2024-05-15T18:09:00.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.477+0000 7f2070a34800 2 removed watcher, disabling cache 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.477+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94271044608656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020b770 con 0x55bd301fabf0 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.479+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94271044608656] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.479+0000 7f2070a34800 20 remove_watcher() i=1 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.479+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94271044612208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30206290 con 0x55bd301ff5e0 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.480+0000 7f206bdc0640 1 -- 172.21.15.173:0/768658703 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94271044612208] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064084040 con 0x55bd301ff5e0 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.480+0000 7f2070a34800 20 remove_watcher() i=2 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.480+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94271044618016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020b770 con 0x7f2064075060 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.481+0000 7f206b5bf640 1 -- 172.21.15.173:0/768658703 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94271044618016] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407f070 con 0x7f2064075060 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.481+0000 7f2070a34800 20 remove_watcher() i=3 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.481+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94271044621744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30207070 con 0x55bd301fabf0 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.482+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94271044621744] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x55bd301fabf0 2024-05-15T18:09:00.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.482+0000 7f2070a34800 20 remove_watcher() i=4 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.482+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94271044625376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30206290 con 0x7f2054074040 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.483+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94271044625376] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.483+0000 7f2070a34800 20 remove_watcher() i=5 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.483+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94271044619072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd30208720 con 0x7f2054074040 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.484+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94271044619072] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.484+0000 7f2070a34800 20 remove_watcher() i=6 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.484+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94271044609712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55bd3020b770 con 0x7f2054074040 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94271044609712] v29'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c031040 con 0x7f2054074040 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 20 remove_watcher() i=7 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2054074040 msgr2=0x7f2054081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2054074040 0x7f2054081410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd301fabf0 msgr2=0x55bd301fd0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd301fabf0 0x55bd301fd0b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2064075060 msgr2=0x7f206403c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2064075060 0x7f206403c270 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301ff5e0 msgr2=0x55bd302019d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.485+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301ff5e0 0x55bd302019d0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 msgr2=0x7f1f34038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f34036950 0x7f1f34038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55bd301cd0b0 tx=0x7f205404f000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 msgr2=0x55bd301ef590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/768658703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301e8260 0x55bd301ef590 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f206403a590 tx=0x7f2064011eb0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 reap_dead start 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f206c5c1640 1 -- 172.21.15.173:0/768658703 reap_dead start 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 shutdown_connections 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 >> 172.21.15.173:0/768658703 conn(0x55bd301e4530 msgr2=0x55bd301e1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 shutdown_connections 2024-05-15T18:09:00.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/768658703 wait complete. 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036950 msgr2=0x7f1f44038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036950 0x7f1f44038e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55bd301c4720 tx=0x7f2054005ac0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301db110 msgr2=0x55bd301db530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301db110 0x55bd301db530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f206401cfd0 tx=0x7f2064041d70 comp rx=0 tx=0).stop 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 shutdown_connections 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f44036950 0x7f1f44038e10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/174426655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd301db110 0x55bd301db530 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 >> 172.21.15.173:0/174426655 conn(0x55bd301cf1b0 msgr2=0x55bd301cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 shutdown_connections 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/174426655 wait complete. 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd301ca100 msgr2=0x55bd301cc550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55bd301ca100 0x55bd301cc550 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd300c1540 msgr2=0x55bd301c3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55bd300c1540 0x55bd301c3890 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301c6170 msgr2=0x55bd301c8560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55bd301c6170 0x55bd301c8560 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036900 msgr2=0x7f1f54038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1f54036900 0x7f1f54038dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2054054000 tx=0x7f205404e000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 msgr2=0x55bd301bc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f2070a34800 1 --2- 172.21.15.173:0/1805206911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd300bfa00 0x55bd301bc650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f206400c010 tx=0x7f2064000ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.486+0000 7f206c5c1640 1 -- 172.21.15.173:0/1805206911 reap_dead start 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.487+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 shutdown_connections 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.487+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 >> 172.21.15.173:0/1805206911 conn(0x55bd300bb5c0 msgr2=0x55bd301aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.487+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 shutdown_connections 2024-05-15T18:09:00.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.487+0000 7f2070a34800 1 -- 172.21.15.173:0/1805206911 wait complete. 2024-05-15T18:09:00.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-15T18:09:00.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-15T18:09:00.475 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-15T18:09:00.519 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:00.519 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:00.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.543+0000 7fb60491f800 1 Processor -- start 2024-05-15T18:09:00.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.543+0000 7fb60491f800 1 -- start start 2024-05-15T18:09:00.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.543+0000 7fb60491f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560528226660 0x560528228a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.543+0000 7fb60491f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560528228f90 con 0x560528222b50 2024-05-15T18:09:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.543+0000 7fb60491f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5605280b3050 con 0x560528226660 2024-05-15T18:09:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.544+0000 7fb5f7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560528226660 0x560528228a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.544+0000 7fb6005e7640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x560528222b50 0x560528224f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57094/0 (socket says 172.21.15.173:57094) 2024-05-15T18:09:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.544+0000 7fb5f7fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560528226660 0x560528228a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38830/0 (socket says 172.21.15.173:38830) 2024-05-15T18:09:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.544+0000 7fb6005e7640 1 -- 172.21.15.173:0/1550211 learned_addr learned my addr 172.21.15.173:0/1550211 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.544+0000 7fb5f7fff640 1 -- 172.21.15.173:0/1550211 >> v1:172.21.15.3:6789/0 conn(0x560528222b50 legacy=0x560528224f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.544+0000 7fb5f7fff640 1 -- 172.21.15.173:0/1550211 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56052822a170 con 0x560528226660 2024-05-15T18:09:00.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/1550211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528226660 0x560528228a50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800a470 tx=0x7fb5e801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f308036b5d866f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb5ffde6640 1 -- 172.21.15.173:0/1550211 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e8057070 con 0x560528226660 2024-05-15T18:09:00.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb5ffde6640 1 -- 172.21.15.173:0/1550211 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8052570 con 0x560528226660 2024-05-15T18:09:00.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb5ffde6640 1 -- 172.21.15.173:0/1550211 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e8052870 con 0x560528226660 2024-05-15T18:09:00.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb60491f800 1 -- 172.21.15.173:0/1550211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528226660 msgr2=0x560528228a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb60491f800 1 --2- 172.21.15.173:0/1550211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528226660 0x560528228a50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb5e800a470 tx=0x7fb5e801ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb60491f800 1 -- 172.21.15.173:0/1550211 shutdown_connections 2024-05-15T18:09:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb60491f800 1 --2- 172.21.15.173:0/1550211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528226660 0x560528228a50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb60491f800 1 -- 172.21.15.173:0/1550211 >> 172.21.15.173:0/1550211 conn(0x56052821c5a0 msgr2=0x56052821e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.546+0000 7fb60491f800 1 -- 172.21.15.173:0/1550211 shutdown_connections 2024-05-15T18:09:00.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.547+0000 7fb60491f800 1 -- 172.21.15.173:0/1550211 wait complete. 2024-05-15T18:09:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.560+0000 7fb60491f800 1 Processor -- start 2024-05-15T18:09:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.560+0000 7fb60491f800 1 -- start start 2024-05-15T18:09:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.560+0000 7fb60491f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x560528222490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.560+0000 7fb60491f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56052816d1d0 con 0x560528222b50 2024-05-15T18:09:00.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.561+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x560528222490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.561+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x560528222490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38844/0 (socket says 172.21.15.173:38844) 2024-05-15T18:09:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.561+0000 7fb6005e7640 1 -- 172.21.15.173:0/1312327942 learned_addr learned my addr 172.21.15.173:0/1312327942 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.561+0000 7fb6005e7640 1 -- 172.21.15.173:0/1312327942 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560528220a50 con 0x560528222b50 2024-05-15T18:09:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.562+0000 7fb6005e7640 1 --2- 172.21.15.173:0/1312327942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x560528222490 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0001de0 tx=0x7fb5f000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a55179727acbb8d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.562+0000 7fb4ee60c640 1 -- 172.21.15.173:0/1312327942 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0012020 con 0x560528222b50 2024-05-15T18:09:00.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.562+0000 7fb4ee60c640 1 -- 172.21.15.173:0/1312327942 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f000e5a0 con 0x560528222b50 2024-05-15T18:09:00.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.562+0000 7fb4ee60c640 1 -- 172.21.15.173:0/1312327942 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f000e8c0 con 0x560528222b50 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 -- 172.21.15.173:0/1312327942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 msgr2=0x560528222490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 --2- 172.21.15.173:0/1312327942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x560528222490 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0001de0 tx=0x7fb5f000b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 -- 172.21.15.173:0/1312327942 shutdown_connections 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 --2- 172.21.15.173:0/1312327942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x560528222490 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 -- 172.21.15.173:0/1312327942 >> 172.21.15.173:0/1312327942 conn(0x56052821c5a0 msgr2=0x56052830f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 -- 172.21.15.173:0/1312327942 shutdown_connections 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 -- 172.21.15.173:0/1312327942 wait complete. 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 Processor -- start 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 -- start start 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x56052831d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb60491f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560528229460 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x56052831d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x56052831d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38860/0 (socket says 172.21.15.173:38860) 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.563+0000 7fb6005e7640 1 -- 172.21.15.173:0/1673740422 learned_addr learned my addr 172.21.15.173:0/1673740422 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.564+0000 7fb6005e7640 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56052831d9a0 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.564+0000 7fb6005e7640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x56052831d460 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0001de0 tx=0x7fb5f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.564+0000 7fb4ece09640 1 -- 172.21.15.173:0/1673740422 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0012030 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.564+0000 7fb4ece09640 1 -- 172.21.15.173:0/1673740422 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f001a7a0 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.564+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56052831dc30 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.564+0000 7fb4ece09640 1 -- 172.21.15.173:0/1673740422 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f001aac0 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.564+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605283208e0 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb4ece09640 1 -- 172.21.15.173:0/1673740422 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5f0015020 con 0x560528222b50 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb4ece09640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4e8036950 0x7fb4e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb4ece09640 1 -- 172.21.15.173:0/1673740422 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb5f0020070 con 0x560528222b50 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4e8036950 0x7fb4e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560528226660 0x5605283246a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528324be0 con 0x560528226660 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb600de8640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560528226660 0x5605283246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb600de8640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560528226660 0x5605283246a0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.565+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4e8036950 0x7fb4e8038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8054000 tx=0x7fb5e804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.566+0000 7fb600de8640 1 -- 172.21.15.173:0/1673740422 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f800a4a0 con 0x560528226660 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.566+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528321c70 con 0x560528226660 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.566+0000 7fb600de8640 1 -- 172.21.15.173:0/1673740422 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5f800a4a0 con 0x560528226660 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.566+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528326f40 0x560528329330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.566+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528329a20 con 0x560528326f40 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.566+0000 7fb6005e7640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528326f40 0x560528329330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.566+0000 7fb6005e7640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528326f40 0x560528329330 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.567+0000 7fb6005e7640 1 -- 172.21.15.173:0/1673740422 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb5f0024980 con 0x560528326f40 2024-05-15T18:09:00.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.567+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528325ef0 con 0x560528226660 2024-05-15T18:09:00.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.567+0000 7fb600de8640 1 -- 172.21.15.173:0/1673740422 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5f800a4a0 con 0x560528226660 2024-05-15T18:09:00.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.567+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56052832aed0 0x56052832d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.567+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56052832da80 con 0x56052832aed0 2024-05-15T18:09:00.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.567+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56052832aed0 0x56052832d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.568+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56052832aed0 0x56052832d320 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.568+0000 7fb5f7fff640 1 -- 172.21.15.173:0/1673740422 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb5e805a040 con 0x56052832aed0 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.568+0000 7fb60491f800 1 Processor -- start 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.568+0000 7fb60491f800 1 -- start start 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.568+0000 7fb60491f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56052833be90 0x56052833c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.568+0000 7fb60491f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560528113cf0 con 0x56052833be90 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56052833be90 0x56052833c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56052833be90 0x56052833c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38872/0 (socket says 172.21.15.173:38872) 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb6005e7640 1 -- 172.21.15.173:0/376003915 learned_addr learned my addr 172.21.15.173:0/376003915 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb6005e7640 1 -- 172.21.15.173:0/376003915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56052833c7f0 con 0x56052833be90 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb6005e7640 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56052833be90 0x56052833c2b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb5f001a6f0 tx=0x7fb5f0044500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb4e5ffb640 1 -- 172.21.15.173:0/376003915 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f003c070 con 0x56052833be90 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb4e5ffb640 1 -- 172.21.15.173:0/376003915 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f0044ac0 con 0x56052833be90 2024-05-15T18:09:00.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56052833d260 con 0x56052833be90 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb4e5ffb640 1 -- 172.21.15.173:0/376003915 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f00166e0 con 0x56052833be90 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.569+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56052833d760 con 0x56052833be90 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.570+0000 7fb4e5ffb640 1 -- 172.21.15.173:0/376003915 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5f003f070 con 0x56052833be90 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.570+0000 7fb4e5ffb640 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d80369c0 0x7fb4d8038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.570+0000 7fb4e5ffb640 1 -- 172.21.15.173:0/376003915 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb5f004d020 con 0x56052833be90 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.570+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d80369c0 0x7fb4d8038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb60491f800 1 Processor -- start 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb60491f800 1 -- start start 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d80369c0 0x7fb4d8038e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5605283254f0 tx=0x7fb5e8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb60491f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528349480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb60491f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560528220dd0 con 0x560528349060 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528349480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528349480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38876/0 (socket says 172.21.15.173:38876) 2024-05-15T18:09:00.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb6005e7640 1 -- 172.21.15.173:0/1255340710 learned_addr learned my addr 172.21.15.173:0/1255340710 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb6005e7640 1 -- 172.21.15.173:0/1255340710 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560528349a50 con 0x560528349060 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.571+0000 7fb6005e7640 1 --2- 172.21.15.173:0/1255340710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528349480 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0034fd0 tx=0x7fb5f004c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6830a1b580d05215 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb4df7fe640 1 -- 172.21.15.173:0/1255340710 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0019e00 con 0x560528349060 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb4df7fe640 1 -- 172.21.15.173:0/1255340710 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f0017a40 con 0x560528349060 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb4df7fe640 1 -- 172.21.15.173:0/1255340710 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f002fd30 con 0x560528349060 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 -- 172.21.15.173:0/1255340710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 msgr2=0x560528349480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 --2- 172.21.15.173:0/1255340710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528349480 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0034fd0 tx=0x7fb5f004c240 comp rx=0 tx=0).stop 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 -- 172.21.15.173:0/1255340710 shutdown_connections 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 --2- 172.21.15.173:0/1255340710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528349480 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 -- 172.21.15.173:0/1255340710 >> 172.21.15.173:0/1255340710 conn(0x5605283452e0 msgr2=0x560528343340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 -- 172.21.15.173:0/1255340710 shutdown_connections 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 -- 172.21.15.173:0/1255340710 wait complete. 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 Processor -- start 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 -- start start 2024-05-15T18:09:00.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.572+0000 7fb60491f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528350380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb60491f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56052834a0c0 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528350380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb6005e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528350380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38882/0 (socket says 172.21.15.173:38882) 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 learned_addr learned my addr 172.21.15.173:0/2288395653 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605283508c0 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb6005e7640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528350380 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0006f60 tx=0x7fb5f0006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb4ddffb640 1 -- 172.21.15.173:0/2288395653 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f006f020 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb4ddffb640 1 -- 172.21.15.173:0/2288395653 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f00475d0 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605283508c0 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb4ddffb640 1 -- 172.21.15.173:0/2288395653 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f0017580 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.573+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560528350d60 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.574+0000 7fb4ddffb640 1 -- 172.21.15.173:0/2288395653 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5f0072020 con 0x560528349060 2024-05-15T18:09:00.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.574+0000 7fb4ddffb640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d0036950 0x7fb4d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.574+0000 7fb4ddffb640 1 -- 172.21.15.173:0/2288395653 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb5f0065040 con 0x560528349060 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.574+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d0036950 0x7fb4d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.575+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.575+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d0036950 0x7fb4d0038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56052832de80 tx=0x7fb5e804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.575+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56052835bb60 0x56052835e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.575+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56052835e770 con 0x56052835bb60 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.575+0000 7fb600de8640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56052835bb60 0x56052835e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.575+0000 7fb600de8640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56052835bb60 0x56052835e020 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 realm 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56052835eb80 con 0x56052835bb60 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56052835f450 con 0x56052835bb60 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x56052835bb60 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528360550 0x560528362940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528362f50 con 0x560528360550 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.576+0000 7fb6005e7640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528360550 0x560528362940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb6005e7640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528360550 0x560528362940 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb60491f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb60491f800 20 searching for the correct realm 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560528364880 con 0x560528360550 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb6005e7640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb5f0074020 0x7fb5f001c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560528364880 con 0x7fb5f0074020 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.577+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb5f0074020 0x7fb5f001c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.578+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb5f0074020 0x7fb5f001c0e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.578+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.578+0000 7fb5f7fff640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb5e8074040 0x7fb5e8081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.578+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560528364880 con 0x7fb5e8074040 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.578+0000 7fb600de8640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb5e8074040 0x7fb5e8081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.578+0000 7fb600de8640 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb5e8074040 0x7fb5e8081410 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.579+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb5f800a4a0 con 0x7fb5e8074040 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.579+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x56052835bb60 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.579+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.579+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x56052835bb60 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.579+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.579+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x7fb5e8074040 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.579+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x7fb5e8074040 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x7fb5e8074040 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x7fb5e8074040 2024-05-15T18:09:00.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x7fb5f0074020 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x560528360550 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x56052835bb60 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.580+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x7fb5e8074040 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.581+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x7fb5e8074040 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.581+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x56052835bb60 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.581+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.581+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56052835f7f0 con 0x7fb5f0074020 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.581+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.581+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x560528360550 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x560528360550 2024-05-15T18:09:00.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5e8074040 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x7fb5e8074040 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x560528360550 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.582+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x560528360550 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x56052835bb60 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x56052835bb60 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb5f800a4a0 con 0x56052835bb60 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5e8074040 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f8033040 con 0x7fb5e8074040 2024-05-15T18:09:00.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.583+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x560528360550 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5f0074020 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x56052835bb60 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5e8074040 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.584+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x560528360550 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5e8074040 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5f0074020 2024-05-15T18:09:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x560528360550 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.585+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5e8074040 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x56052835bb60 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7fb5e808e060 con 0x7fb5f0074020 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528363810 con 0x56052835bb60 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.586+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528363c00 con 0x56052835bb60 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528363c00 con 0x7fb5e8074040 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 zone default found 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 4 Realm: () 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 zonegroup default 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528363390 con 0x7fb5e8074040 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.587+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528363390 con 0x560528360550 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb60491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560528366780 con 0x560528360550 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb60491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb60491f800 20 started sync module instance, tier type = 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb60491f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.588+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528365b80 con 0x7fb5f0074020 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.589+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.589+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94580149477232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5605283657e0 con 0x7fb5f0074020 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.589+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5605283676b0 con 0x56052835bb60 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.590+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94580149477232] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.590+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.590+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94580149481984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528367ad0 con 0x56052835bb60 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.590+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528368490 con 0x560528360550 2024-05-15T18:09:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.591+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94580149481984] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.591+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.591+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94580149483040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528367a40 con 0x560528360550 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.591+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528369350 con 0x7fb5f0074020 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.592+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.592+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94580149483040] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.592+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94580149491520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836a010 con 0x7fb5f0074020 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.593+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5605283688c0 con 0x56052835bb60 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.594+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94580149491520] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.594+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.594+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94580149492576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836aa00 con 0x56052835bb60 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.594+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836b3c0 con 0x7fb5e8074040 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.595+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.595+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94580149497616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836b330 con 0x7fb5e8074040 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.595+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836b330 con 0x7fb5e8074040 2024-05-15T18:09:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.595+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94580149492576] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.596+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.596+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94580149501440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836c2d0 con 0x7fb5e8074040 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.596+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836cd10 con 0x7fb5e8074040 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.596+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94580149497616] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94580149501440] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94580149495120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836ccd0 con 0x7fb5e8074040 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 20 add_watcher() i=0 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 20 add_watcher() i=1 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 20 add_watcher() i=2 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 20 add_watcher() i=3 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 20 add_watcher() i=4 2024-05-15T18:09:00.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 20 add_watcher() i=5 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.597+0000 7fb60491f800 20 add_watcher() i=6 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.598+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94580149495120] v29'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.598+0000 7fb60491f800 20 add_watcher() i=7 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.598+0000 7fb60491f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.598+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56052836b7b0 con 0x56052835bb60 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.598+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.598+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94580149503968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836b7b0 con 0x56052835bb60 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.599+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94580149503968] v29'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.599+0000 7fb4b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.599+0000 7fb60491f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.599+0000 7fb60491f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.599+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528378570 con 0x56052835bb60 2024-05-15T18:09:00.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.600+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.601+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528378bc0 con 0x7fb5e8074040 2024-05-15T18:09:00.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.601+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.601+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528379040 con 0x560528360550 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.602+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.602+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5605283793e0 con 0x56052835bb60 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.604+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'114 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.604+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528379950 con 0x7fb5f0074020 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.604+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.605+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528379ec0 con 0x560528360550 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.605+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.605+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528379f50 con 0x56052835bb60 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.607+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.607+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a310 con 0x7fb5e8074040 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.608+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.608+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a310 con 0x7fb5f0074020 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.609+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.609+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a7c0 con 0x560528360550 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.610+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.610+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a7c0 con 0x7fb5f0074020 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.611+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.611+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a7c0 con 0x7fb5e8074040 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.612+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.612+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a7c0 con 0x7fb5f0074020 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.613+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.613+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a890 con 0x7fb5e8074040 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.614+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.614+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a890 con 0x56052835bb60 2024-05-15T18:09:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.615+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.615+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837a890 con 0x560528360550 2024-05-15T18:09:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.616+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.616+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x7fb5f0074020 2024-05-15T18:09:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.617+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.617+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.618+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.618+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x56052835bb60 2024-05-15T18:09:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.619+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.619+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x56052835bb60 2024-05-15T18:09:00.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.620+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'116 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.620+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.621+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.621+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x7fb5f0074020 2024-05-15T18:09:00.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.622+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.622+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.623+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.623+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.624+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.624+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.625+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.625+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.626+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.626+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x7fb5e8074040 2024-05-15T18:09:00.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.627+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.627+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.628+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.628+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x7fb5e8074040 2024-05-15T18:09:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.629+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.629+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x560528360550 2024-05-15T18:09:00.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.630+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.630+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x7fb5e8074040 2024-05-15T18:09:00.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.631+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.631+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052837ad90 con 0x7fb5f0074020 2024-05-15T18:09:00.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb4b57e2640 20 reqs_thread_entry: start 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb60491f800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb60491f800 20 Filter name: none 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb426ffd640 20 reqs_thread_entry: start 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb60491f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb60491f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.632+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5605283a5a40 con 0x7fb5e8074040 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.633+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.633+0000 7fb60491f800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:09:00.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.633+0000 7fb60491f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-15T18:09:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.633+0000 7fb60491f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:09:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.633+0000 7fb60491f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.633+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5605283a8370 con 0x7fb5e8074040 2024-05-15T18:09:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.633+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.611 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-15T18:09:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.634+0000 7fb4b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.634+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94580149503968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528377380 con 0x56052835bb60 2024-05-15T18:09:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.635+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94580149503968] v29'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.635+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94580149477232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836c7e0 con 0x7fb5f0074020 2024-05-15T18:09:00.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.636+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94580149477232] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.636+0000 7fb60491f800 20 remove_watcher() i=0 2024-05-15T18:09:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.636+0000 7fb60491f800 2 removed watcher, disabling cache 2024-05-15T18:09:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.636+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94580149481984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836c7e0 con 0x56052835bb60 2024-05-15T18:09:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.637+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94580149481984] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.637+0000 7fb60491f800 20 remove_watcher() i=1 2024-05-15T18:09:00.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.637+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94580149483040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528367200 con 0x560528360550 2024-05-15T18:09:00.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.638+0000 7fb6005e7640 1 -- 172.21.15.173:0/2288395653 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94580149483040] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f003e030 con 0x560528360550 2024-05-15T18:09:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.638+0000 7fb60491f800 20 remove_watcher() i=2 2024-05-15T18:09:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.638+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94580149491520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836c7e0 con 0x7fb5f0074020 2024-05-15T18:09:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.639+0000 7fb5f7fff640 1 -- 172.21.15.173:0/2288395653 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94580149491520] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5e807f070 con 0x7fb5f0074020 2024-05-15T18:09:00.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.639+0000 7fb60491f800 20 remove_watcher() i=3 2024-05-15T18:09:00.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.639+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94580149492576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560528369740 con 0x56052835bb60 2024-05-15T18:09:00.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.642+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94580149492576] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x56052835bb60 2024-05-15T18:09:00.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.642+0000 7fb60491f800 20 remove_watcher() i=4 2024-05-15T18:09:00.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.642+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94580149497616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836c7e0 con 0x7fb5e8074040 2024-05-15T18:09:00.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.643+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94580149497616] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.643+0000 7fb60491f800 20 remove_watcher() i=5 2024-05-15T18:09:00.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.643+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94580149501440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836af10 con 0x7fb5e8074040 2024-05-15T18:09:00.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.644+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94580149501440] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.644+0000 7fb60491f800 20 remove_watcher() i=6 2024-05-15T18:09:00.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.644+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94580149495120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56052836c7e0 con 0x7fb5e8074040 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94580149495120] v29'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb5f8031040 con 0x7fb5e8074040 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 20 remove_watcher() i=7 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb5e8074040 msgr2=0x7fb5e8081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb5e8074040 0x7fb5e8081410 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56052835bb60 msgr2=0x56052835e020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56052835bb60 0x56052835e020 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb5f0074020 msgr2=0x7fb5f001c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb5f0074020 0x7fb5f001c0e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528360550 msgr2=0x560528362940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528360550 0x560528362940 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d0036950 msgr2=0x7fb4d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d0036950 0x7fb4d0038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x56052832de80 tx=0x7fb5e804f000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 msgr2=0x560528350380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb600de8640 1 -- 172.21.15.173:0/2288395653 reap_dead start 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528350380 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0006f60 tx=0x7fb5f0006ef0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 shutdown_connections 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/2288395653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528349060 0x560528350380 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 >> 172.21.15.173:0/2288395653 conn(0x5605283452e0 msgr2=0x560528342940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 shutdown_connections 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/2288395653 wait complete. 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d80369c0 msgr2=0x7fb4d8038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d80369c0 0x7fb4d8038e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5605283254f0 tx=0x7fb5e8005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:00.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56052833be90 msgr2=0x56052833c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.645+0000 7fb60491f800 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56052833be90 0x56052833c2b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb5f001a6f0 tx=0x7fb5f0044500 comp rx=0 tx=0).stop 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 shutdown_connections 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4d80369c0 0x7fb4d8038e80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 --2- 172.21.15.173:0/376003915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56052833be90 0x56052833c2b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 >> 172.21.15.173:0/376003915 conn(0x56052832ff30 msgr2=0x560528330330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 shutdown_connections 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/376003915 wait complete. 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56052832aed0 msgr2=0x56052832d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56052832aed0 0x56052832d320 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560528226660 msgr2=0x5605283246a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560528226660 0x5605283246a0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528326f40 msgr2=0x560528329330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560528326f40 0x560528329330 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4e8036950 msgr2=0x7fb4e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb4e8036950 0x7fb4e8038e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8054000 tx=0x7fb5e804e000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 msgr2=0x56052831d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 --2- 172.21.15.173:0/1673740422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560528222b50 0x56052831d460 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0001de0 tx=0x7fb5f0000ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb600de8640 1 -- 172.21.15.173:0/1673740422 reap_dead start 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 shutdown_connections 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 >> 172.21.15.173:0/1673740422 conn(0x56052821c5a0 msgr2=0x560528221330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 shutdown_connections 2024-05-15T18:09:00.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.646+0000 7fb60491f800 1 -- 172.21.15.173:0/1673740422 wait complete. 2024-05-15T18:09:00.631 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-15T18:09:00.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-15T18:09:00.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-15T18:09:00.632 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-05-15T18:09:00.678 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:00.678 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.702+0000 7fc4b1136800 1 Processor -- start 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.702+0000 7fc4b1136800 1 -- start start 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.702+0000 7fc4b1136800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d236ffba10 0x55d236ffbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.702+0000 7fc4b1136800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d236f70a50 con 0x55d236ffc370 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.702+0000 7fc4b1136800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55d236e8e050 con 0x55d236ffba10 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.703+0000 7fc4acecc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d236ffba10 0x55d236ffbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.703+0000 7fc4a46cb640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55d236ffc370 0x55d236ffc820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57096/0 (socket says 172.21.15.173:57096) 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.703+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1771383640 learned_addr learned my addr 172.21.15.173:0/1771383640 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.703+0000 7fc4acecc640 1 -- 172.21.15.173:0/1771383640 >> v1:172.21.15.3:6789/0 conn(0x55d236ffc370 legacy=0x55d236ffc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.703+0000 7fc4acecc640 1 -- 172.21.15.173:0/1771383640 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d236ffcf30 con 0x55d236ffba10 2024-05-15T18:09:00.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.705+0000 7fc4acecc640 1 --2- 172.21.15.173:0/1771383640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d236ffbe30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00a470 tx=0x7fc49c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c284d3aa3555d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.705+0000 7fc4a7fff640 1 -- 172.21.15.173:0/1771383640 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c057070 con 0x55d236ffba10 2024-05-15T18:09:00.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.705+0000 7fc4a7fff640 1 -- 172.21.15.173:0/1771383640 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c052570 con 0x55d236ffba10 2024-05-15T18:09:00.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.705+0000 7fc4a7fff640 1 -- 172.21.15.173:0/1771383640 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c052870 con 0x55d236ffba10 2024-05-15T18:09:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.705+0000 7fc4b1136800 1 -- 172.21.15.173:0/1771383640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 msgr2=0x55d236ffbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.705+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1771383640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d236ffbe30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00a470 tx=0x7fc49c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.706+0000 7fc4b1136800 1 -- 172.21.15.173:0/1771383640 shutdown_connections 2024-05-15T18:09:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.706+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1771383640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d236ffbe30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.706+0000 7fc4b1136800 1 -- 172.21.15.173:0/1771383640 >> 172.21.15.173:0/1771383640 conn(0x55d236ff7570 msgr2=0x55d236ff9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.706+0000 7fc4b1136800 1 -- 172.21.15.173:0/1771383640 shutdown_connections 2024-05-15T18:09:00.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.706+0000 7fc4b1136800 1 -- 172.21.15.173:0/1771383640 wait complete. 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.719+0000 7fc4b1136800 1 Processor -- start 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.719+0000 7fc4b1136800 1 -- start start 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.719+0000 7fc4b1136800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.719+0000 7fc4b1136800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d236f481c0 con 0x55d236ffba10 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.720+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.720+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38902/0 (socket says 172.21.15.173:38902) 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.720+0000 7fc4acecc640 1 -- 172.21.15.173:0/3048294813 learned_addr learned my addr 172.21.15.173:0/3048294813 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.720+0000 7fc4acecc640 1 -- 172.21.15.173:0/3048294813 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2370f1100 con 0x55d236ffba10 2024-05-15T18:09:00.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.720+0000 7fc4acecc640 1 --2- 172.21.15.173:0/3048294813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f0b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc49c055040 tx=0x7fc49c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794a636d20638ad0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.720+0000 7fc39ae0d640 1 -- 172.21.15.173:0/3048294813 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c057040 con 0x55d236ffba10 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc39ae0d640 1 -- 172.21.15.173:0/3048294813 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c052990 con 0x55d236ffba10 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc39ae0d640 1 -- 172.21.15.173:0/3048294813 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c052c70 con 0x55d236ffba10 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc4b1136800 1 -- 172.21.15.173:0/3048294813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 msgr2=0x55d2370f0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc4b1136800 1 --2- 172.21.15.173:0/3048294813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f0b30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc49c055040 tx=0x7fc49c04c000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc4b1136800 1 -- 172.21.15.173:0/3048294813 shutdown_connections 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc4b1136800 1 --2- 172.21.15.173:0/3048294813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f0b30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc4b1136800 1 -- 172.21.15.173:0/3048294813 >> 172.21.15.173:0/3048294813 conn(0x55d236ff7570 msgr2=0x55d2370ec450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc4b1136800 1 -- 172.21.15.173:0/3048294813 shutdown_connections 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.721+0000 7fc4b1136800 1 -- 172.21.15.173:0/3048294813 wait complete. 2024-05-15T18:09:00.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4b1136800 1 Processor -- start 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4b1136800 1 -- start start 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4b1136800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4b1136800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d236ffd460 con 0x55d236ffba10 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38910/0 (socket says 172.21.15.173:38910) 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4acecc640 1 -- 172.21.15.173:0/2173645596 learned_addr learned my addr 172.21.15.173:0/2173645596 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4acecc640 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2370f8b90 con 0x55d236ffba10 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.722+0000 7fc4acecc640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f8650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00a470 tx=0x7fc49c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.723+0000 7fc39960a640 1 -- 172.21.15.173:0/2173645596 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c073070 con 0x55d236ffba10 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.723+0000 7fc39960a640 1 -- 172.21.15.173:0/2173645596 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c05d650 con 0x55d236ffba10 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.723+0000 7fc39960a640 1 -- 172.21.15.173:0/2173645596 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c057070 con 0x55d236ffba10 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.723+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2370f8e20 con 0x55d236ffba10 2024-05-15T18:09:00.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.723+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2370fba30 con 0x55d236ffba10 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.723+0000 7fc39960a640 1 -- 172.21.15.173:0/2173645596 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc49c076070 con 0x55d236ffba10 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc39960a640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc394036900 0x7fc394038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc39960a640 1 -- 172.21.15.173:0/2173645596 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc49c08dda0 con 0x55d236ffba10 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc394036900 0x7fc394038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d236ffc370 0x55d2370ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d2370ffd80 con 0x55d236ffc370 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc4ad6cd640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d236ffc370 0x55d2370ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc394036900 0x7fc394038dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc494000f60 tx=0x7fc4940012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.724+0000 7fc4ad6cd640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d236ffc370 0x55d2370ff7f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.725+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/2173645596 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d236ffc370 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.725+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d2370fcdc0 con 0x55d236ffc370 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.725+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/2173645596 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d236ffc370 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.725+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d2371020d0 0x55d2371044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.725+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237104bb0 con 0x55d2371020d0 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.725+0000 7fc4acecc640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d2371020d0 0x55d2371044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.725+0000 7fc4acecc640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d2371020d0 0x55d2371044c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.726+0000 7fc4acecc640 1 -- 172.21.15.173:0/2173645596 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc49c075030 con 0x55d2371020d0 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.726+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237101080 con 0x55d236ffc370 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.726+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/2173645596 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d236ffc370 2024-05-15T18:09:00.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.726+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d237106060 0x55d2371084b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.726+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237108c10 con 0x55d237106060 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.726+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d237106060 0x55d2371084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.726+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d237106060 0x55d2371084b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4a46cb640 1 -- 172.21.15.173:0/2173645596 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc494009050 con 0x55d237106060 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4b1136800 1 Processor -- start 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4b1136800 1 -- start start 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4b1136800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237117070 0x55d237117490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4b1136800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d236eeecf0 con 0x55d237117070 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237117070 0x55d237117490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237117070 0x55d237117490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38912/0 (socket says 172.21.15.173:38912) 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.727+0000 7fc4acecc640 1 -- 172.21.15.173:0/794060209 learned_addr learned my addr 172.21.15.173:0/794060209 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.728+0000 7fc4acecc640 1 -- 172.21.15.173:0/794060209 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2371179d0 con 0x55d237117070 2024-05-15T18:09:00.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.728+0000 7fc4acecc640 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237117070 0x55d237117490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc49c066fd0 tx=0x7fc49c05cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.728+0000 7fc3927fc640 1 -- 172.21.15.173:0/794060209 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c05ea70 con 0x55d237117070 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.728+0000 7fc3927fc640 1 -- 172.21.15.173:0/794060209 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c08f020 con 0x55d237117070 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.728+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d237118440 con 0x55d237117070 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.728+0000 7fc3927fc640 1 -- 172.21.15.173:0/794060209 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c05ed40 con 0x55d237117070 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.728+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d237118940 con 0x55d237117070 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.729+0000 7fc3927fc640 1 -- 172.21.15.173:0/794060209 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc49c0773b0 con 0x55d237117070 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.729+0000 7fc3927fc640 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc384036950 0x7fc384038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.729+0000 7fc3927fc640 1 -- 172.21.15.173:0/794060209 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc49c090030 con 0x55d237117070 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.729+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc384036950 0x7fc384038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.729+0000 7fc4b1136800 1 Processor -- start 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.729+0000 7fc4b1136800 1 -- start start 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.729+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc384036950 0x7fc384038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc49400bf50 tx=0x7fc49400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc4b1136800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d2371245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc4b1136800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d2370f13c0 con 0x55d237124190 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d2371245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d2371245b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38914/0 (socket says 172.21.15.173:38914) 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc4acecc640 1 -- 172.21.15.173:0/1614997643 learned_addr learned my addr 172.21.15.173:0/1614997643 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc4acecc640 1 -- 172.21.15.173:0/1614997643 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d237124b80 con 0x55d237124190 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc4acecc640 1 --2- 172.21.15.173:0/1614997643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d2371245b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc49c09bfd0 tx=0x7fc49c077810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fee099ee9bc7d8c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc383fff640 1 -- 172.21.15.173:0/1614997643 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c076490 con 0x55d237124190 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc383fff640 1 -- 172.21.15.173:0/1614997643 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c05dca0 con 0x55d237124190 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.730+0000 7fc383fff640 1 -- 172.21.15.173:0/1614997643 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c078440 con 0x55d237124190 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 -- 172.21.15.173:0/1614997643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 msgr2=0x55d2371245b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1614997643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d2371245b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc49c09bfd0 tx=0x7fc49c077810 comp rx=0 tx=0).stop 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 -- 172.21.15.173:0/1614997643 shutdown_connections 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1614997643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d2371245b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 -- 172.21.15.173:0/1614997643 >> 172.21.15.173:0/1614997643 conn(0x55d2371204f0 msgr2=0x55d23711e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 -- 172.21.15.173:0/1614997643 shutdown_connections 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 -- 172.21.15.173:0/1614997643 wait complete. 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 Processor -- start 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 -- start start 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d23712b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.731+0000 7fc4b1136800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d237125230 con 0x55d237124190 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d23712b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc4acecc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d23712b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38928/0 (socket says 172.21.15.173:38928) 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 learned_addr learned my addr 172.21.15.173:0/1824507080 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d23712ba70 con 0x55d237124190 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc4acecc640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d23712b530 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc49c006c60 tx=0x7fc49c09bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc3827fc640 1 -- 172.21.15.173:0/1824507080 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c076360 con 0x55d237124190 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc3827fc640 1 -- 172.21.15.173:0/1824507080 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c07a5a0 con 0x55d237124190 2024-05-15T18:09:00.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc3827fc640 1 -- 172.21.15.173:0/1824507080 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc49c076500 con 0x55d237124190 2024-05-15T18:09:00.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d23712ba70 con 0x55d237124190 2024-05-15T18:09:00.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.732+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d23712ba70 con 0x55d237124190 2024-05-15T18:09:00.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.733+0000 7fc3827fc640 1 -- 172.21.15.173:0/1824507080 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc49c0ba020 con 0x55d237124190 2024-05-15T18:09:00.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.733+0000 7fc3827fc640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc378036950 0x7fc378038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.733+0000 7fc3827fc640 1 -- 172.21.15.173:0/1824507080 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc49c0b8020 con 0x55d237124190 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc378036950 0x7fc378038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d237136c70 0x55d237139130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237139880 con 0x55d237136c70 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4ad6cd640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d237136c70 0x55d237139130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc378036950 0x7fc378038e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc494001b60 tx=0x7fc494010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4ad6cd640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d237136c70 0x55d237139130 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.734+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 realm 2024-05-15T18:09:00.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237139c90 con 0x55d237136c70 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a560 con 0x55d237136c70 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d23713b660 0x55d23713da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23713e060 con 0x55d23713b660 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.735+0000 7fc4acecc640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d23713b660 0x55d23713da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4acecc640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d23713b660 0x55d23713da50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4b1136800 20 searching for the correct realm 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713f990 con 0x55d23713b660 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4acecc640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc49c078060 0x7fc49c094800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.736+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713f990 con 0x7fc49c078060 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.737+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc49c078060 0x7fc49c094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.737+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc49c078060 0x7fc49c094800 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.737+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494009050 con 0x7fc49c078060 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.737+0000 7fc4a46cb640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc494038040 0x7fc49401bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.737+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713f990 con 0x7fc494038040 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.737+0000 7fc4ad6cd640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc494038040 0x7fc49401bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.738+0000 7fc4ad6cd640 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc494038040 0x7fc49401bab0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.738+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4a800a4a0 con 0x7fc494038040 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.738+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.738+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.738+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.738+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.738+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x7fc494038040 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x7fc494038040 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc49c078060 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494009050 con 0x7fc49c078060 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.739+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.740+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.740+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x7fc494038040 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.740+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.740+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.740+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc49c078060 2024-05-15T18:09:00.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.740+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc494009050 con 0x7fc49c078060 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.740+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x7fc494038040 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.741+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4a800a4a0 con 0x55d237136c70 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8033040 con 0x7fc494038040 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.742+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.743+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.743+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc49c078060 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.743+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494009050 con 0x7fc49c078060 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.743+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.743+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.743+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc49c078060 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494009050 con 0x7fc49c078060 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.744+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d23713b660 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.745+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.745+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc494038040 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.745+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.745+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x55d237136c70 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.745+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.745+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d23713a900 con 0x7fc49c078060 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:00.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23713e920 con 0x55d237136c70 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23713ed10 con 0x55d237136c70 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23713ed10 con 0x7fc494038040 2024-05-15T18:09:00.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 zone default found 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 4 Realm: () 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 zonegroup default 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.746+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23713fe10 con 0x7fc494038040 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d2371417f0 con 0x55d23713b660 2024-05-15T18:09:00.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237141b90 con 0x55d23713b660 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 20 started sync module instance, tier type = 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.747+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237140c90 con 0x7fc49c078060 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.748+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.748+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94361355552736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237141f30 con 0x7fc49c078060 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.748+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237142780 con 0x55d237136c70 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.749+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94361355552736] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.750+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.750+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94361355559632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371426f0 con 0x55d237136c70 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.750+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237143540 con 0x55d23713b660 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.751+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.751+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94361355563088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237143e10 con 0x55d23713b660 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.751+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371448c0 con 0x7fc49c078060 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.751+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94361355559632] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.752+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94361355563088] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.752+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.752+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94361355561888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237144ce0 con 0x7fc49c078060 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.752+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371455b0 con 0x55d237136c70 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.753+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94361355561888] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.753+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.753+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94361355571328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371459a0 con 0x55d237136c70 2024-05-15T18:09:00.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.753+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371463a0 con 0x7fc494038040 2024-05-15T18:09:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.754+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94361355571328] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.754+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.754+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94361355568080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237146360 con 0x7fc494038040 2024-05-15T18:09:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.754+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237146de0 con 0x7fc494038040 2024-05-15T18:09:00.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.755+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94361355568080] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.755+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.755+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94361355578128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237146360 con 0x7fc494038040 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.755+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371477f0 con 0x7fc494038040 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.756+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.756+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94361355578128] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.756+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94361355580224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237147760 con 0x7fc494038040 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=0 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=1 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=2 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=3 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=4 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=5 2024-05-15T18:09:00.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=6 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94361355580224] v29'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 20 add_watcher() i=7 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.757+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23714abf0 con 0x55d237136c70 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.758+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.758+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94361355574960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371480b0 con 0x55d237136c70 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94361355574960] v29'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc362fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 5 note: GC not initialized 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc361fe3640 20 reqs_thread_entry: start 2024-05-15T18:09:00.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 20 Filter name: none 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc2d37fe640 20 reqs_thread_entry: start 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.759+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d23717e100 con 0x7fc494038040 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237180080 con 0x7fc49c078060 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.760+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237181d20 con 0x7fc494038040 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(64 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:00.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.761+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237185440 con 0x7fc494038040 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.762+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(65 fud.buckets [call] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.762+0000 7fc4b1136800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.762+0000 7fc4b1136800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.762+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237184470 con 0x7fc49c078060 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.763+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.763+0000 7fc4b1136800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.763+0000 7fc4b1136800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.763+0000 7fc4b1136800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.763+0000 7fc4b1136800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.763+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237188ef0 con 0x7fc49c078060 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v29'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc4b1136800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-15T18:09:00.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc4b1136800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc4b1136800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94361355848032 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d237185d10 con 0x7fc494038040 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== watch-notify(notify (1) cookie 94361355578128 notify 124554051590 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55d237182110 con 0x7fc494038040 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc383fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051590 cookie 94361355578128 notifier 4510 bl.length()=338 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(68 notify.6 [notify cookie 94361355848032 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc383fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc383fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.764+0000 7fc383fff640 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fc370003ea0 con 0x7fc494038040 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.765+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== watch-notify(notify_complete (2) cookie 94361355848032 notify 124554051590 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d237181430 con 0x7fc494038040 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.765+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.765+0000 7fc362fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.765+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94361355574960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237188960 con 0x55d237136c70 2024-05-15T18:09:00.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.766+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94361355574960] v29'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.766+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94361355552736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237188960 con 0x7fc49c078060 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.767+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94361355552736] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.767+0000 7fc4b1136800 20 remove_watcher() i=0 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.767+0000 7fc4b1136800 2 removed watcher, disabling cache 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.767+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94361355559632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371407e0 con 0x55d237136c70 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.768+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94361355559632] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.769+0000 7fc4b1136800 20 remove_watcher() i=1 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.769+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94361355563088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237188960 con 0x55d23713b660 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.769+0000 7fc4acecc640 1 -- 172.21.15.173:0/1824507080 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94361355563088] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc49c075030 con 0x55d23713b660 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.769+0000 7fc4b1136800 20 remove_watcher() i=2 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.769+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94361355561888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371422d0 con 0x7fc49c078060 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.771+0000 7fc4a46cb640 1 -- 172.21.15.173:0/1824507080 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94361355561888] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc494045040 con 0x7fc49c078060 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.771+0000 7fc4b1136800 20 remove_watcher() i=3 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.771+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94361355571328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237143050 con 0x55d237136c70 2024-05-15T18:09:00.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.772+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94361355571328] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x55d237136c70 2024-05-15T18:09:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.772+0000 7fc4b1136800 20 remove_watcher() i=4 2024-05-15T18:09:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.772+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94361355568080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237188960 con 0x7fc494038040 2024-05-15T18:09:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.773+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94361355568080] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.773+0000 7fc4b1136800 20 remove_watcher() i=5 2024-05-15T18:09:00.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.773+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94361355578128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d237142ba0 con 0x7fc494038040 2024-05-15T18:09:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.773+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94361355578128] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.773+0000 7fc4b1136800 20 remove_watcher() i=6 2024-05-15T18:09:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.774+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94361355580224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d2371422d0 con 0x7fc494038040 2024-05-15T18:09:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.774+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94361355580224] v29'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4a8031040 con 0x7fc494038040 2024-05-15T18:09:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.774+0000 7fc4b1136800 20 remove_watcher() i=7 2024-05-15T18:09:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc494038040 msgr2=0x7fc49401bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc494038040 0x7fc49401bab0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d237136c70 msgr2=0x55d237139130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d237136c70 0x55d237139130 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc49c078060 msgr2=0x7fc49c094800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc49c078060 0x7fc49c094800 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d23713b660 msgr2=0x55d23713da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d23713b660 0x55d23713da50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc378036950 msgr2=0x7fc378038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc378036950 0x7fc378038e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc494001b60 tx=0x7fc494010000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 msgr2=0x55d23712b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/1824507080 reap_dead start 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d23712b530 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc49c006c60 tx=0x7fc49c09bea0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 shutdown_connections 2024-05-15T18:09:00.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/1824507080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237124190 0x55d23712b530 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 >> 172.21.15.173:0/1824507080 conn(0x55d2371204f0 msgr2=0x55d23711db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 shutdown_connections 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/1824507080 wait complete. 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc384036950 msgr2=0x7fc384038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc384036950 0x7fc384038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc49400bf50 tx=0x7fc49400f000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237117070 msgr2=0x55d237117490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237117070 0x55d237117490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc49c066fd0 tx=0x7fc49c05cf60 comp rx=0 tx=0).stop 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 shutdown_connections 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc384036950 0x7fc384038e10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 --2- 172.21.15.173:0/794060209 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d237117070 0x55d237117490 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 >> 172.21.15.173:0/794060209 conn(0x55d23710b110 msgr2=0x55d23710b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 shutdown_connections 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.775+0000 7fc4b1136800 1 -- 172.21.15.173:0/794060209 wait complete. 2024-05-15T18:09:00.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d237106060 msgr2=0x55d2371084b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d237106060 0x55d2371084b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d236ffc370 msgr2=0x55d2370ff7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d236ffc370 0x55d2370ff7f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d2371020d0 msgr2=0x55d2371044c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d2371020d0 0x55d2371044c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc394036900 msgr2=0x7fc394038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc394036900 0x7fc394038dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc494000f60 tx=0x7fc4940012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 msgr2=0x55d2370f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 --2- 172.21.15.173:0/2173645596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d236ffba10 0x55d2370f8650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00a470 tx=0x7fc49c003020 comp rx=0 tx=0).stop 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4ad6cd640 1 -- 172.21.15.173:0/2173645596 reap_dead start 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 shutdown_connections 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 >> 172.21.15.173:0/2173645596 conn(0x55d236ff7570 msgr2=0x55d2370eac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 shutdown_connections 2024-05-15T18:09:00.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.776+0000 7fc4b1136800 1 -- 172.21.15.173:0/2173645596 wait complete. 2024-05-15T18:09:00.764 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1'] 2024-05-15T18:09:00.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1'] 2024-05-15T18:09:00.765 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:00.812 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb268687800 1 Processor -- start 2024-05-15T18:09:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb268687800 1 -- start start 2024-05-15T18:09:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb268687800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55efe24749d0 0x55efe2472ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb268687800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efe2473940 con 0x55efe2473420 2024-05-15T18:09:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb268687800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55efe2390050 con 0x55efe24749d0 2024-05-15T18:09:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb266186640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55efe24749d0 0x55efe2472ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb266186640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55efe24749d0 0x55efe2472ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38942/0 (socket says 172.21.15.173:38942) 2024-05-15T18:09:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb266186640 1 -- 172.21.15.173:0/156103950 learned_addr learned my addr 172.21.15.173:0/156103950 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb265985640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55efe2473420 0x55efe2506ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57104/0 (socket says 172.21.15.173:57104) 2024-05-15T18:09:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb266186640 1 -- 172.21.15.173:0/156103950 >> v1:172.21.15.3:6789/0 conn(0x55efe2473420 legacy=0x55efe2506ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.837+0000 7fb266186640 1 -- 172.21.15.173:0/156103950 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe2473b60 con 0x55efe24749d0 2024-05-15T18:09:00.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.839+0000 7fb266186640 1 --2- 172.21.15.173:0/156103950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe24749d0 0x55efe2472ee0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb25800a520 tx=0x7fb25801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd09ccba289c731a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.839+0000 7fb265184640 1 -- 172.21.15.173:0/156103950 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb258057070 con 0x55efe24749d0 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.839+0000 7fb265184640 1 -- 172.21.15.173:0/156103950 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb258052570 con 0x55efe24749d0 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.839+0000 7fb265184640 1 -- 172.21.15.173:0/156103950 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25804ae60 con 0x55efe24749d0 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.840+0000 7fb268687800 1 -- 172.21.15.173:0/156103950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe24749d0 msgr2=0x55efe2472ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.840+0000 7fb268687800 1 --2- 172.21.15.173:0/156103950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe24749d0 0x55efe2472ee0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb25800a520 tx=0x7fb25801d010 comp rx=0 tx=0).stop 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.840+0000 7fb268687800 1 -- 172.21.15.173:0/156103950 shutdown_connections 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.840+0000 7fb268687800 1 --2- 172.21.15.173:0/156103950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe24749d0 0x55efe2472ee0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.840+0000 7fb268687800 1 -- 172.21.15.173:0/156103950 >> 172.21.15.173:0/156103950 conn(0x55efe24fa7a0 msgr2=0x55efe24fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.840+0000 7fb268687800 1 -- 172.21.15.173:0/156103950 shutdown_connections 2024-05-15T18:09:00.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.840+0000 7fb268687800 1 -- 172.21.15.173:0/156103950 wait complete. 2024-05-15T18:09:00.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb268687800 1 Processor -- start 2024-05-15T18:09:00.831 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb268687800 1 -- start start 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb268687800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25f2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb268687800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55efe244a1f0 con 0x55efe2473420 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38956/0 (socket says 172.21.15.173:38956) 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb266186640 1 -- 172.21.15.173:0/3559756409 learned_addr learned my addr 172.21.15.173:0/3559756409 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.854+0000 7fb266186640 1 -- 172.21.15.173:0/3559756409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe25f2f60 con 0x55efe2473420 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.855+0000 7fb266186640 1 --2- 172.21.15.173:0/3559756409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25f2990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb258055040 tx=0x7fb25804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa8ef2a27383ec9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.855+0000 7fb154608640 1 -- 172.21.15.173:0/3559756409 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb258057040 con 0x55efe2473420 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.855+0000 7fb154608640 1 -- 172.21.15.173:0/3559756409 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb258052720 con 0x55efe2473420 2024-05-15T18:09:00.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.855+0000 7fb154608640 1 -- 172.21.15.173:0/3559756409 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb258052a20 con 0x55efe2473420 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 -- 172.21.15.173:0/3559756409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 msgr2=0x55efe25f2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 --2- 172.21.15.173:0/3559756409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25f2990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb258055040 tx=0x7fb25804c000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 -- 172.21.15.173:0/3559756409 shutdown_connections 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 --2- 172.21.15.173:0/3559756409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25f2990 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 -- 172.21.15.173:0/3559756409 >> 172.21.15.173:0/3559756409 conn(0x55efe24fa7a0 msgr2=0x55efe25ee2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 -- 172.21.15.173:0/3559756409 shutdown_connections 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 -- 172.21.15.173:0/3559756409 wait complete. 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 Processor -- start 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 -- start start 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb268687800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55efe250a930 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25fa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38962/0 (socket says 172.21.15.173:38962) 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.856+0000 7fb266186640 1 -- 172.21.15.173:0/3822102078 learned_addr learned my addr 172.21.15.173:0/3822102078 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.857+0000 7fb266186640 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe25fa8f0 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.857+0000 7fb266186640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25fa3b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb25800a520 tx=0x7fb258003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.857+0000 7fb152e05640 1 -- 172.21.15.173:0/3822102078 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb258073070 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.857+0000 7fb152e05640 1 -- 172.21.15.173:0/3822102078 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25805d440 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.857+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efe25fab80 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.857+0000 7fb152e05640 1 -- 172.21.15.173:0/3822102078 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb258057070 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.857+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efe25fd830 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb152e05640 1 -- 172.21.15.173:0/3822102078 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb258076070 con 0x55efe2473420 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb152e05640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb14c036950 0x7fb14c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb152e05640 1 -- 172.21.15.173:0/3822102078 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb25808daa0 con 0x55efe2473420 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb265985640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb14c036950 0x7fb14c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe24749d0 0x55efe26015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2601b70 con 0x55efe24749d0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb266987640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe24749d0 0x55efe26015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.858+0000 7fb265985640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb14c036950 0x7fb14c038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000f60 tx=0x7fb25c001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb266987640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe24749d0 0x55efe26015f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb266987640 1 -- 172.21.15.173:0/3822102078 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe24749d0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe25feba0 con 0x55efe24749d0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb266987640 1 -- 172.21.15.173:0/3822102078 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe24749d0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe2603e80 0x55efe2606270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2606960 con 0x55efe2603e80 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb266186640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe2603e80 0x55efe2606270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.859+0000 7fb266186640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe2603e80 0x55efe2606270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.860+0000 7fb266186640 1 -- 172.21.15.173:0/3822102078 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb258075030 con 0x55efe2603e80 2024-05-15T18:09:00.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.860+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2602e30 con 0x55efe24749d0 2024-05-15T18:09:00.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.860+0000 7fb266987640 1 -- 172.21.15.173:0/3822102078 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe24749d0 2024-05-15T18:09:00.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.860+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55efe2607e10 0x55efe260a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.860+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe260a9c0 con 0x55efe2607e10 2024-05-15T18:09:00.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.860+0000 7fb265985640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55efe2607e10 0x55efe260a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.861+0000 7fb265985640 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55efe2607e10 0x55efe260a260 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.861+0000 7fb265985640 1 -- 172.21.15.173:0/3822102078 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb25c00f690 con 0x55efe2607e10 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.861+0000 7fb268687800 1 Processor -- start 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.861+0000 7fb268687800 1 -- start start 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.861+0000 7fb268687800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2618e20 0x55efe2619240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.861+0000 7fb268687800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55efe23f0cf0 con 0x55efe2618e20 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2618e20 0x55efe2619240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2618e20 0x55efe2619240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38966/0 (socket says 172.21.15.173:38966) 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb266186640 1 -- 172.21.15.173:0/3812677234 learned_addr learned my addr 172.21.15.173:0/3812677234 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb266186640 1 -- 172.21.15.173:0/3812677234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe2619780 con 0x55efe2618e20 2024-05-15T18:09:00.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb266186640 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2618e20 0x55efe2619240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb258052a70 tx=0x7fb258007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb14bfff640 1 -- 172.21.15.173:0/3812677234 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb258092070 con 0x55efe2618e20 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb14bfff640 1 -- 172.21.15.173:0/3812677234 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb258089030 con 0x55efe2618e20 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb14bfff640 1 -- 172.21.15.173:0/3812677234 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2580773b0 con 0x55efe2618e20 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efe261a1f0 con 0x55efe2618e20 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.862+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efe261a6f0 con 0x55efe2618e20 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.863+0000 7fb14bfff640 1 -- 172.21.15.173:0/3812677234 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb258095070 con 0x55efe2618e20 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.863+0000 7fb14bfff640 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb140036950 0x7fb140038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.863+0000 7fb14bfff640 1 -- 172.21.15.173:0/3812677234 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb25808de00 con 0x55efe2618e20 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.863+0000 7fb265985640 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb140036950 0x7fb140038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb268687800 1 Processor -- start 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb268687800 1 -- start start 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb265985640 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb140036950 0x7fb140038e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55efe2602430 tx=0x7fb25c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb268687800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe2626380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb268687800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55efe25f3220 con 0x55efe2625f60 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe2626380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe2626380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38980/0 (socket says 172.21.15.173:38980) 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.864+0000 7fb266186640 1 -- 172.21.15.173:0/3816927814 learned_addr learned my addr 172.21.15.173:0/3816927814 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb266186640 1 -- 172.21.15.173:0/3816927814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe2626950 con 0x55efe2625f60 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb266186640 1 --2- 172.21.15.173:0/3816927814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe2626380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb258008370 tx=0x7fb25808a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4cabd29a16a44d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb149ffb640 1 -- 172.21.15.173:0/3816927814 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2580a9070 con 0x55efe2625f60 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb149ffb640 1 -- 172.21.15.173:0/3816927814 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25808d040 con 0x55efe2625f60 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb149ffb640 1 -- 172.21.15.173:0/3816927814 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb258090120 con 0x55efe2625f60 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb268687800 1 -- 172.21.15.173:0/3816927814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 msgr2=0x55efe2626380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb268687800 1 --2- 172.21.15.173:0/3816927814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe2626380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb258008370 tx=0x7fb25808a970 comp rx=0 tx=0).stop 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb268687800 1 -- 172.21.15.173:0/3816927814 shutdown_connections 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb268687800 1 --2- 172.21.15.173:0/3816927814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe2626380 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb268687800 1 -- 172.21.15.173:0/3816927814 >> 172.21.15.173:0/3816927814 conn(0x55efe2622270 msgr2=0x55efe26202d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb268687800 1 -- 172.21.15.173:0/3816927814 shutdown_connections 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.865+0000 7fb268687800 1 -- 172.21.15.173:0/3816927814 wait complete. 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb268687800 1 Processor -- start 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb268687800 1 -- start start 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb268687800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe262d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb268687800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55efe2626fe0 con 0x55efe2625f60 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe262d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb266186640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe262d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38992/0 (socket says 172.21.15.173:38992) 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 learned_addr learned my addr 172.21.15.173:0/2440831292 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efe262d8b0 con 0x55efe2625f60 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.866+0000 7fb266186640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe262d370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb258008370 tx=0x7fb258080eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.867+0000 7fb137fff640 1 -- 172.21.15.173:0/2440831292 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2580b4070 con 0x55efe2625f60 2024-05-15T18:09:00.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.867+0000 7fb137fff640 1 -- 172.21.15.173:0/2440831292 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25808a460 con 0x55efe2625f60 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.867+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efe262d8b0 con 0x55efe2625f60 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.867+0000 7fb137fff640 1 -- 172.21.15.173:0/2440831292 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2580a9040 con 0x55efe2625f60 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.867+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efe262d8b0 con 0x55efe2625f60 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.867+0000 7fb137fff640 1 -- 172.21.15.173:0/2440831292 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb25808d570 con 0x55efe2625f60 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb137fff640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb130036900 0x7fb130038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb137fff640 1 -- 172.21.15.173:0/2440831292 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb2580b6910 con 0x55efe2625f60 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb265985640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb130036900 0x7fb130038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb265985640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb130036900 0x7fb130038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55efe260adc0 tx=0x7fb25c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe2638a60 0x55efe263af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe263b670 con 0x55efe2638a60 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.868+0000 7fb266987640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe2638a60 0x55efe263af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb266987640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe2638a60 0x55efe263af20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 20 realm 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe263ba80 con 0x55efe2638a60 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c350 con 0x55efe2638a60 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.869+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb268687800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe263d450 0x55efe263f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe263fe50 con 0x55efe263d450 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb266186640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe263d450 0x55efe263f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb266186640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe263d450 0x55efe263f840 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb268687800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb268687800 20 searching for the correct realm 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.870+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe2641780 con 0x55efe263d450 2024-05-15T18:09:00.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb266186640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb25807a490 0x7fb25804b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe2641780 con 0x7fb25807a490 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb265985640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb25807a490 0x7fb25804b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb265985640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb25807a490 0x7fb25804b7c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb265985640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb25c00f070 0x7fb25c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.871+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe2641780 con 0x7fb25c00f070 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.872+0000 7fb266987640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb25c00f070 0x7fb25c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.872+0000 7fb266987640 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb25c00f070 0x7fb25c02e910 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.872+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb26000a4a0 con 0x7fb25c00f070 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.872+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x7fb25c00f070 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x7fb25c00f070 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.873+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25807a490 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.874+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.874+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.874+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.874+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.874+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.874+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x7fb25c00f070 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25807a490 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.875+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x7fb25c00f070 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.876+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.877+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.877+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.877+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb26000a4a0 con 0x55efe2638a60 2024-05-15T18:09:00.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.877+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.877+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260033040 con 0x7fb25c00f070 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.877+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.877+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25807a490 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.878+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.879+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.879+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.879+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25807a490 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.879+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.879+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe263d450 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.879+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.879+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25c00f070 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x55efe2638a60 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55efe263c6f0 con 0x7fb25807a490 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:00.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2640710 con 0x55efe2638a60 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.880+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2640b00 con 0x55efe2638a60 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2640b00 con 0x7fb25c00f070 2024-05-15T18:09:00.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 zone default found 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 4 Realm: () 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 zonegroup default 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2641c00 con 0x7fb25c00f070 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe26435e0 con 0x55efe263d450 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.881+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb268687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2643980 con 0x55efe263d450 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb268687800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb268687800 20 started sync module instance, tier type = 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb268687800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.882+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2642a80 con 0x7fb25807a490 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.883+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.883+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94488783758800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2643d20 con 0x7fb25807a490 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.883+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2644570 con 0x55efe2638a60 2024-05-15T18:09:00.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.884+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94488783758800] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.884+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.884+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94488783765696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe26444e0 con 0x55efe2638a60 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.884+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2645470 con 0x55efe263d450 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.886+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.886+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94488783769472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2645d10 con 0x55efe263d450 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.886+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe26467c0 con 0x7fb25807a490 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.886+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94488783765696] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.887+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94488783769472] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.887+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.887+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94488783767904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2646be0 con 0x7fb25807a490 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.887+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2647430 con 0x55efe2638a60 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.888+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.888+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94488783778144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2647d00 con 0x55efe2638a60 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.888+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94488783767904] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.888+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2646310 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.889+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.889+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94488783778144] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.889+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94488783782512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2646310 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.889+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2647850 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.890+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94488783782512] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.890+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.890+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94488783779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2648cb0 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.890+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2649670 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94488783779920] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94488783783568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2649670 con 0x7fb25c00f070 2024-05-15T18:09:00.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 20 add_watcher() i=0 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 20 add_watcher() i=1 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 20 add_watcher() i=2 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 20 add_watcher() i=3 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 20 add_watcher() i=4 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 20 add_watcher() i=5 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.891+0000 7fb268687800 20 add_watcher() i=6 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.892+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94488783783568] v29'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.892+0000 7fb268687800 20 add_watcher() i=7 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.892+0000 7fb268687800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.892+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe264c9d0 con 0x55efe2638a60 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.892+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.892+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94488783786800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2649c00 con 0x55efe2638a60 2024-05-15T18:09:00.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.893+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94488783786800] v29'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb11cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 5 note: GC not initialized 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb0977fe640 20 reqs_thread_entry: start 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 20 Filter name: none 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb0957fa640 20 reqs_thread_entry: start 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.894+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe267ffc0 con 0x55efe2638a60 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:00.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2681f40 con 0x7fb25807a490 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.895+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2683680 con 0x7fb25c00f070 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:00.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:00.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:00.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-15T18:09:00.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.896+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2687e30 con 0x7fb25c00f070 2024-05-15T18:09:00.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.897+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(65 fud.buckets [call] v29'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.897+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe268dcf0 con 0x7fb25c00f070 2024-05-15T18:09:00.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(66 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94488784026944 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe2688260 con 0x7fb25c00f070 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== watch-notify(notify (1) cookie 94488783783568 notify 124554051591 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55efe2683a70 con 0x7fb25c00f070 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb149ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051591 cookie 94488783783568 notifier 4517 bl.length()=752 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(67 notify.7 [notify cookie 94488784026944 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb149ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb149ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb149ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb149ffb640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fb12c003ea0 con 0x7fb25c00f070 2024-05-15T18:09:00.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== watch-notify(notify_complete (2) cookie 94488784026944 notify 124554051591 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55efe2682ba0 con 0x7fb25c00f070 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_sources= new_sources= 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential sources added=[] removed=[] 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_dests= new_dests= 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential dests added=[] removed=[] 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.899+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe268c550 con 0x7fb25807a490 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.900+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(69 foo.buckets [call] v29'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.900+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2683d20 con 0x7fb25807a490 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.901+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.901+0000 7fb268687800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.901+0000 7fb268687800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.901+0000 7fb268687800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:09:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.901+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94488784026912 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55efe268ca00 con 0x7fb25c00f070 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== watch-notify(notify (1) cookie 94488783779920 notify 124554051592 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fb26001e040 con 0x7fb25c00f070 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb149ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051592 cookie 94488783779920 notifier 4517 bl.length()=314 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(71 notify.6 [notify cookie 94488784026912 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb149ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb149ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb149ffb640 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fb12c003ea0 con 0x7fb25c00f070 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.902+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== watch-notify(notify_complete (2) cookie 94488784026912 notify 124554051592 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb26003d5e0 con 0x7fb25c00f070 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.903+0000 7fb11cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.903+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94488783786800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe264bbd0 con 0x55efe2638a60 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.904+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94488783786800] v29'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.904+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94488783758800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2649330 con 0x7fb25807a490 2024-05-15T18:09:00.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.905+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94488783758800] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.905+0000 7fb268687800 20 remove_watcher() i=0 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.905+0000 7fb268687800 2 removed watcher, disabling cache 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.905+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94488783765696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2649330 con 0x55efe2638a60 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.906+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94488783765696] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.906+0000 7fb268687800 20 remove_watcher() i=1 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.906+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94488783769472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2649330 con 0x55efe263d450 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.907+0000 7fb266186640 1 -- 172.21.15.173:0/2440831292 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94488783769472] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2580ac040 con 0x55efe263d450 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.907+0000 7fb268687800 20 remove_watcher() i=2 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.907+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94488783767904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe26440c0 con 0x7fb25807a490 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.908+0000 7fb265985640 1 -- 172.21.15.173:0/2440831292 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94488783767904] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c037040 con 0x7fb25807a490 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.908+0000 7fb268687800 20 remove_watcher() i=3 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.908+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94488783778144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe26440c0 con 0x55efe2638a60 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.909+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94488783778144] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x55efe2638a60 2024-05-15T18:09:00.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.909+0000 7fb268687800 20 remove_watcher() i=4 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.909+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94488783782512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe26440c0 con 0x7fb25c00f070 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.910+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94488783782512] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.910+0000 7fb268687800 20 remove_watcher() i=5 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.910+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94488783779920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe26440c0 con 0x7fb25c00f070 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.911+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94488783779920] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.911+0000 7fb268687800 20 remove_watcher() i=6 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.911+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94488783783568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55efe2647850 con 0x7fb25c00f070 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94488783783568] v29'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb260031040 con 0x7fb25c00f070 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 20 remove_watcher() i=7 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb25c00f070 msgr2=0x7fb25c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb25c00f070 0x7fb25c02e910 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe2638a60 msgr2=0x55efe263af20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe2638a60 0x55efe263af20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb25807a490 msgr2=0x7fb25804b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb25807a490 0x7fb25804b7c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe263d450 msgr2=0x55efe263f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe263d450 0x55efe263f840 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb130036900 msgr2=0x7fb130038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb130036900 0x7fb130038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55efe260adc0 tx=0x7fb25c010000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 msgr2=0x55efe262d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb266987640 1 -- 172.21.15.173:0/2440831292 reap_dead start 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe262d370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb258008370 tx=0x7fb258080eb0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 shutdown_connections 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 --2- 172.21.15.173:0/2440831292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2625f60 0x55efe262d370 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 >> 172.21.15.173:0/2440831292 conn(0x55efe2622270 msgr2=0x55efe261f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 shutdown_connections 2024-05-15T18:09:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.912+0000 7fb268687800 1 -- 172.21.15.173:0/2440831292 wait complete. 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb140036950 msgr2=0x7fb140038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb140036950 0x7fb140038e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55efe2602430 tx=0x7fb25c00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2618e20 msgr2=0x55efe2619240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2618e20 0x55efe2619240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb258052a70 tx=0x7fb258007e50 comp rx=0 tx=0).stop 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 shutdown_connections 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb140036950 0x7fb140038e10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3812677234 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2618e20 0x55efe2619240 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 >> 172.21.15.173:0/3812677234 conn(0x55efe260cec0 msgr2=0x55efe260d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 shutdown_connections 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3812677234 wait complete. 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55efe2607e10 msgr2=0x55efe260a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55efe2607e10 0x55efe260a260 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe24749d0 msgr2=0x55efe26015f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55efe24749d0 0x55efe26015f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe2603e80 msgr2=0x55efe2606270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55efe2603e80 0x55efe2606270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb14c036950 msgr2=0x7fb14c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb14c036950 0x7fb14c038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb25c000f60 tx=0x7fb25c001370 comp rx=0 tx=0).stop 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 msgr2=0x55efe25fa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 --2- 172.21.15.173:0/3822102078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55efe2473420 0x55efe25fa3b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb25800a520 tx=0x7fb258003020 comp rx=0 tx=0).stop 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb266987640 1 -- 172.21.15.173:0/3822102078 reap_dead start 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 shutdown_connections 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 >> 172.21.15.173:0/3822102078 conn(0x55efe24fa7a0 msgr2=0x55efe25ecab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 shutdown_connections 2024-05-15T18:09:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.913+0000 7fb268687800 1 -- 172.21.15.173:0/3822102078 wait complete. 2024-05-15T18:09:00.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-15T18:09:00.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-15T18:09:00.903 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-15T18:09:00.947 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:00.947 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa243931800 1 Processor -- start 2024-05-15T18:09:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa243931800 1 -- start start 2024-05-15T18:09:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa243931800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e4f9a35fd0 0x55e4f9a363f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa243931800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4f9a36a70 con 0x55e4f9a37230 2024-05-15T18:09:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa243931800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55e4f98c8050 con 0x55e4f9a35fd0 2024-05-15T18:09:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa23f62f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e4f9a35fd0 0x55e4f9a363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa237fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55e4f9a37230 0x55e4f9a376b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57112/0 (socket says 172.21.15.173:57112) 2024-05-15T18:09:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.971+0000 7fa237fff640 1 -- 172.21.15.173:0/287945256 learned_addr learned my addr 172.21.15.173:0/287945256 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.972+0000 7fa23f62f640 1 -- 172.21.15.173:0/287945256 >> v1:172.21.15.3:6789/0 conn(0x55e4f9a37230 legacy=0x55e4f9a376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.972+0000 7fa23f62f640 1 -- 172.21.15.173:0/287945256 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f9a37df0 con 0x55e4f9a35fd0 2024-05-15T18:09:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.973+0000 7fa23f62f640 1 --2- 172.21.15.173:0/287945256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9a363f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa23000a470 tx=0x7fa23001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245132580c3c3dfd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa23ee2e640 1 -- 172.21.15.173:0/287945256 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230057070 con 0x55e4f9a35fd0 2024-05-15T18:09:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa23ee2e640 1 -- 172.21.15.173:0/287945256 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23004adc0 con 0x55e4f9a35fd0 2024-05-15T18:09:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa23ee2e640 1 -- 172.21.15.173:0/287945256 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230052590 con 0x55e4f9a35fd0 2024-05-15T18:09:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa243931800 1 -- 172.21.15.173:0/287945256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 msgr2=0x55e4f9a363f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa243931800 1 --2- 172.21.15.173:0/287945256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9a363f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa23000a470 tx=0x7fa23001ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:00.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa243931800 1 -- 172.21.15.173:0/287945256 shutdown_connections 2024-05-15T18:09:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa243931800 1 --2- 172.21.15.173:0/287945256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9a363f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa243931800 1 -- 172.21.15.173:0/287945256 >> 172.21.15.173:0/287945256 conn(0x55e4f9a315b0 msgr2=0x55e4f9a339d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa243931800 1 -- 172.21.15.173:0/287945256 shutdown_connections 2024-05-15T18:09:00.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.974+0000 7fa243931800 1 -- 172.21.15.173:0/287945256 wait complete. 2024-05-15T18:09:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.987+0000 7fa243931800 1 Processor -- start 2024-05-15T18:09:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.987+0000 7fa243931800 1 -- start start 2024-05-15T18:09:00.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.988+0000 7fa243931800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b2aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.988+0000 7fa243931800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4f99821d0 con 0x55e4f9a35fd0 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.988+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b2aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.988+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b2aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39012/0 (socket says 172.21.15.173:39012) 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.988+0000 7fa23f62f640 1 -- 172.21.15.173:0/2960001492 learned_addr learned my addr 172.21.15.173:0/2960001492 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.988+0000 7fa23f62f640 1 -- 172.21.15.173:0/2960001492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f9b2b000 con 0x55e4f9a35fd0 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.988+0000 7fa23f62f640 1 --2- 172.21.15.173:0/2960001492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b2aa30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa230055040 tx=0x7fa23004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7658d4692a6124a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa12d60a640 1 -- 172.21.15.173:0/2960001492 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230057040 con 0x55e4f9a35fd0 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa12d60a640 1 -- 172.21.15.173:0/2960001492 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa230063070 con 0x55e4f9a35fd0 2024-05-15T18:09:00.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa12d60a640 1 -- 172.21.15.173:0/2960001492 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa23005d790 con 0x55e4f9a35fd0 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa243931800 1 -- 172.21.15.173:0/2960001492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 msgr2=0x55e4f9b2aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa243931800 1 --2- 172.21.15.173:0/2960001492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b2aa30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa230055040 tx=0x7fa23004c000 comp rx=0 tx=0).stop 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa243931800 1 -- 172.21.15.173:0/2960001492 shutdown_connections 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa243931800 1 --2- 172.21.15.173:0/2960001492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b2aa30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa243931800 1 -- 172.21.15.173:0/2960001492 >> 172.21.15.173:0/2960001492 conn(0x55e4f9a315b0 msgr2=0x55e4f9b21f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa243931800 1 -- 172.21.15.173:0/2960001492 shutdown_connections 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.989+0000 7fa243931800 1 -- 172.21.15.173:0/2960001492 wait complete. 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa243931800 1 Processor -- start 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa243931800 1 -- start start 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa243931800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b32550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa243931800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4f99a9570 con 0x55e4f9a35fd0 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b32550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b32550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39024/0 (socket says 172.21.15.173:39024) 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa23f62f640 1 -- 172.21.15.173:0/4078862702 learned_addr learned my addr 172.21.15.173:0/4078862702 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.990+0000 7fa23f62f640 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f9b32a90 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.991+0000 7fa23f62f640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b32550 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa23000a470 tx=0x7fa230002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.991+0000 7fa12be07640 1 -- 172.21.15.173:0/4078862702 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230057050 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.991+0000 7fa12be07640 1 -- 172.21.15.173:0/4078862702 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23005dc90 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.991+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4f9b32d20 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.991+0000 7fa12be07640 1 -- 172.21.15.173:0/4078862702 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230052440 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.991+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4f9b35930 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa12be07640 1 -- 172.21.15.173:0/4078862702 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa230052670 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa12be07640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa124036900 0x7fa124038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa12be07640 1 -- 172.21.15.173:0/4078862702 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa23008dac0 con 0x55e4f9a35fd0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa237fff640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa124036900 0x7fa124038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9a37230 0x55e4f9b396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b39c70 con 0x55e4f9a37230 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa23fe30640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9a37230 0x55e4f9b396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa237fff640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa124036900 0x7fa124038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa228000f60 tx=0x7fa2280012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.992+0000 7fa23fe30640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9a37230 0x55e4f9b396f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.993+0000 7fa23fe30640 1 -- 172.21.15.173:0/4078862702 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9a37230 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.993+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b36cc0 con 0x55e4f9a37230 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.993+0000 7fa23fe30640 1 -- 172.21.15.173:0/4078862702 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9a37230 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.993+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b3bf80 0x55e4f9b3e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.993+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b3ea60 con 0x55e4f9b3bf80 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.993+0000 7fa23f62f640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b3bf80 0x55e4f9b3e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.993+0000 7fa23f62f640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b3bf80 0x55e4f9b3e370 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.994+0000 7fa23f62f640 1 -- 172.21.15.173:0/4078862702 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa230078070 con 0x55e4f9b3bf80 2024-05-15T18:09:00.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.994+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b3af30 con 0x55e4f9a37230 2024-05-15T18:09:00.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.994+0000 7fa23fe30640 1 -- 172.21.15.173:0/4078862702 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9a37230 2024-05-15T18:09:00.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.994+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4f9b3ff10 0x55e4f9b42360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.994+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b42ac0 con 0x55e4f9b3ff10 2024-05-15T18:09:00.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.994+0000 7fa237fff640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4f9b3ff10 0x55e4f9b42360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.995+0000 7fa237fff640 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4f9b3ff10 0x55e4f9b42360 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.995+0000 7fa237fff640 1 -- 172.21.15.173:0/4078862702 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa228009050 con 0x55e4f9b3ff10 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.995+0000 7fa243931800 1 Processor -- start 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.995+0000 7fa243931800 1 -- start start 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.995+0000 7fa243931800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b50f20 0x55e4f9b51340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.995+0000 7fa243931800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4f9928cf0 con 0x55e4f9b50f20 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b50f20 0x55e4f9b51340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b50f20 0x55e4f9b51340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39026/0 (socket says 172.21.15.173:39026) 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa23f62f640 1 -- 172.21.15.173:0/2242678693 learned_addr learned my addr 172.21.15.173:0/2242678693 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa23f62f640 1 -- 172.21.15.173:0/2242678693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f9b51880 con 0x55e4f9b50f20 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa23f62f640 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b50f20 0x55e4f9b51340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa23008c120 tx=0x7fa230052c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa129602640 1 -- 172.21.15.173:0/2242678693 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa23007c460 con 0x55e4f9b50f20 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa129602640 1 -- 172.21.15.173:0/2242678693 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23007c600 con 0x55e4f9b50f20 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4f9b51880 con 0x55e4f9b50f20 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa129602640 1 -- 172.21.15.173:0/2242678693 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa23007c920 con 0x55e4f9b50f20 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.996+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4f9b51880 con 0x55e4f9b50f20 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.997+0000 7fa129602640 1 -- 172.21.15.173:0/2242678693 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa230086070 con 0x55e4f9b50f20 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.997+0000 7fa129602640 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa118036950 0x7fa118038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.997+0000 7fa129602640 1 -- 172.21.15.173:0/2242678693 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa230098af0 con 0x55e4f9b50f20 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.997+0000 7fa237fff640 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa118036950 0x7fa118038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa243931800 1 Processor -- start 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa243931800 1 -- start start 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa237fff640 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa118036950 0x7fa118038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa22800bf50 tx=0x7fa22800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa243931800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b5e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa243931800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4f9b2b2c0 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b5e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b5e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39036/0 (socket says 172.21.15.173:39036) 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa23f62f640 1 -- 172.21.15.173:0/1869532861 learned_addr learned my addr 172.21.15.173:0/1869532861 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa23f62f640 1 -- 172.21.15.173:0/1869532861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f9b5e6b0 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.998+0000 7fa23f62f640 1 --2- 172.21.15.173:0/1869532861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b5e0e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa230085e20 tx=0x7fa230085b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971083359decb476 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa122ffd640 1 -- 172.21.15.173:0/1869532861 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2300a5020 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa122ffd640 1 -- 172.21.15.173:0/1869532861 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23007a3e0 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa122ffd640 1 -- 172.21.15.173:0/1869532861 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa23007cca0 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 -- 172.21.15.173:0/1869532861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 msgr2=0x55e4f9b5e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 --2- 172.21.15.173:0/1869532861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b5e0e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa230085e20 tx=0x7fa230085b00 comp rx=0 tx=0).stop 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 -- 172.21.15.173:0/1869532861 shutdown_connections 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 --2- 172.21.15.173:0/1869532861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b5e0e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 -- 172.21.15.173:0/1869532861 >> 172.21.15.173:0/1869532861 conn(0x55e4f9b5a020 msgr2=0x55e4f9b58080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:00.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 -- 172.21.15.173:0/1869532861 shutdown_connections 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 -- 172.21.15.173:0/1869532861 wait complete. 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 Processor -- start 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 -- start start 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b65060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:00.999+0000 7fa243931800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e4f9b5ed60 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b65060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa23f62f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b65060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39044/0 (socket says 172.21.15.173:39044) 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 learned_addr learned my addr 172.21.15.173:0/3223093815 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4f9b655a0 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa23f62f640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b65060 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa230085e20 tx=0x7fa23009e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa1217fa640 1 -- 172.21.15.173:0/3223093815 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2300b9070 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa1217fa640 1 -- 172.21.15.173:0/3223093815 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23007ac20 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4f9b655a0 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa1217fa640 1 -- 172.21.15.173:0/3223093815 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230087d50 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.000+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4f9b655a0 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.001+0000 7fa1217fa640 1 -- 172.21.15.173:0/3223093815 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa2300bc070 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.001+0000 7fa1217fa640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa108036950 0x7fa108038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.001+0000 7fa1217fa640 1 -- 172.21.15.173:0/3223093815 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fa2300b1070 con 0x55e4f9b5dcc0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.001+0000 7fa237fff640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa108036950 0x7fa108038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.002+0000 7fa237fff640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa108036950 0x7fa108038e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa228001b60 tx=0x7fa228010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.002+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.002+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9b707d0 0x55e4f9b72c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.002+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b733e0 con 0x55e4f9b707d0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.002+0000 7fa23fe30640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9b707d0 0x55e4f9b72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.002+0000 7fa23fe30640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9b707d0 0x55e4f9b72c90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 realm 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b737f0 con 0x55e4f9b707d0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b740c0 con 0x55e4f9b707d0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:00.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b751c0 0x55e4f9b775b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b77bc0 con 0x55e4f9b751c0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.003+0000 7fa23f62f640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b751c0 0x55e4f9b775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa23f62f640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b751c0 0x55e4f9b775b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa243931800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa243931800 20 searching for the correct realm 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b794f0 con 0x55e4f9b751c0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:00.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa23f62f640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa2300be060 0x7fa2300715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.004+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b794f0 con 0x7fa2300be060 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.005+0000 7fa237fff640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa2300be060 0x7fa2300715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.005+0000 7fa237fff640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa2300be060 0x7fa2300715b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.005+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228009050 con 0x7fa2300be060 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.005+0000 7fa237fff640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa228038040 0x7fa22801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.005+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b794f0 con 0x7fa228038040 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.005+0000 7fa23fe30640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa228038040 0x7fa22801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.006+0000 7fa23fe30640 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa228038040 0x7fa22801bab0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.006+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa23800a4a0 con 0x7fa228038040 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.006+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.006+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.006+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:00.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x7fa228038040 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x7fa228038040 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa2300be060 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228009050 con 0x7fa2300be060 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.007+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x7fa228038040 2024-05-15T18:09:00.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa2300be060 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.008+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa228009050 con 0x7fa2300be060 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.009+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.009+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.009+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.009+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.009+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.009+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x7fa228038040 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.009+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:00.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:00.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:00.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa23800a4a0 con 0x55e4f9b707d0 2024-05-15T18:09:00.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.010+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa238033040 con 0x7fa228038040 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa2300be060 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228009050 con 0x7fa2300be060 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.011+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa2300be060 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228009050 con 0x7fa2300be060 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.012+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b751c0 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa228038040 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x55e4f9b707d0 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b74460 con 0x7fa2300be060 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.013+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b78480 con 0x55e4f9b707d0 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b78870 con 0x55e4f9b707d0 2024-05-15T18:09:01.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b78870 con 0x7fa228038040 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 zone default found 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 4 Realm: () 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 zonegroup default 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b79970 con 0x7fa228038040 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.014+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7b350 con 0x55e4f9b751c0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7b6f0 con 0x55e4f9b751c0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 20 started sync module instance, tier type = 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.015+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7a7f0 con 0x7fa2300be060 2024-05-15T18:09:01.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.016+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.016+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94441930466112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7ba90 con 0x7fa2300be060 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.016+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7c320 con 0x55e4f9b707d0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.017+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94441930466112] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.017+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.017+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94441930468320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7c710 con 0x55e4f9b707d0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.017+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7d170 con 0x55e4f9b751c0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.019+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.019+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94441930476624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7da10 con 0x55e4f9b751c0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.019+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7e4f0 con 0x7fa2300be060 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.019+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94441930468320] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.020+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94441930476624] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.020+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.020+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94441930473008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7da10 con 0x7fa2300be060 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.020+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7edd0 con 0x55e4f9b707d0 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.021+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.021+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94441930483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7f670 con 0x55e4f9b707d0 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.021+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b80140 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.021+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94441930473008] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.022+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.022+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94441930483936] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.022+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94441930478944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b80140 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.022+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7f1c0 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.023+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94441930478944] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.023+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.023+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94441930486208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b806a0 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.023+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b81060 con 0x7fa228038040 2024-05-15T18:09:01.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94441930486208] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94441930488832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b81060 con 0x7fa228038040 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 20 add_watcher() i=0 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 20 add_watcher() i=1 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 20 add_watcher() i=2 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 20 add_watcher() i=3 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 20 add_watcher() i=4 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 20 add_watcher() i=5 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.024+0000 7fa243931800 20 add_watcher() i=6 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.025+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94441930488832] v29'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.025+0000 7fa243931800 20 add_watcher() i=7 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.025+0000 7fa243931800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:01.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.025+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b84350 con 0x55e4f9b707d0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.025+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.025+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94441930493216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b815f0 con 0x55e4f9b707d0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.026+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94441930493216] v29'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.026+0000 7fa0f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.026+0000 7fa243931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.026+0000 7fa243931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.026+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b83ae0 con 0x55e4f9b707d0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.028+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.028+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8d410 con 0x7fa228038040 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.029+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.029+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8d410 con 0x55e4f9b751c0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.030+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.030+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8d920 con 0x55e4f9b707d0 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.031+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'123 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.031+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8dfd0 con 0x7fa2300be060 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.032+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.032+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8e9f0 con 0x55e4f9b751c0 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.033+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.033+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8e9f0 con 0x55e4f9b707d0 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.034+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.034+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8e9f0 con 0x7fa228038040 2024-05-15T18:09:01.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.035+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.035+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8edd0 con 0x7fa2300be060 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.036+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.036+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8f280 con 0x55e4f9b751c0 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.037+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.037+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8f280 con 0x7fa2300be060 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.038+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.038+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cb50 con 0x7fa228038040 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.039+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.039+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cb50 con 0x7fa2300be060 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.040+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.040+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cb50 con 0x7fa228038040 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.041+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.041+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cd20 con 0x55e4f9b707d0 2024-05-15T18:09:01.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.042+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.042+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cd20 con 0x55e4f9b751c0 2024-05-15T18:09:01.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.043+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.043+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cd20 con 0x7fa2300be060 2024-05-15T18:09:01.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.044+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.044+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cd20 con 0x55e4f9b751c0 2024-05-15T18:09:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.045+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.045+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8cd20 con 0x55e4f9b707d0 2024-05-15T18:09:01.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.046+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.047+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b707d0 2024-05-15T18:09:01.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.047+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'125 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x55e4f9b707d0 2024-05-15T18:09:01.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.047+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b751c0 2024-05-15T18:09:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.049+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.049+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x7fa2300be060 2024-05-15T18:09:01.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.049+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.050+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b751c0 2024-05-15T18:09:01.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.051+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.051+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b751c0 2024-05-15T18:09:01.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.051+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.051+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b751c0 2024-05-15T18:09:01.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.052+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.052+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b751c0 2024-05-15T18:09:01.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.053+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.053+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x7fa228038040 2024-05-15T18:09:01.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.055+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.055+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b751c0 2024-05-15T18:09:01.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.056+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.056+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x7fa228038040 2024-05-15T18:09:01.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.057+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.057+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x55e4f9b751c0 2024-05-15T18:09:01.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.058+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.058+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x7fa228038040 2024-05-15T18:09:01.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.059+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.059+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b8fde0 con 0x7fa2300be060 2024-05-15T18:09:01.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.060+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa0f4fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 20 Filter name: none 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa06e7fc640 20 reqs_thread_entry: start 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bba9f0 con 0x7fa228038040 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.061+0000 7fa243931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:01.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.062+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd320 con 0x7fa228038040 2024-05-15T18:09:01.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.062+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.062+0000 7fa243931800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-15T18:09:01.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.062+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbb300 con 0x7fa228038040 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v29'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa243931800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94441930735120 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd930 con 0x55e4f9b751c0 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== watch-notify(notify (1) cookie 94441930476624 notify 124554051593 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e4f9b8e540 con 0x55e4f9b751c0 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa122ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94441930476624 notifier 4524 bl.length()=170 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(97 notify.2 [notify cookie 94441930735120 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa122ffd640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa104003d60 con 0x55e4f9b751c0 2024-05-15T18:09:01.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.063+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== watch-notify(notify_complete (2) cookie 94441930735120 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa23008d040 con 0x55e4f9b751c0 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.064+0000 7fa243931800 10 removing email index: 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.064+0000 7fa243931800 10 removing user buckets index 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.064+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd830 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(99 fud.buckets [delete] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa243931800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94441930740608 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbce20 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== watch-notify(notify (1) cookie 94441930486208 notify 124554051593 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55e4f9b8c400 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa122ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051593 cookie 94441930486208 notifier 4524 bl.length()=160 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(100 notify.6 [notify cookie 94441930740608 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa122ffd640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa104003d60 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== watch-notify(notify_complete (2) cookie 94441930740608 notify 124554051593 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4f9b83730 con 0x7fa228038040 2024-05-15T18:09:01.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa243931800 10 removing user index: fud 2024-05-15T18:09:01.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.065+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd380 con 0x7fa228038040 2024-05-15T18:09:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.066+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(102 fud [call,call,delete] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.066+0000 7fa243931800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-15T18:09:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.066+0000 7fa243931800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-15T18:09:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.066+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94441930741664 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd380 con 0x7fa228038040 2024-05-15T18:09:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.066+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== watch-notify(notify (1) cookie 94441930478944 notify 124554051594 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e4f9b83730 con 0x7fa228038040 2024-05-15T18:09:01.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.066+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(103 notify.5 [notify cookie 94441930741664 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.066+0000 7fa1227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 94441930478944 notifier 4524 bl.length()=152 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.067+0000 7fa1227fc640 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fa0740032c0 con 0x7fa228038040 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.067+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== watch-notify(notify_complete (2) cookie 94441930741664 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4f9b83c70 con 0x7fa228038040 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.067+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238031040 con 0x7fa228038040 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.068+0000 7fa0f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.068+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94441930493216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd380 con 0x55e4f9b707d0 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.069+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94441930493216] v29'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa238046040 con 0x55e4f9b707d0 2024-05-15T18:09:01.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.069+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94441930466112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd380 con 0x7fa2300be060 2024-05-15T18:09:01.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.070+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94441930466112] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.070+0000 7fa243931800 20 remove_watcher() i=0 2024-05-15T18:09:01.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.070+0000 7fa243931800 2 removed watcher, disabling cache 2024-05-15T18:09:01.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.070+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94441930468320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd380 con 0x55e4f9b707d0 2024-05-15T18:09:01.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.071+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94441930468320] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238046040 con 0x55e4f9b707d0 2024-05-15T18:09:01.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.071+0000 7fa243931800 20 remove_watcher() i=1 2024-05-15T18:09:01.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.071+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94441930476624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9bbd380 con 0x55e4f9b751c0 2024-05-15T18:09:01.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.072+0000 7fa23f62f640 1 -- 172.21.15.173:0/3223093815 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94441930476624] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2300bb030 con 0x55e4f9b751c0 2024-05-15T18:09:01.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.072+0000 7fa243931800 20 remove_watcher() i=2 2024-05-15T18:09:01.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.072+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94441930473008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b80d20 con 0x7fa2300be060 2024-05-15T18:09:01.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.073+0000 7fa237fff640 1 -- 172.21.15.173:0/3223093815 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94441930473008] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228045040 con 0x7fa2300be060 2024-05-15T18:09:01.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.073+0000 7fa243931800 20 remove_watcher() i=3 2024-05-15T18:09:01.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.073+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94441930483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7cc50 con 0x55e4f9b707d0 2024-05-15T18:09:01.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.074+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94441930483936] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238046040 con 0x55e4f9b707d0 2024-05-15T18:09:01.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.074+0000 7fa243931800 20 remove_watcher() i=4 2024-05-15T18:09:01.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.074+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94441930478944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7be30 con 0x7fa228038040 2024-05-15T18:09:01.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.075+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94441930478944] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238046040 con 0x7fa228038040 2024-05-15T18:09:01.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.075+0000 7fa243931800 20 remove_watcher() i=5 2024-05-15T18:09:01.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.075+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94441930486208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b80d20 con 0x7fa228038040 2024-05-15T18:09:01.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.076+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94441930486208] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238046040 con 0x7fa228038040 2024-05-15T18:09:01.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.076+0000 7fa243931800 20 remove_watcher() i=6 2024-05-15T18:09:01.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.076+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94441930488832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e4f9b7cc50 con 0x7fa228038040 2024-05-15T18:09:01.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94441930488832] v29'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa238046040 con 0x7fa228038040 2024-05-15T18:09:01.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 20 remove_watcher() i=7 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa228038040 msgr2=0x7fa22801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa228038040 0x7fa22801bab0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9b707d0 msgr2=0x55e4f9b72c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9b707d0 0x55e4f9b72c90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa2300be060 msgr2=0x7fa2300715b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa2300be060 0x7fa2300715b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b751c0 msgr2=0x55e4f9b775b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b751c0 0x55e4f9b775b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa108036950 msgr2=0x7fa108038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa108036950 0x7fa108038e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa228001b60 tx=0x7fa228010000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 msgr2=0x55e4f9b65060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b65060 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa230085e20 tx=0x7fa23009e000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa23fe30640 1 -- 172.21.15.173:0/3223093815 reap_dead start 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 shutdown_connections 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 --2- 172.21.15.173:0/3223093815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b5dcc0 0x55e4f9b65060 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.077+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 >> 172.21.15.173:0/3223093815 conn(0x55e4f9b5a020 msgr2=0x55e4f9b57680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 shutdown_connections 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/3223093815 wait complete. 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa118036950 msgr2=0x7fa118038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa118036950 0x7fa118038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa22800bf50 tx=0x7fa22800f000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b50f20 msgr2=0x55e4f9b51340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b50f20 0x55e4f9b51340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa23008c120 tx=0x7fa230052c50 comp rx=0 tx=0).stop 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 shutdown_connections 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa118036950 0x7fa118038e10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/2242678693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9b50f20 0x55e4f9b51340 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 >> 172.21.15.173:0/2242678693 conn(0x55e4f9b44fc0 msgr2=0x55e4f9b453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 shutdown_connections 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/2242678693 wait complete. 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4f9b3ff10 msgr2=0x55e4f9b42360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e4f9b3ff10 0x55e4f9b42360 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9a37230 msgr2=0x55e4f9b396f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e4f9a37230 0x55e4f9b396f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b3bf80 msgr2=0x55e4f9b3e370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e4f9b3bf80 0x55e4f9b3e370 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa124036900 msgr2=0x7fa124038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa124036900 0x7fa124038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa228000f60 tx=0x7fa2280012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 msgr2=0x55e4f9b32550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 --2- 172.21.15.173:0/4078862702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e4f9a35fd0 0x55e4f9b32550 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa23000a470 tx=0x7fa230002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa23fe30640 1 -- 172.21.15.173:0/4078862702 reap_dead start 2024-05-15T18:09:01.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 shutdown_connections 2024-05-15T18:09:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.078+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 >> 172.21.15.173:0/4078862702 conn(0x55e4f9a315b0 msgr2=0x55e4f9b20740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.079+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 shutdown_connections 2024-05-15T18:09:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.079+0000 7fa243931800 1 -- 172.21.15.173:0/4078862702 wait complete. 2024-05-15T18:09:01.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-15T18:09:01.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-15T18:09:01.065 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-15T18:09:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:01.119 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.143+0000 7f9f75f3f800 1 Processor -- start 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.143+0000 7f9f75f3f800 1 -- start start 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.143+0000 7f9f75f3f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55779e0719a0 0x55779e071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.143+0000 7f9f75f3f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55779dfe69e0 con 0x55779e072300 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.143+0000 7f9f75f3f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55779df04050 con 0x55779e0719a0 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.144+0000 7f9f71c9b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55779e0719a0 0x55779e071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.144+0000 7f9f6949a640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55779e072300 0x55779e0727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57120/0 (socket says 172.21.15.173:57120) 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.144+0000 7f9f71c9b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55779e0719a0 0x55779e071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39048/0 (socket says 172.21.15.173:39048) 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.144+0000 7f9f6949a640 1 -- 172.21.15.173:0/3503677081 learned_addr learned my addr 172.21.15.173:0/3503677081 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.144+0000 7f9f71c9b640 1 -- 172.21.15.173:0/3503677081 >> v1:172.21.15.3:6789/0 conn(0x55779e072300 legacy=0x55779e0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.144+0000 7f9f71c9b640 1 -- 172.21.15.173:0/3503677081 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779e072ec0 con 0x55779e0719a0 2024-05-15T18:09:01.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.146+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/3503677081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e071dc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400a470 tx=0x7f9f6401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc5a8db948d2ee7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.146+0000 7f9f7149a640 1 -- 172.21.15.173:0/3503677081 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64057070 con 0x55779e0719a0 2024-05-15T18:09:01.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.146+0000 7f9f7149a640 1 -- 172.21.15.173:0/3503677081 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f64052570 con 0x55779e0719a0 2024-05-15T18:09:01.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.146+0000 7f9f7149a640 1 -- 172.21.15.173:0/3503677081 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64052870 con 0x55779e0719a0 2024-05-15T18:09:01.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.147+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3503677081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 msgr2=0x55779e071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.147+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/3503677081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e071dc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400a470 tx=0x7f9f6401ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.147+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3503677081 shutdown_connections 2024-05-15T18:09:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.147+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/3503677081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e071dc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.147+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3503677081 >> 172.21.15.173:0/3503677081 conn(0x55779e06d540 msgr2=0x55779e06f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.147+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3503677081 shutdown_connections 2024-05-15T18:09:01.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.147+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3503677081 wait complete. 2024-05-15T18:09:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.160+0000 7f9f75f3f800 1 Processor -- start 2024-05-15T18:09:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.160+0000 7f9f75f3f800 1 -- start start 2024-05-15T18:09:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9f75f3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e166b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9f75f3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55779dfbe170 con 0x55779e0719a0 2024-05-15T18:09:01.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e166b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e166b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39064/0 (socket says 172.21.15.173:39064) 2024-05-15T18:09:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1216921808 learned_addr learned my addr 172.21.15.173:0/1216921808 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1216921808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779e167150 con 0x55779e0719a0 2024-05-15T18:09:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/1216921808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e166b80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f64055040 tx=0x7f9f6404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988ec172a6442c46 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.161+0000 7f9e5fe07640 1 -- 172.21.15.173:0/1216921808 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64057040 con 0x55779e0719a0 2024-05-15T18:09:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9e5fe07640 1 -- 172.21.15.173:0/1216921808 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f64052990 con 0x55779e0719a0 2024-05-15T18:09:01.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9e5fe07640 1 -- 172.21.15.173:0/1216921808 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64052c70 con 0x55779e0719a0 2024-05-15T18:09:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1216921808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 msgr2=0x55779e166b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1216921808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e166b80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9f64055040 tx=0x7f9f6404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1216921808 shutdown_connections 2024-05-15T18:09:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1216921808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e166b80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1216921808 >> 172.21.15.173:0/1216921808 conn(0x55779e06d540 msgr2=0x55779e1624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1216921808 shutdown_connections 2024-05-15T18:09:01.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.162+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1216921808 wait complete. 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f75f3f800 1 Processor -- start 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f75f3f800 1 -- start start 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f75f3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e16e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f75f3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55779e0733f0 con 0x55779e0719a0 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e16e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e16e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39080/0 (socket says 172.21.15.173:39080) 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f71c9b640 1 -- 172.21.15.173:0/2810608821 learned_addr learned my addr 172.21.15.173:0/2810608821 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.163+0000 7f9f71c9b640 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779e16eba0 con 0x55779e0719a0 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.164+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e16e660 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400a470 tx=0x7f9f64003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.164+0000 7f9e5e604640 1 -- 172.21.15.173:0/2810608821 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64073070 con 0x55779e0719a0 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.164+0000 7f9e5e604640 1 -- 172.21.15.173:0/2810608821 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6405d650 con 0x55779e0719a0 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.164+0000 7f9e5e604640 1 -- 172.21.15.173:0/2810608821 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64057070 con 0x55779e0719a0 2024-05-15T18:09:01.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.164+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55779e16ee30 con 0x55779e0719a0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.164+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779e171a40 con 0x55779e0719a0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9e5e604640 1 -- 172.21.15.173:0/2810608821 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9f64076070 con 0x55779e0719a0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9e5e604640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e58036950 0x7f9e58038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9e5e604640 1 -- 172.21.15.173:0/2810608821 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9f6408dd70 con 0x55779e0719a0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9f6949a640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e58036950 0x7f9e58038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e072300 0x55779e175800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e175d40 con 0x55779e072300 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9f7249c640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e072300 0x55779e175800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9f6949a640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e58036950 0x7f9e58038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c001d90 tx=0x7f9f5c0012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.165+0000 7f9f7249c640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e072300 0x55779e175800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.166+0000 7f9f7249c640 1 -- 172.21.15.173:0/2810608821 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e072300 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.166+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1765e0 con 0x55779e072300 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.166+0000 7f9f7249c640 1 -- 172.21.15.173:0/2810608821 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e072300 2024-05-15T18:09:01.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.166+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e177ef0 0x55779e17a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.166+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e17ab20 con 0x55779e177ef0 2024-05-15T18:09:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.166+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e177ef0 0x55779e17a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.166+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e177ef0 0x55779e17a390 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.167+0000 7f9f71c9b640 1 -- 172.21.15.173:0/2810608821 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f64075030 con 0x55779e177ef0 2024-05-15T18:09:01.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.167+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e176e60 con 0x55779e072300 2024-05-15T18:09:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.167+0000 7f9f7249c640 1 -- 172.21.15.173:0/2810608821 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e072300 2024-05-15T18:09:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.167+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55779e17bf80 0x55779e17e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.167+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e17eba0 con 0x55779e17bf80 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.167+0000 7f9f6949a640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55779e17bf80 0x55779e17e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.168+0000 7f9f6949a640 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55779e17bf80 0x55779e17e410 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.168+0000 7f9f6949a640 1 -- 172.21.15.173:0/2810608821 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f5c009050 con 0x55779e17bf80 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.168+0000 7f9f75f3f800 1 Processor -- start 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.168+0000 7f9f75f3f800 1 -- start start 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.168+0000 7f9f75f3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e18d000 0x55779e18d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.168+0000 7f9f75f3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55779df64cf0 con 0x55779e18d000 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e18d000 0x55779e18d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e18d000 0x55779e18d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39084/0 (socket says 172.21.15.173:39084) 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9f71c9b640 1 -- 172.21.15.173:0/3149650307 learned_addr learned my addr 172.21.15.173:0/3149650307 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9f71c9b640 1 -- 172.21.15.173:0/3149650307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779e18d960 con 0x55779e18d000 2024-05-15T18:09:01.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e18d000 0x55779e18d420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f64006d70 tx=0x7f9f640066e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9e577fe640 1 -- 172.21.15.173:0/3149650307 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6405cb90 con 0x55779e18d000 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9e577fe640 1 -- 172.21.15.173:0/3149650307 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f64088070 con 0x55779e18d000 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55779e18e3d0 con 0x55779e18d000 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9e577fe640 1 -- 172.21.15.173:0/3149650307 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6405ce60 con 0x55779e18d000 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.169+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779e18e8d0 con 0x55779e18d000 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.170+0000 7f9e577fe640 1 -- 172.21.15.173:0/3149650307 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9f64093020 con 0x55779e18d000 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.170+0000 7f9e577fe640 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e4c036900 0x7f9e4c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.170+0000 7f9e577fe640 1 -- 172.21.15.173:0/3149650307 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9f64091020 con 0x55779e18d000 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.170+0000 7f9f6949a640 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e4c036900 0x7f9e4c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f75f3f800 1 Processor -- start 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f75f3f800 1 -- start start 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f6949a640 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e4c036900 0x7f9e4c038dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55779e17aef0 tx=0x7f9f5c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f75f3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e19a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f75f3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55779e167410 con 0x55779e19a2e0 2024-05-15T18:09:01.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39098/0 (socket says 172.21.15.173:39098) 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f71c9b640 1 -- 172.21.15.173:0/2147481572 learned_addr learned my addr 172.21.15.173:0/2147481572 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f71c9b640 1 -- 172.21.15.173:0/2147481572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779e19acd0 con 0x55779e19a2e0 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.171+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/2147481572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e19a700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9f64052d20 tx=0x7f9f640848e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae61b0486574ce85 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9e557fa640 1 -- 172.21.15.173:0/2147481572 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f640970b0 con 0x55779e19a2e0 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9e557fa640 1 -- 172.21.15.173:0/2147481572 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f640a5030 con 0x55779e19a2e0 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9e557fa640 1 -- 172.21.15.173:0/2147481572 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6408db70 con 0x55779e19a2e0 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2147481572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 msgr2=0x55779e19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2147481572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e19a700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9f64052d20 tx=0x7f9f640848e0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2147481572 shutdown_connections 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2147481572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e19a700 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2147481572 >> 172.21.15.173:0/2147481572 conn(0x55779e196560 msgr2=0x55779e1945c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2147481572 shutdown_connections 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2147481572 wait complete. 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.172+0000 7f9f75f3f800 1 Processor -- start 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f75f3f800 1 -- start start 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f75f3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f75f3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55779e19b340 con 0x55779e19a2e0 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e1a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f71c9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e1a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39114/0 (socket says 172.21.15.173:39114) 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 learned_addr learned my addr 172.21.15.173:0/1208825478 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55779e1a1b10 con 0x55779e19a2e0 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.173+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e1a15d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f64052d20 tx=0x7f9f64098f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.174+0000 7f9e437fe640 1 -- 172.21.15.173:0/1208825478 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f640ba070 con 0x55779e19a2e0 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.174+0000 7f9e437fe640 1 -- 172.21.15.173:0/1208825478 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f64084b80 con 0x55779e19a2e0 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.174+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55779e1a1b10 con 0x55779e19a2e0 2024-05-15T18:09:01.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.174+0000 7f9e437fe640 1 -- 172.21.15.173:0/1208825478 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f64079990 con 0x55779e19a2e0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.174+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55779e1a1b10 con 0x55779e19a2e0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.174+0000 7f9e437fe640 1 -- 172.21.15.173:0/1208825478 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9f640bd070 con 0x55779e19a2e0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.175+0000 7f9e437fe640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e3c036950 0x7f9e3c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.175+0000 7f9e437fe640 1 -- 172.21.15.173:0/1208825478 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f9f640b1030 con 0x55779e19a2e0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.175+0000 7f9f6949a640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e3c036950 0x7f9e3c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.175+0000 7f9f6949a640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e3c036950 0x7f9e3c038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55779e176e30 tx=0x7f9f5c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.176+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.176+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e1acd90 0x55779e1af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.176+0000 7f9f7249c640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e1acd90 0x55779e1af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.176+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1af9a0 con 0x55779e1acd90 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.176+0000 7f9f7249c640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e1acd90 0x55779e1af250 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 20 realm 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1afdb0 con 0x55779e1acd90 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0680 con 0x55779e1acd90 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.177+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f75f3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e1b1780 0x55779e1b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b4130 con 0x55779e1b1780 2024-05-15T18:09:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e1b1780 0x55779e1b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e1b1780 0x55779e1b3b70 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f75f3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f75f3f800 20 searching for the correct realm 2024-05-15T18:09:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.178+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b5a60 con 0x55779e1b1780 2024-05-15T18:09:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.179+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.179+0000 7f9f71c9b640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9f640bf060 0x7f9f640aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.179+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b5a60 con 0x7f9f640bf060 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.179+0000 7f9f6949a640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9f640bf060 0x7f9f640aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.179+0000 7f9f6949a640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9f640bf060 0x7f9f640aa420 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.180+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.180+0000 7f9f6949a640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9f5c037040 0x7f9f5c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.180+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b5a60 con 0x7f9f5c037040 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.180+0000 7f9f7249c640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9f5c037040 0x7f9f5c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.180+0000 7f9f7249c640 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9f5c037040 0x7f9f5c036410 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.181+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x7f9f5c037040 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.181+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.181+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.181+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.181+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.181+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x7f9f5c037040 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x7f9f5c037040 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f640bf060 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.182+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x7f9f5c037040 2024-05-15T18:09:01.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f640bf060 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.183+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.184+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.184+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.184+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.184+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.184+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x7f9f5c037040 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.184+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9f6c00a4a0 con 0x55779e1acd90 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.185+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.186+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c033040 con 0x7f9f5c037040 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.186+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.186+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.186+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f640bf060 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.186+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.186+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.186+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.187+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.187+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.187+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.187+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.187+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.187+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.187+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f640bf060 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1b1780 2024-05-15T18:09:01.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f5c037040 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x55779e1acd90 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.188+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b0a20 con 0x7f9f640bf060 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:01.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b49f0 con 0x55779e1acd90 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b4de0 con 0x55779e1acd90 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.189+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b4de0 con 0x7f9f5c037040 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 zone default found 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 4 Realm: () 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 zonegroup default 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b4590 con 0x7f9f5c037040 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b45c0 con 0x55779e1b1780 2024-05-15T18:09:01.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b79b0 con 0x55779e1b1780 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 started sync module instance, tier type = 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.190+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b6d60 con 0x7f9f640bf060 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.191+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.191+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93972242067792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b69c0 con 0x7f9f640bf060 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.191+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b88e0 con 0x55779e1acd90 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.192+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93972242067792] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.192+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.192+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93972242072624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b8850 con 0x55779e1acd90 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.193+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b97a0 con 0x55779e1b1780 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.194+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.194+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93972242076400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b9710 con 0x55779e1b1780 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.194+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1ba790 con 0x7f9f640bf060 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.194+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93972242072624] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.195+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93972242076400] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.195+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.195+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93972242078608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b8cd0 con 0x7f9f640bf060 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.195+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bb070 con 0x55779e1acd90 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.196+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93972242078608] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.196+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.196+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93972242080352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bb460 con 0x55779e1acd90 2024-05-15T18:09:01.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.196+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bbe60 con 0x7f9f5c037040 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.197+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93972242080352] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.197+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.197+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93972242082688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bbe20 con 0x7f9f5c037040 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.197+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bc870 con 0x7f9f5c037040 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.198+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93972242082688] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.198+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.198+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93972242086256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bc870 con 0x7f9f5c037040 2024-05-15T18:09:01.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.198+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bd230 con 0x7f9f5c037040 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93972242086256] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93972242088896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bd230 con 0x7f9f5c037040 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 20 add_watcher() i=0 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 20 add_watcher() i=1 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 20 add_watcher() i=2 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 20 add_watcher() i=3 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 20 add_watcher() i=4 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 20 add_watcher() i=5 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.199+0000 7f9f75f3f800 20 add_watcher() i=6 2024-05-15T18:09:01.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.200+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93972242088896] v29'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.200+0000 7f9f75f3f800 20 add_watcher() i=7 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.200+0000 7f9f75f3f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.200+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1c0660 con 0x55779e1acd90 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.200+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.201+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93972242091856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1bdb20 con 0x55779e1acd90 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.201+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93972242091856] v29'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9e237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 5 note: GC not initialized 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9e227fc640 20 reqs_thread_entry: start 2024-05-15T18:09:01.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 20 Filter name: none 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9d93fff640 20 reqs_thread_entry: start 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.202+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f3da0 con 0x7f9f5c037040 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-15T18:09:01.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f2490 con 0x7f9f5c037040 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.203+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f67f0 con 0x7f9f5c037040 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v29'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9f75f3f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9f75f3f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9f75f3f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-15T18:09:01.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93972242321856 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f7360 con 0x7f9f640bf060 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== watch-notify(notify (1) cookie 93972242078608 notify 124554051596 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f9f5c041060 con 0x7f9f640bf060 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 notify.3 [notify cookie 93972242321856 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9e54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 93972242078608 notifier 4531 bl.length()=610 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9e54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9e54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.204+0000 7f9e54ff9640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9d9c003430 con 0x7f9f640bf060 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.205+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== watch-notify(notify_complete (2) cookie 93972242321856 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55779dfe69e0 con 0x7f9f640bf060 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.205+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.205+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f41b0 con 0x7f9f5c037040 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v29'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9f75f3f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9f75f3f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:09:01.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9f75f3f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93972242329104 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f61d0 con 0x55779e1b1780 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== watch-notify(notify (1) cookie 93972242076400 notify 124554051594 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55779e18e3d0 con 0x55779e1b1780 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9e54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051594 cookie 93972242076400 notifier 4531 bl.length()=192 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9e54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9e54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9e54ff9640 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9d9c003430 con 0x55779e1b1780 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.206+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 notify.2 [notify cookie 93972242329104 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.207+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.207+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== watch-notify(notify_complete (2) cookie 93972242329104 notify 124554051594 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55779e18d960 con 0x55779e1b1780 2024-05-15T18:09:01.197 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-15T18:09:01.203857Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:09:01.203840Z","tags":[],"group_ids":[]} 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.208+0000 7f9e237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.208+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93972242091856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f3070 con 0x55779e1acd90 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.209+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93972242091856] v29'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.209+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93972242067792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1f3070 con 0x7f9f640bf060 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.210+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93972242067792] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.210+0000 7f9f75f3f800 20 remove_watcher() i=0 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.210+0000 7f9f75f3f800 2 removed watcher, disabling cache 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.210+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93972242072624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b7150 con 0x55779e1acd90 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.211+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93972242072624] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.211+0000 7f9f75f3f800 20 remove_watcher() i=1 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.211+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93972242076400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b7150 con 0x55779e1b1780 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.212+0000 7f9f71c9b640 1 -- 172.21.15.173:0/1208825478 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93972242076400] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f640bc030 con 0x55779e1b1780 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.212+0000 7f9f75f3f800 20 remove_watcher() i=2 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.212+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93972242078608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b92f0 con 0x7f9f640bf060 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.213+0000 7f9f6949a640 1 -- 172.21.15.173:0/1208825478 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93972242078608] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f5c009050 con 0x7f9f640bf060 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.213+0000 7f9f75f3f800 20 remove_watcher() i=3 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.213+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93972242080352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b7150 con 0x55779e1acd90 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.214+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93972242080352] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x55779e1acd90 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.214+0000 7f9f75f3f800 20 remove_watcher() i=4 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.214+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93972242082688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b92f0 con 0x7f9f5c037040 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.215+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93972242082688] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.215+0000 7f9f75f3f800 20 remove_watcher() i=5 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.215+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93972242086256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b7150 con 0x7f9f5c037040 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.216+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93972242086256] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.216+0000 7f9f75f3f800 20 remove_watcher() i=6 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.216+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93972242088896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55779e1b92f0 con 0x7f9f5c037040 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93972242088896] v29'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f6c031040 con 0x7f9f5c037040 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 20 remove_watcher() i=7 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9f5c037040 msgr2=0x7f9f5c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9f5c037040 0x7f9f5c036410 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e1acd90 msgr2=0x55779e1af250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e1acd90 0x55779e1af250 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9f640bf060 msgr2=0x7f9f640aa420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9f640bf060 0x7f9f640aa420 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e1b1780 msgr2=0x55779e1b3b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e1b1780 0x55779e1b3b70 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e3c036950 msgr2=0x7f9e3c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e3c036950 0x7f9e3c038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55779e176e30 tx=0x7f9f5c010000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 msgr2=0x55779e1a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f7249c640 1 -- 172.21.15.173:0/1208825478 reap_dead start 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e1a15d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9f64052d20 tx=0x7f9f64098f00 comp rx=0 tx=0).stop 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 shutdown_connections 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/1208825478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e19a2e0 0x55779e1a15d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 >> 172.21.15.173:0/1208825478 conn(0x55779e196560 msgr2=0x55779e193bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 shutdown_connections 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.217+0000 7f9f75f3f800 1 -- 172.21.15.173:0/1208825478 wait complete. 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e4c036900 msgr2=0x7f9e4c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e4c036900 0x7f9e4c038dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55779e17aef0 tx=0x7f9f5c00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e18d000 msgr2=0x55779e18d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e18d000 0x55779e18d420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9f64006d70 tx=0x7f9f640066e0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 shutdown_connections 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e4c036900 0x7f9e4c038dc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/3149650307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e18d000 0x55779e18d420 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 >> 172.21.15.173:0/3149650307 conn(0x55779e1810a0 msgr2=0x55779e1814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 shutdown_connections 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/3149650307 wait complete. 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55779e17bf80 msgr2=0x55779e17e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55779e17bf80 0x55779e17e410 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e072300 msgr2=0x55779e175800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55779e072300 0x55779e175800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e177ef0 msgr2=0x55779e17a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55779e177ef0 0x55779e17a390 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e58036950 msgr2=0x7f9e58038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9e58036950 0x7f9e58038e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c001d90 tx=0x7f9f5c0012f0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 msgr2=0x55779e16e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 --2- 172.21.15.173:0/2810608821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55779e0719a0 0x55779e16e660 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400a470 tx=0x7f9f64003020 comp rx=0 tx=0).stop 2024-05-15T18:09:01.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f7249c640 1 -- 172.21.15.173:0/2810608821 reap_dead start 2024-05-15T18:09:01.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 shutdown_connections 2024-05-15T18:09:01.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 >> 172.21.15.173:0/2810608821 conn(0x55779e06d540 msgr2=0x55779e160ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 shutdown_connections 2024-05-15T18:09:01.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.218+0000 7f9f75f3f800 1 -- 172.21.15.173:0/2810608821 wait complete. 2024-05-15T18:09:01.209 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-15T18:09:01.203857Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:09:01.203840Z', 'tags': [], 'group_ids': []} 2024-05-15T18:09:01.209 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-15T18:09:01.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-15T18:09:01.209 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-05-15T18:09:01.257 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:01.258 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.281+0000 7f3fce146800 1 Processor -- start 2024-05-15T18:09:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fce146800 1 -- start start 2024-05-15T18:09:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fce146800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5640b2f5e540 0x5640b2f67040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fce146800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5640b2ed1940 con 0x5640b2f5ca00 2024-05-15T18:09:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fce146800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5640b2def050 con 0x5640b2f5e540 2024-05-15T18:09:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fcb44b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5640b2f5e540 0x5640b2f67040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fcbc4c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5640b2f5ca00 0x5640b2f5ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57128/0 (socket says 172.21.15.173:57128) 2024-05-15T18:09:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/2062838938 learned_addr learned my addr 172.21.15.173:0/2062838938 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fcb44b640 1 -- 172.21.15.173:0/2062838938 >> v1:172.21.15.3:6789/0 conn(0x5640b2f5ca00 legacy=0x5640b2f5ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.282+0000 7f3fcb44b640 1 -- 172.21.15.173:0/2062838938 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b2f68590 con 0x5640b2f5e540 2024-05-15T18:09:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.284+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/2062838938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5e540 0x5640b2f67040 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000a470 tx=0x7f3fc001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe70a2e1afec9275 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.284+0000 7f3fcac4a640 1 -- 172.21.15.173:0/2062838938 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0057070 con 0x5640b2f5e540 2024-05-15T18:09:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.284+0000 7f3fcac4a640 1 -- 172.21.15.173:0/2062838938 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc004adc0 con 0x5640b2f5e540 2024-05-15T18:09:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.284+0000 7f3fcac4a640 1 -- 172.21.15.173:0/2062838938 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc0052590 con 0x5640b2f5e540 2024-05-15T18:09:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.285+0000 7f3fce146800 1 -- 172.21.15.173:0/2062838938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5e540 msgr2=0x5640b2f67040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.285+0000 7f3fce146800 1 --2- 172.21.15.173:0/2062838938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5e540 0x5640b2f67040 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000a470 tx=0x7f3fc001ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.285+0000 7f3fce146800 1 -- 172.21.15.173:0/2062838938 shutdown_connections 2024-05-15T18:09:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.285+0000 7f3fce146800 1 --2- 172.21.15.173:0/2062838938 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5e540 0x5640b2f67040 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.285+0000 7f3fce146800 1 -- 172.21.15.173:0/2062838938 >> 172.21.15.173:0/2062838938 conn(0x5640b2f585c0 msgr2=0x5640b2f5a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.285+0000 7f3fce146800 1 -- 172.21.15.173:0/2062838938 shutdown_connections 2024-05-15T18:09:01.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.285+0000 7f3fce146800 1 -- 172.21.15.173:0/2062838938 wait complete. 2024-05-15T18:09:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fce146800 1 Processor -- start 2024-05-15T18:09:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fce146800 1 -- start start 2024-05-15T18:09:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fce146800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3051a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fce146800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5640b2ea91f0 con 0x5640b2f5ca00 2024-05-15T18:09:01.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3051a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3051a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39144/0 (socket says 172.21.15.173:39144) 2024-05-15T18:09:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3973528166 learned_addr learned my addr 172.21.15.173:0/3973528166 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3973528166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b3051fe0 con 0x5640b2f5ca00 2024-05-15T18:09:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.299+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/3973528166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3051a10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc001de0 tx=0x7f3fbc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca3142eda7aa0dc server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3eb9e0b640 1 -- 172.21.15.173:0/3973528166 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc012020 con 0x5640b2f5ca00 2024-05-15T18:09:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3eb9e0b640 1 -- 172.21.15.173:0/3973528166 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc00e5a0 con 0x5640b2f5ca00 2024-05-15T18:09:01.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3eb9e0b640 1 -- 172.21.15.173:0/3973528166 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc00e8c0 con 0x5640b2f5ca00 2024-05-15T18:09:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3fce146800 1 -- 172.21.15.173:0/3973528166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 msgr2=0x5640b3051a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3fce146800 1 --2- 172.21.15.173:0/3973528166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3051a10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc001de0 tx=0x7f3fbc00b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3fce146800 1 -- 172.21.15.173:0/3973528166 shutdown_connections 2024-05-15T18:09:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3fce146800 1 --2- 172.21.15.173:0/3973528166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3051a10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3fce146800 1 -- 172.21.15.173:0/3973528166 >> 172.21.15.173:0/3973528166 conn(0x5640b2f585c0 msgr2=0x5640b304d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3fce146800 1 -- 172.21.15.173:0/3973528166 shutdown_connections 2024-05-15T18:09:01.283 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.300+0000 7f3fce146800 1 -- 172.21.15.173:0/3973528166 wait complete. 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fce146800 1 Processor -- start 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fce146800 1 -- start start 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fce146800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3059580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fce146800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5640b2f67850 con 0x5640b2f5ca00 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3059580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3059580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39158/0 (socket says 172.21.15.173:39158) 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/2312038663 learned_addr learned my addr 172.21.15.173:0/2312038663 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.301+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b3059ac0 con 0x5640b2f5ca00 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.302+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3059580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc001de0 tx=0x7f3fbc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.302+0000 7f3eb3fff640 1 -- 172.21.15.173:0/2312038663 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc012030 con 0x5640b2f5ca00 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.302+0000 7f3eb3fff640 1 -- 172.21.15.173:0/2312038663 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc01a7a0 con 0x5640b2f5ca00 2024-05-15T18:09:01.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.302+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640b3059d50 con 0x5640b2f5ca00 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.302+0000 7f3eb3fff640 1 -- 172.21.15.173:0/2312038663 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc01aac0 con 0x5640b2f5ca00 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.302+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b305ca00 con 0x5640b2f5ca00 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3eb3fff640 1 -- 172.21.15.173:0/2312038663 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fbc015020 con 0x5640b2f5ca00 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3eb3fff640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3eb4036900 0x7f3eb4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3eb3fff640 1 -- 172.21.15.173:0/2312038663 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3fbc020070 con 0x5640b2f5ca00 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3eb4036900 0x7f3eb4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b2f5e540 0x5640b30607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b3060d00 con 0x5640b2f5e540 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3fcc44d640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b2f5e540 0x5640b30607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3eb4036900 0x7f3eb4038dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0054000 tx=0x7f3fc004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.303+0000 7f3fcc44d640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b2f5e540 0x5640b30607c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.304+0000 7f3fcc44d640 1 -- 172.21.15.173:0/2312038663 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b2f5e540 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.304+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b305dd90 con 0x5640b2f5e540 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.304+0000 7f3fcc44d640 1 -- 172.21.15.173:0/2312038663 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b2f5e540 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.304+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b3063050 0x5640b3065440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.304+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b3065b30 con 0x5640b3063050 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.304+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b3063050 0x5640b3065440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.304+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b3063050 0x5640b3065440 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.305+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/2312038663 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3fbc024980 con 0x5640b3063050 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.305+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b3062000 con 0x5640b2f5e540 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.305+0000 7f3fcc44d640 1 -- 172.21.15.173:0/2312038663 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b2f5e540 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.305+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5640b3066fe0 0x5640b3069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.305+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b3069b90 con 0x5640b3066fe0 2024-05-15T18:09:01.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.305+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5640b3066fe0 0x5640b3069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.306+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5640b3066fe0 0x5640b3069430 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.306+0000 7f3fcb44b640 1 -- 172.21.15.173:0/2312038663 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3fc005a040 con 0x5640b3066fe0 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.306+0000 7f3fce146800 1 Processor -- start 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.306+0000 7f3fce146800 1 -- start start 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.306+0000 7f3fce146800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3077ff0 0x5640b3078410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.306+0000 7f3fce146800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5640b2e4fcf0 con 0x5640b3077ff0 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3077ff0 0x5640b3078410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3077ff0 0x5640b3078410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39160/0 (socket says 172.21.15.173:39160) 2024-05-15T18:09:01.287 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/703162665 learned_addr learned my addr 172.21.15.173:0/703162665 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/703162665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b3078950 con 0x5640b3077ff0 2024-05-15T18:09:01.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3077ff0 0x5640b3078410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0015f0 tx=0x7f3fbc04c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3eb17fa640 1 -- 172.21.15.173:0/703162665 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc03a020 con 0x5640b3077ff0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3eb17fa640 1 -- 172.21.15.173:0/703162665 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc044510 con 0x5640b3077ff0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640b30793c0 con 0x5640b3077ff0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3eb17fa640 1 -- 172.21.15.173:0/703162665 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc0447f0 con 0x5640b3077ff0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.307+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b30793c0 con 0x5640b3077ff0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.308+0000 7f3eb17fa640 1 -- 172.21.15.173:0/703162665 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fbc03d070 con 0x5640b3077ff0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.308+0000 7f3eb17fa640 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ea4036900 0x7f3ea4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.308+0000 7f3eb17fa640 1 -- 172.21.15.173:0/703162665 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3fbc037aa0 con 0x5640b3077ff0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.308+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ea4036900 0x7f3ea4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.308+0000 7f3fce146800 1 Processor -- start 2024-05-15T18:09:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fce146800 1 -- start start 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ea4036900 0x7f3ea4038dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5640b3061600 tx=0x7f3fc0005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fce146800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b3085430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fce146800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5640b3052360 con 0x5640b3085010 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b3085430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b3085430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39174/0 (socket says 172.21.15.173:39174) 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/2619874271 learned_addr learned my addr 172.21.15.173:0/2619874271 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/2619874271 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b3085a00 con 0x5640b3085010 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/2619874271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b3085430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cb00 tx=0x7f3fbc040ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53414eb1fc273173 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3eaaffd640 1 -- 172.21.15.173:0/2619874271 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc044990 con 0x5640b3085010 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3eaaffd640 1 -- 172.21.15.173:0/2619874271 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc0165c0 con 0x5640b3085010 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.309+0000 7f3eaaffd640 1 -- 172.21.15.173:0/2619874271 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc046cd0 con 0x5640b3085010 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 -- 172.21.15.173:0/2619874271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 msgr2=0x5640b3085430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 --2- 172.21.15.173:0/2619874271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b3085430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cb00 tx=0x7f3fbc040ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 -- 172.21.15.173:0/2619874271 shutdown_connections 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 --2- 172.21.15.173:0/2619874271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b3085430 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 -- 172.21.15.173:0/2619874271 >> 172.21.15.173:0/2619874271 conn(0x5640b3081290 msgr2=0x5640b307f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 -- 172.21.15.173:0/2619874271 shutdown_connections 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 -- 172.21.15.173:0/2619874271 wait complete. 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 Processor -- start 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 -- start start 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b308c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fce146800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5640b3086070 con 0x5640b3085010 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.310+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b308c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3fcbc4c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b308c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39178/0 (socket says 172.21.15.173:39178) 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 learned_addr learned my addr 172.21.15.173:0/3569882955 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b308c900 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b308c3c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cb00 tx=0x7f3fbc040f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3ea97fa640 1 -- 172.21.15.173:0/3569882955 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc017430 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3ea97fa640 1 -- 172.21.15.173:0/3569882955 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc0168f0 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640b308c900 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3ea97fa640 1 -- 172.21.15.173:0/3569882955 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fbc0175d0 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.311+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b308c900 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.312+0000 7f3ea97fa640 1 -- 172.21.15.173:0/3569882955 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fbc056040 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.312+0000 7f3ea97fa640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e94036900 0x7f3e94038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.312+0000 7f3ea97fa640 1 -- 172.21.15.173:0/3569882955 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f3fbc053040 con 0x5640b3085010 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.312+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e94036900 0x7f3e94038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e94036900 0x7f3e94038dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0055040 tx=0x7f3fc0060040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b3097aa0 0x5640b3099f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309a6b0 con 0x5640b3097aa0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fcc44d640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b3097aa0 0x5640b3099f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fcc44d640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b3097aa0 0x5640b3099f60 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.313+0000 7f3fce146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 realm 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309aac0 con 0x5640b3097aa0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b390 con 0x5640b3097aa0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b309c490 0x5640b309e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309ee90 con 0x5640b309c490 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.314+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b309c490 0x5640b309e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b309c490 0x5640b309e880 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fce146800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fce146800 20 searching for the correct realm 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a07c0 con 0x5640b309c490 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fcbc4c640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3fbc063040 0x7f3fbc038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a07c0 con 0x7f3fbc063040 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.315+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3fbc063040 0x7f3fbc038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.316+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3fbc063040 0x7f3fbc038a50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.316+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.316+0000 7f3fcb44b640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3fc0080930 0x7f3fc0073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.316+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a07c0 con 0x7f3fc0080930 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.316+0000 7f3fcc44d640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3fc0080930 0x7f3fc0073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.317+0000 7f3fcc44d640 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3fc0080930 0x7f3fc0073420 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.317+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3fc400a4a0 con 0x7f3fc0080930 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.317+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.317+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.317+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.317+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.317+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x7f3fc0080930 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x7f3fc0080930 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fbc063040 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.318+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.319+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.319+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.319+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x7f3fc0080930 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.319+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.319+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.319+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fbc063040 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.320+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.320+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.320+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.320+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.320+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.320+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x7f3fc0080930 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3fc400a4a0 con 0x5640b3097aa0 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.321+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc4033040 con 0x7f3fc0080930 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fbc063040 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.322+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.323+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.323+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.323+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.323+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.323+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.323+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fbc063040 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.323+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.324+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b309c490 2024-05-15T18:09:01.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.324+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.324+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fc0080930 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.324+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.324+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x5640b3097aa0 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.324+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.324+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5640b309b730 con 0x7f3fbc063040 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:01.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309f750 con 0x5640b3097aa0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309fb40 con 0x5640b3097aa0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309fb40 con 0x7f3fc0080930 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.325+0000 7f3fce146800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 zone default found 2024-05-15T18:09:01.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 4 Realm: () 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 zonegroup default 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309fff0 con 0x7f3fc0080930 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b309fff0 con 0x5640b309c490 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a2720 con 0x5640b309c490 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 started sync module instance, tier type = 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.326+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a1ac0 con 0x7f3fbc063040 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.327+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.327+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94835881680560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a3030 con 0x7f3fbc063040 2024-05-15T18:09:01.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.327+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a3880 con 0x5640b3097aa0 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.328+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94835881680560] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.329+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.329+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94835881683840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a3880 con 0x5640b3097aa0 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.329+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a4370 con 0x5640b309c490 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.330+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94835881683840] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.330+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.330+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94835881685968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a37f0 con 0x5640b309c490 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.330+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a5230 con 0x7f3fbc063040 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.331+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94835881685968] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.331+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.331+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94835881690976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a5a80 con 0x7f3fbc063040 2024-05-15T18:09:01.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.331+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a6440 con 0x5640b3097aa0 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.332+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94835881690976] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.332+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.332+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94835881697168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a6860 con 0x5640b3097aa0 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.332+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a7220 con 0x7f3fc0080930 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.333+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94835881697168] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.333+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.333+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94835881698704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a7220 con 0x7f3fc0080930 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.333+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a7be0 con 0x7f3fc0080930 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.334+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94835881698704] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.335+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.335+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94835881701200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a7be0 con 0x7f3fc0080930 2024-05-15T18:09:01.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.335+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a85a0 con 0x7f3fc0080930 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.335+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94835881701200] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.335+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.335+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94835881706192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a7be0 con 0x7f3fc0080930 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.336+0000 7f3fce146800 20 add_watcher() i=0 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.336+0000 7f3fce146800 20 add_watcher() i=1 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.336+0000 7f3fce146800 20 add_watcher() i=2 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.336+0000 7f3fce146800 20 add_watcher() i=3 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.336+0000 7f3fce146800 20 add_watcher() i=4 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.336+0000 7f3fce146800 20 add_watcher() i=5 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.336+0000 7f3fce146800 20 add_watcher() i=6 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.337+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94835881706192] v29'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.337+0000 7f3fce146800 20 add_watcher() i=7 2024-05-15T18:09:01.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.337+0000 7f3fce146800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.337+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30ab9c0 con 0x5640b3097aa0 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.337+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.337+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94835881703680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a8ec0 con 0x5640b3097aa0 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.338+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94835881703680] v29'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.338+0000 7f3e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.338+0000 7f3fce146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.338+0000 7f3fce146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.338+0000 7f3fce146800 5 note: GC not initialized 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.338+0000 7f3e80fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.338+0000 7f3fce146800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.339+0000 7f3fce146800 20 Filter name: none 2024-05-15T18:09:01.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.339+0000 7f3dfa7fc640 20 reqs_thread_entry: start 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.339+0000 7f3fce146800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.339+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.339+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30df080 con 0x7f3fc0080930 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 20 rados_obj.operate() r=0 bl.length=419 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30dead0 con 0x7f3fbc063040 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.340+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e2590 con 0x7f3fc0080930 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(64 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:01.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.341+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e6cf0 con 0x7f3fbc063040 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.342+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 foo.buckets [call] v29'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.342+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 8.16 8:6bd3cc74:root::.bucket.meta.testx%3amyfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30ea600 con 0x5640b309c490 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.343+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [create,call,writefull 0~412,setxattr (203)] v29'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.343+0000 7f3fce146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x7 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.343+0000 7f3fce146800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.343+0000 7f3fce146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.343+0000 7f3fce146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.343+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94835881967920 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9d30 con 0x7f3fc0080930 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== watch-notify(notify (1) cookie 94835881701200 notify 124554051595 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5640b30e2980 con 0x7f3fc0080930 2024-05-15T18:09:01.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3eaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94835881701200 notifier 4538 bl.length()=847 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(67 notify.6 [notify cookie 94835881967920 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3eaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x7 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3eaaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3eaaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3eaaffd640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3e90003ea0 con 0x7f3fc0080930 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== watch-notify(notify_complete (2) cookie 94835881967920 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640b30e1b60 con 0x7f3fc0080930 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fce146800 20 handle_bi_update(): bucket=testx:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_sources= new_sources= 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fce146800 20 handle_bi_update(): bucket=testx:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential sources added=[] removed=[] 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fce146800 20 handle_bi_update(): bucket=testx:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_dests= new_dests= 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fce146800 20 handle_bi_update(): bucket=testx:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential dests added=[] removed=[] 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.344+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9db0 con 0x5640b3097aa0 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.345+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v29'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.345+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9db0 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.346+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v29'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.346+0000 7f3fce146800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.346+0000 7f3fce146800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.346+0000 7f3fce146800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.346+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94835881974016 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9d20 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94835881697168 notify 124554051595 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5640b30ea150 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3eaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 94835881697168 notifier 4538 bl.length()=348 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3eaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3eaaffd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(71 notify.4 [notify cookie 94835881974016 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3eaaffd640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3e90003ea0 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== watch-notify(notify_complete (2) cookie 94835881974016 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3fc4046040 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.347+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9db0 con 0x7f3fbc063040 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.348+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(73 myfoo [call,delete] v29'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.348+0000 7f3fce146800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.348+0000 7f3fce146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.348+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94835881974016 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9d20 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.349+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== watch-notify(notify (1) cookie 94835881701200 notify 124554051596 ret 0) ==== 191+0+0 (crc 0 0 0) 0x7f3fc4046040 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.349+0000 7f3eaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94835881701200 notifier 4538 bl.length()=149 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.349+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(74 notify.6 [notify cookie 94835881974016 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.349+0000 7f3eaaffd640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3e90003ea0 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.349+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== watch-notify(notify_complete (2) cookie 94835881974016 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640b30e9140 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.349+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.349+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9db0 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(76 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call,delete] v29'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3fce146800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 from cache 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3fce146800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94835881946128 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9db0 con 0x7f3fc0080930 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== watch-notify(notify (1) cookie 94835881706192 notify 124554051597 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5640b30e9140 con 0x7f3fc0080930 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 94835881706192 notifier 4538 bl.length()=206 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(77 notify.7 [notify cookie 94835881946128 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.350+0000 7f3eaa7fc640 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f3e000032c0 con 0x7f3fc0080930 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.351+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== watch-notify(notify_complete (2) cookie 94835881946128 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640b30e1b60 con 0x7f3fc0080930 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.351+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.351+0000 7f3e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.351+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94835881703680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30e9900 con 0x5640b3097aa0 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.352+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94835881703680] v29'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.352+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94835881680560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a78d0 con 0x7f3fbc063040 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.353+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94835881680560] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.353+0000 7f3fce146800 20 remove_watcher() i=0 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.353+0000 7f3fce146800 2 removed watcher, disabling cache 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.353+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94835881683840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a1eb0 con 0x5640b3097aa0 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.355+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94835881683840] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.355+0000 7f3fce146800 20 remove_watcher() i=1 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.355+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94835881685968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a2b80 con 0x5640b309c490 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.356+0000 7f3fcbc4c640 1 -- 172.21.15.173:0/3569882955 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94835881685968] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fbc072020 con 0x5640b309c490 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.356+0000 7f3fce146800 20 remove_watcher() i=2 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.356+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94835881690976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a33d0 con 0x7f3fbc063040 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.357+0000 7f3fcb44b640 1 -- 172.21.15.173:0/3569882955 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94835881690976] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc0070070 con 0x7f3fbc063040 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.357+0000 7f3fce146800 20 remove_watcher() i=3 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.357+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94835881697168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a33d0 con 0x5640b3097aa0 2024-05-15T18:09:01.345 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.358+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94835881697168] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x5640b3097aa0 2024-05-15T18:09:01.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.358+0000 7f3fce146800 20 remove_watcher() i=4 2024-05-15T18:09:01.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.358+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94835881698704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a33d0 con 0x7f3fc0080930 2024-05-15T18:09:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.359+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94835881698704] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.359+0000 7f3fce146800 20 remove_watcher() i=5 2024-05-15T18:09:01.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.359+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94835881701200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a6590 con 0x7f3fc0080930 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.360+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94835881701200] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.360+0000 7f3fce146800 20 remove_watcher() i=6 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.360+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94835881706192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5640b30a33d0 con 0x7f3fc0080930 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94835881706192] v29'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc4031040 con 0x7f3fc0080930 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 20 remove_watcher() i=7 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3fc0080930 msgr2=0x7f3fc0073420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3fc0080930 0x7f3fc0073420 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b3097aa0 msgr2=0x5640b3099f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b3097aa0 0x5640b3099f60 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3fbc063040 msgr2=0x7f3fbc038a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3fbc063040 0x7f3fbc038a50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.351 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b309c490 msgr2=0x5640b309e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b309c490 0x5640b309e880 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e94036900 msgr2=0x7f3e94038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e94036900 0x7f3e94038dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0055040 tx=0x7f3fc0060040 comp rx=0 tx=0).stop 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 msgr2=0x5640b308c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fcc44d640 1 -- 172.21.15.173:0/3569882955 reap_dead start 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b308c3c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00cb00 tx=0x7f3fbc040f60 comp rx=0 tx=0).stop 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 shutdown_connections 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 --2- 172.21.15.173:0/3569882955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3085010 0x5640b308c3c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.361+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 >> 172.21.15.173:0/3569882955 conn(0x5640b3081290 msgr2=0x5640b307e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 shutdown_connections 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/3569882955 wait complete. 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ea4036900 msgr2=0x7f3ea4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ea4036900 0x7f3ea4038dc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x5640b3061600 tx=0x7f3fc0005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:01.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3077ff0 msgr2=0x5640b3078410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3077ff0 0x5640b3078410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0015f0 tx=0x7f3fbc04c010 comp rx=0 tx=0).stop 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 shutdown_connections 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ea4036900 0x7f3ea4038dc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/703162665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b3077ff0 0x5640b3078410 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 >> 172.21.15.173:0/703162665 conn(0x5640b306c090 msgr2=0x5640b306c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 shutdown_connections 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/703162665 wait complete. 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5640b3066fe0 msgr2=0x5640b3069430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5640b3066fe0 0x5640b3069430 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b2f5e540 msgr2=0x5640b30607c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5640b2f5e540 0x5640b30607c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b3063050 msgr2=0x5640b3065440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5640b3063050 0x5640b3065440 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3eb4036900 msgr2=0x7f3eb4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3eb4036900 0x7f3eb4038dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0054000 tx=0x7f3fc004e000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 msgr2=0x5640b3059580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 --2- 172.21.15.173:0/2312038663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5640b2f5ca00 0x5640b3059580 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc001de0 tx=0x7f3fbc000ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fcc44d640 1 -- 172.21.15.173:0/2312038663 reap_dead start 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 shutdown_connections 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.362+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 >> 172.21.15.173:0/2312038663 conn(0x5640b2f585c0 msgr2=0x5640b304bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.363+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 shutdown_connections 2024-05-15T18:09:01.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.363+0000 7f3fce146800 1 -- 172.21.15.173:0/2312038663 wait complete. 2024-05-15T18:09:01.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-05-15T18:09:01.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-05-15T18:09:01.355 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-05-15T18:09:01.399 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:01.399 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff583375800 1 Processor -- start 2024-05-15T18:09:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff583375800 1 -- start start 2024-05-15T18:09:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff583375800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5645e5bdc3b0 0x5645e5bdc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff583375800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5645e5bdce00 con 0x5645e5bdf3f0 2024-05-15T18:09:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff583375800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5645e5a6f050 con 0x5645e5bdc3b0 2024-05-15T18:09:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff580e74640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5645e5bdc3b0 0x5645e5bdc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff57bfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5645e5bdf3f0 0x5645e5bdf8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57134/0 (socket says 172.21.15.173:57134) 2024-05-15T18:09:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.423+0000 7ff57bfff640 1 -- 172.21.15.173:0/2973197875 learned_addr learned my addr 172.21.15.173:0/2973197875 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.424+0000 7ff580e74640 1 -- 172.21.15.173:0/2973197875 >> v1:172.21.15.3:6789/0 conn(0x5645e5bdf3f0 legacy=0x5645e5bdf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.424+0000 7ff580e74640 1 -- 172.21.15.173:0/2973197875 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e5bdffb0 con 0x5645e5bdc3b0 2024-05-15T18:09:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff580e74640 1 --2- 172.21.15.173:0/2973197875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bdc7d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff57400a470 tx=0x7ff57401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdffc28ccc9541a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff57b7fe640 1 -- 172.21.15.173:0/2973197875 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff574057070 con 0x5645e5bdc3b0 2024-05-15T18:09:01.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff57b7fe640 1 -- 172.21.15.173:0/2973197875 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57404adc0 con 0x5645e5bdc3b0 2024-05-15T18:09:01.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff57b7fe640 1 -- 172.21.15.173:0/2973197875 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff574052590 con 0x5645e5bdc3b0 2024-05-15T18:09:01.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff583375800 1 -- 172.21.15.173:0/2973197875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 msgr2=0x5645e5bdc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff583375800 1 --2- 172.21.15.173:0/2973197875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bdc7d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff57400a470 tx=0x7ff57401ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff583375800 1 -- 172.21.15.173:0/2973197875 shutdown_connections 2024-05-15T18:09:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff583375800 1 --2- 172.21.15.173:0/2973197875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bdc7d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff583375800 1 -- 172.21.15.173:0/2973197875 >> 172.21.15.173:0/2973197875 conn(0x5645e5bd7d30 msgr2=0x5645e5bda150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff583375800 1 -- 172.21.15.173:0/2973197875 shutdown_connections 2024-05-15T18:09:01.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.426+0000 7ff583375800 1 -- 172.21.15.173:0/2973197875 wait complete. 2024-05-15T18:09:01.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.440+0000 7ff583375800 1 Processor -- start 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.440+0000 7ff583375800 1 -- start start 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.440+0000 7ff583375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bded30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.440+0000 7ff583375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5645e5b291d0 con 0x5645e5bdc3b0 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.440+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.440+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bded30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39202/0 (socket says 172.21.15.173:39202) 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.440+0000 7ff580e74640 1 -- 172.21.15.173:0/2195044317 learned_addr learned my addr 172.21.15.173:0/2195044317 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.441+0000 7ff580e74640 1 -- 172.21.15.173:0/2195044317 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e5bdd2f0 con 0x5645e5bdc3b0 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.441+0000 7ff580e74640 1 --2- 172.21.15.173:0/2195044317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bded30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff57401ced0 tx=0x7ff57404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785a65a00c2403f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.441+0000 7ff46ee05640 1 -- 172.21.15.173:0/2195044317 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff574057040 con 0x5645e5bdc3b0 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.441+0000 7ff46ee05640 1 -- 172.21.15.173:0/2195044317 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574063070 con 0x5645e5bdc3b0 2024-05-15T18:09:01.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.441+0000 7ff46ee05640 1 -- 172.21.15.173:0/2195044317 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff574052800 con 0x5645e5bdc3b0 2024-05-15T18:09:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 -- 172.21.15.173:0/2195044317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 msgr2=0x5645e5bded30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 --2- 172.21.15.173:0/2195044317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bded30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff57401ced0 tx=0x7ff57404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 -- 172.21.15.173:0/2195044317 shutdown_connections 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 --2- 172.21.15.173:0/2195044317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5bded30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 -- 172.21.15.173:0/2195044317 >> 172.21.15.173:0/2195044317 conn(0x5645e5bd7d30 msgr2=0x5645e5ccb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 -- 172.21.15.173:0/2195044317 shutdown_connections 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 -- 172.21.15.173:0/2195044317 wait complete. 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 Processor -- start 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 -- start start 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5cd9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff583375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5645e5be7860 con 0x5645e5bdc3b0 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.442+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5cd9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5cd9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39208/0 (socket says 172.21.15.173:39208) 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff580e74640 1 -- 172.21.15.173:0/3963244896 learned_addr learned my addr 172.21.15.173:0/3963244896 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff580e74640 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e5cd99c0 con 0x5645e5bdc3b0 2024-05-15T18:09:01.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff580e74640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5cd9480 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff57401ced0 tx=0x7ff574002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff46d602640 1 -- 172.21.15.173:0/3963244896 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57406d070 con 0x5645e5bdc3b0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff46d602640 1 -- 172.21.15.173:0/3963244896 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff574052d20 con 0x5645e5bdc3b0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645e5cd9c50 con 0x5645e5bdc3b0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff46d602640 1 -- 172.21.15.173:0/3963244896 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff574057050 con 0x5645e5bdc3b0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.443+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e5cdc900 con 0x5645e5bdc3b0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.444+0000 7ff46d602640 1 -- 172.21.15.173:0/3963244896 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff57405d470 con 0x5645e5bdc3b0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.444+0000 7ff46d602640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff468036900 0x7ff468038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.444+0000 7ff46d602640 1 -- 172.21.15.173:0/3963244896 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff57408d930 con 0x5645e5bdc3b0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.444+0000 7ff57bfff640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff468036900 0x7ff468038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.444+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5bdf3f0 0x5645e5ce06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.444+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5ce0c00 con 0x5645e5bdf3f0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.444+0000 7ff581675640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5bdf3f0 0x5645e5ce06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff57bfff640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff468036900 0x7ff468038dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff56c000f60 tx=0x7ff56c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff581675640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5bdf3f0 0x5645e5ce06c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff581675640 1 -- 172.21.15.173:0/3963244896 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5bdf3f0 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5cddc90 con 0x5645e5bdf3f0 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff581675640 1 -- 172.21.15.173:0/3963244896 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5bdf3f0 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5ce2f80 0x5645e5ce5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5ce5a10 con 0x5645e5ce2f80 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.445+0000 7ff580e74640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5ce2f80 0x5645e5ce5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.446+0000 7ff580e74640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5ce2f80 0x5645e5ce5370 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.446+0000 7ff580e74640 1 -- 172.21.15.173:0/3963244896 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff574078070 con 0x5645e5ce2f80 2024-05-15T18:09:01.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.446+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5ce1f30 con 0x5645e5bdf3f0 2024-05-15T18:09:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.446+0000 7ff581675640 1 -- 172.21.15.173:0/3963244896 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5bdf3f0 2024-05-15T18:09:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.446+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5645e5ce6e70 0x5645e5ce9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.446+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5ce9a60 con 0x5645e5ce6e70 2024-05-15T18:09:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.447+0000 7ff57bfff640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5645e5ce6e70 0x5645e5ce9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.447+0000 7ff57bfff640 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5645e5ce6e70 0x5645e5ce9300 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.447+0000 7ff57bfff640 1 -- 172.21.15.173:0/3963244896 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff56c009050 con 0x5645e5ce6e70 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff583375800 1 Processor -- start 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff583375800 1 -- start start 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff583375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5cf7ec0 0x5645e5cf82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff583375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5645e5acfcf0 con 0x5645e5cf7ec0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5cf7ec0 0x5645e5cf82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5cf7ec0 0x5645e5cf82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39210/0 (socket says 172.21.15.173:39210) 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff580e74640 1 -- 172.21.15.173:0/2771679193 learned_addr learned my addr 172.21.15.173:0/2771679193 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff580e74640 1 -- 172.21.15.173:0/2771679193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e5cf8820 con 0x5645e5cf7ec0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.448+0000 7ff580e74640 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5cf7ec0 0x5645e5cf82e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff57408be80 tx=0x7ff57405b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.449+0000 7ff4667fc640 1 -- 172.21.15.173:0/2771679193 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57405b800 con 0x5645e5cf7ec0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.449+0000 7ff4667fc640 1 -- 172.21.15.173:0/2771679193 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57405b9a0 con 0x5645e5cf7ec0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.449+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645e5cf9290 con 0x5645e5cf7ec0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.449+0000 7ff4667fc640 1 -- 172.21.15.173:0/2771679193 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff574066b90 con 0x5645e5cf7ec0 2024-05-15T18:09:01.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.449+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e5cf9790 con 0x5645e5cf7ec0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.449+0000 7ff4667fc640 1 -- 172.21.15.173:0/2771679193 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff574054aa0 con 0x5645e5cf7ec0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff4667fc640 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff458036970 0x7ff458038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff4667fc640 1 -- 172.21.15.173:0/2771679193 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff574098af0 con 0x5645e5cf7ec0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff57bfff640 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff458036970 0x7ff458038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff583375800 1 Processor -- start 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff583375800 1 -- start start 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff57bfff640 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff458036970 0x7ff458038e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00bf50 tx=0x7ff56c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff583375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d05500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff583375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5645e5bdd5b0 con 0x5645e5d050e0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d05500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d05500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39222/0 (socket says 172.21.15.173:39222) 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.450+0000 7ff580e74640 1 -- 172.21.15.173:0/2393161690 learned_addr learned my addr 172.21.15.173:0/2393161690 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.451+0000 7ff580e74640 1 -- 172.21.15.173:0/2393161690 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e5d05ad0 con 0x5645e5d050e0 2024-05-15T18:09:01.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.451+0000 7ff580e74640 1 --2- 172.21.15.173:0/2393161690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d05500 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff574094fd0 tx=0x7ff574087f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376eb26dab4f1d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.451+0000 7ff457fff640 1 -- 172.21.15.173:0/2393161690 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5740a5020 con 0x5645e5d050e0 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.451+0000 7ff457fff640 1 -- 172.21.15.173:0/2393161690 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57408a960 con 0x5645e5d050e0 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.451+0000 7ff457fff640 1 -- 172.21.15.173:0/2393161690 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57407cd60 con 0x5645e5d050e0 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 -- 172.21.15.173:0/2393161690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 msgr2=0x5645e5d05500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 --2- 172.21.15.173:0/2393161690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d05500 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff574094fd0 tx=0x7ff574087f00 comp rx=0 tx=0).stop 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 -- 172.21.15.173:0/2393161690 shutdown_connections 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 --2- 172.21.15.173:0/2393161690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d05500 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 -- 172.21.15.173:0/2393161690 >> 172.21.15.173:0/2393161690 conn(0x5645e5d01440 msgr2=0x5645e5cff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 -- 172.21.15.173:0/2393161690 shutdown_connections 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 -- 172.21.15.173:0/2393161690 wait complete. 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 Processor -- start 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 -- start start 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d0c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff583375800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5645e5d06180 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d0c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff580e74640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d0c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39226/0 (socket says 172.21.15.173:39226) 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.452+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 learned_addr learned my addr 172.21.15.173:0/1143679910 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.453+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e5d0ca00 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.453+0000 7ff580e74640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d0c4c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff574087f40 tx=0x7ff574071e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.453+0000 7ff4567fc640 1 -- 172.21.15.173:0/1143679910 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5740ba070 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.453+0000 7ff4567fc640 1 -- 172.21.15.173:0/1143679910 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57408d290 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.453+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645e5d0ca00 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.453+0000 7ff4567fc640 1 -- 172.21.15.173:0/1143679910 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff57408d570 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.453+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e5d0ca00 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff4567fc640 1 -- 172.21.15.173:0/1143679910 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff5740bd070 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff4567fc640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff44c036900 0x7ff44c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff4567fc640 1 -- 172.21.15.173:0/1143679910 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ff5740b1030 con 0x5645e5d050e0 2024-05-15T18:09:01.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff57bfff640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff44c036900 0x7ff44c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5d17ab0 0x5645e5d19f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1a6c0 con 0x5645e5d17ab0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.454+0000 7ff581675640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5d17ab0 0x5645e5d19f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff57bfff640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff44c036900 0x7ff44c038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001b60 tx=0x7ff56c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff581675640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5d17ab0 0x5645e5d19f70 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 20 realm 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1aad0 con 0x5645e5d17ab0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b3a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.455+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff583375800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5d1c270 0x5645e5d1e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1eda0 con 0x5645e5d1c270 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff580e74640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5d1c270 0x5645e5d1e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff580e74640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5d1c270 0x5645e5d1e660 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff583375800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff583375800 20 searching for the correct realm 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.456+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d20730 con 0x5645e5d1c270 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff580e74640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5740bf060 0x7ff574083920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d20730 con 0x7ff5740bf060 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff57bfff640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5740bf060 0x7ff574083920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff57bfff640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5740bf060 0x7ff574083920 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff57bfff640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff56c037040 0x7ff56c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.457+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d20730 con 0x7ff56c037040 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.458+0000 7ff581675640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff56c037040 0x7ff56c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.458+0000 7ff581675640 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff56c037040 0x7ff56c036410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.458+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.458+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.459+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff5740bf060 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.460+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff5740bf060 2024-05-15T18:09:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.461+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.462+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff5740bf060 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.463+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.464+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.464+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.464+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.464+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.464+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.464+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff5740bf060 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d1c270 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff56c037040 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x5645e5d17ab0 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.465+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1b740 con 0x7ff5740bf060 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:01.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1f850 con 0x5645e5d17ab0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d200f0 con 0x5645e5d17ab0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.466+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1fc40 con 0x7ff56c037040 2024-05-15T18:09:01.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 zone default found 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 4 Realm: () 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 zonegroup default 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d1fc40 con 0x7ff56c037040 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d20070 con 0x5645e5d1c270 2024-05-15T18:09:01.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d225c0 con 0x5645e5d1c270 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 started sync module instance, tier type = 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.467+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d21a60 con 0x7ff5740bf060 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.468+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.468+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858208484992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d22e60 con 0x7ff5740bf060 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.468+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d236b0 con 0x5645e5d17ab0 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.469+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94858208484992] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.469+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.470+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858208487856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d23770 con 0x5645e5d17ab0 2024-05-15T18:09:01.459 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.470+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d24290 con 0x5645e5d1c270 2024-05-15T18:09:01.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.471+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94858208487856] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.477+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.477+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858208492896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d24250 con 0x5645e5d1c270 2024-05-15T18:09:01.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.477+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d24cf0 con 0x7ff5740bf060 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.478+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.478+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858208495648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d25590 con 0x7ff5740bf060 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.478+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d26070 con 0x5645e5d17ab0 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.478+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94858208492896] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.479+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.479+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858208500608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d26460 con 0x5645e5d17ab0 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.479+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d26e60 con 0x7ff56c037040 2024-05-15T18:09:01.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.479+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94858208495648] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.480+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.480+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858208497888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d26e20 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.480+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d27890 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.480+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94858208500608] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.481+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.481+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94858208497888] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.481+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858208506720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d27850 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.481+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d26970 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94858208506720] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858208489984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d27df0 con 0x7ff56c037040 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 20 add_watcher() i=0 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 20 add_watcher() i=1 2024-05-15T18:09:01.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 20 add_watcher() i=2 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 20 add_watcher() i=3 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 20 add_watcher() i=4 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 20 add_watcher() i=5 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.482+0000 7ff583375800 20 add_watcher() i=6 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.483+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94858208489984] v29'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.483+0000 7ff583375800 20 add_watcher() i=7 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.483+0000 7ff583375800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.483+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d2b2d0 con 0x5645e5d17ab0 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.483+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.483+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858208509424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d286c0 con 0x5645e5d17ab0 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.484+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94858208509424] v29'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff4377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff583375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff583375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:01.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff583375800 5 note: GC not initialized 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff4367e4640 20 reqs_thread_entry: start 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff583375800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff583375800 20 Filter name: none 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff42ffff640 20 reqs_thread_entry: start 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff583375800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.485+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d5e0a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.486+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.486+0000 7ff583375800 20 rados_obj.operate() r=0 bl.length=193 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.487+0000 7ff4377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.487+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858208509424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d286c0 con 0x5645e5d17ab0 2024-05-15T18:09:01.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.488+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94858208509424] v29'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.488+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858208484992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d282a0 con 0x7ff5740bf060 2024-05-15T18:09:01.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.488+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94858208484992] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.488+0000 7ff583375800 20 remove_watcher() i=0 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.488+0000 7ff583375800 2 removed watcher, disabling cache 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.488+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858208487856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d21e80 con 0x5645e5d17ab0 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.490+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94858208487856] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.490+0000 7ff583375800 20 remove_watcher() i=1 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.490+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858208492896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d229b0 con 0x5645e5d1c270 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.491+0000 7ff580e74640 1 -- 172.21.15.173:0/1143679910 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94858208492896] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5740bc030 con 0x5645e5d1c270 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.491+0000 7ff583375800 20 remove_watcher() i=2 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.491+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858208495648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d23d60 con 0x7ff5740bf060 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.492+0000 7ff57bfff640 1 -- 172.21.15.173:0/1143679910 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94858208495648] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c009050 con 0x7ff5740bf060 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.492+0000 7ff583375800 20 remove_watcher() i=3 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.492+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858208500608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d23d60 con 0x5645e5d17ab0 2024-05-15T18:09:01.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.492+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94858208500608] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x5645e5d17ab0 2024-05-15T18:09:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.492+0000 7ff583375800 20 remove_watcher() i=4 2024-05-15T18:09:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.492+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858208497888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d25b80 con 0x7ff56c037040 2024-05-15T18:09:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.493+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94858208497888] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.493+0000 7ff583375800 20 remove_watcher() i=5 2024-05-15T18:09:01.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.493+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858208506720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d23d60 con 0x7ff56c037040 2024-05-15T18:09:01.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.494+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94858208506720] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.494+0000 7ff583375800 20 remove_watcher() i=6 2024-05-15T18:09:01.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.494+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858208489984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5645e5d250e0 con 0x7ff56c037040 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.495+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94858208489984] v29'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff57c00a4a0 con 0x7ff56c037040 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.495+0000 7ff583375800 20 remove_watcher() i=7 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff56c037040 msgr2=0x7ff56c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff56c037040 0x7ff56c036410 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5d17ab0 msgr2=0x5645e5d19f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5d17ab0 0x5645e5d19f70 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5740bf060 msgr2=0x7ff574083920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5740bf060 0x7ff574083920 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5d1c270 msgr2=0x5645e5d1e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5d1c270 0x5645e5d1e660 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff44c036900 msgr2=0x7ff44c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff44c036900 0x7ff44c038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001b60 tx=0x7ff56c010000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 msgr2=0x5645e5d0c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/1143679910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5d050e0 0x5645e5d0c4c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff574087f40 tx=0x7ff574071e90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 reap_dead start 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff581675640 1 -- 172.21.15.173:0/1143679910 reap_dead start 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 shutdown_connections 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 >> 172.21.15.173:0/1143679910 conn(0x5645e5d01440 msgr2=0x5645e5cfeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 shutdown_connections 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/1143679910 wait complete. 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff458036970 msgr2=0x7ff458038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff458036970 0x7ff458038e30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00bf50 tx=0x7ff56c00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5cf7ec0 msgr2=0x5645e5cf82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5cf7ec0 0x5645e5cf82e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff57408be80 tx=0x7ff57405b370 comp rx=0 tx=0).stop 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 shutdown_connections 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff458036970 0x7ff458038e30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 --2- 172.21.15.173:0/2771679193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5cf7ec0 0x5645e5cf82e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 >> 172.21.15.173:0/2771679193 conn(0x5645e5cebf60 msgr2=0x5645e5cec360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 shutdown_connections 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.496+0000 7ff583375800 1 -- 172.21.15.173:0/2771679193 wait complete. 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5645e5ce6e70 msgr2=0x5645e5ce9300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5645e5ce6e70 0x5645e5ce9300 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5bdf3f0 msgr2=0x5645e5ce06c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5645e5bdf3f0 0x5645e5ce06c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5ce2f80 msgr2=0x5645e5ce5370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5645e5ce2f80 0x5645e5ce5370 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff468036900 msgr2=0x7ff468038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff468036900 0x7ff468038dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff56c000f60 tx=0x7ff56c0012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 msgr2=0x5645e5cd9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 --2- 172.21.15.173:0/3963244896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645e5bdc3b0 0x5645e5cd9480 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff57401ced0 tx=0x7ff574002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff581675640 1 -- 172.21.15.173:0/3963244896 reap_dead start 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 shutdown_connections 2024-05-15T18:09:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 >> 172.21.15.173:0/3963244896 conn(0x5645e5bd7d30 msgr2=0x5645e5bddb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 shutdown_connections 2024-05-15T18:09:01.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.497+0000 7ff583375800 1 -- 172.21.15.173:0/3963244896 wait complete. 2024-05-15T18:09:01.482 INFO:teuthology.orchestra.run.smithi173.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"sg4fvnAfgvKclqrAUwQK0KSt","ver":2},"mtime":"2024-05-15T18:09:01.346266Z","data":{"bucket":{"name":"myfoo","marker":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","bucket_id":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-05-15T18:08:58.890026Z","linked":true,"has_bucket_info":false}} 2024-05-15T18:09:01.482 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'sg4fvnAfgvKclqrAUwQK0KSt', 'ver': 2}, 'mtime': '2024-05-15T18:09:01.346266Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'bucket_id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-05-15T18:08:58.890026Z', 'linked': True, 'has_bucket_info': False}} 2024-05-15T18:09:01.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-15T18:09:01.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-15T18:09:01.483 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-05-15T18:09:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:01.569 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:01.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad65e16800 1 Processor -- start 2024-05-15T18:09:01.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad65e16800 1 -- start start 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad65e16800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560b9f8a8fd0 0x560b9f8a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad65e16800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b9f8a9a70 con 0x560b9f8aa230 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad65e16800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x560b9f73b050 con 0x560b9f8a8fd0 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad61484640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560b9f8a8fd0 0x560b9f8a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad60c83640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x560b9f8aa230 0x560b9f8aa6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57150/0 (socket says 172.21.15.173:57150) 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.593+0000 7fad60c83640 1 -- 172.21.15.173:0/2171400162 learned_addr learned my addr 172.21.15.173:0/2171400162 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.594+0000 7fad61484640 1 -- 172.21.15.173:0/2171400162 >> v1:172.21.15.3:6789/0 conn(0x560b9f8aa230 legacy=0x560b9f8aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.594+0000 7fad61484640 1 -- 172.21.15.173:0/2171400162 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9f8aadf0 con 0x560b9f8a8fd0 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.595+0000 7fad61484640 1 --2- 172.21.15.173:0/2171400162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f8a93f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00a470 tx=0x7fad5c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305fb51cf558e64d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad5bfff640 1 -- 172.21.15.173:0/2171400162 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c057070 con 0x560b9f8a8fd0 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad5bfff640 1 -- 172.21.15.173:0/2171400162 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c04adc0 con 0x560b9f8a8fd0 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad5bfff640 1 -- 172.21.15.173:0/2171400162 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c052590 con 0x560b9f8a8fd0 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad65e16800 1 -- 172.21.15.173:0/2171400162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 msgr2=0x560b9f8a93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad65e16800 1 --2- 172.21.15.173:0/2171400162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f8a93f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00a470 tx=0x7fad5c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad65e16800 1 -- 172.21.15.173:0/2171400162 shutdown_connections 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad65e16800 1 --2- 172.21.15.173:0/2171400162 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f8a93f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad65e16800 1 -- 172.21.15.173:0/2171400162 >> 172.21.15.173:0/2171400162 conn(0x560b9f8a45b0 msgr2=0x560b9f8a69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad65e16800 1 -- 172.21.15.173:0/2171400162 shutdown_connections 2024-05-15T18:09:01.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.596+0000 7fad65e16800 1 -- 172.21.15.173:0/2171400162 wait complete. 2024-05-15T18:09:01.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad65e16800 1 Processor -- start 2024-05-15T18:09:01.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad65e16800 1 -- start start 2024-05-15T18:09:01.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad65e16800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f99a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad65e16800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b9f7f51c0 con 0x560b9f8a8fd0 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f99a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f99a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39248/0 (socket says 172.21.15.173:39248) 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad61484640 1 -- 172.21.15.173:0/3721847055 learned_addr learned my addr 172.21.15.173:0/3721847055 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.610+0000 7fad61484640 1 -- 172.21.15.173:0/3721847055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9f99ac80 con 0x560b9f8a8fd0 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.611+0000 7fad61484640 1 --2- 172.21.15.173:0/3721847055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f99a6b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad5c01ced0 tx=0x7fad5c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5009e6e6343c26b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.611+0000 7fac4f606640 1 -- 172.21.15.173:0/3721847055 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c057040 con 0x560b9f8a8fd0 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.611+0000 7fac4f606640 1 -- 172.21.15.173:0/3721847055 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c063070 con 0x560b9f8a8fd0 2024-05-15T18:09:01.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.611+0000 7fac4f606640 1 -- 172.21.15.173:0/3721847055 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c052800 con 0x560b9f8a8fd0 2024-05-15T18:09:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.611+0000 7fad65e16800 1 -- 172.21.15.173:0/3721847055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 msgr2=0x560b9f99a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.611+0000 7fad65e16800 1 --2- 172.21.15.173:0/3721847055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f99a6b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad5c01ced0 tx=0x7fad5c04c000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 -- 172.21.15.173:0/3721847055 shutdown_connections 2024-05-15T18:09:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 --2- 172.21.15.173:0/3721847055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f99a6b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 -- 172.21.15.173:0/3721847055 >> 172.21.15.173:0/3721847055 conn(0x560b9f8a45b0 msgr2=0x560b9f995fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 -- 172.21.15.173:0/3721847055 shutdown_connections 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 -- 172.21.15.173:0/3721847055 wait complete. 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 Processor -- start 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 -- start start 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f9a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad65e16800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b9f8b2700 con 0x560b9f8a8fd0 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f9a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f9a2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39262/0 (socket says 172.21.15.173:39262) 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad61484640 1 -- 172.21.15.173:0/282371056 learned_addr learned my addr 172.21.15.173:0/282371056 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.612+0000 7fad61484640 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9f9a2640 con 0x560b9f8a8fd0 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.613+0000 7fad61484640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f9a2100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad5c01ced0 tx=0x7fad5c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.613+0000 7fac4de03640 1 -- 172.21.15.173:0/282371056 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c06d070 con 0x560b9f8a8fd0 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.613+0000 7fac4de03640 1 -- 172.21.15.173:0/282371056 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c052d20 con 0x560b9f8a8fd0 2024-05-15T18:09:01.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.613+0000 7fac4de03640 1 -- 172.21.15.173:0/282371056 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c057050 con 0x560b9f8a8fd0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.613+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b9f9a28d0 con 0x560b9f8a8fd0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.613+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b9f9a5580 con 0x560b9f8a8fd0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fac4de03640 1 -- 172.21.15.173:0/282371056 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad5c05d470 con 0x560b9f8a8fd0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fac4de03640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac48036900 0x7fac48038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fac4de03640 1 -- 172.21.15.173:0/282371056 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fad5c08d930 con 0x560b9f8a8fd0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fad60c83640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac48036900 0x7fac48038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f8aa230 0x560b9f9a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9a9880 con 0x560b9f8aa230 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fad61c85640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f8aa230 0x560b9f9a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.614+0000 7fad60c83640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac48036900 0x7fac48038dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad4c000f60 tx=0x7fad4c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad61c85640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f8aa230 0x560b9f9a9340 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad61c85640 1 -- 172.21.15.173:0/282371056 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f8aa230 2024-05-15T18:09:01.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9a6910 con 0x560b9f8aa230 2024-05-15T18:09:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad61c85640 1 -- 172.21.15.173:0/282371056 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f8aa230 2024-05-15T18:09:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9abb90 0x560b9f9adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ae670 con 0x560b9f9abb90 2024-05-15T18:09:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad61484640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9abb90 0x560b9f9adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.615+0000 7fad61484640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9abb90 0x560b9f9adf80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.616+0000 7fad61484640 1 -- 172.21.15.173:0/282371056 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad5c078070 con 0x560b9f9abb90 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.616+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9aab40 con 0x560b9f8aa230 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.616+0000 7fad61c85640 1 -- 172.21.15.173:0/282371056 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f8aa230 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.616+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560b9f9afad0 0x560b9f9b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.616+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9b26a0 con 0x560b9f9afad0 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.616+0000 7fad60c83640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560b9f9afad0 0x560b9f9b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.617+0000 7fad60c83640 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560b9f9afad0 0x560b9f9b1f40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.617+0000 7fad60c83640 1 -- 172.21.15.173:0/282371056 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad4c009050 con 0x560b9f9afad0 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.617+0000 7fad65e16800 1 Processor -- start 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.617+0000 7fad65e16800 1 -- start start 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.617+0000 7fad65e16800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9b6860 0x560b9f9b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.617+0000 7fad65e16800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b9f79bcf0 con 0x560b9f9b6860 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9b6860 0x560b9f9b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9b6860 0x560b9f9b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39266/0 (socket says 172.21.15.173:39266) 2024-05-15T18:09:01.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fad61484640 1 -- 172.21.15.173:0/1082982119 learned_addr learned my addr 172.21.15.173:0/1082982119 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fad61484640 1 -- 172.21.15.173:0/1082982119 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9f9b5210 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fad61484640 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9b6860 0x560b9f9b4cd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad5c08be80 tx=0x7fad5c05b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fac46ffd640 1 -- 172.21.15.173:0/1082982119 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c05b800 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fac46ffd640 1 -- 172.21.15.173:0/1082982119 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c05b9a0 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b9f9b54a0 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fac46ffd640 1 -- 172.21.15.173:0/1082982119 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c066b90 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.618+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b9f9b59a0 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.619+0000 7fac46ffd640 1 -- 172.21.15.173:0/1082982119 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad5c054aa0 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.619+0000 7fac46ffd640 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac3c036900 0x7fac3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.619+0000 7fac46ffd640 1 -- 172.21.15.173:0/1082982119 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fad5c098af0 con 0x560b9f9b6860 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.619+0000 7fad60c83640 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac3c036900 0x7fac3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad65e16800 1 Processor -- start 2024-05-15T18:09:01.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad65e16800 1 -- start start 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad60c83640 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac3c036900 0x7fac3c038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00bf50 tx=0x7fad4c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad65e16800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad65e16800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b9f99af40 con 0x560b9f9d1080 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39276/0 (socket says 172.21.15.173:39276) 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad61484640 1 -- 172.21.15.173:0/2486800918 learned_addr learned my addr 172.21.15.173:0/2486800918 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad61484640 1 -- 172.21.15.173:0/2486800918 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9f9d1a70 con 0x560b9f9d1080 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.620+0000 7fad61484640 1 --2- 172.21.15.173:0/2486800918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d14a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad5c094fd0 tx=0x7fad5c087f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802fdbd30b54d306 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fac44ff9640 1 -- 172.21.15.173:0/2486800918 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c0a5020 con 0x560b9f9d1080 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fac44ff9640 1 -- 172.21.15.173:0/2486800918 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c08a960 con 0x560b9f9d1080 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fac44ff9640 1 -- 172.21.15.173:0/2486800918 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c07cd60 con 0x560b9f9d1080 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 -- 172.21.15.173:0/2486800918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 msgr2=0x560b9f9d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 --2- 172.21.15.173:0/2486800918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d14a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fad5c094fd0 tx=0x7fad5c087f00 comp rx=0 tx=0).stop 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 -- 172.21.15.173:0/2486800918 shutdown_connections 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 --2- 172.21.15.173:0/2486800918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d14a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 -- 172.21.15.173:0/2486800918 >> 172.21.15.173:0/2486800918 conn(0x560b9f9cd3e0 msgr2=0x560b9f9cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 -- 172.21.15.173:0/2486800918 shutdown_connections 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 -- 172.21.15.173:0/2486800918 wait complete. 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 Processor -- start 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.621+0000 7fad65e16800 1 -- start start 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.622+0000 7fad65e16800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.622+0000 7fad65e16800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560b9f9d2120 con 0x560b9f9d1080 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.622+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.622+0000 7fad61484640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39290/0 (socket says 172.21.15.173:39290) 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.622+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 learned_addr learned my addr 172.21.15.173:0/3464918564 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.622+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b9f9d8960 con 0x560b9f9d1080 2024-05-15T18:09:01.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.622+0000 7fad61484640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d8420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad5c08ac80 tx=0x7fad5c071e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.623+0000 7fac32ffd640 1 -- 172.21.15.173:0/3464918564 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c0ba070 con 0x560b9f9d1080 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.623+0000 7fac32ffd640 1 -- 172.21.15.173:0/3464918564 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c08d290 con 0x560b9f9d1080 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.623+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b9f9d8960 con 0x560b9f9d1080 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.623+0000 7fac32ffd640 1 -- 172.21.15.173:0/3464918564 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad5c08d570 con 0x560b9f9d1080 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.623+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b9f9d8960 con 0x560b9f9d1080 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.623+0000 7fac32ffd640 1 -- 172.21.15.173:0/3464918564 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fad5c0bd070 con 0x560b9f9d1080 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fac32ffd640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac2c036900 0x7fac2c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fac32ffd640 1 -- 172.21.15.173:0/3464918564 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fad5c0b1030 con 0x560b9f9d1080 2024-05-15T18:09:01.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fad60c83640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac2c036900 0x7fac2c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fad60c83640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac2c036900 0x7fac2c038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad4c001b60 tx=0x7fad4c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f9e3a80 0x560b9f9e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e6690 con 0x560b9f9e3a80 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.624+0000 7fad61c85640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f9e3a80 0x560b9f9e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad61c85640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f9e3a80 0x560b9f9e5f40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 20 realm 2024-05-15T18:09:01.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e6aa0 con 0x560b9f9e3a80 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7370 con 0x560b9f9e3a80 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.625+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad65e16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9e8470 0x560b9f9ea860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9eae20 con 0x560b9f9e8470 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad61484640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9e8470 0x560b9f9ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad61484640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9e8470 0x560b9f9ea860 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad65e16800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad65e16800 20 searching for the correct realm 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.626+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ec750 con 0x560b9f9e8470 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad61484640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fad5c0bf060 0x7fad5c083920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ec750 con 0x7fad5c0bf060 2024-05-15T18:09:01.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad60c83640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fad5c0bf060 0x7fad5c083920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad60c83640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fad5c0bf060 0x7fad5c083920 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad60c83640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fad4c037040 0x7fad4c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.627+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ec750 con 0x7fad4c037040 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.628+0000 7fad61c85640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fad4c037040 0x7fad4c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.628+0000 7fad61c85640 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fad4c037040 0x7fad4c036410 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.628+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad5400a4a0 con 0x7fad4c037040 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.628+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.628+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.628+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x7fad4c037040 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x7fad4c037040 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad5c0bf060 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.629+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x7fad4c037040 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.630+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad5c0bf060 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.631+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.631+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.631+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.631+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.631+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.631+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x7fad4c037040 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.632+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad5400a4a0 con 0x560b9f9e3a80 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54033040 con 0x7fad4c037040 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad5c0bf060 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.633+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.634+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.634+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.634+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.634+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad5c0bf060 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e8470 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad4c037040 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.635+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x560b9f9e3a80 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9e7710 con 0x7fad5c0bf060 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9eb6e0 con 0x560b9f9e3a80 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ebad0 con 0x560b9f9e3a80 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.636+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ebad0 con 0x7fad4c037040 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 zone default found 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 4 Realm: () 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 zonegroup default 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9eb340 con 0x7fad4c037040 2024-05-15T18:09:01.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9eb340 con 0x560b9f9e8470 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ee6f0 con 0x560b9f9e8470 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 started sync module instance, tier type = 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.637+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9eda50 con 0x7fad5c0bf060 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.638+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.638+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94607922617920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ed6b0 con 0x7fad5c0bf060 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.638+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9ef620 con 0x560b9f9e3a80 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.639+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94607922617920] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.640+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.640+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94607922622832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9efa40 con 0x560b9f9e3a80 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.640+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f0400 con 0x560b9f9e8470 2024-05-15T18:09:01.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.641+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94607922622832] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.641+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.641+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94607922626896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9efa40 con 0x560b9f9e8470 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.641+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f0e80 con 0x7fad5c0bf060 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.642+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.642+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94607922629008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f1750 con 0x7fad5c0bf060 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.642+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f2250 con 0x560b9f9e3a80 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.642+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94607922626896] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.643+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.643+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94607922634048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f2640 con 0x560b9f9e3a80 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.643+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f3060 con 0x7fad4c037040 2024-05-15T18:09:01.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.643+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94607922629008] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.644+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.644+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94607922637648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f3020 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.644+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f3a70 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.644+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94607922634048] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.645+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94607922637648] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.645+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.645+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94607922631328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f35c0 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.645+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f3e90 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94607922640320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f4540 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94607922631328] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 20 add_watcher() i=0 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 20 add_watcher() i=1 2024-05-15T18:09:01.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 20 add_watcher() i=2 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 20 add_watcher() i=3 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 20 add_watcher() i=4 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 20 add_watcher() i=5 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.646+0000 7fad65e16800 20 add_watcher() i=6 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.647+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94607922640320] v29'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.647+0000 7fad65e16800 20 add_watcher() i=7 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.647+0000 7fad65e16800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.647+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f7470 con 0x560b9f9e3a80 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.648+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.648+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94607922642832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9f9f4860 con 0x560b9f9e3a80 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.649+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94607922642832] v29'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.649+0000 7fac177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.649+0000 7fad65e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.649+0000 7fad65e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.649+0000 7fad65e16800 5 note: GC not initialized 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.649+0000 7fac167e4640 20 reqs_thread_entry: start 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.649+0000 7fad65e16800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 20 Filter name: none 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fab87fff640 20 reqs_thread_entry: start 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa2a830 con 0x560b9f9e3a80 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:01.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa2c7b0 con 0x560b9f9e3a80 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 20 rados_obj.operate() r=0 bl.length=193 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.650+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 8.16 8:6bd3cc74:root::.bucket.meta.testx%3amyfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa2df00 con 0x560b9f9e8470 2024-05-15T18:09:01.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 20 rados_obj.operate() r=0 bl.length=412 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.651+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa32210 con 0x560b9f9e3a80 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.652+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v29'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.652+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35b20 con 0x7fad4c037040 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.653+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(66 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [create,call,writefull 0~379,setxattr (123)] v29'7 uv7 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.653+0000 7fad65e16800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x7 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.653+0000 7fad65e16800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:01.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.653+0000 7fad65e16800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.653+0000 7fad65e16800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.653+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94607922903040 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa354a0 con 0x7fad4c037040 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== watch-notify(notify (1) cookie 94607922640320 notify 124554051598 ret 0) ==== 770+0+0 (crc 0 0 0) 0x560b9fa35ec0 con 0x7fad4c037040 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fac44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 94607922640320 notifier 4552 bl.length()=728 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(67 notify.7 [notify cookie 94607922903040 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fac44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x7 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fac44ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fac44ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fac44ff9640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fac24003ea0 con 0x7fad4c037040 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== watch-notify(notify_complete (2) cookie 94607922903040 notify 124554051598 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560b9fa31c40 con 0x7fad4c037040 2024-05-15T18:09:01.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad65e16800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_sources= new_sources= 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad65e16800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential sources added=[] removed=[] 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad65e16800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_dests= new_dests= 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad65e16800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential dests added=[] removed=[] 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.654+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa355a0 con 0x7fad5c0bf060 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.655+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(69 foo.buckets [call] v29'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.655+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x7fad5c0bf060 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v29'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fad65e16800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fad65e16800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fad65e16800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94607922903040 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x7fad4c037040 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== watch-notify(notify (1) cookie 94607922631328 notify 124554051599 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fad5401e040 con 0x7fad4c037040 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fac44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 94607922631328 notifier 4552 bl.length()=314 2024-05-15T18:09:01.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fac44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fac44ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(71 notify.6 [notify cookie 94607922903040 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.656+0000 7fac44ff9640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fac24003ea0 con 0x7fad4c037040 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.657+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.657+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== watch-notify(notify_complete (2) cookie 94607922903040 notify 124554051599 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fad54038620 con 0x7fad4c037040 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.657+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x560b9f9e3a80 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v29'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad65e16800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad65e16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94607922868976 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x560b9f9e3a80 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== watch-notify(notify (1) cookie 94607922634048 notify 124554051596 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7fad54038620 con 0x560b9f9e3a80 2024-05-15T18:09:01.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fac44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051596 cookie 94607922634048 notifier 4552 bl.length()=155 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(74 notify.4 [notify cookie 94607922868976 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fac44ff9640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fac24003ea0 con 0x560b9f9e3a80 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== watch-notify(notify_complete (2) cookie 94607922868976 notify 124554051596 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fad540388c0 con 0x560b9f9e3a80 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.658+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:76 8.16 8:6bd3cc74:root::.bucket.meta.testx%3amyfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x560b9f9e8470 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.659+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call,delete] v29'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.659+0000 7fad65e16800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 from cache 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.659+0000 7fad65e16800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.659+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94607922880112 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x7fad4c037040 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.660+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== watch-notify(notify (1) cookie 94607922631328 notify 124554051600 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7fad540388c0 con 0x7fad4c037040 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.660+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(77 notify.6 [notify cookie 94607922880112 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.660+0000 7fac33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051600 cookie 94607922631328 notifier 4552 bl.length()=212 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.660+0000 7fac33fff640 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fab94003330 con 0x7fad4c037040 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.660+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.660+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== watch-notify(notify_complete (2) cookie 94607922880112 notify 124554051600 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fad54038c90 con 0x7fad4c037040 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.661+0000 7fac177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.661+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94607922642832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x560b9f9e3a80 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.662+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94607922642832] v29'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.662+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94607922617920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa2d970 con 0x7fad5c0bf060 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.663+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94607922617920] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.663+0000 7fad65e16800 20 remove_watcher() i=0 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.663+0000 7fad65e16800 2 removed watcher, disabling cache 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.663+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94607922622832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x560b9f9e3a80 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.664+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94607922622832] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.664+0000 7fad65e16800 20 remove_watcher() i=1 2024-05-15T18:09:01.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.664+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94607922626896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa2d970 con 0x560b9f9e8470 2024-05-15T18:09:01.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.665+0000 7fad61484640 1 -- 172.21.15.173:0/3464918564 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94607922626896] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad5c0bc030 con 0x560b9f9e8470 2024-05-15T18:09:01.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.665+0000 7fad65e16800 20 remove_watcher() i=2 2024-05-15T18:09:01.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.665+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94607922629008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x7fad5c0bf060 2024-05-15T18:09:01.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.666+0000 7fad60c83640 1 -- 172.21.15.173:0/3464918564 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94607922629008] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad4c009050 con 0x7fad5c0bf060 2024-05-15T18:09:01.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.666+0000 7fad65e16800 20 remove_watcher() i=3 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.666+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94607922634048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa2d970 con 0x560b9f9e3a80 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.668+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94607922634048] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x560b9f9e3a80 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.668+0000 7fad65e16800 20 remove_watcher() i=4 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.668+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94607922637648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x7fad4c037040 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.669+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94607922637648] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.669+0000 7fad65e16800 20 remove_watcher() i=5 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.669+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94607922631328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa2d970 con 0x7fad4c037040 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.669+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94607922631328] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.669+0000 7fad65e16800 20 remove_watcher() i=6 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.669+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94607922640320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560b9fa35940 con 0x7fad4c037040 2024-05-15T18:09:01.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.670+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94607922640320] v29'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad54031040 con 0x7fad4c037040 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.670+0000 7fad65e16800 20 remove_watcher() i=7 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fad4c037040 msgr2=0x7fad4c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fad4c037040 0x7fad4c036410 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f9e3a80 msgr2=0x560b9f9e5f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f9e3a80 0x560b9f9e5f40 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fad5c0bf060 msgr2=0x7fad5c083920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fad5c0bf060 0x7fad5c083920 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9e8470 msgr2=0x560b9f9ea860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9e8470 0x560b9f9ea860 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac2c036900 msgr2=0x7fac2c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac2c036900 0x7fac2c038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad4c001b60 tx=0x7fad4c010000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 msgr2=0x560b9f9d8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad61c85640 1 -- 172.21.15.173:0/3464918564 reap_dead start 2024-05-15T18:09:01.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d8420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fad5c08ac80 tx=0x7fad5c071e90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 shutdown_connections 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/3464918564 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9d1080 0x560b9f9d8420 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 >> 172.21.15.173:0/3464918564 conn(0x560b9f9cd3e0 msgr2=0x560b9f9caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 shutdown_connections 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/3464918564 wait complete. 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac3c036900 msgr2=0x7fac3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac3c036900 0x7fac3c038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00bf50 tx=0x7fad4c00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9b6860 msgr2=0x560b9f9b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9b6860 0x560b9f9b4cd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad5c08be80 tx=0x7fad5c05b370 comp rx=0 tx=0).stop 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 shutdown_connections 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac3c036900 0x7fac3c038dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 --2- 172.21.15.173:0/1082982119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f9b6860 0x560b9f9b4cd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 >> 172.21.15.173:0/1082982119 conn(0x560b9f9b7200 msgr2=0x560b9f9b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 shutdown_connections 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.671+0000 7fad65e16800 1 -- 172.21.15.173:0/1082982119 wait complete. 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560b9f9afad0 msgr2=0x560b9f9b1f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560b9f9afad0 0x560b9f9b1f40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f8aa230 msgr2=0x560b9f9a9340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560b9f8aa230 0x560b9f9a9340 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9abb90 msgr2=0x560b9f9adf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560b9f9abb90 0x560b9f9adf80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac48036900 msgr2=0x7fac48038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fac48036900 0x7fac48038dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad4c000f60 tx=0x7fad4c0012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 msgr2=0x560b9f9a2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 --2- 172.21.15.173:0/282371056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560b9f8a8fd0 0x560b9f9a2100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad5c01ced0 tx=0x7fad5c002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad61c85640 1 -- 172.21.15.173:0/282371056 reap_dead start 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 shutdown_connections 2024-05-15T18:09:01.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 >> 172.21.15.173:0/282371056 conn(0x560b9f8a45b0 msgr2=0x560b9f9947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 shutdown_connections 2024-05-15T18:09:01.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.672+0000 7fad65e16800 1 -- 172.21.15.173:0/282371056 wait complete. 2024-05-15T18:09:01.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-15T18:09:01.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-15T18:09:01.662 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-05-15T18:09:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:01.708 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:01.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.732+0000 7f42d400e800 1 Processor -- start 2024-05-15T18:09:01.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.732+0000 7f42d400e800 1 -- start start 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.732+0000 7f42d400e800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557d97173550 0x557d9717c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.732+0000 7f42d400e800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d970e6910 con 0x557d97171a10 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.732+0000 7f42d400e800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x557d97004050 con 0x557d97173550 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.733+0000 7f42d130c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557d97173550 0x557d9717c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.733+0000 7f42d1b0d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x557d97171a10 0x557d97171e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57160/0 (socket says 172.21.15.173:57160) 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.733+0000 7f42d1b0d640 1 -- 172.21.15.173:0/2000917902 learned_addr learned my addr 172.21.15.173:0/2000917902 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.733+0000 7f42d130c640 1 -- 172.21.15.173:0/2000917902 >> v1:172.21.15.3:6789/0 conn(0x557d97171a10 legacy=0x557d97171e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.733+0000 7f42d130c640 1 -- 172.21.15.173:0/2000917902 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d970e6ae0 con 0x557d97173550 2024-05-15T18:09:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.735+0000 7f42d130c640 1 --2- 172.21.15.173:0/2000917902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97173550 0x557d9717c050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a470 tx=0x7f42bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebe5c706c54fd44 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.735+0000 7f42d0b0b640 1 -- 172.21.15.173:0/2000917902 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42bc057070 con 0x557d97173550 2024-05-15T18:09:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.735+0000 7f42d0b0b640 1 -- 172.21.15.173:0/2000917902 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42bc052570 con 0x557d97173550 2024-05-15T18:09:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.735+0000 7f42d0b0b640 1 -- 172.21.15.173:0/2000917902 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42bc052870 con 0x557d97173550 2024-05-15T18:09:01.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.735+0000 7f42d400e800 1 -- 172.21.15.173:0/2000917902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97173550 msgr2=0x557d9717c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.735+0000 7f42d400e800 1 --2- 172.21.15.173:0/2000917902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97173550 0x557d9717c050 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a470 tx=0x7f42bc01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.736+0000 7f42d400e800 1 -- 172.21.15.173:0/2000917902 shutdown_connections 2024-05-15T18:09:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.736+0000 7f42d400e800 1 --2- 172.21.15.173:0/2000917902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97173550 0x557d9717c050 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.736+0000 7f42d400e800 1 -- 172.21.15.173:0/2000917902 >> 172.21.15.173:0/2000917902 conn(0x557d9716d5b0 msgr2=0x557d9716f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.736+0000 7f42d400e800 1 -- 172.21.15.173:0/2000917902 shutdown_connections 2024-05-15T18:09:01.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.736+0000 7f42d400e800 1 -- 172.21.15.173:0/2000917902 wait complete. 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.749+0000 7f42d400e800 1 Processor -- start 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.749+0000 7f42d400e800 1 -- start start 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.749+0000 7f42d400e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d97266870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.749+0000 7f42d400e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d970be1c0 con 0x557d97171a10 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d97266870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d97266870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39306/0 (socket says 172.21.15.173:39306) 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1631451826 learned_addr learned my addr 172.21.15.173:0/1631451826 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1631451826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d97266e40 con 0x557d97171a10 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/1631451826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d97266870 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001d50 tx=0x7f42c400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b4074dd9c856c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f41bfe07640 1 -- 172.21.15.173:0/1631451826 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4013030 con 0x557d97171a10 2024-05-15T18:09:01.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f41bfe07640 1 -- 172.21.15.173:0/1631451826 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c400e470 con 0x557d97171a10 2024-05-15T18:09:01.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.750+0000 7f41bfe07640 1 -- 172.21.15.173:0/1631451826 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c400e810 con 0x557d97171a10 2024-05-15T18:09:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 -- 172.21.15.173:0/1631451826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 msgr2=0x557d97266870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 --2- 172.21.15.173:0/1631451826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d97266870 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f42c4001d50 tx=0x7f42c400b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 -- 172.21.15.173:0/1631451826 shutdown_connections 2024-05-15T18:09:01.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 --2- 172.21.15.173:0/1631451826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d97266870 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 -- 172.21.15.173:0/1631451826 >> 172.21.15.173:0/1631451826 conn(0x557d9716d5b0 msgr2=0x557d97262190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 -- 172.21.15.173:0/1631451826 shutdown_connections 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 -- 172.21.15.173:0/1631451826 wait complete. 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 Processor -- start 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 -- start start 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d9726e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.751+0000 7f42d400e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d9717c860 con 0x557d97171a10 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d9726e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d9726e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39318/0 (socket says 172.21.15.173:39318) 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f42d1b0d640 1 -- 172.21.15.173:0/2307153493 learned_addr learned my addr 172.21.15.173:0/2307153493 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f42d1b0d640 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9726e930 con 0x557d97171a10 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d9726e3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x557d97267600 tx=0x7f42c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f41be604640 1 -- 172.21.15.173:0/2307153493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4027070 con 0x557d97171a10 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f41be604640 1 -- 172.21.15.173:0/2307153493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c4019900 con 0x557d97171a10 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9726ebc0 con 0x557d97171a10 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f41be604640 1 -- 172.21.15.173:0/2307153493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4019c40 con 0x557d97171a10 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.752+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d97271870 con 0x557d97171a10 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.753+0000 7f41be604640 1 -- 172.21.15.173:0/2307153493 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42c402a070 con 0x557d97171a10 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.753+0000 7f41be604640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41b8036900 0x7f41b8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.753+0000 7f41be604640 1 -- 172.21.15.173:0/2307153493 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f42c401f070 con 0x557d97171a10 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.753+0000 7f42d130c640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41b8036900 0x7f41b8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d97173550 0x557d97275630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d97275c00 con 0x557d97173550 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d230e640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d97173550 0x557d97275630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d130c640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41b8036900 0x7f41b8038dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42bc054000 tx=0x7f42bc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d230e640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d97173550 0x557d97275630 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d230e640 1 -- 172.21.15.173:0/2307153493 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d97173550 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d97272c00 con 0x557d97173550 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d230e640 1 -- 172.21.15.173:0/2307153493 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d97173550 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d97277f60 0x557d9727a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.754+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d9727aa40 con 0x557d97277f60 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.755+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d97277f60 0x557d9727a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.755+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d97277f60 0x557d9727a350 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.755+0000 7f42d1b0d640 1 -- 172.21.15.173:0/2307153493 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42c4029030 con 0x557d97277f60 2024-05-15T18:09:01.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.755+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d97276f10 con 0x557d97173550 2024-05-15T18:09:01.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.755+0000 7f42d230e640 1 -- 172.21.15.173:0/2307153493 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d97173550 2024-05-15T18:09:01.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.755+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d9727bea0 0x557d9727e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.755+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d9727ea90 con 0x557d9727bea0 2024-05-15T18:09:01.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.756+0000 7f42d130c640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d9727bea0 0x557d9727e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.756+0000 7f42d130c640 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d9727bea0 0x557d9727e330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.756+0000 7f42d130c640 1 -- 172.21.15.173:0/2307153493 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f42bc05a040 con 0x557d9727bea0 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d400e800 1 Processor -- start 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d400e800 1 -- start start 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d400e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9728ce70 0x557d9728d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d400e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d97064cf0 con 0x557d9728ce70 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9728ce70 0x557d9728d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9728ce70 0x557d9728d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39326/0 (socket says 172.21.15.173:39326) 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d1b0d640 1 -- 172.21.15.173:0/2501486392 learned_addr learned my addr 172.21.15.173:0/2501486392 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d1b0d640 1 -- 172.21.15.173:0/2501486392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9728d7d0 con 0x557d9728ce70 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9728ce70 0x557d9728d290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f42c404c010 tx=0x7f42c40177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.757+0000 7f41b77fe640 1 -- 172.21.15.173:0/2501486392 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c404c3f0 con 0x557d9728ce70 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f41b77fe640 1 -- 172.21.15.173:0/2501486392 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c40448d0 con 0x557d9728ce70 2024-05-15T18:09:01.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9728e240 con 0x557d9728ce70 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f41b77fe640 1 -- 172.21.15.173:0/2501486392 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4044bb0 con 0x557d9728ce70 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9728e740 con 0x557d9728ce70 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f41b77fe640 1 -- 172.21.15.173:0/2501486392 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42c4036040 con 0x557d9728ce70 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f41b77fe640 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41ac036a50 0x7f41ac038f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f41b77fe640 1 -- 172.21.15.173:0/2501486392 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f42c4033040 con 0x557d9728ce70 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.758+0000 7f42d130c640 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41ac036a50 0x7f41ac038f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d400e800 1 Processor -- start 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d400e800 1 -- start start 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d130c640 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41ac036a50 0x7f41ac038f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557d97276ee0 tx=0x7f42bc005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d400e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d9729a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d400e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d972671c0 con 0x557d9729a070 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d9729a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d9729a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39336/0 (socket says 172.21.15.173:39336) 2024-05-15T18:09:01.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.759+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1633384535 learned_addr learned my addr 172.21.15.173:0/1633384535 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1633384535 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9729aa60 con 0x557d9729a070 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/1633384535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d9729a490 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f42c4027f90 tx=0x7f42c40224d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507b9986834b4bf server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f41b57fa640 1 -- 172.21.15.173:0/1633384535 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c405b070 con 0x557d9729a070 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f41b57fa640 1 -- 172.21.15.173:0/1633384535 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c404c850 con 0x557d9729a070 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f41b57fa640 1 -- 172.21.15.173:0/1633384535 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4049620 con 0x557d9729a070 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d400e800 1 -- 172.21.15.173:0/1633384535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 msgr2=0x557d9729a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d400e800 1 --2- 172.21.15.173:0/1633384535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d9729a490 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f42c4027f90 tx=0x7f42c40224d0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d400e800 1 -- 172.21.15.173:0/1633384535 shutdown_connections 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d400e800 1 --2- 172.21.15.173:0/1633384535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d9729a490 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d400e800 1 -- 172.21.15.173:0/1633384535 >> 172.21.15.173:0/1633384535 conn(0x557d97296340 msgr2=0x557d972943a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d400e800 1 -- 172.21.15.173:0/1633384535 shutdown_connections 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.760+0000 7f42d400e800 1 -- 172.21.15.173:0/1633384535 wait complete. 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d400e800 1 Processor -- start 2024-05-15T18:09:01.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d400e800 1 -- start start 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d400e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d972a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d400e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d9729b130 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d972a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d1b0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d972a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39350/0 (socket says 172.21.15.173:39350) 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 learned_addr learned my addr 172.21.15.173:0/1080140682 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d972a19c0 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.761+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d972a1480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f42c4049960 tx=0x7f42c4027f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.762+0000 7f41a37fe640 1 -- 172.21.15.173:0/1080140682 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c403aa80 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.762+0000 7f41a37fe640 1 -- 172.21.15.173:0/1080140682 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c403ac20 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.762+0000 7f41a37fe640 1 -- 172.21.15.173:0/1080140682 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c40217d0 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.762+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d972a19c0 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.762+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d972a19c0 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.762+0000 7f41a37fe640 1 -- 172.21.15.173:0/1080140682 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42c4072020 con 0x557d9729a070 2024-05-15T18:09:01.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.763+0000 7f41a37fe640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f419c036900 0x7f419c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.763+0000 7f41a37fe640 1 -- 172.21.15.173:0/1080140682 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f42c4070020 con 0x557d9729a070 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.763+0000 7f42d130c640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f419c036900 0x7f419c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.763+0000 7f42d130c640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f419c036900 0x7f419c038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f42bc052fd0 tx=0x7f42bc04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.763+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d972acb40 0x557d972af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972af750 con 0x557d972acb40 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d230e640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d972acb40 0x557d972af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d230e640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d972acb40 0x557d972af000 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 20 realm 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972afb60 con 0x557d972acb40 2024-05-15T18:09:01.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.764+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b0430 con 0x557d972acb40 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x557d972acb40 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d972b1530 0x557d972b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b3ee0 con 0x557d972b1530 2024-05-15T18:09:01.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d972b1530 0x557d972b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d972b1530 0x557d972b3920 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 20 searching for the correct realm 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.765+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b5810 con 0x557d972b1530 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.766+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.766+0000 7f42d1b0d640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f42c4057040 0x7f42c4021970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.766+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b5810 con 0x7f42c4057040 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.766+0000 7f42d130c640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f42c4057040 0x7f42c4021970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.766+0000 7f42d130c640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f42c4057040 0x7f42c4021970 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.767+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.767+0000 7f42d130c640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f42bc074040 0x7f42bc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.767+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b5810 con 0x7f42bc074040 2024-05-15T18:09:01.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.767+0000 7f42d230e640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f42bc074040 0x7f42bc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.767+0000 7f42d230e640 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f42bc074040 0x7f42bc081410 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f42cc00a4a0 con 0x7f42bc074040 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x557d972acb40 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x557d972acb40 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x7f42bc074040 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x7f42bc074040 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.768+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x7f42bc074040 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x7f42bc074040 2024-05-15T18:09:01.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x7f42c4057040 2024-05-15T18:09:01.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x557d972b1530 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x557d972acb40 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.769+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x7f42bc074040 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x7f42bc074040 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x557d972acb40 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x557d972b07d0 con 0x7f42c4057040 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972b1530 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.770+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972b1530 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42bc074040 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x7f42bc074040 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972b1530 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972b1530 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.771+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972acb40 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.772+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.772+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972acb40 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.772+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f42cc00a4a0 con 0x557d972acb40 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.772+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42bc074040 2024-05-15T18:09:01.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.772+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc033040 con 0x7f42bc074040 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.772+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972b1530 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42c4057040 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972acb40 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42bc074040 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.773+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972b1530 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42bc074040 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42c4057040 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972b1530 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.774+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42bc074040 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x557d972acb40 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f42bc08e060 con 0x7f42c4057040 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:01.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b47a0 con 0x557d972acb40 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.775+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b4b90 con 0x557d972acb40 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b4b90 con 0x7f42bc074040 2024-05-15T18:09:01.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 zone default found 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 4 Realm: () 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 zonegroup default 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b43c0 con 0x7f42bc074040 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b43c0 con 0x557d972b1530 2024-05-15T18:09:01.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.776+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.777+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972b77b0 con 0x557d972b1530 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.777+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.777+0000 7f42d400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.777+0000 7f42d400e800 20 started sync module instance, tier type = 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.777+0000 7f42d400e800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.777+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b6b10 con 0x7f42c4057040 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.778+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.778+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93997895479040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b6770 con 0x7f42c4057040 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.778+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b86e0 con 0x557d972acb40 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.779+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93997895479040] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.779+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.779+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93997895483952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b8b00 con 0x557d972acb40 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.779+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b94c0 con 0x557d972b1530 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.780+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93997895483952] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.780+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.780+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93997895487984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b8b00 con 0x557d972b1530 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.780+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b9f30 con 0x7f42c4057040 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.781+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93997895487984] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.781+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.781+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93997895485008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b8a70 con 0x7f42c4057040 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.781+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972badf0 con 0x557d972acb40 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.782+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.783+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93997895494432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bb690 con 0x557d972acb40 2024-05-15T18:09:01.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.783+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bc160 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.783+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93997895485008] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.784+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.784+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93997895498832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bc120 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.784+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bcb70 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.784+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93997895494432] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.784+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93997895498832] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.785+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.785+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93997895492384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bc6c0 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.785+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bd080 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93997895492384] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93997895496160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bd080 con 0x7f42bc074040 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 20 add_watcher() i=0 2024-05-15T18:09:01.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 20 add_watcher() i=1 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 20 add_watcher() i=2 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 20 add_watcher() i=3 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 20 add_watcher() i=4 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 20 add_watcher() i=5 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.786+0000 7f42d400e800 20 add_watcher() i=6 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.787+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93997895496160] v29'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.787+0000 7f42d400e800 20 add_watcher() i=7 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.787+0000 7f42d400e800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.787+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972c0380 con 0x557d972acb40 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.787+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.787+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93997895503168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bd610 con 0x557d972acb40 2024-05-15T18:09:01.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.788+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93997895503168] v29'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.788+0000 7f41837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.788+0000 7f42d400e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.788+0000 7f42d400e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:01.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.788+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bfb50 con 0x557d972acb40 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.790+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.790+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972c9440 con 0x7f42bc074040 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.791+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.791+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972c9440 con 0x557d972b1530 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.792+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.792+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972c9440 con 0x557d972acb40 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.793+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'136 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.793+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972c9ea0 con 0x7f42c4057040 2024-05-15T18:09:01.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.794+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.794+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972ca350 con 0x557d972b1530 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.795+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.795+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972ca350 con 0x557d972acb40 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.796+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.796+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972c7b60 con 0x7f42bc074040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.797+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.797+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972c7b60 con 0x7f42c4057040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.798+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.798+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x557d972b1530 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.799+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.799+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x7f42c4057040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.799+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.800+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x7f42bc074040 2024-05-15T18:09:01.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.801+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.801+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x7f42c4057040 2024-05-15T18:09:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.801+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.802+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x7f42bc074040 2024-05-15T18:09:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.803+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.803+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x557d972acb40 2024-05-15T18:09:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.804+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.804+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x557d972b1530 2024-05-15T18:09:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.805+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.805+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x7f42c4057040 2024-05-15T18:09:01.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.806+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.806+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x557d972b1530 2024-05-15T18:09:01.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.807+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.807+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x557d972acb40 2024-05-15T18:09:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.808+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.808+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x557d972acb40 2024-05-15T18:09:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.809+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'138 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.809+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972caca0 con 0x557d972b1530 2024-05-15T18:09:01.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.810+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.811+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x7f42c4057040 2024-05-15T18:09:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.811+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.811+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x557d972b1530 2024-05-15T18:09:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.813+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.813+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x557d972b1530 2024-05-15T18:09:01.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.814+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.814+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x557d972b1530 2024-05-15T18:09:01.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.814+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.814+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x557d972b1530 2024-05-15T18:09:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.815+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.815+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x7f42bc074040 2024-05-15T18:09:01.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.816+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.817+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x557d972b1530 2024-05-15T18:09:01.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.817+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.817+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x7f42bc074040 2024-05-15T18:09:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.819+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.819+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x557d972b1530 2024-05-15T18:09:01.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.820+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.820+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x7f42bc074040 2024-05-15T18:09:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.821+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.821+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972cae70 con 0x7f42c4057040 2024-05-15T18:09:01.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.822+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.822+0000 7f41827fc640 20 reqs_thread_entry: start 2024-05-15T18:09:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.822+0000 7f42d400e800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.822+0000 7f42d400e800 20 Filter name: none 2024-05-15T18:09:01.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.822+0000 7f40f3fff640 20 reqs_thread_entry: start 2024-05-15T18:09:01.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-15T18:09:01.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972f5e60 con 0x7f42bc074040 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 20 rados_obj.operate() r=0 bl.length=419 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.823+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972f58d0 con 0x557d972acb40 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.824+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.824+0000 7f42d400e800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-15T18:09:01.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.824+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972f58d0 con 0x7f42bc074040 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v29'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d400e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93997895742080 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972f8c90 con 0x557d972b1530 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== watch-notify(notify (1) cookie 93997895487984 notify 124554051595 ret 0) ==== 212+0+0 (crc 0 0 0) 0x557d972c7b30 con 0x557d972b1530 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f41b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051595 cookie 93997895487984 notifier 4559 bl.length()=170 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f41b57fa640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4194003d60 con 0x557d972b1530 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(97 notify.2 [notify cookie 93997895742080 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== watch-notify(notify_complete (2) cookie 93997895742080 notify 124554051595 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d9728d7d0 con 0x557d972b1530 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d400e800 10 removing email index: 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d400e800 10 removing user buckets index 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.825+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972f6720 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.826+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v29'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.826+0000 7f42d400e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.826+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93997895737968 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972f6690 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.826+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== watch-notify(notify (1) cookie 93997895494432 notify 124554051597 ret 0) ==== 217+0+0 (crc 0 0 0) 0x557d972c7d00 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.826+0000 7f41b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 93997895494432 notifier 4559 bl.length()=175 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.826+0000 7f41b4ff9640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f40fc0032c0 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.827+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(100 notify.4 [notify cookie 93997895737968 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.827+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== watch-notify(notify_complete (2) cookie 93997895737968 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d9728e240 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.827+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.827+0000 7f42d400e800 10 removing user index: testx$tenanteduser 2024-05-15T18:09:01.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.827+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972f7b30 con 0x7f42bc074040 2024-05-15T18:09:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v29'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f42d400e800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-05-15T18:09:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f42d400e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-15T18:09:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93997895737968 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557d972f6690 con 0x7f42c4057040 2024-05-15T18:09:01.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== watch-notify(notify (1) cookie 93997895485008 notify 124554051597 ret 0) ==== 209+0+0 (crc 0 0 0) 0x557d972c9610 con 0x7f42c4057040 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f41b57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051597 cookie 93997895485008 notifier 4559 bl.length()=167 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f41b57fa640 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4194003d60 con 0x7f42c4057040 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.828+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(103 notify.3 [notify cookie 93997895737968 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.829+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== watch-notify(notify_complete (2) cookie 93997895737968 notify 124554051597 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d972c7f00 con 0x7f42c4057040 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.829+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.830+0000 7f41837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.830+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93997895503168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972c6e20 con 0x557d972acb40 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.831+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93997895503168] v29'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.831+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93997895479040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bcd40 con 0x7f42c4057040 2024-05-15T18:09:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.832+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93997895479040] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.832+0000 7f42d400e800 20 remove_watcher() i=0 2024-05-15T18:09:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.832+0000 7f42d400e800 2 removed watcher, disabling cache 2024-05-15T18:09:01.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.832+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93997895483952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bcd40 con 0x557d972acb40 2024-05-15T18:09:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.833+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93997895483952] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.833+0000 7f42d400e800 20 remove_watcher() i=1 2024-05-15T18:09:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.833+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93997895487984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972b8230 con 0x557d972b1530 2024-05-15T18:09:01.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.834+0000 7f42d1b0d640 1 -- 172.21.15.173:0/1080140682 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93997895487984] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42c403e020 con 0x557d972b1530 2024-05-15T18:09:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.834+0000 7f42d400e800 20 remove_watcher() i=2 2024-05-15T18:09:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.834+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93997895485008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bcd40 con 0x7f42c4057040 2024-05-15T18:09:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.835+0000 7f42d130c640 1 -- 172.21.15.173:0/1080140682 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93997895485008] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42bc07f070 con 0x7f42c4057040 2024-05-15T18:09:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.835+0000 7f42d400e800 20 remove_watcher() i=3 2024-05-15T18:09:01.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.835+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93997895494432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bcd40 con 0x557d972acb40 2024-05-15T18:09:01.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.836+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93997895494432] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x557d972acb40 2024-05-15T18:09:01.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.836+0000 7f42d400e800 20 remove_watcher() i=4 2024-05-15T18:09:01.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.836+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93997895498832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bcd40 con 0x7f42bc074040 2024-05-15T18:09:01.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.837+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93997895498832] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.837+0000 7f42d400e800 20 remove_watcher() i=5 2024-05-15T18:09:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.837+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93997895492384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bbc50 con 0x7f42bc074040 2024-05-15T18:09:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.838+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93997895492384] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.838+0000 7f42d400e800 20 remove_watcher() i=6 2024-05-15T18:09:01.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.838+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93997895496160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557d972bcd40 con 0x7f42bc074040 2024-05-15T18:09:01.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93997895496160] v29'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc031040 con 0x7f42bc074040 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 20 remove_watcher() i=7 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f42bc074040 msgr2=0x7f42bc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f42bc074040 0x7f42bc081410 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d972acb40 msgr2=0x557d972af000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d972acb40 0x557d972af000 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f42c4057040 msgr2=0x7f42c4021970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f42c4057040 0x7f42c4021970 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d972b1530 msgr2=0x557d972b3920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d972b1530 0x557d972b3920 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f419c036900 msgr2=0x7f419c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f419c036900 0x7f419c038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f42bc052fd0 tx=0x7f42bc04f000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 msgr2=0x557d972a1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/1080140682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9729a070 0x557d972a1480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f42c4049960 tx=0x7f42c4027f20 comp rx=0 tx=0).stop 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 reap_dead start 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d230e640 1 -- 172.21.15.173:0/1080140682 reap_dead start 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 shutdown_connections 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 >> 172.21.15.173:0/1080140682 conn(0x557d97296340 msgr2=0x557d972939a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 shutdown_connections 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/1080140682 wait complete. 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41ac036a50 msgr2=0x7f41ac038f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41ac036a50 0x7f41ac038f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557d97276ee0 tx=0x7f42bc005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9728ce70 msgr2=0x557d9728d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9728ce70 0x557d9728d290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f42c404c010 tx=0x7f42c40177a0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 shutdown_connections 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41ac036a50 0x7f41ac038f10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 --2- 172.21.15.173:0/2501486392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d9728ce70 0x557d9728d290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.839+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 >> 172.21.15.173:0/2501486392 conn(0x557d97280f10 msgr2=0x557d97281310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 shutdown_connections 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2501486392 wait complete. 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d9727bea0 msgr2=0x557d9727e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d9727bea0 0x557d9727e330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d97173550 msgr2=0x557d97275630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d97173550 0x557d97275630 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d97277f60 msgr2=0x557d9727a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d97277f60 0x557d9727a350 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41b8036900 msgr2=0x7f41b8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f41b8036900 0x7f41b8038dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f42bc054000 tx=0x7f42bc04e000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 msgr2=0x557d9726e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 --2- 172.21.15.173:0/2307153493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d97171a10 0x557d9726e3f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x557d97267600 tx=0x7f42c4000bc0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d230e640 1 -- 172.21.15.173:0/2307153493 reap_dead start 2024-05-15T18:09:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 shutdown_connections 2024-05-15T18:09:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 >> 172.21.15.173:0/2307153493 conn(0x557d9716d5b0 msgr2=0x557d97260990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 shutdown_connections 2024-05-15T18:09:01.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.840+0000 7f42d400e800 1 -- 172.21.15.173:0/2307153493 wait complete. 2024-05-15T18:09:01.831 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-15T18:09:01.834 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-05-15T18:09:01.837 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:01.837 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-15T18:09:01.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-15T18:09:01.837 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-05-15T18:09:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:01.884 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:01.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.908+0000 7fc80a546800 1 Processor -- start 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.908+0000 7fc80a546800 1 -- start start 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.908+0000 7fc80a546800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e66f78c150 0x55e66f78c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.908+0000 7fc80a546800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e66f78cbf0 con 0x55e66f78d360 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.908+0000 7fc80a546800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55e66f61d050 con 0x55e66f78c150 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.909+0000 7fc80804c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55e66f78c150 0x55e66f78c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.909+0000 7fc7fffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55e66f78d360 0x55e66f78d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57166/0 (socket says 172.21.15.173:57166) 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.909+0000 7fc7fffff640 1 -- 172.21.15.173:0/1495583174 learned_addr learned my addr 172.21.15.173:0/1495583174 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.909+0000 7fc80804c640 1 -- 172.21.15.173:0/1495583174 >> v1:172.21.15.3:6789/0 conn(0x55e66f78d360 legacy=0x55e66f78d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.909+0000 7fc80804c640 1 -- 172.21.15.173:0/1495583174 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66f78df20 con 0x55e66f78c150 2024-05-15T18:09:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80804c640 1 --2- 172.21.15.173:0/1495583174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f78c570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800a470 tx=0x7fc7f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e726327ddce49003 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.887 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80784b640 1 -- 172.21.15.173:0/1495583174 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8057070 con 0x55e66f78c150 2024-05-15T18:09:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80784b640 1 -- 172.21.15.173:0/1495583174 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f804adc0 con 0x55e66f78c150 2024-05-15T18:09:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80784b640 1 -- 172.21.15.173:0/1495583174 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8052590 con 0x55e66f78c150 2024-05-15T18:09:01.888 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80a546800 1 -- 172.21.15.173:0/1495583174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 msgr2=0x55e66f78c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80a546800 1 --2- 172.21.15.173:0/1495583174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f78c570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800a470 tx=0x7fc7f801ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80a546800 1 -- 172.21.15.173:0/1495583174 shutdown_connections 2024-05-15T18:09:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80a546800 1 --2- 172.21.15.173:0/1495583174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f78c570 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80a546800 1 -- 172.21.15.173:0/1495583174 >> 172.21.15.173:0/1495583174 conn(0x55e66f787790 msgr2=0x55e66f789bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80a546800 1 -- 172.21.15.173:0/1495583174 shutdown_connections 2024-05-15T18:09:01.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.911+0000 7fc80a546800 1 -- 172.21.15.173:0/1495583174 wait complete. 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.925+0000 7fc80a546800 1 Processor -- start 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.925+0000 7fc80a546800 1 -- start start 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.925+0000 7fc80a546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f87d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.925+0000 7fc80a546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e66f6d71c0 con 0x55e66f78c150 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.926+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f87d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.926+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f87d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39360/0 (socket says 172.21.15.173:39360) 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.926+0000 7fc80804c640 1 -- 172.21.15.173:0/2752459500 learned_addr learned my addr 172.21.15.173:0/2752459500 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.926+0000 7fc80804c640 1 -- 172.21.15.173:0/2752459500 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66f87dd40 con 0x55e66f78c150 2024-05-15T18:09:01.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.926+0000 7fc80804c640 1 --2- 172.21.15.173:0/2752459500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f87d770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801ced0 tx=0x7fc7f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9289c040d93537a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.926+0000 7fc6f660c640 1 -- 172.21.15.173:0/2752459500 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8057040 con 0x55e66f78c150 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc6f660c640 1 -- 172.21.15.173:0/2752459500 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8063070 con 0x55e66f78c150 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc6f660c640 1 -- 172.21.15.173:0/2752459500 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8052800 con 0x55e66f78c150 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc80a546800 1 -- 172.21.15.173:0/2752459500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 msgr2=0x55e66f87d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc80a546800 1 --2- 172.21.15.173:0/2752459500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f87d770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801ced0 tx=0x7fc7f804c000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc80a546800 1 -- 172.21.15.173:0/2752459500 shutdown_connections 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc80a546800 1 --2- 172.21.15.173:0/2752459500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f87d770 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc80a546800 1 -- 172.21.15.173:0/2752459500 >> 172.21.15.173:0/2752459500 conn(0x55e66f787790 msgr2=0x55e66f879090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc80a546800 1 -- 172.21.15.173:0/2752459500 shutdown_connections 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.927+0000 7fc80a546800 1 -- 172.21.15.173:0/2752459500 wait complete. 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80a546800 1 Processor -- start 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80a546800 1 -- start start 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80a546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f8851c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80a546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e66f795830 con 0x55e66f78c150 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f8851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f8851c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39370/0 (socket says 172.21.15.173:39370) 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80804c640 1 -- 172.21.15.173:0/1654049551 learned_addr learned my addr 172.21.15.173:0/1654049551 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80804c640 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66f885700 con 0x55e66f78c150 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.928+0000 7fc80804c640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f8851c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801ced0 tx=0x7fc7f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.929+0000 7fc6f4e09640 1 -- 172.21.15.173:0/1654049551 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f806d070 con 0x55e66f78c150 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.929+0000 7fc6f4e09640 1 -- 172.21.15.173:0/1654049551 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8052d20 con 0x55e66f78c150 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.929+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66f885990 con 0x55e66f78c150 2024-05-15T18:09:01.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.929+0000 7fc6f4e09640 1 -- 172.21.15.173:0/1654049551 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8057050 con 0x55e66f78c150 2024-05-15T18:09:01.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.929+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66f888640 con 0x55e66f78c150 2024-05-15T18:09:01.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.929+0000 7fc6f4e09640 1 -- 172.21.15.173:0/1654049551 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7f805d470 con 0x55e66f78c150 2024-05-15T18:09:01.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc6f4e09640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6f0036900 0x7fc6f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc6f4e09640 1 -- 172.21.15.173:0/1654049551 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7f808d8b0 con 0x55e66f78c150 2024-05-15T18:09:01.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc7fffff640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6f0036900 0x7fc6f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f78d360 0x55e66f88c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f88c9e0 con 0x55e66f78d360 2024-05-15T18:09:01.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc80884d640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f78d360 0x55e66f88c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc7fffff640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6f0036900 0x7fc6f0038dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0000f60 tx=0x7fc7f00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc80884d640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f78d360 0x55e66f88c460 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.930+0000 7fc80884d640 1 -- 172.21.15.173:0/1654049551 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f78d360 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f889a30 con 0x55e66f78d360 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80884d640 1 -- 172.21.15.173:0/1654049551 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f78d360 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f88ecd0 0x55e66f8910c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f891760 con 0x55e66f88ecd0 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80804c640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f88ecd0 0x55e66f8910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80804c640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f88ecd0 0x55e66f8910c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80804c640 1 -- 172.21.15.173:0/1654049551 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7f8078070 con 0x55e66f88ecd0 2024-05-15T18:09:01.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.931+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f88dc80 con 0x55e66f78d360 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.932+0000 7fc80884d640 1 -- 172.21.15.173:0/1654049551 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f78d360 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.932+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e66f892c10 0x55e66f895060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.932+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8957c0 con 0x55e66f892c10 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.932+0000 7fc7fffff640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e66f892c10 0x55e66f895060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.932+0000 7fc7fffff640 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e66f892c10 0x55e66f895060 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc7fffff640 1 -- 172.21.15.173:0/1654049551 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7f0009050 con 0x55e66f892c10 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc80a546800 1 Processor -- start 2024-05-15T18:09:01.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc80a546800 1 -- start start 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc80a546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f701a80 0x55e66f6ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc80a546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e66f67dcf0 con 0x55e66f701a80 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f701a80 0x55e66f6ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f701a80 0x55e66f6ffef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39384/0 (socket says 172.21.15.173:39384) 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.933+0000 7fc80804c640 1 -- 172.21.15.173:0/2859225311 learned_addr learned my addr 172.21.15.173:0/2859225311 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.934+0000 7fc80804c640 1 -- 172.21.15.173:0/2859225311 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66f700430 con 0x55e66f701a80 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.934+0000 7fc80804c640 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f701a80 0x55e66f6ffef0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc7f805c720 tx=0x7fc7f8008300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.934+0000 7fc6edffb640 1 -- 172.21.15.173:0/2859225311 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f805b800 con 0x55e66f701a80 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.934+0000 7fc6edffb640 1 -- 172.21.15.173:0/2859225311 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f805b9a0 con 0x55e66f701a80 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.934+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66f7006c0 con 0x55e66f701a80 2024-05-15T18:09:01.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.934+0000 7fc6edffb640 1 -- 172.21.15.173:0/2859225311 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8066b90 con 0x55e66f701a80 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.934+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66f700bc0 con 0x55e66f701a80 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc6edffb640 1 -- 172.21.15.173:0/2859225311 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7f8084030 con 0x55e66f701a80 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc6edffb640 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6e0036900 0x7fc6e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc6edffb640 1 -- 172.21.15.173:0/2859225311 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7f8087070 con 0x55e66f701a80 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc7fffff640 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6e0036900 0x7fc6e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc80a546800 1 Processor -- start 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc7fffff640 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6e0036900 0x7fc6e0038dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000bf50 tx=0x7fc7f000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc80a546800 1 -- start start 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc80a546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.935+0000 7fc80a546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e66f87e000 con 0x55e66f8b2f60 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39386/0 (socket says 172.21.15.173:39386) 2024-05-15T18:09:01.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc80804c640 1 -- 172.21.15.173:0/3796481742 learned_addr learned my addr 172.21.15.173:0/3796481742 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc80804c640 1 -- 172.21.15.173:0/3796481742 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66f8b3950 con 0x55e66f8b2f60 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc80804c640 1 --2- 172.21.15.173:0/3796481742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8b3380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80669f0 tx=0x7fc7f808d1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7c95053047629d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc6e77fe640 1 -- 172.21.15.173:0/3796481742 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8086d80 con 0x55e66f8b2f60 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc6e77fe640 1 -- 172.21.15.173:0/3796481742 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f808a380 con 0x55e66f8b2f60 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.936+0000 7fc6e77fe640 1 -- 172.21.15.173:0/3796481742 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f805d760 con 0x55e66f8b2f60 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 -- 172.21.15.173:0/3796481742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 msgr2=0x55e66f8b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 --2- 172.21.15.173:0/3796481742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8b3380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80669f0 tx=0x7fc7f808d1d0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 -- 172.21.15.173:0/3796481742 shutdown_connections 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 --2- 172.21.15.173:0/3796481742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8b3380 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 -- 172.21.15.173:0/3796481742 >> 172.21.15.173:0/3796481742 conn(0x55e66f8af2c0 msgr2=0x55e66f8ad320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 -- 172.21.15.173:0/3796481742 shutdown_connections 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 -- 172.21.15.173:0/3796481742 wait complete. 2024-05-15T18:09:01.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 Processor -- start 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 -- start start 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8ba380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.937+0000 7fc80a546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e66f8b4000 con 0x55e66f8b2f60 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8ba380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc80804c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8ba380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39390/0 (socket says 172.21.15.173:39390) 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 learned_addr learned my addr 172.21.15.173:0/3349671767 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66f8ba8c0 con 0x55e66f8b2f60 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc80804c640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8ba380 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80669f0 tx=0x7fc7f809f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc6e5ffb640 1 -- 172.21.15.173:0/3349671767 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f80b0070 con 0x55e66f8b2f60 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66f8ba8c0 con 0x55e66f8b2f60 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc6e5ffb640 1 -- 172.21.15.173:0/3349671767 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8086460 con 0x55e66f8b2f60 2024-05-15T18:09:01.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc6e5ffb640 1 -- 172.21.15.173:0/3349671767 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7f8054c80 con 0x55e66f8b2f60 2024-05-15T18:09:01.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.938+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66f8ba8c0 con 0x55e66f8b2f60 2024-05-15T18:09:01.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.939+0000 7fc6e5ffb640 1 -- 172.21.15.173:0/3349671767 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7f80bb060 con 0x55e66f8b2f60 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.939+0000 7fc6e5ffb640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6d8036900 0x7fc6d8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.939+0000 7fc6e5ffb640 1 -- 172.21.15.173:0/3349671767 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fc7f80b5ab0 con 0x55e66f8b2f60 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.939+0000 7fc7fffff640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6d8036900 0x7fc6d8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc7fffff640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6d8036900 0x7fc6d8038dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0001b60 tx=0x7fc7f0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f8c5a90 0x55e66f8c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c86a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80884d640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f8c5a90 0x55e66f8c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80884d640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f8c5a90 0x55e66f8c7f50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80a546800 20 realm 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.940+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c8ab0 con 0x55e66f8c5a90 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9380 con 0x55e66f8c5a90 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f8ca480 0x55e66f8cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8cce80 con 0x55e66f8ca480 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80804c640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f8ca480 0x55e66f8cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.941+0000 7fc80804c640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f8ca480 0x55e66f8cc870 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc80a546800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc80a546800 20 searching for the correct realm 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8ce7b0 con 0x55e66f8ca480 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc80804c640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc7f80bd070 0x7fc7f808a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8ce7b0 con 0x7fc7f80bd070 2024-05-15T18:09:01.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.942+0000 7fc7fffff640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc7f80bd070 0x7fc7f808a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.943+0000 7fc7fffff640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc7f80bd070 0x7fc7f808a640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.943+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f0009050 con 0x7fc7f80bd070 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.943+0000 7fc7fffff640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7f0038040 0x7fc7f001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.943+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8ce7b0 con 0x7fc7f0038040 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.943+0000 7fc80884d640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7f0038040 0x7fc7f001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.944+0000 7fc80884d640 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7f0038040 0x7fc7f001bab0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.944+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc80000a4a0 con 0x7fc7f0038040 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.944+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.944+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.944+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.944+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.944+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x7fc7f0038040 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x7fc7f0038040 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f80bd070 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f0009050 con 0x7fc7f80bd070 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.945+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x7fc7f0038040 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f80bd070 2024-05-15T18:09:01.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7f0009050 con 0x7fc7f80bd070 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.946+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.947+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.947+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.947+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.947+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.947+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x7fc7f0038040 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.947+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.947+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc80000a4a0 con 0x55e66f8c5a90 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800033040 con 0x7fc7f0038040 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.948+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.949+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.949+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f80bd070 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.949+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f0009050 con 0x7fc7f80bd070 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.949+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.949+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.949+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f80bd070 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f0009050 con 0x7fc7f80bd070 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.950+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8ca480 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.951+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.951+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f0038040 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.951+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.951+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x55e66f8c5a90 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.951+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.951+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8c9720 con 0x7fc7f80bd070 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:01.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8cd740 con 0x55e66f8c5a90 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8cdb30 con 0x55e66f8c5a90 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8cdb30 con 0x7fc7f0038040 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.952+0000 7fc80a546800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 zone default found 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 4 Realm: () 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 zonegroup default 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8cec30 con 0x7fc7f0038040 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d0610 con 0x55e66f8ca480 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d09b0 con 0x55e66f8ca480 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 started sync module instance, tier type = 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.953+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8cfab0 con 0x7fc7f80bd070 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.954+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.954+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94448202348032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d0d50 con 0x7fc7f80bd070 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.954+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d15e0 con 0x55e66f8c5a90 2024-05-15T18:09:01.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.955+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94448202348032] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.956+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.956+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94448202350240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d19d0 con 0x55e66f8c5a90 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.956+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d2410 con 0x55e66f8ca480 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.957+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.957+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94448202358496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d2cb0 con 0x55e66f8ca480 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.957+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d3790 con 0x7fc7f80bd070 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.958+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94448202350240] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.958+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94448202358496] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.958+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.958+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94448202363552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d3b80 con 0x7fc7f80bd070 2024-05-15T18:09:01.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.958+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d4410 con 0x55e66f8c5a90 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.960+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.960+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94448202366752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d4cb0 con 0x55e66f8c5a90 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.960+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d57b0 con 0x7fc7f0038040 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.961+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94448202363552] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.961+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.961+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94448202371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d5770 con 0x7fc7f0038040 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.961+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d61c0 con 0x7fc7f0038040 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.961+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94448202366752] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.962+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94448202371744] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.962+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.963+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94448202354928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d5d10 con 0x7fc7f0038040 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.963+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d66d0 con 0x7fc7f0038040 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.963+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94448202354928] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94448202369024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d66d0 con 0x7fc7f0038040 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=0 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=1 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=2 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=3 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=4 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=5 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=6 2024-05-15T18:09:01.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94448202369024] v29'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 20 add_watcher() i=7 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.964+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d9a40 con 0x55e66f8c5a90 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.965+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.965+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94448202388528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8d6840 con 0x55e66f8c5a90 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.966+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94448202388528] v29'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.966+0000 7fc6be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.966+0000 7fc80a546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.966+0000 7fc80a546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.966+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e23e0 con 0x55e66f8c5a90 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.967+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.967+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e2a30 con 0x7fc7f0038040 2024-05-15T18:09:01.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.968+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.968+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e2e70 con 0x55e66f8ca480 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.969+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.969+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e2de0 con 0x55e66f8c5a90 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.970+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'141 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.970+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e3450 con 0x7fc7f80bd070 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.971+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.971+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e3e70 con 0x55e66f8ca480 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.972+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.972+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e3e70 con 0x55e66f8c5a90 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.973+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.973+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e3e70 con 0x7fc7f0038040 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.974+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.974+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e3f00 con 0x7fc7f80bd070 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.975+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.975+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e44b0 con 0x55e66f8ca480 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.976+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.976+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e44b0 con 0x7fc7f80bd070 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.977+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.977+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4a20 con 0x7fc7f0038040 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.978+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.978+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4a20 con 0x7fc7f80bd070 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.979+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.979+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e48e0 con 0x7fc7f0038040 2024-05-15T18:09:01.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.981+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.981+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e48e0 con 0x55e66f8c5a90 2024-05-15T18:09:01.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.981+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.982+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e48e0 con 0x55e66f8ca480 2024-05-15T18:09:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.983+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.983+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x7fc7f80bd070 2024-05-15T18:09:01.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.983+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.983+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.984+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.984+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8c5a90 2024-05-15T18:09:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.985+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.985+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8c5a90 2024-05-15T18:09:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.986+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'143 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.986+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.987+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.987+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x7fc7f80bd070 2024-05-15T18:09:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.988+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.988+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.989+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.989+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.990+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.990+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.991+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.991+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.992+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.992+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x7fc7f0038040 2024-05-15T18:09:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.993+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.994+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.994+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.994+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x7fc7f0038040 2024-05-15T18:09:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.995+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.995+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x55e66f8ca480 2024-05-15T18:09:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.996+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.996+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x7fc7f0038040 2024-05-15T18:09:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.997+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.998+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f8e4e00 con 0x7fc7f80bd070 2024-05-15T18:09:01.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc6bd7e2640 20 reqs_thread_entry: start 2024-05-15T18:09:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc80a546800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc80a546800 20 Filter name: none 2024-05-15T18:09:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc62effd640 20 reqs_thread_entry: start 2024-05-15T18:09:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc80a546800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:01.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:01.999+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f90fc60 con 0x7fc7f80bd070 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:95 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f911730 con 0x7fc7f0038040 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(95 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:01.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 get_obj_state: octx=0x7fc80000aaf0 obj=myfoo:four state=0x55e66f9129f8 s->prefetch_data=0 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 3.15 3:ab409a20:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e66f913820 con 0x7fc7f80bd070 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(96 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 10 manifest: total_size = 4 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.3475998535135169772 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 get_obj_state: octx=0x7fc80000aaf0 obj=myfoo:four state=0x55e66f9129f8 s->prefetch_data=0 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 prepare_atomic_modification: state is not atomic. state=0x55e66f9129f8 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.000+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:97 4.34 4:2d6893ae:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f80bd070 2024-05-15T18:09:01.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.001+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(97 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 [stat,call,call] v29'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.002+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 3.15 3:ab409a20:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f80bd070 2024-05-15T18:09:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.002+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(98 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1_four [call] v29'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.002+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:99 4.34 4:2d6893ae:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f80bd070 2024-05-15T18:09:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.003+0000 7fc6be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.003+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94448202388528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x55e66f8c5a90 2024-05-15T18:09:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.003+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(99 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 [stat,call,call] v29'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.004+0000 7fc6e77fe640 20 handle_completion(): completion ok for obj=four 2024-05-15T18:09:01.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.004+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94448202388528] v29'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.004+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94448202348032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f80bd070 2024-05-15T18:09:01.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.005+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94448202348032] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.005+0000 7fc80a546800 20 remove_watcher() i=0 2024-05-15T18:09:01.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.005+0000 7fc80a546800 2 removed watcher, disabling cache 2024-05-15T18:09:01.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.006+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94448202350240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x55e66f8c5a90 2024-05-15T18:09:01.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.007+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94448202350240] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.007+0000 7fc80a546800 20 remove_watcher() i=1 2024-05-15T18:09:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.007+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94448202358496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x55e66f8ca480 2024-05-15T18:09:01.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.008+0000 7fc80804c640 1 -- 172.21.15.173:0/3349671767 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94448202358496] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f80a7020 con 0x55e66f8ca480 2024-05-15T18:09:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.008+0000 7fc80a546800 20 remove_watcher() i=2 2024-05-15T18:09:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.008+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94448202363552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f80bd070 2024-05-15T18:09:01.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.009+0000 7fc7fffff640 1 -- 172.21.15.173:0/3349671767 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94448202363552] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f0045040 con 0x7fc7f80bd070 2024-05-15T18:09:01.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.009+0000 7fc80a546800 20 remove_watcher() i=3 2024-05-15T18:09:01.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.009+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94448202366752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x55e66f8c5a90 2024-05-15T18:09:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.010+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94448202366752] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x55e66f8c5a90 2024-05-15T18:09:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.010+0000 7fc80a546800 20 remove_watcher() i=4 2024-05-15T18:09:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.010+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94448202371744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f0038040 2024-05-15T18:09:01.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.011+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94448202371744] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.011+0000 7fc80a546800 20 remove_watcher() i=5 2024-05-15T18:09:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.011+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94448202354928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f0038040 2024-05-15T18:09:01.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.012+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94448202354928] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.012+0000 7fc80a546800 20 remove_watcher() i=6 2024-05-15T18:09:01.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.012+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94448202369024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e66f9181c0 con 0x7fc7f0038040 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94448202369024] v29'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc800031040 con 0x7fc7f0038040 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 20 remove_watcher() i=7 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7f0038040 msgr2=0x7fc7f001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc7f0038040 0x7fc7f001bab0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f8c5a90 msgr2=0x55e66f8c7f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f8c5a90 0x55e66f8c7f50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc7f80bd070 msgr2=0x7fc7f808a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc7f80bd070 0x7fc7f808a640 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f8ca480 msgr2=0x55e66f8cc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f8ca480 0x55e66f8cc870 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6d8036900 msgr2=0x7fc6d8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6d8036900 0x7fc6d8038dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0001b60 tx=0x7fc7f0010000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 msgr2=0x55e66f8ba380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 --2- 172.21.15.173:0/3349671767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f8b2f60 0x55e66f8ba380 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80669f0 tx=0x7fc7f809f000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 reap_dead start 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80884d640 1 -- 172.21.15.173:0/3349671767 reap_dead start 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 shutdown_connections 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 >> 172.21.15.173:0/3349671767 conn(0x55e66f8af2c0 msgr2=0x55e66f8ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 shutdown_connections 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.013+0000 7fc80a546800 1 -- 172.21.15.173:0/3349671767 wait complete. 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6e0036900 msgr2=0x7fc6e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6e0036900 0x7fc6e0038dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000bf50 tx=0x7fc7f000f000 comp rx=0 tx=0).stop 2024-05-15T18:09:01.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f701a80 msgr2=0x55e66f6ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f701a80 0x55e66f6ffef0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc7f805c720 tx=0x7fc7f8008300 comp rx=0 tx=0).stop 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 shutdown_connections 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6e0036900 0x7fc6e0038dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/2859225311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f701a80 0x55e66f6ffef0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 >> 172.21.15.173:0/2859225311 conn(0x55e66f897cc0 msgr2=0x55e66f8980c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 shutdown_connections 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/2859225311 wait complete. 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e66f892c10 msgr2=0x55e66f895060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55e66f892c10 0x55e66f895060 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f78d360 msgr2=0x55e66f88c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55e66f78d360 0x55e66f88c460 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f88ecd0 msgr2=0x55e66f8910c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55e66f88ecd0 0x55e66f8910c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6f0036900 msgr2=0x7fc6f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc6f0036900 0x7fc6f0038dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0000f60 tx=0x7fc7f00012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 msgr2=0x55e66f8851c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 --2- 172.21.15.173:0/1654049551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e66f78c150 0x55e66f8851c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc7f801ced0 tx=0x7fc7f8002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80884d640 1 -- 172.21.15.173:0/1654049551 reap_dead start 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 shutdown_connections 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 >> 172.21.15.173:0/1654049551 conn(0x55e66f787790 msgr2=0x55e66f877890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 shutdown_connections 2024-05-15T18:09:01.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.014+0000 7fc80a546800 1 -- 172.21.15.173:0/1654049551 wait complete. 2024-05-15T18:09:02.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-15T18:09:02.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-15T18:09:02.000 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-15T18:09:02.044 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:02.045 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.068+0000 7fb3c0f29800 1 Processor -- start 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.068+0000 7fb3c0f29800 1 -- start start 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3c0f29800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55a747ba4bf0 0x55a747ba6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3c0f29800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a747bab030 con 0x55a747ba7520 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3c0f29800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55a747a35050 con 0x55a747ba4bf0 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3bcb4e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55a747ba4bf0 0x55a747ba6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3b7fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55a747ba7520 0x55a747ba9910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57168/0 (socket says 172.21.15.173:57168) 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3681202113 learned_addr learned my addr 172.21.15.173:0/3681202113 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:02.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3681202113 >> v1:172.21.15.3:6789/0 conn(0x55a747ba7520 legacy=0x55a747ba9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.069+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3681202113 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a747bac210 con 0x55a747ba4bf0 2024-05-15T18:09:02.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.071+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/3681202113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba6fe0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000a470 tx=0x7fb3b001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bb554778ce0d6a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.071+0000 7fb3b77fe640 1 -- 172.21.15.173:0/3681202113 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0057070 con 0x55a747ba4bf0 2024-05-15T18:09:02.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.071+0000 7fb3b77fe640 1 -- 172.21.15.173:0/3681202113 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0052570 con 0x55a747ba4bf0 2024-05-15T18:09:02.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.071+0000 7fb3b77fe640 1 -- 172.21.15.173:0/3681202113 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0052870 con 0x55a747ba4bf0 2024-05-15T18:09:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.072+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3681202113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 msgr2=0x55a747ba6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.072+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3681202113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba6fe0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000a470 tx=0x7fb3b001ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.072+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3681202113 shutdown_connections 2024-05-15T18:09:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.072+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3681202113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba6fe0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.072+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3681202113 >> 172.21.15.173:0/3681202113 conn(0x55a747b9e560 msgr2=0x55a747ba0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.072+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3681202113 shutdown_connections 2024-05-15T18:09:02.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.072+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3681202113 wait complete. 2024-05-15T18:09:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.085+0000 7fb3c0f29800 1 Processor -- start 2024-05-15T18:09:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.085+0000 7fb3c0f29800 1 -- start start 2024-05-15T18:09:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.086+0000 7fb3c0f29800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.086+0000 7fb3c0f29800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a747aef1d0 con 0x55a747ba4bf0 2024-05-15T18:09:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.086+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.086+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39404/0 (socket says 172.21.15.173:39404) 2024-05-15T18:09:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.086+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3381372326 learned_addr learned my addr 172.21.15.173:0/3381372326 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.086+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3381372326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a747ba2af0 con 0x55a747ba4bf0 2024-05-15T18:09:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.086+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/3381372326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba4530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0055040 tx=0x7fb3b004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330a75061ae89d63 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb2aae05640 1 -- 172.21.15.173:0/3381372326 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0057040 con 0x55a747ba4bf0 2024-05-15T18:09:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb2aae05640 1 -- 172.21.15.173:0/3381372326 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0052990 con 0x55a747ba4bf0 2024-05-15T18:09:02.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb2aae05640 1 -- 172.21.15.173:0/3381372326 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0052c70 con 0x55a747ba4bf0 2024-05-15T18:09:02.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3381372326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 msgr2=0x55a747ba4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3381372326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba4530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0055040 tx=0x7fb3b004c000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3381372326 shutdown_connections 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3381372326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747ba4530 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3381372326 >> 172.21.15.173:0/3381372326 conn(0x55a747b9e560 msgr2=0x55a747c90fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3381372326 shutdown_connections 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.087+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3381372326 wait complete. 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3c0f29800 1 Processor -- start 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3c0f29800 1 -- start start 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3c0f29800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747c9f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3c0f29800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a747bab4a0 con 0x55a747ba4bf0 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747c9f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747c9f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39412/0 (socket says 172.21.15.173:39412) 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/676386479 learned_addr learned my addr 172.21.15.173:0/676386479 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a747c9f820 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.088+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747c9f2e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000a470 tx=0x7fb3b0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.089+0000 7fb2a9602640 1 -- 172.21.15.173:0/676386479 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0073070 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.089+0000 7fb2a9602640 1 -- 172.21.15.173:0/676386479 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b005d780 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.089+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a747c9fab0 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.089+0000 7fb2a9602640 1 -- 172.21.15.173:0/676386479 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0057070 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.089+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a747ca2760 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb2a9602640 1 -- 172.21.15.173:0/676386479 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb3b0076070 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb2a9602640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2a4036950 0x7fb2a4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb2a9602640 1 -- 172.21.15.173:0/676386479 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb3b008deb0 con 0x55a747ba4bf0 2024-05-15T18:09:02.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2a4036950 0x7fb2a4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747ba7520 0x55a747ca6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ca6a60 con 0x55a747ba7520 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb3bd34f640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747ba7520 0x55a747ca6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.090+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2a4036950 0x7fb2a4038e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000f60 tx=0x7fb3a80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3bd34f640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747ba7520 0x55a747ca6520 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3bd34f640 1 -- 172.21.15.173:0/676386479 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747ba7520 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ca3af0 con 0x55a747ba7520 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3bd34f640 1 -- 172.21.15.173:0/676386479 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747ba7520 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ca8db0 0x55a747cab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747cab890 con 0x55a747ca8db0 2024-05-15T18:09:02.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ca8db0 0x55a747cab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.091+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ca8db0 0x55a747cab1a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.092+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/676386479 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb3b0075030 con 0x55a747ca8db0 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.092+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ca7d30 con 0x55a747ba7520 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.092+0000 7fb3bd34f640 1 -- 172.21.15.173:0/676386479 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747ba7520 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.092+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a747caccf0 0x55a747caf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.092+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747caf8c0 con 0x55a747caccf0 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.092+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a747caccf0 0x55a747caf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.093+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a747caccf0 0x55a747caf160 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.093+0000 7fb3b7fff640 1 -- 172.21.15.173:0/676386479 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb3a8009050 con 0x55a747caccf0 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.093+0000 7fb3c0f29800 1 Processor -- start 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.093+0000 7fb3c0f29800 1 -- start start 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.093+0000 7fb3c0f29800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747cbdd20 0x55a747cbe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.093+0000 7fb3c0f29800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a747a95cf0 con 0x55a747cbdd20 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747cbdd20 0x55a747cbe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747cbdd20 0x55a747cbe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39428/0 (socket says 172.21.15.173:39428) 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/1381198753 learned_addr learned my addr 172.21.15.173:0/1381198753 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/1381198753 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a747cbe680 con 0x55a747cbdd20 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747cbdd20 0x55a747cbe140 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb3b006d000 tx=0x7fb3b0066ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb2a27fc640 1 -- 172.21.15.173:0/1381198753 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b0006700 con 0x55a747cbdd20 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb2a27fc640 1 -- 172.21.15.173:0/1381198753 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b008f020 con 0x55a747cbdd20 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a747cbf0f0 con 0x55a747cbdd20 2024-05-15T18:09:02.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb2a27fc640 1 -- 172.21.15.173:0/1381198753 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b00069d0 con 0x55a747cbdd20 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.094+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a747cbf5f0 con 0x55a747cbdd20 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.095+0000 7fb2a27fc640 1 -- 172.21.15.173:0/1381198753 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb3b00773b0 con 0x55a747cbdd20 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.095+0000 7fb2a27fc640 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2940368b0 0x7fb294038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.095+0000 7fb2a27fc640 1 -- 172.21.15.173:0/1381198753 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb3b0090030 con 0x55a747cbdd20 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.095+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2940368b0 0x7fb294038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.095+0000 7fb3c0f29800 1 Processor -- start 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3c0f29800 1 -- start start 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2940368b0 0x7fb294038d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800bf50 tx=0x7fb3a800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3c0f29800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747ccb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3c0f29800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a747ba2db0 con 0x55a747ccaea0 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747ccb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747ccb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39430/0 (socket says 172.21.15.173:39430) 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/480118101 learned_addr learned my addr 172.21.15.173:0/480118101 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/480118101 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a747ccb890 con 0x55a747ccaea0 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/480118101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747ccb2c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0002f40 tx=0x7fb3b0077820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4daf43faa4742c31 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb293fff640 1 -- 172.21.15.173:0/480118101 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b006f950 con 0x55a747ccaea0 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.096+0000 7fb293fff640 1 -- 172.21.15.173:0/480118101 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b008a070 con 0x55a747ccaea0 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb293fff640 1 -- 172.21.15.173:0/480118101 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b008c770 con 0x55a747ccaea0 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 -- 172.21.15.173:0/480118101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 msgr2=0x55a747ccb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/480118101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747ccb2c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0002f40 tx=0x7fb3b0077820 comp rx=0 tx=0).stop 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 -- 172.21.15.173:0/480118101 shutdown_connections 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/480118101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747ccb2c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 -- 172.21.15.173:0/480118101 >> 172.21.15.173:0/480118101 conn(0x55a747cc7200 msgr2=0x55a747cc5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 -- 172.21.15.173:0/480118101 shutdown_connections 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 -- 172.21.15.173:0/480118101 wait complete. 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 Processor -- start 2024-05-15T18:09:02.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 -- start start 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747cd2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.097+0000 7fb3c0f29800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a747ccbf40 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747cd2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb3bcb4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747cd2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39442/0 (socket says 172.21.15.173:39442) 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 learned_addr learned my addr 172.21.15.173:0/3526527173 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a747cd27c0 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747cd2280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb3b005cfd0 tx=0x7fb3b0065f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb2927fc640 1 -- 172.21.15.173:0/3526527173 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b00ba070 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb2927fc640 1 -- 172.21.15.173:0/3526527173 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0086d30 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a747cd27c0 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a747cd27c0 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.098+0000 7fb2927fc640 1 -- 172.21.15.173:0/3526527173 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3b008cc20 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.099+0000 7fb2927fc640 1 -- 172.21.15.173:0/3526527173 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb3b00bd070 con 0x55a747ccaea0 2024-05-15T18:09:02.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.099+0000 7fb2927fc640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb288036900 0x7fb288038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.099+0000 7fb2927fc640 1 -- 172.21.15.173:0/3526527173 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fb3b00a5070 con 0x55a747ccaea0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.099+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb288036900 0x7fb288038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb288036900 0x7fb288038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8001b60 tx=0x7fb3a8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747cdd980 0x55a747cdfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce0590 con 0x55a747cdd980 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3bd34f640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747cdd980 0x55a747cdfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3bd34f640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747cdd980 0x55a747cdfe40 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3c0f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3c0f29800 20 realm 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.100+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce09a0 con 0x55a747cdd980 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1270 con 0x55a747cdd980 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ce2100 0x55a747ce44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce4c50 con 0x55a747ce2100 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ce2100 0x55a747ce44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.101+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ce2100 0x55a747ce44f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3c0f29800 20 searching for the correct realm 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce6630 con 0x55a747ce2100 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3bcb4e640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb3b00bf060 0x7fb3b006e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce6630 con 0x7fb3b00bf060 2024-05-15T18:09:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.102+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb3b00bf060 0x7fb3b006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.103+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb3b00bf060 0x7fb3b006e690 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.103+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3a8009050 con 0x7fb3b00bf060 2024-05-15T18:09:02.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.103+0000 7fb3b7fff640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb3a8038040 0x7fb3a801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.103+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce6630 con 0x7fb3a8038040 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.103+0000 7fb3bd34f640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb3a8038040 0x7fb3a801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.104+0000 7fb3bd34f640 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb3a8038040 0x7fb3a801bab0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.104+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.104+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.104+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.104+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.104+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.104+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3b00bf060 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3a8009050 con 0x7fb3b00bf060 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.105+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3b00bf060 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb3a8009050 con 0x7fb3b00bf060 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.106+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.107+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.107+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.107+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.107+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.107+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.107+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.108+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3b00bf060 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3a8009050 con 0x7fb3b00bf060 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.109+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.110+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.110+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.110+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.110+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.110+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.110+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3b00bf060 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3a8009050 con 0x7fb3b00bf060 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747ce2100 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3a8038040 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x55a747cdd980 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.111+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce1610 con 0x7fb3b00bf060 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:02.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce5600 con 0x55a747cdd980 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce59f0 con 0x55a747cdd980 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.112+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce59f0 con 0x7fb3a8038040 2024-05-15T18:09:02.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 zone default found 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 4 Realm: () 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 zonegroup default 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce5e10 con 0x7fb3a8038040 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce5e10 con 0x55a747ce2100 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce84e0 con 0x55a747ce2100 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 started sync module instance, tier type = 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.113+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce7980 con 0x7fb3b00bf060 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.114+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.115+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94176952614256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce75e0 con 0x7fb3b00bf060 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.115+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce9350 con 0x55a747cdd980 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.116+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94176952614256] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.116+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.116+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94176952618656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ce92c0 con 0x55a747cdd980 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.116+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747cea210 con 0x55a747ce2100 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.117+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.117+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94176952622432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ceaab0 con 0x55a747ce2100 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.117+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ceb560 con 0x7fb3b00bf060 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.117+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94176952618656] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.118+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94176952622432] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.118+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.118+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94176952620864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ceb980 con 0x7fb3b00bf060 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.118+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747cec210 con 0x55a747cdd980 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.119+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94176952620864] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.119+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.119+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94176952627312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747cec600 con 0x55a747cdd980 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.119+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ced020 con 0x7fb3a8038040 2024-05-15T18:09:02.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.120+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.120+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94176952634128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ced490 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.120+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94176952627312] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.120+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747cedd90 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.121+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94176952634128] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.121+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.121+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94176952635360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ced400 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.121+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747cee410 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94176952635360] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94176952637664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747cee410 con 0x7fb3a8038040 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 20 add_watcher() i=0 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 20 add_watcher() i=1 2024-05-15T18:09:02.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 20 add_watcher() i=2 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 20 add_watcher() i=3 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 20 add_watcher() i=4 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 20 add_watcher() i=5 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.122+0000 7fb3c0f29800 20 add_watcher() i=6 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.123+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94176952637664] v29'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.123+0000 7fb3c0f29800 20 add_watcher() i=7 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.123+0000 7fb3c0f29800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.123+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747cf1810 con 0x55a747cdd980 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.124+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.124+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94176952639792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747ceecd0 con 0x55a747cdd980 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94176952639792] v29'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb272fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3c0f29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3c0f29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:02.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3c0f29800 5 note: GC not initialized 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb271fe3640 20 reqs_thread_entry: start 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3c0f29800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3c0f29800 20 Filter name: none 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb1e37fe640 20 reqs_thread_entry: start 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.125+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d24c80 con 0x7fb3b00bf060 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.126+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.126+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.126+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.126+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d25810 con 0x7fb3a8038040 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:02.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d26ee0 con 0x7fb3b00bf060 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d26ee0 con 0x7fb3a8038040 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(65 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 4.20 4:0571a38c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d26870 con 0x55a747cdd980 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 4.2 4:437c4f96:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d2b490 con 0x55a747cdd980 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 4.7 4:e385301a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d2de50 con 0x7fb3a8038040 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 4.28 4:16086eb9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d2de50 con 0x55a747cdd980 2024-05-15T18:09:02.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.127+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 4.11 4:8b23f7bc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d32ea0 con 0x7fb3a8038040 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 4.25 4:a4f38253:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d35470 con 0x55a747ce2100 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 4.34 4:2d6893ae:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d38300 con 0x7fb3b00bf060 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 4.34 4:2c099a43:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x7fb3b00bf060 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:74 4.16 4:6a82d888:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3df20 con 0x55a747ce2100 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(66 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:75 4.3e 4:7d40b125:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d27310 con 0x7fb3b00bf060 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(67 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 4.11 4:8b3667c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a747d27c60 con 0x7fb3a8038040 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(69 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(71 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(70 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(68 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(74 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.6 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(73 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(76 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.128+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(75 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.129+0000 7fb272fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.129+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94176952639792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x55a747cdd980 2024-05-15T18:09:02.126 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.130+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94176952639792] v29'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.130+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94176952614256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x7fb3b00bf060 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.131+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94176952614256] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.131+0000 7fb3c0f29800 20 remove_watcher() i=0 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.131+0000 7fb3c0f29800 2 removed watcher, disabling cache 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.131+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94176952618656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x55a747cdd980 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.132+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94176952618656] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.132+0000 7fb3c0f29800 20 remove_watcher() i=1 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.132+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94176952622432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x55a747ce2100 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.133+0000 7fb3bcb4e640 1 -- 172.21.15.173:0/3526527173 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94176952622432] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b00bc030 con 0x55a747ce2100 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.133+0000 7fb3c0f29800 20 remove_watcher() i=2 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.133+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94176952620864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x7fb3b00bf060 2024-05-15T18:09:02.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.134+0000 7fb3b7fff640 1 -- 172.21.15.173:0/3526527173 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94176952620864] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3a8045040 con 0x7fb3b00bf060 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.134+0000 7fb3c0f29800 20 remove_watcher() i=3 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.134+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94176952627312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x55a747cdd980 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.135+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94176952627312] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x55a747cdd980 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.135+0000 7fb3c0f29800 20 remove_watcher() i=4 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.135+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94176952634128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x7fb3a8038040 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.136+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94176952634128] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.136+0000 7fb3c0f29800 20 remove_watcher() i=5 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.136+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94176952635360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x7fb3a8038040 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.137+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94176952635360] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.137+0000 7fb3c0f29800 20 remove_watcher() i=6 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.137+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94176952637664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a747d3b110 con 0x7fb3a8038040 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94176952637664] v29'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3b800a4a0 con 0x7fb3a8038040 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 20 remove_watcher() i=7 2024-05-15T18:09:02.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb3a8038040 msgr2=0x7fb3a801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb3a8038040 0x7fb3a801bab0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747cdd980 msgr2=0x55a747cdfe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747cdd980 0x55a747cdfe40 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb3b00bf060 msgr2=0x7fb3b006e690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb3b00bf060 0x7fb3b006e690 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ce2100 msgr2=0x55a747ce44f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ce2100 0x55a747ce44f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb288036900 msgr2=0x7fb288038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb288036900 0x7fb288038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8001b60 tx=0x7fb3a8010000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 msgr2=0x55a747cd2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3bd34f640 1 -- 172.21.15.173:0/3526527173 reap_dead start 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747cd2280 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb3b005cfd0 tx=0x7fb3b0065f50 comp rx=0 tx=0).stop 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 shutdown_connections 2024-05-15T18:09:02.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/3526527173 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ccaea0 0x55a747cd2280 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.138+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 >> 172.21.15.173:0/3526527173 conn(0x55a747cc7200 msgr2=0x55a747cc4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 shutdown_connections 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/3526527173 wait complete. 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2940368b0 msgr2=0x7fb294038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2940368b0 0x7fb294038d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800bf50 tx=0x7fb3a800f000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747cbdd20 msgr2=0x55a747cbe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747cbdd20 0x55a747cbe140 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb3b006d000 tx=0x7fb3b0066ac0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 shutdown_connections 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2940368b0 0x7fb294038d70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/1381198753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747cbdd20 0x55a747cbe140 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 >> 172.21.15.173:0/1381198753 conn(0x55a747cb1dc0 msgr2=0x55a747cb21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 shutdown_connections 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/1381198753 wait complete. 2024-05-15T18:09:02.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a747caccf0 msgr2=0x55a747caf160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a747caccf0 0x55a747caf160 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747ba7520 msgr2=0x55a747ca6520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a747ba7520 0x55a747ca6520 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ca8db0 msgr2=0x55a747cab1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a747ca8db0 0x55a747cab1a0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2a4036950 msgr2=0x7fb2a4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb2a4036950 0x7fb2a4038e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8000f60 tx=0x7fb3a80012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 msgr2=0x55a747c9f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 --2- 172.21.15.173:0/676386479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a747ba4bf0 0x55a747c9f2e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000a470 tx=0x7fb3b0003020 comp rx=0 tx=0).stop 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3bd34f640 1 -- 172.21.15.173:0/676386479 reap_dead start 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 shutdown_connections 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 >> 172.21.15.173:0/676386479 conn(0x55a747b9e560 msgr2=0x55a747ba3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.139+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 shutdown_connections 2024-05-15T18:09:02.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.140+0000 7fb3c0f29800 1 -- 172.21.15.173:0/676386479 wait complete. 2024-05-15T18:09:02.132 INFO:teuthology.orchestra.run.smithi173.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0a7d7418-39f7-493f-89f0-016c6637672d","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","marker":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-15T18:09:01.653027Z","creation_time":"2024-05-15T18:08:58.890026Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-15T18:09:02.132 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:09:01.653027Z', 'creation_time': '2024-05-15T18:08:58.890026Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-15T18:09:02.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-05-15T18:09:02.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-05-15T18:09:02.133 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-05-15T18:09:02.175 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:02.176 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:02.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.199+0000 7ffb25c12800 1 Processor -- start 2024-05-15T18:09:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb25c12800 1 -- start start 2024-05-15T18:09:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb25c12800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55a0d9537780 0x55a0d9537ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb25c12800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a0d95349c0 con 0x55a0d95380e0 2024-05-15T18:09:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb25c12800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55a0d93c7050 con 0x55a0d9537780 2024-05-15T18:09:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb211ee640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55a0d9537780 0x55a0d9537ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb1bfff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55a0d95380e0 0x55a0d95341c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57174/0 (socket says 172.21.15.173:57174) 2024-05-15T18:09:02.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb1bfff640 1 -- 172.21.15.173:0/2002849025 learned_addr learned my addr 172.21.15.173:0/2002849025 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:02.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb211ee640 1 -- 172.21.15.173:0/2002849025 >> v1:172.21.15.3:6789/0 conn(0x55a0d95380e0 legacy=0x55a0d95341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.200+0000 7ffb211ee640 1 -- 172.21.15.173:0/2002849025 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d9534bc0 con 0x55a0d9537780 2024-05-15T18:09:02.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.202+0000 7ffb211ee640 1 --2- 172.21.15.173:0/2002849025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9537ba0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400a470 tx=0x7ffb1401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b1de652a394648 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.202+0000 7ffb209ed640 1 -- 172.21.15.173:0/2002849025 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14057070 con 0x55a0d9537780 2024-05-15T18:09:02.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.202+0000 7ffb209ed640 1 -- 172.21.15.173:0/2002849025 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14052570 con 0x55a0d9537780 2024-05-15T18:09:02.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.202+0000 7ffb209ed640 1 -- 172.21.15.173:0/2002849025 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14052870 con 0x55a0d9537780 2024-05-15T18:09:02.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.203+0000 7ffb25c12800 1 -- 172.21.15.173:0/2002849025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 msgr2=0x55a0d9537ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.203+0000 7ffb25c12800 1 --2- 172.21.15.173:0/2002849025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9537ba0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400a470 tx=0x7ffb1401ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:02.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.203+0000 7ffb25c12800 1 -- 172.21.15.173:0/2002849025 shutdown_connections 2024-05-15T18:09:02.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.203+0000 7ffb25c12800 1 --2- 172.21.15.173:0/2002849025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9537ba0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.203+0000 7ffb25c12800 1 -- 172.21.15.173:0/2002849025 >> 172.21.15.173:0/2002849025 conn(0x55a0d952fd20 msgr2=0x55a0d9532140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.203+0000 7ffb25c12800 1 -- 172.21.15.173:0/2002849025 shutdown_connections 2024-05-15T18:09:02.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.203+0000 7ffb25c12800 1 -- 172.21.15.173:0/2002849025 wait complete. 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb25c12800 1 Processor -- start 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb25c12800 1 -- start start 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb25c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9627a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb25c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0d94811c0 con 0x55a0d9537780 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9627a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9627a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39468/0 (socket says 172.21.15.173:39468) 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb211ee640 1 -- 172.21.15.173:0/1141333054 learned_addr learned my addr 172.21.15.173:0/1141333054 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.217+0000 7ffb211ee640 1 -- 172.21.15.173:0/1141333054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d9628030 con 0x55a0d9537780 2024-05-15T18:09:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffb211ee640 1 --2- 172.21.15.173:0/1141333054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9627a60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffb14055040 tx=0x7ffb1404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4061a8fa95de1d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffa0f606640 1 -- 172.21.15.173:0/1141333054 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14057040 con 0x55a0d9537780 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffa0f606640 1 -- 172.21.15.173:0/1141333054 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14052990 con 0x55a0d9537780 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffa0f606640 1 -- 172.21.15.173:0/1141333054 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14052c70 con 0x55a0d9537780 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffb25c12800 1 -- 172.21.15.173:0/1141333054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 msgr2=0x55a0d9627a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1141333054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9627a60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffb14055040 tx=0x7ffb1404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffb25c12800 1 -- 172.21.15.173:0/1141333054 shutdown_connections 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1141333054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d9627a60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.218+0000 7ffb25c12800 1 -- 172.21.15.173:0/1141333054 >> 172.21.15.173:0/1141333054 conn(0x55a0d952fd20 msgr2=0x55a0d9623380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb25c12800 1 -- 172.21.15.173:0/1141333054 shutdown_connections 2024-05-15T18:09:02.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb25c12800 1 -- 172.21.15.173:0/1141333054 wait complete. 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb25c12800 1 Processor -- start 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb25c12800 1 -- start start 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb25c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d962f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb25c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0d953f9e0 con 0x55a0d9537780 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d962f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d962f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39484/0 (socket says 172.21.15.173:39484) 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb211ee640 1 -- 172.21.15.173:0/1759007683 learned_addr learned my addr 172.21.15.173:0/1759007683 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.219+0000 7ffb211ee640 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d962f9b0 con 0x55a0d9537780 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.220+0000 7ffb211ee640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d962f470 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400a470 tx=0x7ffb14003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.220+0000 7ffa0de03640 1 -- 172.21.15.173:0/1759007683 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14073070 con 0x55a0d9537780 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.220+0000 7ffa0de03640 1 -- 172.21.15.173:0/1759007683 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1405d570 con 0x55a0d9537780 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.220+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0d962fc40 con 0x55a0d9537780 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.220+0000 7ffa0de03640 1 -- 172.21.15.173:0/1759007683 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14057070 con 0x55a0d9537780 2024-05-15T18:09:02.199 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.220+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d96328f0 con 0x55a0d9537780 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffa0de03640 1 -- 172.21.15.173:0/1759007683 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb14076070 con 0x55a0d9537780 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffa0de03640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ffa08036900 0x7ffa08038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffa0de03640 1 -- 172.21.15.173:0/1759007683 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ffb1408dd60 con 0x55a0d9537780 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ffa08036900 0x7ffa08038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d95380e0 0x55a0d96366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9636c40 con 0x55a0d95380e0 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffb219ef640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d95380e0 0x55a0d96366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ffa08036900 0x7ffa08038dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c000f60 tx=0x7ffb0c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.221+0000 7ffb219ef640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d95380e0 0x55a0d96366b0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.222+0000 7ffb219ef640 1 -- 172.21.15.173:0/1759007683 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d95380e0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.222+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9633c80 con 0x55a0d95380e0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.222+0000 7ffb219ef640 1 -- 172.21.15.173:0/1759007683 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d95380e0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.222+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9638f90 0x55a0d963b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.222+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d963ba70 con 0x55a0d9638f90 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.222+0000 7ffb211ee640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9638f90 0x55a0d963b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.222+0000 7ffb211ee640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9638f90 0x55a0d963b380 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.223+0000 7ffb211ee640 1 -- 172.21.15.173:0/1759007683 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb14075030 con 0x55a0d9638f90 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.223+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9637f40 con 0x55a0d95380e0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.223+0000 7ffb219ef640 1 -- 172.21.15.173:0/1759007683 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d95380e0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.223+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a0d963ced0 0x55a0d963f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.223+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d963fac0 con 0x55a0d963ced0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.223+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a0d963ced0 0x55a0d963f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.224+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a0d963ced0 0x55a0d963f360 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.224+0000 7ffb1bfff640 1 -- 172.21.15.173:0/1759007683 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb0c009050 con 0x55a0d963ced0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.224+0000 7ffb25c12800 1 Processor -- start 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.224+0000 7ffb25c12800 1 -- start start 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.224+0000 7ffb25c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d95370a0 0x55a0d9535510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.224+0000 7ffb25c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0d9427cf0 con 0x55a0d95370a0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d95370a0 0x55a0d9535510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d95370a0 0x55a0d9535510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39496/0 (socket says 172.21.15.173:39496) 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffb211ee640 1 -- 172.21.15.173:0/1648229395 learned_addr learned my addr 172.21.15.173:0/1648229395 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffb211ee640 1 -- 172.21.15.173:0/1648229395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d9535a50 con 0x55a0d95370a0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffb211ee640 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d95370a0 0x55a0d9535510 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ffb1408c360 tx=0x7ffb14077fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffa06ffd640 1 -- 172.21.15.173:0/1648229395 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14006690 con 0x55a0d95370a0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffa06ffd640 1 -- 172.21.15.173:0/1648229395 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb14076a70 con 0x55a0d95370a0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0d9535ce0 con 0x55a0d95370a0 2024-05-15T18:09:02.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffa06ffd640 1 -- 172.21.15.173:0/1648229395 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14076d50 con 0x55a0d95370a0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.225+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d95361e0 con 0x55a0d95370a0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.226+0000 7ffa06ffd640 1 -- 172.21.15.173:0/1648229395 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb1405ca60 con 0x55a0d95370a0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.226+0000 7ffa06ffd640 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9f80368f0 0x7ff9f8038db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.226+0000 7ffa06ffd640 1 -- 172.21.15.173:0/1648229395 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ffb1409a850 con 0x55a0d95370a0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.226+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9f80368f0 0x7ff9f8038db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.226+0000 7ffb25c12800 1 Processor -- start 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb25c12800 1 -- start start 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9f80368f0 0x7ff9f8038db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00bf50 tx=0x7ffb0c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb25c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d965d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb25c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0d96282f0 con 0x55a0d965d3b0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d965d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d965d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39508/0 (socket says 172.21.15.173:39508) 2024-05-15T18:09:02.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb211ee640 1 -- 172.21.15.173:0/1034711695 learned_addr learned my addr 172.21.15.173:0/1034711695 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb211ee640 1 -- 172.21.15.173:0/1034711695 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d965dda0 con 0x55a0d965d3b0 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffb211ee640 1 --2- 172.21.15.173:0/1034711695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d965d7d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ffb14076f90 tx=0x7ffb14095f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3835457101efa29e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffa04ff9640 1 -- 172.21.15.173:0/1034711695 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb140a8020 con 0x55a0d965d3b0 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.227+0000 7ffa04ff9640 1 -- 172.21.15.173:0/1034711695 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140766e0 con 0x55a0d965d3b0 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffa04ff9640 1 -- 172.21.15.173:0/1034711695 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1409ab70 con 0x55a0d965d3b0 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 -- 172.21.15.173:0/1034711695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 msgr2=0x55a0d965d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1034711695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d965d7d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ffb14076f90 tx=0x7ffb14095f10 comp rx=0 tx=0).stop 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 -- 172.21.15.173:0/1034711695 shutdown_connections 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1034711695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d965d7d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 -- 172.21.15.173:0/1034711695 >> 172.21.15.173:0/1034711695 conn(0x55a0d9659680 msgr2=0x55a0d96576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 -- 172.21.15.173:0/1034711695 shutdown_connections 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 -- 172.21.15.173:0/1034711695 wait complete. 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 Processor -- start 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 -- start start 2024-05-15T18:09:02.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d96646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.228+0000 7ffb25c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0d965e400 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d96646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ffb211ee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d96646b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39524/0 (socket says 172.21.15.173:39524) 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 learned_addr learned my addr 172.21.15.173:0/313128937 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d9664bf0 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ffb211ee640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d96646b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ffb1408ccd0 tx=0x7ffb1409cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ff9f6ffd640 1 -- 172.21.15.173:0/313128937 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb140bd070 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ff9f6ffd640 1 -- 172.21.15.173:0/313128937 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1405dc60 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0d9664bf0 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ff9f6ffd640 1 -- 172.21.15.173:0/313128937 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb14079930 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.229+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d9665150 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.230+0000 7ff9f6ffd640 1 -- 172.21.15.173:0/313128937 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ffb140c0070 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.230+0000 7ff9f6ffd640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9ec036900 0x7ff9ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.230+0000 7ff9f6ffd640 1 -- 172.21.15.173:0/313128937 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7ffb140b4030 con 0x55a0d965d3b0 2024-05-15T18:09:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.230+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9ec036900 0x7ff9ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d966fdf0 0x55a0d96722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9672a00 con 0x55a0d966fdf0 2024-05-15T18:09:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9ec036900 0x7ff9ec038dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c001b60 tx=0x7ffb0c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb219ef640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d966fdf0 0x55a0d96722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb219ef640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d966fdf0 0x55a0d96722b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb25c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb25c12800 20 realm 2024-05-15T18:09:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.231+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9672e10 con 0x55a0d966fdf0 2024-05-15T18:09:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d96736e0 con 0x55a0d966fdf0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9674570 0x55a0d9676960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d96770a0 con 0x55a0d9674570 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb211ee640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9674570 0x55a0d9676960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.232+0000 7ffb211ee640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9674570 0x55a0d9676960 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb25c12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb25c12800 20 searching for the correct realm 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9678a70 con 0x55a0d9674570 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb211ee640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ffb140c2060 0x7ffb140cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9678a70 con 0x7ffb140c2060 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.233+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ffb140c2060 0x7ffb140cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.234+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ffb140c2060 0x7ffb140cc7a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.234+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.234+0000 7ffb1bfff640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ffb0c037040 0x7ffb0c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.234+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9678a70 con 0x7ffb0c037040 2024-05-15T18:09:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.234+0000 7ffb219ef640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ffb0c037040 0x7ffb0c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.234+0000 7ffb219ef640 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ffb0c037040 0x7ffb0c036410 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.235+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb140c2060 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.236+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb140c2060 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.237+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.238+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.239+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.239+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.239+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.239+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.239+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.239+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb140c2060 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.240+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb140c2060 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d9674570 2024-05-15T18:09:02.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb0c037040 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.241+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x55a0d966fdf0 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9673a80 con 0x7ffb140c2060 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a40 con 0x55a0d966fdf0 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677e30 con 0x55a0d966fdf0 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.242+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677e30 con 0x7ffb0c037040 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 zone default found 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 4 Realm: () 2024-05-15T18:09:02.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 zonegroup default 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9678250 con 0x7ffb0c037040 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9678670 con 0x55a0d9674570 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.243+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967a920 con 0x55a0d9674570 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.244+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.244+0000 7ffb25c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.244+0000 7ffb25c12800 20 started sync module instance, tier type = 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.244+0000 7ffb25c12800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.244+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9679dc0 con 0x7ffb140c2060 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.244+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.245+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94149330575792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9679a20 con 0x7ffb140c2060 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.245+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967b790 con 0x55a0d966fdf0 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.246+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94149330575792] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.246+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.246+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94149330580192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bbb0 con 0x55a0d966fdf0 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.246+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967c570 con 0x55a0d9674570 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.247+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94149330580192] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.247+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.247+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94149330581248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.247+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967d430 con 0x7ffb140c2060 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.248+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.248+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94149330589728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967e0f0 con 0x7ffb140c2060 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.248+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94149330581248] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.248+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967c9a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.249+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94149330589728] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.249+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.249+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94149330590784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967eae0 con 0x55a0d966fdf0 2024-05-15T18:09:02.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.249+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967f4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.250+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94149330590784] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.250+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.250+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94149330596304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967eae0 con 0x7ffb0c037040 2024-05-15T18:09:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.250+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967feb0 con 0x7ffb0c037040 2024-05-15T18:09:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.251+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94149330596304] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.251+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.251+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94149330593328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967feb0 con 0x7ffb0c037040 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.251+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9680870 con 0x7ffb0c037040 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94149330593328] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94149330598400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9680870 con 0x7ffb0c037040 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 20 add_watcher() i=0 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 20 add_watcher() i=1 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 20 add_watcher() i=2 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 20 add_watcher() i=3 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 20 add_watcher() i=4 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 20 add_watcher() i=5 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.252+0000 7ffb25c12800 20 add_watcher() i=6 2024-05-15T18:09:02.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.253+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94149330598400] v29'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.253+0000 7ffb25c12800 20 add_watcher() i=7 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.253+0000 7ffb25c12800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.253+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9683cc0 con 0x55a0d966fdf0 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.254+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.254+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94149330601360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9681180 con 0x55a0d966fdf0 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94149330601360] v29'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ff9d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ffb25c12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ffb25c12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ffb25c12800 5 note: GC not initialized 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ff9d67e4640 20 reqs_thread_entry: start 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ffb25c12800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:02.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ffb25c12800 20 Filter name: none 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ff947fff640 20 reqs_thread_entry: start 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.255+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d96b6760 con 0x7ffb0c037040 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.256+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(62 [pgnls start_epoch 29 out=254b] v29'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.256+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a40 con 0x7ffb0c037040 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.257+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(63 [pgnls start_epoch 29 out=131b] v29'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.257+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a40 con 0x55a0d9674570 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.257+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.257+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb0c037040 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.257+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(65 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.257+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d966fdf0 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.258+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(66 [pgnls start_epoch 29 out=335b] v29'147 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.258+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb140c2060 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.258+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(67 [pgnls start_epoch 29 out=213b] v29'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.258+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.258+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.258+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.259+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(69 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.259+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.259+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(70 [pgnls start_epoch 29 out=213b] v29'11 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.259+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb140c2060 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.259+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(71 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.259+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb140c2060 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 [pgnls start_epoch 29 out=336b] v29'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(73 [pgnls start_epoch 29 out=131b] v29'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(74 [pgnls start_epoch 29 out=254b] v29'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(75 [pgnls start_epoch 29 out=90b] v29'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.260+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d966fdf0 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(76 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(77 [pgnls start_epoch 29 out=254b] v29'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d966fdf0 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(78 [pgnls start_epoch 29 out=254b] v29'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(79 [pgnls start_epoch 29 out=213b] v29'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.261+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.262+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(80 [pgnls start_epoch 29 out=172b] v29'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.262+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d966fdf0 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.262+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(81 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.262+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb140c2060 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.262+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(82 [pgnls start_epoch 29 out=276b] v29'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.262+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb140c2060 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.262+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(83 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.263+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d966fdf0 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.263+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(84 [pgnls start_epoch 29 out=295b] v29'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.263+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb0c037040 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.263+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(85 [pgnls start_epoch 29 out=172b] v29'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.263+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb140c2060 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.263+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(86 [pgnls start_epoch 29 out=213b] v29'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.263+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb0c037040 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(87 [pgnls start_epoch 29 out=172b] v29'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(88 [pgnls start_epoch 29 out=172b] v29'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(89 [pgnls start_epoch 29 out=90b] v29'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d9674570 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(90 [pgnls start_epoch 29 out=90b] v29'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.264+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x55a0d966fdf0 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.265+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(91 [pgnls start_epoch 29 out=131b] v29'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.265+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb140c2060 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.265+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(92 [pgnls start_epoch 29 out=295b] v29'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.265+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55a0d967bb20 con 0x7ffb0c037040 2024-05-15T18:09:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.265+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(93 [pgnls start_epoch 29 out=213b] v29'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.254 INFO:teuthology.orchestra.run.smithi173.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-05-15T18:09:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.267+0000 7ff9d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.267+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94149330601360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d96b6720 con 0x55a0d966fdf0 2024-05-15T18:09:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.268+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94149330601360] v29'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.268+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94149330575792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d96b4c90 con 0x7ffb140c2060 2024-05-15T18:09:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.269+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94149330575792] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.269+0000 7ffb25c12800 20 remove_watcher() i=0 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.269+0000 7ffb25c12800 2 removed watcher, disabling cache 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.269+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94149330580192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a40 con 0x55a0d966fdf0 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.270+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94149330580192] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.270+0000 7ffb25c12800 20 remove_watcher() i=1 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.270+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94149330581248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d96b6720 con 0x55a0d9674570 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.271+0000 7ffb211ee640 1 -- 172.21.15.173:0/313128937 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94149330581248] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb140bf030 con 0x55a0d9674570 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.271+0000 7ffb25c12800 20 remove_watcher() i=2 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.271+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94149330589728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a00 con 0x7ffb140c2060 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.272+0000 7ffb1bfff640 1 -- 172.21.15.173:0/313128937 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94149330589728] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c009050 con 0x7ffb140c2060 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.272+0000 7ffb25c12800 20 remove_watcher() i=3 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.272+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94149330590784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a00 con 0x55a0d966fdf0 2024-05-15T18:09:02.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.273+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94149330590784] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x55a0d966fdf0 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.273+0000 7ffb25c12800 20 remove_watcher() i=4 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.273+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94149330596304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a00 con 0x7ffb0c037040 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.274+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94149330596304] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.274+0000 7ffb25c12800 20 remove_watcher() i=5 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.274+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94149330593328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a00 con 0x7ffb0c037040 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.275+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94149330593328] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.275+0000 7ffb25c12800 20 remove_watcher() i=6 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.275+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94149330598400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55a0d9677a00 con 0x7ffb0c037040 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94149330598400] v29'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb1c00a4a0 con 0x7ffb0c037040 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 20 remove_watcher() i=7 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ffb0c037040 msgr2=0x7ffb0c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ffb0c037040 0x7ffb0c036410 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d966fdf0 msgr2=0x55a0d96722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d966fdf0 0x55a0d96722b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ffb140c2060 msgr2=0x7ffb140cc7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ffb140c2060 0x7ffb140cc7a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9674570 msgr2=0x55a0d9676960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9674570 0x55a0d9676960 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9ec036900 msgr2=0x7ff9ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9ec036900 0x7ff9ec038dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c001b60 tx=0x7ffb0c010000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 msgr2=0x55a0d96646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb219ef640 1 -- 172.21.15.173:0/313128937 reap_dead start 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.276+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d96646b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ffb1408ccd0 tx=0x7ffb1409cef0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 shutdown_connections 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/313128937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d965d3b0 0x55a0d96646b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 >> 172.21.15.173:0/313128937 conn(0x55a0d9659680 msgr2=0x55a0d9656ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 shutdown_connections 2024-05-15T18:09:02.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/313128937 wait complete. 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9f80368f0 msgr2=0x7ff9f8038db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9f80368f0 0x7ff9f8038db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00bf50 tx=0x7ffb0c00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d95370a0 msgr2=0x55a0d9535510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d95370a0 0x55a0d9535510 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ffb1408c360 tx=0x7ffb14077fc0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 shutdown_connections 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff9f80368f0 0x7ff9f8038db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1648229395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d95370a0 0x55a0d9535510 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 >> 172.21.15.173:0/1648229395 conn(0x55a0d9642010 msgr2=0x55a0d9642410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 shutdown_connections 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1648229395 wait complete. 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a0d963ced0 msgr2=0x55a0d963f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a0d963ced0 0x55a0d963f360 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d95380e0 msgr2=0x55a0d96366b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a0d95380e0 0x55a0d96366b0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9638f90 msgr2=0x55a0d963b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a0d9638f90 0x55a0d963b380 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ffa08036900 msgr2=0x7ffa08038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ffa08036900 0x7ffa08038dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c000f60 tx=0x7ffb0c0012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 msgr2=0x55a0d962f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.277+0000 7ffb25c12800 1 --2- 172.21.15.173:0/1759007683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d9537780 0x55a0d962f470 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400a470 tx=0x7ffb14003020 comp rx=0 tx=0).stop 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.278+0000 7ffb219ef640 1 -- 172.21.15.173:0/1759007683 reap_dead start 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.278+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 shutdown_connections 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.278+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 >> 172.21.15.173:0/1759007683 conn(0x55a0d952fd20 msgr2=0x55a0d9621b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.278+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 shutdown_connections 2024-05-15T18:09:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.278+0000 7ffb25c12800 1 -- 172.21.15.173:0/1759007683 wait complete. 2024-05-15T18:09:02.265 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-05-15T18:09:02.265 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-15T18:09:02.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-15T18:09:02.266 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-15T18:09:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.374+0000 7fcc4f71f800 1 Processor -- start 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.374+0000 7fcc4f71f800 1 -- start start 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.374+0000 7fcc4f71f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d4f27739b0 0x55d4f2771ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.374+0000 7fcc4f71f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d4f2772920 con 0x55d4f2772400 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.374+0000 7fcc4f71f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55d4f268f050 con 0x55d4f27739b0 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.375+0000 7fcc4b3e7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d4f27739b0 0x55d4f2771ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.375+0000 7fcc42be6640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55d4f2772400 0x55d4f2805fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57184/0 (socket says 172.21.15.173:57184) 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.375+0000 7fcc4b3e7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d4f27739b0 0x55d4f2771ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39534/0 (socket says 172.21.15.173:39534) 2024-05-15T18:09:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.375+0000 7fcc42be6640 1 -- 172.21.15.173:0/1416064477 learned_addr learned my addr 172.21.15.173:0/1416064477 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:02.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.375+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1416064477 >> v1:172.21.15.3:6789/0 conn(0x55d4f2772400 legacy=0x55d4f2805fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.375+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1416064477 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f2772b40 con 0x55d4f27739b0 2024-05-15T18:09:02.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.377+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/1416064477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f27739b0 0x55d4f2771ec0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00a470 tx=0x7fcc3c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86ddf7b89229d29 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.378+0000 7fcc4abe6640 1 -- 172.21.15.173:0/1416064477 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c057070 con 0x55d4f27739b0 2024-05-15T18:09:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.378+0000 7fcc4abe6640 1 -- 172.21.15.173:0/1416064477 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c052570 con 0x55d4f27739b0 2024-05-15T18:09:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.378+0000 7fcc4abe6640 1 -- 172.21.15.173:0/1416064477 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c052870 con 0x55d4f27739b0 2024-05-15T18:09:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.379+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1416064477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f27739b0 msgr2=0x55d4f2771ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.379+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1416064477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f27739b0 0x55d4f2771ec0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00a470 tx=0x7fcc3c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.379+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1416064477 shutdown_connections 2024-05-15T18:09:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.379+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1416064477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f27739b0 0x55d4f2771ec0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.379+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1416064477 >> 172.21.15.173:0/1416064477 conn(0x55d4f27f9780 msgr2=0x55d4f27fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.379+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1416064477 shutdown_connections 2024-05-15T18:09:02.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.379+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1416064477 wait complete. 2024-05-15T18:09:02.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.392+0000 7fcc4f71f800 1 Processor -- start 2024-05-15T18:09:02.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.392+0000 7fcc4f71f800 1 -- start start 2024-05-15T18:09:02.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.392+0000 7fcc4f71f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.392+0000 7fcc4f71f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4f27491d0 con 0x55d4f2772400 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39542/0 (socket says 172.21.15.173:39542) 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/269960722 learned_addr learned my addr 172.21.15.173:0/269960722 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/269960722 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f28f1e70 con 0x55d4f2772400 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/269960722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f18a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000c00 tx=0x7fcc3c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3595cd71256eefed server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcb3960a640 1 -- 172.21.15.173:0/269960722 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c061070 con 0x55d4f2772400 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcb3960a640 1 -- 172.21.15.173:0/269960722 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c052a40 con 0x55d4f2772400 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.393+0000 7fcb3960a640 1 -- 172.21.15.173:0/269960722 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c057040 con 0x55d4f2772400 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 -- 172.21.15.173:0/269960722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 msgr2=0x55d4f28f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/269960722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f18a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000c00 tx=0x7fcc3c04c000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 -- 172.21.15.173:0/269960722 shutdown_connections 2024-05-15T18:09:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/269960722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f18a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 -- 172.21.15.173:0/269960722 >> 172.21.15.173:0/269960722 conn(0x55d4f27f9780 msgr2=0x55d4f28ed1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 -- 172.21.15.173:0/269960722 shutdown_connections 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 -- 172.21.15.173:0/269960722 wait complete. 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 Processor -- start 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 -- start start 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.394+0000 7fcc4f71f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4f2809910 con 0x55d4f2772400 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39558/0 (socket says 172.21.15.173:39558) 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/2596941249 learned_addr learned my addr 172.21.15.173:0/2596941249 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f28f9790 con 0x55d4f2772400 2024-05-15T18:09:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f9250 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000c00 tx=0x7fcc3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcb37e07640 1 -- 172.21.15.173:0/2596941249 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c073070 con 0x55d4f2772400 2024-05-15T18:09:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcb37e07640 1 -- 172.21.15.173:0/2596941249 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c066790 con 0x55d4f2772400 2024-05-15T18:09:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4f28f9a20 con 0x55d4f2772400 2024-05-15T18:09:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.395+0000 7fcb37e07640 1 -- 172.21.15.173:0/2596941249 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c057070 con 0x55d4f2772400 2024-05-15T18:09:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.396+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f28fc6d0 con 0x55d4f2772400 2024-05-15T18:09:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.396+0000 7fcb37e07640 1 -- 172.21.15.173:0/2596941249 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcc3c076070 con 0x55d4f2772400 2024-05-15T18:09:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.396+0000 7fcb37e07640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb30036950 0x7fcb30038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.396+0000 7fcb37e07640 1 -- 172.21.15.173:0/2596941249 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcc3c08dca0 con 0x55d4f2772400 2024-05-15T18:09:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc42be6640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb30036950 0x7fcb30038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f27739b0 0x55d4f2900490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2900a10 con 0x55d4f27739b0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc4bbe8640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f27739b0 0x55d4f2900490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc42be6640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb30036950 0x7fcb30038e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc34000f60 tx=0x7fcc340012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc4bbe8640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f27739b0 0x55d4f2900490 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/2596941249 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f27739b0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.397+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f28fda60 con 0x55d4f27739b0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.398+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/2596941249 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f27739b0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.398+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f2902d90 0x55d4f2905180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.398+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2905870 con 0x55d4f2902d90 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.398+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f2902d90 0x55d4f2905180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.398+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f2902d90 0x55d4f2905180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.398+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/2596941249 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcc3c075030 con 0x55d4f2902d90 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.398+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2901d40 con 0x55d4f27739b0 2024-05-15T18:09:02.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.399+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/2596941249 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f27739b0 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.399+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4f2906d20 0x55d4f2909170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.399+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29098d0 con 0x55d4f2906d20 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.399+0000 7fcc42be6640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4f2906d20 0x55d4f2909170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.399+0000 7fcc42be6640 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4f2906d20 0x55d4f2909170 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.400+0000 7fcc42be6640 1 -- 172.21.15.173:0/2596941249 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcc34009050 con 0x55d4f2906d20 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.400+0000 7fcc4f71f800 1 Processor -- start 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.400+0000 7fcc4f71f800 1 -- start start 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.400+0000 7fcc4f71f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2917d30 0x55d4f2918150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.400+0000 7fcc4f71f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4f26efcf0 con 0x55d4f2917d30 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2917d30 0x55d4f2918150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2917d30 0x55d4f2918150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39568/0 (socket says 172.21.15.173:39568) 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/3518834670 learned_addr learned my addr 172.21.15.173:0/3518834670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/3518834670 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f2918690 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2917d30 0x55d4f2918150 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c060040 tx=0x7fcc3c064c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcb35602640 1 -- 172.21.15.173:0/3518834670 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c0646f0 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcb35602640 1 -- 172.21.15.173:0/3518834670 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0648b0 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4f2919100 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcb35602640 1 -- 172.21.15.173:0/3518834670 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c007df0 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.401+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f2919600 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.402+0000 7fcb35602640 1 -- 172.21.15.173:0/3518834670 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcc3c094060 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.402+0000 7fcb35602640 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb24036900 0x7fcb24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.402+0000 7fcb35602640 1 -- 172.21.15.173:0/3518834670 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcc3c088070 con 0x55d4f2917d30 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.402+0000 7fcc42be6640 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb24036900 0x7fcb24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.402+0000 7fcc4f71f800 1 Processor -- start 2024-05-15T18:09:02.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.402+0000 7fcc4f71f800 1 -- start start 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.402+0000 7fcc42be6640 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb24036900 0x7fcb24038dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400bf50 tx=0x7fcc3400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.403+0000 7fcc4f71f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f2925220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.403+0000 7fcc4f71f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4f28f2130 con 0x55d4f2924e00 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.403+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f2925220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.403+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f2925220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39572/0 (socket says 172.21.15.173:39572) 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.403+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/3240852528 learned_addr learned my addr 172.21.15.173:0/3240852528 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.403+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/3240852528 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f29257f0 con 0x55d4f2924e00 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.403+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/3240852528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f2925220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c079fd0 tx=0x7fcc3c06eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f12f268ada098b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcb2effd640 1 -- 172.21.15.173:0/3240852528 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c0a4020 con 0x55d4f2924e00 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcb2effd640 1 -- 172.21.15.173:0/3240852528 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0778b0 con 0x55d4f2924e00 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcb2effd640 1 -- 172.21.15.173:0/3240852528 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c079550 con 0x55d4f2924e00 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3240852528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 msgr2=0x55d4f2925220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/3240852528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f2925220 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c079fd0 tx=0x7fcc3c06eae0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3240852528 shutdown_connections 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/3240852528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f2925220 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3240852528 >> 172.21.15.173:0/3240852528 conn(0x55d4f2921160 msgr2=0x55d4f291f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3240852528 shutdown_connections 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3240852528 wait complete. 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 Processor -- start 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.404+0000 7fcc4f71f800 1 -- start start 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4f71f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f292c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4f71f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d4f2925ea0 con 0x55d4f2924e00 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f292c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4b3e7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f292c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39588/0 (socket says 172.21.15.173:39588) 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 learned_addr learned my addr 172.21.15.173:0/1738598359 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f292c710 con 0x55d4f2924e00 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f292c1d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0646a0 tx=0x7fcc3c04cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcb2d7fa640 1 -- 172.21.15.173:0/1738598359 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c0b8070 con 0x55d4f2924e00 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcb2d7fa640 1 -- 172.21.15.173:0/1738598359 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c077b70 con 0x55d4f2924e00 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d4f292c710 con 0x55d4f2924e00 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcb2d7fa640 1 -- 172.21.15.173:0/1738598359 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc3c077e50 con 0x55d4f2924e00 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.405+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f292c710 con 0x55d4f2924e00 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.406+0000 7fcb2d7fa640 1 -- 172.21.15.173:0/1738598359 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcc3c0bb070 con 0x55d4f2924e00 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.406+0000 7fcb2d7fa640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb140368b0 0x7fcb14038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcb2d7fa640 1 -- 172.21.15.173:0/1738598359 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fcc3c0b0050 con 0x55d4f2924e00 2024-05-15T18:09:02.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcc42be6640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb140368b0 0x7fcb14038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcc42be6640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb140368b0 0x7fcb14038d70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcc34001b60 tx=0x7fcc34010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f29377d0 0x55d4f2939c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293a3e0 con 0x55d4f29377d0 2024-05-15T18:09:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcc4bbe8640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f29377d0 0x55d4f2939c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.407+0000 7fcc4bbe8640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f29377d0 0x55d4f2939c90 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 realm 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293a7f0 con 0x55d4f29377d0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b0c0 con 0x55d4f29377d0 2024-05-15T18:09:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f293c1c0 0x55d4f293e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293ebc0 con 0x55d4f293c1c0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.408+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f293c1c0 0x55d4f293e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.409+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f293c1c0 0x55d4f293e5b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.409+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.409+0000 7fcc4f71f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.409+0000 7fcc4f71f800 20 searching for the correct realm 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.409+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29404f0 con 0x55d4f293c1c0 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.409+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.410+0000 7fcc4b3e7640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcc3c0bd060 0x7fcc3c078870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.410+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29404f0 con 0x7fcc3c0bd060 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.410+0000 7fcc42be6640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcc3c0bd060 0x7fcc3c078870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.410+0000 7fcc42be6640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcc3c0bd060 0x7fcc3c078870 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.410+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.410+0000 7fcc42be6640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcc34037040 0x7fcc34036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.410+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29404f0 con 0x7fcc34037040 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.411+0000 7fcc4bbe8640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcc34037040 0x7fcc34036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.411+0000 7fcc4bbe8640 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcc34037040 0x7fcc34036410 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.411+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcc4400a4a0 con 0x7fcc34037040 2024-05-15T18:09:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.411+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.411+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x7fcc34037040 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x7fcc34037040 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc3c0bd060 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.412+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x7fcc34037040 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.413+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc3c0bd060 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x7fcc34037040 2024-05-15T18:09:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.414+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcc4400a4a0 con 0x55d4f29377d0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.415+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc44033040 con 0x7fcc34037040 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc3c0bd060 2024-05-15T18:09:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.416+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc3c0bd060 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.417+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f293c1c0 2024-05-15T18:09:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc34037040 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x55d4f29377d0 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293b460 con 0x7fcc3c0bd060 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.418+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293f480 con 0x55d4f29377d0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293f870 con 0x55d4f29377d0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f293f870 con 0x7fcc34037040 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 zone default found 2024-05-15T18:09:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 4 Realm: () 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 zonegroup default 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2940970 con 0x7fcc34037040 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.419+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2942350 con 0x55d4f293c1c0 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29426f0 con 0x55d4f293c1c0 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4f71f800 20 started sync module instance, tier type = 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4f71f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.420+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29417f0 con 0x7fcc3c0bd060 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.421+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.421+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94373091218240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2942a90 con 0x7fcc3c0bd060 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.421+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2943340 con 0x55d4f29377d0 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.422+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94373091218240] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.423+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.423+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94373091225136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2943730 con 0x55d4f29377d0 2024-05-15T18:09:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.423+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2944190 con 0x55d4f293c1c0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.423+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94373091225136] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.424+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.424+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94373091220496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2944580 con 0x55d4f293c1c0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.424+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2944fc0 con 0x7fcc3c0bd060 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.425+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94373091220496] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.425+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.425+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94373091228784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2945860 con 0x7fcc3c0bd060 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.425+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2946220 con 0x55d4f29377d0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.426+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94373091228784] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.426+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.426+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94373091237232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2946640 con 0x55d4f29377d0 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.426+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2947000 con 0x7fcc34037040 2024-05-15T18:09:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.427+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94373091237232] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.427+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.427+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94373091238768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2947000 con 0x7fcc34037040 2024-05-15T18:09:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.427+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29479c0 con 0x7fcc34037040 2024-05-15T18:09:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.428+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94373091238768] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.428+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.428+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94373091240784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2947ba0 con 0x7fcc34037040 2024-05-15T18:09:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.428+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29483f0 con 0x7fcc34037040 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v29'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94373091240784] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94373091245440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29487b0 con 0x7fcc34037040 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 20 add_watcher() i=0 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 20 add_watcher() i=1 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 20 add_watcher() i=2 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 20 add_watcher() i=3 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 20 add_watcher() i=4 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 20 add_watcher() i=5 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.430+0000 7fcc4f71f800 20 add_watcher() i=6 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.431+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94373091245440] v29'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.431+0000 7fcc4f71f800 20 add_watcher() i=7 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.431+0000 7fcc4f71f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.431+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29477e0 con 0x55d4f29377d0 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.431+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.431+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94373091246656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29477e0 con 0x55d4f29377d0 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94373091246656] v29'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcb01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 5 note: GC not initialized 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcb00fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 20 Filter name: none 2024-05-15T18:09:02.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fca7a7fc640 20 reqs_thread_entry: start 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.433+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f297ed40 con 0x55d4f29377d0 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2981670 con 0x7fcc3c0bd060 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 20 disabling bucket name=myfoo 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f297f650 con 0x7fcc3c0bd060 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.434+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2980f30 con 0x7fcc34037040 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(65 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4f71f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4f71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4f71f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4f71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:02.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4f71f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4f71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.435+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2989de0 con 0x7fcc34037040 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(66 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4f71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4f71f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4f71f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4f71f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94373091491680 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2984830 con 0x7fcc34037040 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== watch-notify(notify (1) cookie 94373091245440 notify 124554051601 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55d4f2981320 con 0x7fcc34037040 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcb2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051601 cookie 94373091245440 notifier 4587 bl.length()=752 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(67 notify.7 [notify cookie 94373091491680 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcb2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:02.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcb2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcb2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.436+0000 7fcb2effd640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fcb10003ea0 con 0x7fcc34037040 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.437+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.437+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== watch-notify(notify_complete (2) cookie 94373091491680 notify 124554051601 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d4f297f320 con 0x7fcc34037040 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.437+0000 7fcc4f71f800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_sources= new_sources= 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.437+0000 7fcc4f71f800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential sources added=[] removed=[] 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.437+0000 7fcc4f71f800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_dests= new_dests= 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.437+0000 7fcc4f71f800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential dests added=[] removed=[] 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.437+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2984ef0 con 0x55d4f29377d0 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v29'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4f71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4f71f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4f71f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:09:02.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94373091464352 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d4f29869b0 con 0x55d4f29377d0 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94373091237232 notify 124554051598 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55d4f297f320 con 0x55d4f29377d0 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcb2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051598 cookie 94373091237232 notifier 4587 bl.length()=567 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(70 notify.4 [notify cookie 94373091464352 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcb2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcb2effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcb2effd640 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fcb10003ea0 con 0x55d4f29377d0 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.438+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.439+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94373091464352 notify 124554051598 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcc4401e040 con 0x55d4f29377d0 2024-05-15T18:09:02.431 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:09:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.439+0000 7fcb01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.439+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94373091246656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2988e40 con 0x55d4f29377d0 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.440+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94373091246656] v29'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.440+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94373091218240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2948200 con 0x7fcc3c0bd060 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.441+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94373091218240] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.441+0000 7fcc4f71f800 20 remove_watcher() i=0 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.441+0000 7fcc4f71f800 2 removed watcher, disabling cache 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.441+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94373091225136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2941340 con 0x55d4f29377d0 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.443+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94373091225136] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.443+0000 7fcc4f71f800 20 remove_watcher() i=1 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.443+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94373091220496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2942e30 con 0x55d4f293c1c0 2024-05-15T18:09:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.444+0000 7fcc4b3e7640 1 -- 172.21.15.173:0/1738598359 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94373091220496] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc3c0ba030 con 0x55d4f293c1c0 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.444+0000 7fcc4f71f800 20 remove_watcher() i=2 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.444+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94373091228784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2941c10 con 0x7fcc3c0bd060 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.445+0000 7fcc42be6640 1 -- 172.21.15.173:0/1738598359 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94373091228784] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc34009050 con 0x7fcc3c0bd060 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.445+0000 7fcc4f71f800 20 remove_watcher() i=3 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.445+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94373091237232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2941c10 con 0x55d4f29377d0 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.446+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94373091237232] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x55d4f29377d0 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.446+0000 7fcc4f71f800 20 remove_watcher() i=4 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.446+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94373091238768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2945d70 con 0x7fcc34037040 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.447+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94373091238768] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.447+0000 7fcc4f71f800 20 remove_watcher() i=5 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.447+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94373091240784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2945d70 con 0x7fcc34037040 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.448+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94373091240784] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.448+0000 7fcc4f71f800 20 remove_watcher() i=6 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.448+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94373091245440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d4f2945d70 con 0x7fcc34037040 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94373091245440] v29'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc44031040 con 0x7fcc34037040 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 20 remove_watcher() i=7 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcc34037040 msgr2=0x7fcc34036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fcc34037040 0x7fcc34036410 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f29377d0 msgr2=0x55d4f2939c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f29377d0 0x55d4f2939c90 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcc3c0bd060 msgr2=0x7fcc3c078870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fcc3c0bd060 0x7fcc3c078870 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f293c1c0 msgr2=0x55d4f293e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f293c1c0 0x55d4f293e5b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb140368b0 msgr2=0x7fcb14038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb140368b0 0x7fcb14038d70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcc34001b60 tx=0x7fcc34010000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 msgr2=0x55d4f292c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/1738598359 reap_dead start 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f292c1d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0646a0 tx=0x7fcc3c04cf90 comp rx=0 tx=0).stop 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 shutdown_connections 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/1738598359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2924e00 0x55d4f292c1d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 >> 172.21.15.173:0/1738598359 conn(0x55d4f2921160 msgr2=0x55d4f291e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 shutdown_connections 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/1738598359 wait complete. 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb24036900 msgr2=0x7fcb24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb24036900 0x7fcb24038dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400bf50 tx=0x7fcc3400f000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2917d30 msgr2=0x55d4f2918150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2917d30 0x55d4f2918150 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c060040 tx=0x7fcc3c064c80 comp rx=0 tx=0).stop 2024-05-15T18:09:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 shutdown_connections 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb24036900 0x7fcb24038dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/3518834670 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2917d30 0x55d4f2918150 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.449+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 >> 172.21.15.173:0/3518834670 conn(0x55d4f290bdd0 msgr2=0x55d4f290c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 shutdown_connections 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/3518834670 wait complete. 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4f2906d20 msgr2=0x55d4f2909170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d4f2906d20 0x55d4f2909170 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f27739b0 msgr2=0x55d4f2900490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d4f27739b0 0x55d4f2900490 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f2902d90 msgr2=0x55d4f2905180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d4f2902d90 0x55d4f2905180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb30036950 msgr2=0x7fcb30038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcb30036950 0x7fcb30038e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc34000f60 tx=0x7fcc340012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 msgr2=0x55d4f28f9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 --2- 172.21.15.173:0/2596941249 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d4f2772400 0x55d4f28f9250 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c000c00 tx=0x7fcc3c002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4bbe8640 1 -- 172.21.15.173:0/2596941249 reap_dead start 2024-05-15T18:09:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 shutdown_connections 2024-05-15T18:09:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 >> 172.21.15.173:0/2596941249 conn(0x55d4f27f9780 msgr2=0x55d4f28eb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 shutdown_connections 2024-05-15T18:09:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.450+0000 7fcc4f71f800 1 -- 172.21.15.173:0/2596941249 wait complete. 2024-05-15T18:09:02.443 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:09:02.445 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-15T18:09:02.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-15T18:09:02.446 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-15T18:09:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:02.490 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f470ff2b800 1 Processor -- start 2024-05-15T18:09:02.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f470ff2b800 1 -- start start 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f470ff2b800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559069356540 0x55906935f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f470ff2b800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590692c9900 con 0x559069354a00 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f470ff2b800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5590691e7050 con 0x559069356540 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f4703fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559069356540 0x55906935f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f4703fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559069356540 0x55906935f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39600/0 (socket says 172.21.15.173:39600) 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f470bcc2640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x559069354a00 0x559069354e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:57192/0 (socket says 172.21.15.173:57192) 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.514+0000 7f4703fff640 1 -- 172.21.15.173:0/3727116456 learned_addr learned my addr 172.21.15.173:0/3727116456 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.515+0000 7f4703fff640 1 -- 172.21.15.173:0/3727116456 >> v1:172.21.15.3:6789/0 conn(0x559069354a00 legacy=0x559069354e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.515+0000 7f4703fff640 1 -- 172.21.15.173:0/3727116456 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590692c9ad0 con 0x559069356540 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f4703fff640 1 --2- 172.21.15.173:0/3727116456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069356540 0x55906935f040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f46f400a520 tx=0x7f46f401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e83d9eaeab368b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470b4c1640 1 -- 172.21.15.173:0/3727116456 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46f4057070 con 0x559069356540 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470b4c1640 1 -- 172.21.15.173:0/3727116456 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f4052570 con 0x559069356540 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470b4c1640 1 -- 172.21.15.173:0/3727116456 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46f404ae60 con 0x559069356540 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470ff2b800 1 -- 172.21.15.173:0/3727116456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069356540 msgr2=0x55906935f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470ff2b800 1 --2- 172.21.15.173:0/3727116456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069356540 0x55906935f040 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f46f400a520 tx=0x7f46f401d010 comp rx=0 tx=0).stop 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470ff2b800 1 -- 172.21.15.173:0/3727116456 shutdown_connections 2024-05-15T18:09:02.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470ff2b800 1 --2- 172.21.15.173:0/3727116456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069356540 0x55906935f040 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470ff2b800 1 -- 172.21.15.173:0/3727116456 >> 172.21.15.173:0/3727116456 conn(0x5590693505a0 msgr2=0x5590693529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470ff2b800 1 -- 172.21.15.173:0/3727116456 shutdown_connections 2024-05-15T18:09:02.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.517+0000 7f470ff2b800 1 -- 172.21.15.173:0/3727116456 wait complete. 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.531+0000 7f470ff2b800 1 Processor -- start 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.531+0000 7f470ff2b800 1 -- start start 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.531+0000 7f470ff2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x559069449860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.531+0000 7f470ff2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5590692a11d0 con 0x559069354a00 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.531+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x559069449860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.531+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x559069449860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39612/0 (socket says 172.21.15.173:39612) 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.531+0000 7f470bcc2640 1 -- 172.21.15.173:0/2802580256 learned_addr learned my addr 172.21.15.173:0/2802580256 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.532+0000 7f470bcc2640 1 -- 172.21.15.173:0/2802580256 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559069449e30 con 0x559069354a00 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.532+0000 7f470bcc2640 1 --2- 172.21.15.173:0/2802580256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x559069449860 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f46fc001e10 tx=0x7f46fc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95db0143e2f68eea server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.532+0000 7f45f9e0b640 1 -- 172.21.15.173:0/2802580256 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc00e5c0 con 0x559069354a00 2024-05-15T18:09:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.532+0000 7f45f9e0b640 1 -- 172.21.15.173:0/2802580256 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc006070 con 0x559069354a00 2024-05-15T18:09:02.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.532+0000 7f45f9e0b640 1 -- 172.21.15.173:0/2802580256 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc00e930 con 0x559069354a00 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 -- 172.21.15.173:0/2802580256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 msgr2=0x559069449860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2802580256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x559069449860 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f46fc001e10 tx=0x7f46fc00b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 -- 172.21.15.173:0/2802580256 shutdown_connections 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2802580256 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x559069449860 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 -- 172.21.15.173:0/2802580256 >> 172.21.15.173:0/2802580256 conn(0x5590693505a0 msgr2=0x559069445180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 -- 172.21.15.173:0/2802580256 shutdown_connections 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 -- 172.21.15.173:0/2802580256 wait complete. 2024-05-15T18:09:02.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 Processor -- start 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 -- start start 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x5590694513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.533+0000 7f470ff2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55906935f850 con 0x559069354a00 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x5590694513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x5590694513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39622/0 (socket says 172.21.15.173:39622) 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f470bcc2640 1 -- 172.21.15.173:0/49567042 learned_addr learned my addr 172.21.15.173:0/49567042 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f470bcc2640 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559069451920 con 0x559069354a00 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f470bcc2640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x5590694513e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00b700 tx=0x7f46fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f45f3fff640 1 -- 172.21.15.173:0/49567042 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc00f8d0 con 0x559069354a00 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f45f3fff640 1 -- 172.21.15.173:0/49567042 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc00fa70 con 0x559069354a00 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559069451bb0 con 0x559069354a00 2024-05-15T18:09:02.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f45f3fff640 1 -- 172.21.15.173:0/49567042 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc00fd50 con 0x559069354a00 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.534+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559069454860 con 0x559069354a00 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.535+0000 7f45f3fff640 1 -- 172.21.15.173:0/49567042 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f46fc017070 con 0x559069354a00 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.535+0000 7f45f3fff640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45f4036900 0x7f45f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.535+0000 7f45f3fff640 1 -- 172.21.15.173:0/49567042 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f46fc015020 con 0x559069354a00 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.535+0000 7f4703fff640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45f4036900 0x7f45f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.535+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559069356540 0x559069458620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.535+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069458bf0 con 0x559069356540 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f470c4c3640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559069356540 0x559069458620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f4703fff640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45f4036900 0x7f45f4038dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46f4054000 tx=0x7f46f404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f470c4c3640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559069356540 0x559069458620 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f470c4c3640 1 -- 172.21.15.173:0/49567042 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f470400a4a0 con 0x559069356540 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069455bd0 con 0x559069356540 2024-05-15T18:09:02.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f470c4c3640 1 -- 172.21.15.173:0/49567042 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f470400a4a0 con 0x559069356540 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55906945af00 0x55906945d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.536+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55906945d990 con 0x55906945af00 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.537+0000 7f470bcc2640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55906945af00 0x55906945d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.537+0000 7f470bcc2640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55906945af00 0x55906945d2f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.537+0000 7f470bcc2640 1 -- 172.21.15.173:0/49567042 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46fc046040 con 0x55906945af00 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.537+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069459eb0 con 0x559069356540 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.537+0000 7f470c4c3640 1 -- 172.21.15.173:0/49567042 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f470400a4a0 con 0x559069356540 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.537+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55906945ee40 0x559069461290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.537+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694619f0 con 0x55906945ee40 2024-05-15T18:09:02.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.538+0000 7f4703fff640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55906945ee40 0x559069461290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.538+0000 7f4703fff640 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55906945ee40 0x559069461290 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.538+0000 7f4703fff640 1 -- 172.21.15.173:0/49567042 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46f405a040 con 0x55906945ee40 2024-05-15T18:09:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470ff2b800 1 Processor -- start 2024-05-15T18:09:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470ff2b800 1 -- start start 2024-05-15T18:09:02.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470ff2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906946fe50 0x559069470270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470ff2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559069247cf0 con 0x55906946fe50 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906946fe50 0x559069470270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906946fe50 0x559069470270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39630/0 (socket says 172.21.15.173:39630) 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470bcc2640 1 -- 172.21.15.173:0/4166583948 learned_addr learned my addr 172.21.15.173:0/4166583948 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470bcc2640 1 -- 172.21.15.173:0/4166583948 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590694707b0 con 0x55906946fe50 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.539+0000 7f470bcc2640 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906946fe50 0x559069470270 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f46fc04b4d0 tx=0x7f46fc017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.540+0000 7f45f17fa640 1 -- 172.21.15.173:0/4166583948 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc01ae10 con 0x55906946fe50 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.540+0000 7f45f17fa640 1 -- 172.21.15.173:0/4166583948 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc01a690 con 0x55906946fe50 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.540+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559069471220 con 0x55906946fe50 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.540+0000 7f45f17fa640 1 -- 172.21.15.173:0/4166583948 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc044b00 con 0x55906946fe50 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.540+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559069471720 con 0x55906946fe50 2024-05-15T18:09:02.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.540+0000 7f45f17fa640 1 -- 172.21.15.173:0/4166583948 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f46fc044ca0 con 0x55906946fe50 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.540+0000 7f45f17fa640 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45e4036900 0x7f45e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f45f17fa640 1 -- 172.21.15.173:0/4166583948 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f46fc03cae0 con 0x55906946fe50 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f4703fff640 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45e4036900 0x7f45e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f470ff2b800 1 Processor -- start 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f470ff2b800 1 -- start start 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f4703fff640 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45e4036900 0x7f45e4038dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x559069455b10 tx=0x7f46f4005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f470ff2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x55906947d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f470ff2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55906944a1b0 con 0x55906947cfb0 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x55906947d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x55906947d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39646/0 (socket says 172.21.15.173:39646) 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.541+0000 7f470bcc2640 1 -- 172.21.15.173:0/460372411 learned_addr learned my addr 172.21.15.173:0/460372411 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470bcc2640 1 -- 172.21.15.173:0/460372411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55906947d9a0 con 0x55906947cfb0 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470bcc2640 1 --2- 172.21.15.173:0/460372411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x55906947d3d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f46fc04ef30 tx=0x7f46fc026ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c795d90f62c46c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f45eaffd640 1 -- 172.21.15.173:0/460372411 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc060070 con 0x55906947cfb0 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f45eaffd640 1 -- 172.21.15.173:0/460372411 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc02cde0 con 0x55906947cfb0 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f45eaffd640 1 -- 172.21.15.173:0/460372411 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc055040 con 0x55906947cfb0 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470ff2b800 1 -- 172.21.15.173:0/460372411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 msgr2=0x55906947d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470ff2b800 1 --2- 172.21.15.173:0/460372411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x55906947d3d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f46fc04ef30 tx=0x7f46fc026ae0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470ff2b800 1 -- 172.21.15.173:0/460372411 shutdown_connections 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470ff2b800 1 --2- 172.21.15.173:0/460372411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x55906947d3d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470ff2b800 1 -- 172.21.15.173:0/460372411 >> 172.21.15.173:0/460372411 conn(0x5590694792d0 msgr2=0x559069477330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470ff2b800 1 -- 172.21.15.173:0/460372411 shutdown_connections 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.542+0000 7f470ff2b800 1 -- 172.21.15.173:0/460372411 wait complete. 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.543+0000 7f470ff2b800 1 Processor -- start 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.543+0000 7f470ff2b800 1 -- start start 2024-05-15T18:09:02.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.543+0000 7f470ff2b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x559069484400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.543+0000 7f470ff2b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55906947e0c0 con 0x55906947cfb0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.543+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x559069484400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.543+0000 7f470bcc2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x559069484400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:39658/0 (socket says 172.21.15.173:39658) 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.543+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 learned_addr learned my addr 172.21.15.173:0/2931067689 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.544+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559069484940 con 0x55906947cfb0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.544+0000 7f470bcc2640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x559069484400 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f46fc026bb0 tx=0x7f46fc04eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.544+0000 7f45e97fa640 1 -- 172.21.15.173:0/2931067689 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc060030 con 0x55906947cfb0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.544+0000 7f45e97fa640 1 -- 172.21.15.173:0/2931067689 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc019860 con 0x55906947cfb0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.544+0000 7f45e97fa640 1 -- 172.21.15.173:0/2931067689 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46fc04bbb0 con 0x55906947cfb0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.544+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559069484940 con 0x55906947cfb0 2024-05-15T18:09:02.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.544+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559069484940 con 0x55906947cfb0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.545+0000 7f45e97fa640 1 -- 172.21.15.173:0/2931067689 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f46fc06e020 con 0x55906947cfb0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.545+0000 7f45e97fa640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45d4036900 0x7f45d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.545+0000 7f45e97fa640 1 -- 172.21.15.173:0/2931067689 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7f46fc06c020 con 0x55906947cfb0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.545+0000 7f4703fff640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45d4036900 0x7f45d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f4703fff640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45d4036900 0x7f45d4038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46f4052fd0 tx=0x7f46f404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55906948f9a0 0x559069491e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694925b0 con 0x55906948f9a0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470c4c3640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55906948f9a0 0x559069491e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470c4c3640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55906948f9a0 0x559069491e60 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470ff2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470ff2b800 20 realm 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694929c0 con 0x55906948f9a0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.546+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069493290 con 0x55906948f9a0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x55906948f9a0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559069494390 0x559069496780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069496d90 con 0x559069494390 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470bcc2640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559069494390 0x559069496780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.547+0000 7f470bcc2640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559069494390 0x559069496780 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f470ff2b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f470ff2b800 20 searching for the correct realm 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590694986c0 con 0x559069494390 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f470bcc2640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f46fc00f070 0x7f46fc048350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590694986c0 con 0x7f46fc00f070 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.548+0000 7f4703fff640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f46fc00f070 0x7f46fc048350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.549+0000 7f4703fff640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f46fc00f070 0x7f46fc048350 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.549+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.549+0000 7f4703fff640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f46f4074040 0x7f46f4081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.549+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5590694986c0 con 0x7f46f4074040 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.549+0000 7f470c4c3640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f46f4074040 0x7f46f4081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.549+0000 7f470c4c3640 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f46f4074040 0x7f46f4081410 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f470400a4a0 con 0x7f46f4074040 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x55906948f9a0 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x55906948f9a0 2024-05-15T18:09:02.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x7f46f4074040 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x7f46f4074040 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.550+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x7f46f4074040 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x7f46f4074040 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x7f46fc00f070 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x559069494390 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x55906948f9a0 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.551+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x7f46f4074040 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x7f46f4074040 2024-05-15T18:09:02.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x55906948f9a0 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559069493630 con 0x7f46fc00f070 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x559069494390 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.552+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x559069494390 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46f4074040 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x7f46f4074040 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x559069494390 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x559069494390 2024-05-15T18:09:02.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.553+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x55906948f9a0 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.554+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.554+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x55906948f9a0 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.554+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f470400a4a0 con 0x55906948f9a0 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.554+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46f4074040 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.554+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4704033040 con 0x7f46f4074040 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.554+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x559069494390 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46fc00f070 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x55906948f9a0 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46f4074040 2024-05-15T18:09:02.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.555+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x559069494390 2024-05-15T18:09:02.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46f4074040 2024-05-15T18:09:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46fc00f070 2024-05-15T18:09:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x559069494390 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.556+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46f4074040 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x55906948f9a0 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f46f408e060 con 0x7f46fc00f070 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.557+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069497650 con 0x55906948f9a0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069497a40 con 0x55906948f9a0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069497a40 con 0x7f46f4074040 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 zone default found 2024-05-15T18:09:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 4 Realm: () 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 zonegroup default 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.558+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559069498b40 con 0x7f46f4074040 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55906949a520 con 0x559069494390 2024-05-15T18:09:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55906949a8c0 con 0x559069494390 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 20 started sync module instance, tier type = 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.559+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590694999c0 con 0x7f46fc00f070 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.560+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.560+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078730081552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949ac60 con 0x7f46fc00f070 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.560+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949b4b0 con 0x55906948f9a0 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.561+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078730081552] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.561+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.561+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078730088448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949b420 con 0x55906948f9a0 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.561+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949c370 con 0x559069494390 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.562+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.562+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078730092224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949c320 con 0x559069494390 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.562+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949d330 con 0x7f46fc00f070 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.563+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078730088448] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.563+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.564+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078730092224] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.564+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078730096096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949b8a0 con 0x7f46fc00f070 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.564+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949dd40 con 0x55906948f9a0 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.564+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078730096096] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.565+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.565+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078730098832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949e160 con 0x55906948f9a0 2024-05-15T18:09:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.565+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949eb20 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.566+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.566+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078730102384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949ef40 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.566+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078730098832] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.566+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949dcb0 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.566+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078730102384] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.567+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.567+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078730103440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949eeb0 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.567+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949fe30 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078730103440] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078730106032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949fe30 con 0x7f46f4074040 2024-05-15T18:09:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 20 add_watcher() i=0 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 20 add_watcher() i=1 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 20 add_watcher() i=2 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 20 add_watcher() i=3 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 20 add_watcher() i=4 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 20 add_watcher() i=5 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.568+0000 7f470ff2b800 20 add_watcher() i=6 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.569+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078730106032] v29'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.569+0000 7f470ff2b800 20 add_watcher() i=7 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.569+0000 7f470ff2b800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.569+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694a3230 con 0x55906948f9a0 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.569+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.569+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078730107088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590694a06f0 con 0x55906948f9a0 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.570+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078730107088] v29'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.570+0000 7f45c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.570+0000 7f470ff2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.570+0000 7f470ff2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.570+0000 7f470ff2b800 5 note: GC not initialized 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.570+0000 7f45c0fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 20 Filter name: none 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f453a7fc640 20 reqs_thread_entry: start 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694d6740 con 0x55906948f9a0 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.571+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694d6260 con 0x7f46fc00f070 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 20 enabling bucket name=myfoo 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694d7050 con 0x7f46fc00f070 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 : miss 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 20 rados->read ofs=0 len=0 2024-05-15T18:09:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.572+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694d8930 con 0x7f46f4074040 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(65 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470ff2b800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470ff2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470ff2b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470ff2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470ff2b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470ff2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.573+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 8.1a 8:5be9615e:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590694e1360 con 0x7f46f4074040 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(66 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v29'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470ff2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470ff2b800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470ff2b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470ff2b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1, ofs0, ns] 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94078730342640 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694dffb0 con 0x7f46f4074040 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== watch-notify(notify (1) cookie 94078730106032 notify 124554051602 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5590694d8d20 con 0x7f46f4074040 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f45eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94078730106032 notifier 4594 bl.length()=752 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f45eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 info.flags=0x17 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(67 notify.7 [notify cookie 94078730342640 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f45eaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1 to cache LRU end 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f45eaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f45eaffd640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f45d0003ea0 con 0x7f46f4074040 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.574+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.575+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== watch-notify(notify_complete (2) cookie 94078730342640 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5590694d6ba0 con 0x7f46f4074040 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.575+0000 7f470ff2b800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_sources= new_sources= 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.575+0000 7f470ff2b800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential sources added=[] removed=[] 2024-05-15T18:09:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.575+0000 7f470ff2b800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): orig_dests= new_dests= 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.575+0000 7f470ff2b800 20 handle_bi_update(): bucket=:myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1]): potential dests added=[] removed=[] 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.575+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590694dc5d0 con 0x55906948f9a0 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v29'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470ff2b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470ff2b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470ff2b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94078730325632 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5590694de070 con 0x55906948f9a0 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94078730098832 notify 124554051599 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5590694d6ba0 con 0x55906948f9a0 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f45eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 94078730098832 notifier 4594 bl.length()=567 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f45eaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f45eaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(70 notify.4 [notify cookie 94078730325632 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f45eaffd640 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f45d0003ea0 con 0x55906948f9a0 2024-05-15T18:09:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.576+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94078730325632 notify 124554051599 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f470401e040 con 0x55906948f9a0 2024-05-15T18:09:02.569 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:09:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.577+0000 7f45c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.577+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078730107088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590694e03c0 con 0x55906948f9a0 2024-05-15T18:09:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.578+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94078730107088] v29'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.578+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078730081552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5590694dff10 con 0x7f46fc00f070 2024-05-15T18:09:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.579+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94078730081552] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.579+0000 7f470ff2b800 20 remove_watcher() i=0 2024-05-15T18:09:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.579+0000 7f470ff2b800 2 removed watcher, disabling cache 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.579+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078730088448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559069499510 con 0x55906948f9a0 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.581+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94078730088448] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.581+0000 7f470ff2b800 20 remove_watcher() i=1 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.581+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078730092224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559069499510 con 0x559069494390 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.582+0000 7f470bcc2640 1 -- 172.21.15.173:0/2931067689 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94078730092224] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46fc058040 con 0x559069494390 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.582+0000 7f470ff2b800 20 remove_watcher() i=2 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.582+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078730096096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949bec0 con 0x7f46fc00f070 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.582+0000 7f4703fff640 1 -- 172.21.15.173:0/2931067689 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94078730096096] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f407f070 con 0x7f46fc00f070 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.582+0000 7f470ff2b800 20 remove_watcher() i=3 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.582+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078730098832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559069499510 con 0x55906948f9a0 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.583+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94078730098832] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x55906948f9a0 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.583+0000 7f470ff2b800 20 remove_watcher() i=4 2024-05-15T18:09:02.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.583+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078730102384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949cde0 con 0x7f46f4074040 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.584+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94078730102384] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.584+0000 7f470ff2b800 20 remove_watcher() i=5 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.584+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078730103440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55906949d890 con 0x7f46f4074040 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.586+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94078730103440] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.586+0000 7f470ff2b800 20 remove_watcher() i=6 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.586+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078730106032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559069499510 con 0x7f46f4074040 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94078730106032] v29'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4704031040 con 0x7f46f4074040 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 20 remove_watcher() i=7 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f46f4074040 msgr2=0x7f46f4081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f46f4074040 0x7f46f4081410 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55906948f9a0 msgr2=0x559069491e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55906948f9a0 0x559069491e60 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f46fc00f070 msgr2=0x7f46fc048350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f46fc00f070 0x7f46fc048350 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559069494390 msgr2=0x559069496780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559069494390 0x559069496780 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45d4036900 msgr2=0x7f45d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45d4036900 0x7f45d4038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46f4052fd0 tx=0x7f46f404f000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 msgr2=0x559069484400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/2931067689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906947cfb0 0x559069484400 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f46fc026bb0 tx=0x7f46fc04eec0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 reap_dead start 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470c4c3640 1 -- 172.21.15.173:0/2931067689 reap_dead start 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 shutdown_connections 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 >> 172.21.15.173:0/2931067689 conn(0x5590694792d0 msgr2=0x559069476930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 shutdown_connections 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/2931067689 wait complete. 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45e4036900 msgr2=0x7f45e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45e4036900 0x7f45e4038dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x559069455b10 tx=0x7f46f4005ac0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906946fe50 msgr2=0x559069470270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906946fe50 0x559069470270 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f46fc04b4d0 tx=0x7f46fc017d50 comp rx=0 tx=0).stop 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 shutdown_connections 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45e4036900 0x7f45e4038dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 --2- 172.21.15.173:0/4166583948 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55906946fe50 0x559069470270 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 >> 172.21.15.173:0/4166583948 conn(0x559069463ef0 msgr2=0x5590694642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 shutdown_connections 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.587+0000 7f470ff2b800 1 -- 172.21.15.173:0/4166583948 wait complete. 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55906945ee40 msgr2=0x559069461290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55906945ee40 0x559069461290 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559069356540 msgr2=0x559069458620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559069356540 0x559069458620 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55906945af00 msgr2=0x55906945d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.579 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55906945af00 0x55906945d2f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45f4036900 msgr2=0x7f45f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f45f4036900 0x7f45f4038dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46f4054000 tx=0x7f46f404e000 comp rx=0 tx=0).stop 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 msgr2=0x5590694513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 --2- 172.21.15.173:0/49567042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559069354a00 0x5590694513e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00b700 tx=0x7f46fc000bc0 comp rx=0 tx=0).stop 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470c4c3640 1 -- 172.21.15.173:0/49567042 reap_dead start 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 shutdown_connections 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 >> 172.21.15.173:0/49567042 conn(0x5590693505a0 msgr2=0x559069443980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 shutdown_connections 2024-05-15T18:09:02.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:02.588+0000 7f470ff2b800 1 -- 172.21.15.173:0/49567042 wait complete. 2024-05-15T18:09:02.580 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:09:02.587 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-15T18:09:02.857 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-05-15T18:09:02.864 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:17.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-15T18:09:17.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-15T18:09:17.865 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-15T18:09:17.919 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:17.919 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:17.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.943+0000 7fecb3329800 1 Processor -- start 2024-05-15T18:09:17.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.943+0000 7fecb3329800 1 -- start start 2024-05-15T18:09:17.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.943+0000 7fecb3329800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5622651595f0 0x5622651edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.943+0000 7fecb3329800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562265159b30 con 0x56226515a9d0 2024-05-15T18:09:17.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.943+0000 7fecb3329800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x562265076050 con 0x5622651595f0 2024-05-15T18:09:17.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.944+0000 7fecae74d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5622651595f0 0x5622651edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.944+0000 7fecaef4e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x56226515a9d0 0x562265158ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:47146/0 (socket says 172.21.15.173:47146) 2024-05-15T18:09:17.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.944+0000 7fecaef4e640 1 -- 172.21.15.173:0/505157334 learned_addr learned my addr 172.21.15.173:0/505157334 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:17.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.944+0000 7fecadf4c640 1 -- 172.21.15.173:0/505157334 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261098059 0 0) 0x562265159b30 con 0x56226515a9d0 2024-05-15T18:09:17.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.944+0000 7fecadf4c640 1 -- 172.21.15.173:0/505157334 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec98001e10 con 0x56226515a9d0 2024-05-15T18:09:17.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.944+0000 7fecae74d640 1 -- 172.21.15.173:0/505157334 >> v1:172.21.15.3:6789/0 conn(0x56226515a9d0 legacy=0x562265158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:17.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.944+0000 7fecae74d640 1 -- 172.21.15.173:0/505157334 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622651ef510 con 0x5622651595f0 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.946+0000 7fecae74d640 1 --2- 172.21.15.173:0/505157334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622651edfc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feca400a470 tx=0x7feca401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d9da7b15c9856d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.946+0000 7fecadf4c640 1 -- 172.21.15.173:0/505157334 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca4057070 con 0x5622651595f0 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.946+0000 7fecadf4c640 1 -- 172.21.15.173:0/505157334 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca4052570 con 0x5622651595f0 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.946+0000 7fecadf4c640 1 -- 172.21.15.173:0/505157334 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca4052850 con 0x5622651595f0 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.947+0000 7fecb3329800 1 -- 172.21.15.173:0/505157334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 msgr2=0x5622651edfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.947+0000 7fecb3329800 1 --2- 172.21.15.173:0/505157334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622651edfc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feca400a470 tx=0x7feca401cdb0 comp rx=0 tx=0).stop 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.947+0000 7fecb3329800 1 -- 172.21.15.173:0/505157334 shutdown_connections 2024-05-15T18:09:17.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.947+0000 7fecb3329800 1 --2- 172.21.15.173:0/505157334 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622651edfc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:17.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.947+0000 7fecb3329800 1 -- 172.21.15.173:0/505157334 >> 172.21.15.173:0/505157334 conn(0x5622651e0780 msgr2=0x5622651e2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:17.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.947+0000 7fecb3329800 1 -- 172.21.15.173:0/505157334 shutdown_connections 2024-05-15T18:09:17.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.947+0000 7fecb3329800 1 -- 172.21.15.173:0/505157334 wait complete. 2024-05-15T18:09:17.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.963+0000 7fecb3329800 1 Processor -- start 2024-05-15T18:09:17.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.963+0000 7fecb3329800 1 -- start start 2024-05-15T18:09:17.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.963+0000 7fecb3329800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652d8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.963+0000 7fecb3329800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5622651301d0 con 0x5622651595f0 2024-05-15T18:09:17.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.963+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652d8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.963+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652d8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54778/0 (socket says 172.21.15.173:54778) 2024-05-15T18:09:17.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.963+0000 7fecaef4e640 1 -- 172.21.15.173:0/678188470 learned_addr learned my addr 172.21.15.173:0/678188470 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:17.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.964+0000 7fecaef4e640 1 -- 172.21.15.173:0/678188470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622652d8bf0 con 0x5622651595f0 2024-05-15T18:09:17.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.964+0000 7fecaef4e640 1 --2- 172.21.15.173:0/678188470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652d8620 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feca0006fd0 tx=0x7feca0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87efe7180e9c6beb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.964+0000 7feb9ce09640 1 -- 172.21.15.173:0/678188470 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca00044e0 con 0x5622651595f0 2024-05-15T18:09:17.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.964+0000 7feb9ce09640 1 -- 172.21.15.173:0/678188470 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca00046a0 con 0x5622651595f0 2024-05-15T18:09:17.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.964+0000 7feb9ce09640 1 -- 172.21.15.173:0/678188470 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0004a00 con 0x5622651595f0 2024-05-15T18:09:17.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 -- 172.21.15.173:0/678188470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 msgr2=0x5622652d8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 --2- 172.21.15.173:0/678188470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652d8620 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feca0006fd0 tx=0x7feca0001ae0 comp rx=0 tx=0).stop 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 -- 172.21.15.173:0/678188470 shutdown_connections 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 --2- 172.21.15.173:0/678188470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652d8620 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 -- 172.21.15.173:0/678188470 >> 172.21.15.173:0/678188470 conn(0x5622651e0780 msgr2=0x5622652d3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 -- 172.21.15.173:0/678188470 shutdown_connections 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 -- 172.21.15.173:0/678188470 wait complete. 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 Processor -- start 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 -- start start 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652e0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.965+0000 7fecb3329800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5622651ee770 con 0x5622651595f0 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652e0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54784/0 (socket says 172.21.15.173:54784) 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7fecaef4e640 1 -- 172.21.15.173:0/3972146163 learned_addr learned my addr 172.21.15.173:0/3972146163 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:17.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7fecaef4e640 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622652e06a0 con 0x5622651595f0 2024-05-15T18:09:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7fecaef4e640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652e0160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x5622652d93b0 tx=0x7feca0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7feb9b606640 1 -- 172.21.15.173:0/3972146163 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0022020 con 0x5622651595f0 2024-05-15T18:09:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7feb9b606640 1 -- 172.21.15.173:0/3972146163 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca0019040 con 0x5622651595f0 2024-05-15T18:09:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.966+0000 7feb9b606640 1 -- 172.21.15.173:0/3972146163 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0014a20 con 0x5622651595f0 2024-05-15T18:09:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.967+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622652e0930 con 0x5622651595f0 2024-05-15T18:09:17.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.967+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622652e35e0 con 0x5622651595f0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.967+0000 7feb9b606640 1 -- 172.21.15.173:0/3972146163 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7feca0025020 con 0x5622651595f0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7feb9b606640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb94036950 0x7feb94038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7feb9b606640 1 -- 172.21.15.173:0/3972146163 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7feca004c4a0 con 0x5622651595f0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7fecae74d640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb94036950 0x7feb94038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226515a9d0 0x5622652e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5622652e78e0 con 0x56226515a9d0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7fecaf74f640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226515a9d0 0x5622652e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7fecae74d640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb94036950 0x7feb94038e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feca4054000 tx=0x7feca404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.968+0000 7fecaf74f640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226515a9d0 0x5622652e73a0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.969+0000 7fecaf74f640 1 -- 172.21.15.173:0/3972146163 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226515a9d0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.969+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5622652e4950 con 0x56226515a9d0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.969+0000 7fecaf74f640 1 -- 172.21.15.173:0/3972146163 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feca80083e0 con 0x56226515a9d0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.969+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5622652e9c00 0x5622652ebff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.969+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5622652ec6e0 con 0x5622652e9c00 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.969+0000 7fecaef4e640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5622652e9c00 0x5622652ebff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.970+0000 7fecaef4e640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5622652e9c00 0x5622652ebff0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.970+0000 7fecaef4e640 1 -- 172.21.15.173:0/3972146163 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feca000f030 con 0x5622652e9c00 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.970+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5622652e8b80 con 0x56226515a9d0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.970+0000 7fecaf74f640 1 -- 172.21.15.173:0/3972146163 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feca80083e0 con 0x56226515a9d0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.970+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5622652edb40 0x5622652eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.970+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5622652f06d0 con 0x5622652edb40 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.971+0000 7fecae74d640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5622652edb40 0x5622652eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.971+0000 7fecae74d640 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5622652edb40 0x5622652eff70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecae74d640 1 -- 172.21.15.173:0/3972146163 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feca405a040 con 0x5622652edb40 2024-05-15T18:09:17.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecb3329800 1 Processor -- start 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecb3329800 1 -- start start 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecb3329800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622652feae0 0x5622652fef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecb3329800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5622650d6cf0 con 0x5622652feae0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622652feae0 0x5622652fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622652feae0 0x5622652fef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54794/0 (socket says 172.21.15.173:54794) 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.972+0000 7fecaef4e640 1 -- 172.21.15.173:0/546614892 learned_addr learned my addr 172.21.15.173:0/546614892 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.973+0000 7fecaef4e640 1 -- 172.21.15.173:0/546614892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622652ff440 con 0x5622652feae0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.973+0000 7fecaef4e640 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622652feae0 0x5622652fef00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feca004ab00 tx=0x7feca001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.973+0000 7feb98e01640 1 -- 172.21.15.173:0/546614892 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca004ab80 con 0x5622652feae0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.973+0000 7feb98e01640 1 -- 172.21.15.173:0/546614892 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca0034020 con 0x5622652feae0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.973+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622652ffeb0 con 0x5622652feae0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.973+0000 7feb98e01640 1 -- 172.21.15.173:0/546614892 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca004ae50 con 0x5622652feae0 2024-05-15T18:09:17.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.973+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622653003b0 con 0x5622652feae0 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.974+0000 7feb98e01640 1 -- 172.21.15.173:0/546614892 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7feca0010070 con 0x5622652feae0 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.974+0000 7feb98e01640 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb88036b60 0x7feb88039020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.974+0000 7feb98e01640 1 -- 172.21.15.173:0/546614892 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7feca0035030 con 0x5622652feae0 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.974+0000 7fecae74d640 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb88036b60 0x7feb88039020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.974+0000 7fecb3329800 1 Processor -- start 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.974+0000 7fecb3329800 1 -- start start 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecae74d640 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb88036b60 0x7feb88039020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5622652e81b0 tx=0x7feca4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecb3329800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x56226530c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecb3329800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5622652d8f70 con 0x56226530bc10 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x56226530c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x56226530c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54798/0 (socket says 172.21.15.173:54798) 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecaef4e640 1 -- 172.21.15.173:0/161174340 learned_addr learned my addr 172.21.15.173:0/161174340 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:17.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecaef4e640 1 -- 172.21.15.173:0/161174340 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226530c600 con 0x56226530bc10 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7fecaef4e640 1 --2- 172.21.15.173:0/161174340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x56226530c030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feca004a9a0 tx=0x7feca0027ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ba39b8e160165a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7feb927fc640 1 -- 172.21.15.173:0/161174340 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca00491f0 con 0x56226530bc10 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.975+0000 7feb927fc640 1 -- 172.21.15.173:0/161174340 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca0027400 con 0x56226530bc10 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7feb927fc640 1 -- 172.21.15.173:0/161174340 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca00383c0 con 0x56226530bc10 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 -- 172.21.15.173:0/161174340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 msgr2=0x56226530c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 --2- 172.21.15.173:0/161174340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x56226530c030 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7feca004a9a0 tx=0x7feca0027ad0 comp rx=0 tx=0).stop 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 -- 172.21.15.173:0/161174340 shutdown_connections 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 --2- 172.21.15.173:0/161174340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x56226530c030 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 -- 172.21.15.173:0/161174340 >> 172.21.15.173:0/161174340 conn(0x562265307f30 msgr2=0x562265305f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 -- 172.21.15.173:0/161174340 shutdown_connections 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 -- 172.21.15.173:0/161174340 wait complete. 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.976+0000 7fecb3329800 1 Processor -- start 2024-05-15T18:09:17.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecb3329800 1 -- start start 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecb3329800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x5622653130a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecb3329800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56226530cd20 con 0x56226530bc10 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x5622653130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecaef4e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x5622653130a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54810/0 (socket says 172.21.15.173:54810) 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 learned_addr learned my addr 172.21.15.173:0/3326921637 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622653135e0 con 0x56226530bc10 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.977+0000 7fecaef4e640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x5622653130a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feca004a9a0 tx=0x7feca0007400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.978+0000 7feb90ff9640 1 -- 172.21.15.173:0/3326921637 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0065070 con 0x56226530bc10 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.978+0000 7feb90ff9640 1 -- 172.21.15.173:0/3326921637 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca0011bc0 con 0x56226530bc10 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.978+0000 7feb90ff9640 1 -- 172.21.15.173:0/3326921637 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feca0044190 con 0x56226530bc10 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.978+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622653135e0 con 0x56226530bc10 2024-05-15T18:09:17.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.978+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622653135e0 con 0x56226530bc10 2024-05-15T18:09:17.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7feb90ff9640 1 -- 172.21.15.173:0/3326921637 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7feca0055070 con 0x56226530bc10 2024-05-15T18:09:17.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7feb90ff9640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb78036900 0x7feb78038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7feb90ff9640 1 -- 172.21.15.173:0/3326921637 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7feca005b070 con 0x56226530bc10 2024-05-15T18:09:17.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7fecae74d640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb78036900 0x7feb78038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226531e720 0x562265320be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265321330 con 0x56226531e720 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7fecaf74f640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226531e720 0x562265320be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.979+0000 7fecae74d640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb78036900 0x7feb78038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5622652f0ad0 tx=0x7feca404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecaf74f640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226531e720 0x562265320be0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 20 realm 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265321760 con 0x56226531e720 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:17.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.980+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x56226531e720 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecb3329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5622653223d0 con 0x56226531e720 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecb3329800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562265322d90 0x562265325180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5622653256c0 con 0x562265322d90 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecaef4e640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562265322d90 0x562265325180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.981+0000 7fecaef4e640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562265322d90 0x562265325180 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecb3329800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecb3329800 20 searching for the correct realm 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265327060 con 0x562265322d90 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecaef4e640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7feca00113d0 0x7feca0007920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265327060 con 0x7feca00113d0 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.982+0000 7fecae74d640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7feca00113d0 0x7feca0007920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.983+0000 7fecae74d640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7feca00113d0 0x7feca0007920 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.983+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.983+0000 7fecae74d640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feca4074040 0x7feca4081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.983+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265327060 con 0x7feca4074040 2024-05-15T18:09:17.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.983+0000 7fecaf74f640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feca4074040 0x7feca4081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.984+0000 7fecaf74f640 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feca4074040 0x7feca4081410 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.984+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.984+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x56226531e720 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.984+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.984+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x56226531e720 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.985+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.985+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x7feca4074040 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.985+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.985+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x7feca4074040 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.985+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.985+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x7feca00113d0 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.986+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.986+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x562265322d90 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.986+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.986+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x562265322030 con 0x56226531e720 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.986+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.986+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca8026040 con 0x7feca4074040 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca8026040 con 0x56226531e720 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca8026040 con 0x7feca00113d0 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x562265322d90 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.987+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x562265322d90 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.988+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.988+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca4074040 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.988+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.988+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x562265322d90 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.988+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.988+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x562265322d90 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x56226531e720 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x56226531e720 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca4074040 2024-05-15T18:09:17.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.989+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x562265322d90 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.990+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.990+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca00113d0 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.990+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.990+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x56226531e720 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.990+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.990+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca4074040 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x562265322d90 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca4074040 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca00113d0 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.991+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x562265322d90 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.992+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.992+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca4074040 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.992+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.992+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x56226531e720 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.992+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.992+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7feca408e060 con 0x7feca00113d0 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:17.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265322010 con 0x56226531e720 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265326030 con 0x56226531e720 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.993+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265326030 con 0x7feca4074040 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 zone default found 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 4 Realm: () 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 zonegroup default 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265326450 con 0x7feca4074040 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265326870 con 0x562265322d90 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 20 rados->read ofs=0 len=0 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265328f10 con 0x562265322d90 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.994+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.995+0000 7fecb3329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.995+0000 7fecb3329800 20 started sync module instance, tier type = 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.995+0000 7fecb3329800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.995+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5622653283b0 con 0x7feca00113d0 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.996+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.996+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94705726684928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5622653292b0 con 0x7feca00113d0 2024-05-15T18:09:17.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.996+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562265329b00 con 0x56226531e720 2024-05-15T18:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.997+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94705726684928] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.997+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.997+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94705726690896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562265329f20 con 0x56226531e720 2024-05-15T18:09:17.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.997+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532a7f0 con 0x562265322d90 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.998+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94705726690896] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.998+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.999+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94705726692432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532abe0 con 0x562265322d90 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:17.999+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532b610 con 0x7feca00113d0 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.000+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.000+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94705726697760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532bee0 con 0x7feca00113d0 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.000+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532c9e0 con 0x56226531e720 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.000+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94705726692432] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.001+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94705726697760] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.001+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.001+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94705726700080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532a0f0 con 0x56226531e720 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.001+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532d3f0 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.002+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.002+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94705726705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532d810 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.002+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532e210 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.002+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94705726700080] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.003+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94705726705472] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.003+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.003+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94705726702800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532df00 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.003+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532e750 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.004+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94705726702800] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.004+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.004+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94705726709504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532e7d0 con 0x7feca4074040 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.005+0000 7fecb3329800 20 add_watcher() i=0 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.005+0000 7fecb3329800 20 add_watcher() i=1 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.005+0000 7fecb3329800 20 add_watcher() i=2 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.005+0000 7fecb3329800 20 add_watcher() i=3 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.005+0000 7fecb3329800 20 add_watcher() i=4 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.005+0000 7fecb3329800 20 add_watcher() i=5 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.005+0000 7fecb3329800 20 add_watcher() i=6 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.006+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94705726709504] v29'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.006+0000 7fecb3329800 20 add_watcher() i=7 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.006+0000 7fecb3329800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:17.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.006+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265331a00 con 0x56226531e720 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.006+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.006+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94705726710928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532ed60 con 0x56226531e720 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.007+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94705726710928] v29'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.007+0000 7feb657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.007+0000 7fecb3329800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.007+0000 7fecb3329800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.007+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562265331080 con 0x56226531e720 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.008+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.008+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562265330ff0 con 0x7feca4074040 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.009+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.009+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533ac90 con 0x562265322d90 2024-05-15T18:09:17.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.010+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.010+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533ac90 con 0x56226531e720 2024-05-15T18:09:17.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.011+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'155 uv153 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.011+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533b140 con 0x7feca00113d0 2024-05-15T18:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.012+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.012+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533a220 con 0x562265322d90 2024-05-15T18:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.014+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.014+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533a220 con 0x56226531e720 2024-05-15T18:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.015+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.015+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533a1c0 con 0x7feca4074040 2024-05-15T18:09:17.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.016+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.016+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533a1c0 con 0x7feca00113d0 2024-05-15T18:09:17.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.017+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.017+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bca0 con 0x562265322d90 2024-05-15T18:09:17.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.018+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:17.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.018+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bca0 con 0x7feca00113d0 2024-05-15T18:09:17.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.019+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.019+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bca0 con 0x7feca4074040 2024-05-15T18:09:17.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.020+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.020+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bca0 con 0x7feca00113d0 2024-05-15T18:09:17.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.021+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:17.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.021+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bd30 con 0x7feca4074040 2024-05-15T18:09:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.022+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'35 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:17.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.022+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bf00 con 0x56226531e720 2024-05-15T18:09:18.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.023+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'156 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.023+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bf00 con 0x562265322d90 2024-05-15T18:09:18.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.025+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.025+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bf00 con 0x7feca00113d0 2024-05-15T18:09:18.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.025+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.026+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bf00 con 0x562265322d90 2024-05-15T18:09:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.027+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.027+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533bf00 con 0x56226531e720 2024-05-15T18:09:18.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.028+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.028+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x56226531e720 2024-05-15T18:09:18.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.029+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'157 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.029+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x562265322d90 2024-05-15T18:09:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.030+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.030+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x7feca00113d0 2024-05-15T18:09:18.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.031+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.031+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x562265322d90 2024-05-15T18:09:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.032+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.032+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x562265322d90 2024-05-15T18:09:18.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.033+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.033+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x562265322d90 2024-05-15T18:09:18.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.034+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.034+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x562265322d90 2024-05-15T18:09:18.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.035+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.035+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x7feca4074040 2024-05-15T18:09:18.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.036+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.036+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x562265322d90 2024-05-15T18:09:18.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.037+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.037+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x7feca4074040 2024-05-15T18:09:18.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.039+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.039+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x562265322d90 2024-05-15T18:09:18.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.040+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.040+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x7feca4074040 2024-05-15T18:09:18.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.041+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.041+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226533be70 con 0x7feca00113d0 2024-05-15T18:09:18.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.042+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.042+0000 7feadffff640 20 reqs_thread_entry: start 2024-05-15T18:09:18.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.042+0000 7fecb3329800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:18.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.042+0000 7fecb3329800 20 Filter name: none 2024-05-15T18:09:18.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7feaddffb640 20 reqs_thread_entry: start 2024-05-15T18:09:18.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x56226531e720 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265366d10 con 0x56226531e720 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x56226531e720 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.043+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x7feca4074040 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.044+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.044+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265366d10 con 0x7feca4074040 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.044+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.044+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x7feca4074040 2024-05-15T18:09:18.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.044+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.044+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x562265322d90 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265366d10 con 0x562265322d90 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x562265322d90 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x56226531e720 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv153 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.045+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265366d10 con 0x56226531e720 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.046+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv153 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.046+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367d20 con 0x56226531e720 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.046+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(105 gc.3 [call out=1702b] v0'0 uv153 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.046+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.046+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.046+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.047+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x56226531e720 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x56226531e720 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x56226531e720 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.048+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.049+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.049+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.049+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.049+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.050+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.051+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.052+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.053+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.053+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.053+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.053+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.054+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.054+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.054+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.054+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.054+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.054+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.055+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.055+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.055+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.055+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x56226531e720 2024-05-15T18:09:18.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x56226531e720 2024-05-15T18:09:18.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x56226531e720 2024-05-15T18:09:18.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.056+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.057+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.058+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.059+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x56226531e720 2024-05-15T18:09:18.048 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x56226531e720 2024-05-15T18:09:18.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.049 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.060+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.061+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.062+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.063+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.064+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.064+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.064+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.064+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.064+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.064+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.064+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.065+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.065+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.065+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.065+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.065+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.065+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.066+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.066+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.066+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.066+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.066+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.066+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.067+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.067+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.067+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.067+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.067+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.067+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x562265322d90 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x562265322d90 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.068+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca4074040 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.069+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.069+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca4074040 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.069+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.069+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.070+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.070+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265367430 con 0x7feca00113d0 2024-05-15T18:09:18.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.070+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.070+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562265368440 con 0x7feca00113d0 2024-05-15T18:09:18.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.070+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.071+0000 7feb657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.071+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94705726710928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5622652cff80 con 0x56226531e720 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.072+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94705726710928] v29'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.072+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94705726684928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532e490 con 0x7feca00113d0 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.073+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94705726684928] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.073+0000 7fecb3329800 20 remove_watcher() i=0 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.073+0000 7fecb3329800 2 removed watcher, disabling cache 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.073+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94705726690896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532e490 con 0x56226531e720 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.074+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94705726690896] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.074+0000 7fecb3329800 20 remove_watcher() i=1 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.074+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94705726692432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562265329650 con 0x562265322d90 2024-05-15T18:09:18.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.075+0000 7fecaef4e640 1 -- 172.21.15.173:0/3326921637 <== osd.3 v2:172.21.15.173:6814/3793320597 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94705726692432] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca000f030 con 0x562265322d90 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.075+0000 7fecb3329800 20 remove_watcher() i=2 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.075+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94705726697760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532e490 con 0x7feca00113d0 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.076+0000 7fecae74d640 1 -- 172.21.15.173:0/3326921637 <== osd.2 v2:172.21.15.173:6808/3098545592 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94705726697760] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca407f070 con 0x7feca00113d0 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.076+0000 7fecb3329800 20 remove_watcher() i=3 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.076+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94705726700080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562265329650 con 0x56226531e720 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.077+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.1 v2:172.21.15.173:6800/3225970667 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94705726700080] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x56226531e720 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.077+0000 7fecb3329800 20 remove_watcher() i=4 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.077+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94705726705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532e490 con 0x7feca4074040 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.079+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94705726705472] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.079+0000 7fecb3329800 20 remove_watcher() i=5 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.079+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94705726702800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56226532ba30 con 0x7feca4074040 2024-05-15T18:09:18.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.080+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94705726702800] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.080+0000 7fecb3329800 20 remove_watcher() i=6 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.080+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94705726709504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562265329650 con 0x7feca4074040 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 <== osd.0 v2:172.21.15.3:6800/774076599 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94705726709504] v29'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feca80083e0 con 0x7feca4074040 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 20 remove_watcher() i=7 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feca4074040 msgr2=0x7feca4081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feca4074040 0x7feca4081410 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226531e720 msgr2=0x562265320be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226531e720 0x562265320be0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7feca00113d0 msgr2=0x7feca0007920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7feca00113d0 0x7feca0007920 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562265322d90 msgr2=0x562265325180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562265322d90 0x562265325180 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb78036900 msgr2=0x7feb78038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb78036900 0x7feb78038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5622652f0ad0 tx=0x7feca404f000 comp rx=0 tx=0).stop 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 msgr2=0x5622653130a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/3326921637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56226530bc10 0x5622653130a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7feca004a9a0 tx=0x7feca0007400 comp rx=0 tx=0).stop 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 reap_dead start 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecaf74f640 1 -- 172.21.15.173:0/3326921637 reap_dead start 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 shutdown_connections 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 >> 172.21.15.173:0/3326921637 conn(0x562265307f30 msgr2=0x562265305590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 shutdown_connections 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/3326921637 wait complete. 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb88036b60 msgr2=0x7feb88039020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb88036b60 0x7feb88039020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5622652e81b0 tx=0x7feca4005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622652feae0 msgr2=0x5622652fef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622652feae0 0x5622652fef00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feca004ab00 tx=0x7feca001eb50 comp rx=0 tx=0).stop 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 shutdown_connections 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb88036b60 0x7feb88039020 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 --2- 172.21.15.173:0/546614892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622652feae0 0x5622652fef00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 >> 172.21.15.173:0/546614892 conn(0x5622652f2b80 msgr2=0x5622652f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 shutdown_connections 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.081+0000 7fecb3329800 1 -- 172.21.15.173:0/546614892 wait complete. 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5622652edb40 msgr2=0x5622652eff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5622652edb40 0x5622652eff70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226515a9d0 msgr2=0x5622652e73a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56226515a9d0 0x5622652e73a0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5622652e9c00 msgr2=0x5622652ebff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5622652e9c00 0x5622652ebff0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb94036950 msgr2=0x7feb94038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7feb94036950 0x7feb94038e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feca4054000 tx=0x7feca404e000 comp rx=0 tx=0).stop 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 msgr2=0x5622652e0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 --2- 172.21.15.173:0/3972146163 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5622651595f0 0x5622652e0160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x5622652d93b0 tx=0x7feca0000f40 comp rx=0 tx=0).stop 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecaf74f640 1 -- 172.21.15.173:0/3972146163 reap_dead start 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 shutdown_connections 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 >> 172.21.15.173:0/3972146163 conn(0x5622651e0780 msgr2=0x5622652d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 shutdown_connections 2024-05-15T18:09:18.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.082+0000 7fecb3329800 1 -- 172.21.15.173:0/3972146163 wait complete. 2024-05-15T18:09:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:[{"tag":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.12204784220167793315\u0000","time":"2024-05-15T18:09:17.887694+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_7","key":"","instance":""}]}] 2024-05-15T18:09:18.067 DEBUG:tasks.util.rgw: json result: [{'tag': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.12204784220167793315\x00', 'time': '2024-05-15T18:09:17.887694+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_7', 'key': '', 'instance': ''}]}] 2024-05-15T18:09:18.067 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-05-15T18:09:18.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-05-15T18:09:18.068 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-05-15T18:09:18.109 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:18.109 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadff546800 1 Processor -- start 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadff546800 1 -- start start 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadff546800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5625873aebc0 0x5625873b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadff546800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625873b5000 con 0x5625873b14f0 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadff546800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56258723f050 con 0x5625873aebc0 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadfd04c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5625873aebc0 0x5625873b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadf7fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5625873b14f0 0x5625873b38e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:47150/0 (socket says 172.21.15.173:47150) 2024-05-15T18:09:18.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.134+0000 7fadf7fff640 1 -- 172.21.15.173:0/2345775452 learned_addr learned my addr 172.21.15.173:0/2345775452 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:18.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.135+0000 7fadfd04c640 1 -- 172.21.15.173:0/2345775452 >> v1:172.21.15.3:6789/0 conn(0x5625873b14f0 legacy=0x5625873b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.135+0000 7fadfd04c640 1 -- 172.21.15.173:0/2345775452 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625873b61e0 con 0x5625873aebc0 2024-05-15T18:09:18.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.136+0000 7fadfd04c640 1 --2- 172.21.15.173:0/2345775452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625873b0fb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fadf000a470 tx=0x7fadf001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58da02e63e822bde server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadfc84b640 1 -- 172.21.15.173:0/2345775452 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf0057070 con 0x5625873aebc0 2024-05-15T18:09:18.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadfc84b640 1 -- 172.21.15.173:0/2345775452 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0052570 con 0x5625873aebc0 2024-05-15T18:09:18.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadfc84b640 1 -- 172.21.15.173:0/2345775452 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf0052870 con 0x5625873aebc0 2024-05-15T18:09:18.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadff546800 1 -- 172.21.15.173:0/2345775452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 msgr2=0x5625873b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadff546800 1 --2- 172.21.15.173:0/2345775452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625873b0fb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fadf000a470 tx=0x7fadf001ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:18.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadff546800 1 -- 172.21.15.173:0/2345775452 shutdown_connections 2024-05-15T18:09:18.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadff546800 1 --2- 172.21.15.173:0/2345775452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625873b0fb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadff546800 1 -- 172.21.15.173:0/2345775452 >> 172.21.15.173:0/2345775452 conn(0x5625873a8550 msgr2=0x5625873aa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadff546800 1 -- 172.21.15.173:0/2345775452 shutdown_connections 2024-05-15T18:09:18.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.137+0000 7fadff546800 1 -- 172.21.15.173:0/2345775452 wait complete. 2024-05-15T18:09:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.151+0000 7fadff546800 1 Processor -- start 2024-05-15T18:09:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.151+0000 7fadff546800 1 -- start start 2024-05-15T18:09:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.151+0000 7fadff546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x56258749f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.151+0000 7fadff546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625872f91c0 con 0x5625873aebc0 2024-05-15T18:09:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.151+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x56258749f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.151+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x56258749f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54828/0 (socket says 172.21.15.173:54828) 2024-05-15T18:09:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.151+0000 7fadfd04c640 1 -- 172.21.15.173:0/906134816 learned_addr learned my addr 172.21.15.173:0/906134816 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:18.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.152+0000 7fadfd04c640 1 -- 172.21.15.173:0/906134816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56258749fc20 con 0x5625873aebc0 2024-05-15T18:09:18.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.152+0000 7fadfd04c640 1 --2- 172.21.15.173:0/906134816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x56258749f650 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fadf001ced0 tx=0x7fadf004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b5061634745d98 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.152+0000 7faceb606640 1 -- 172.21.15.173:0/906134816 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf0057040 con 0x5625873aebc0 2024-05-15T18:09:18.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.152+0000 7faceb606640 1 -- 172.21.15.173:0/906134816 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf00529a0 con 0x5625873aebc0 2024-05-15T18:09:18.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.152+0000 7faceb606640 1 -- 172.21.15.173:0/906134816 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf0052cc0 con 0x5625873aebc0 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 -- 172.21.15.173:0/906134816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 msgr2=0x56258749f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 --2- 172.21.15.173:0/906134816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x56258749f650 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fadf001ced0 tx=0x7fadf004c000 comp rx=0 tx=0).stop 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 -- 172.21.15.173:0/906134816 shutdown_connections 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 --2- 172.21.15.173:0/906134816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x56258749f650 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 -- 172.21.15.173:0/906134816 >> 172.21.15.173:0/906134816 conn(0x5625873a8550 msgr2=0x56258749af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 -- 172.21.15.173:0/906134816 shutdown_connections 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 -- 172.21.15.173:0/906134816 wait complete. 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 Processor -- start 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.153+0000 7fadff546800 1 -- start start 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadff546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625874a7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadff546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625873b5470 con 0x5625873aebc0 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625874a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625874a7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54836/0 (socket says 172.21.15.173:54836) 2024-05-15T18:09:18.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadfd04c640 1 -- 172.21.15.173:0/2805858962 learned_addr learned my addr 172.21.15.173:0/2805858962 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:18.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadfd04c640 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625874a7650 con 0x5625873aebc0 2024-05-15T18:09:18.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadfd04c640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625874a7110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fadf0000c00 tx=0x7fadf0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7face9e03640 1 -- 172.21.15.173:0/2805858962 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf0073070 con 0x5625873aebc0 2024-05-15T18:09:18.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7face9e03640 1 -- 172.21.15.173:0/2805858962 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf005d780 con 0x5625873aebc0 2024-05-15T18:09:18.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.154+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625874a78e0 con 0x5625873aebc0 2024-05-15T18:09:18.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.155+0000 7face9e03640 1 -- 172.21.15.173:0/2805858962 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf0057070 con 0x5625873aebc0 2024-05-15T18:09:18.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.155+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625874aa590 con 0x5625873aebc0 2024-05-15T18:09:18.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.155+0000 7face9e03640 1 -- 172.21.15.173:0/2805858962 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fadf0076070 con 0x5625873aebc0 2024-05-15T18:09:18.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7face9e03640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7face4036900 0x7face4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7face9e03640 1 -- 172.21.15.173:0/2805858962 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fadf008ddb0 con 0x5625873aebc0 2024-05-15T18:09:18.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7fadf7fff640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7face4036900 0x7face4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625873b14f0 0x5625874ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874ae920 con 0x5625873b14f0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7fadfd84d640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625873b14f0 0x5625874ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7fadf7fff640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7face4036900 0x7face4038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fade8000f60 tx=0x7fade80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7fadfd84d640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625873b14f0 0x5625874ae350 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.156+0000 7fadfd84d640 1 -- 172.21.15.173:0/2805858962 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625873b14f0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.157+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874ab920 con 0x5625873b14f0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.157+0000 7fadfd84d640 1 -- 172.21.15.173:0/2805858962 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625873b14f0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.157+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874b0c70 0x5625874b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.157+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874b3730 con 0x5625874b0c70 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.157+0000 7fadfd04c640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874b0c70 0x5625874b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.157+0000 7fadfd04c640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874b0c70 0x5625874b3060 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.157+0000 7fadfd04c640 1 -- 172.21.15.173:0/2805858962 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fadf0075030 con 0x5625874b0c70 2024-05-15T18:09:18.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.158+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874afc20 con 0x5625873b14f0 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.158+0000 7fadfd84d640 1 -- 172.21.15.173:0/2805858962 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625873b14f0 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.158+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625874b4b70 0x5625874b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.158+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874b77c0 con 0x5625874b4b70 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.158+0000 7fadf7fff640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625874b4b70 0x5625874b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.158+0000 7fadf7fff640 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625874b4b70 0x5625874b7030 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.159+0000 7fadf7fff640 1 -- 172.21.15.173:0/2805858962 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fade8009050 con 0x5625874b4b70 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.159+0000 7fadff546800 1 Processor -- start 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.159+0000 7fadff546800 1 -- start start 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadff546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625874c5c70 0x5625874c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadff546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56258729fcf0 con 0x5625874c5c70 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625874c5c70 0x5625874c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625874c5c70 0x5625874c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54846/0 (socket says 172.21.15.173:54846) 2024-05-15T18:09:18.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadfd04c640 1 -- 172.21.15.173:0/1035515679 learned_addr learned my addr 172.21.15.173:0/1035515679 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:18.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadfd04c640 1 -- 172.21.15.173:0/1035515679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625874c65d0 con 0x5625874c5c70 2024-05-15T18:09:18.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadfd04c640 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625874c5c70 0x5625874c6090 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fadf008c3c0 tx=0x7fadf005cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7face2ffd640 1 -- 172.21.15.173:0/1035515679 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf00774e0 con 0x5625874c5c70 2024-05-15T18:09:18.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7face2ffd640 1 -- 172.21.15.173:0/1035515679 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0089070 con 0x5625874c5c70 2024-05-15T18:09:18.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625874c7040 con 0x5625874c5c70 2024-05-15T18:09:18.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.160+0000 7face2ffd640 1 -- 172.21.15.173:0/1035515679 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf00777b0 con 0x5625874c5c70 2024-05-15T18:09:18.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.161+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625874c7540 con 0x5625874c5c70 2024-05-15T18:09:18.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.161+0000 7face2ffd640 1 -- 172.21.15.173:0/1035515679 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fadf0076360 con 0x5625874c5c70 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.161+0000 7face2ffd640 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facd40368b0 0x7facd4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.161+0000 7face2ffd640 1 -- 172.21.15.173:0/1035515679 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fadf0095ad0 con 0x5625874c5c70 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadf7fff640 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facd40368b0 0x7facd4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadff546800 1 Processor -- start 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadff546800 1 -- start start 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadf7fff640 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facd40368b0 0x7facd4038d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fade800bf50 tx=0x7fade800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadff546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625873ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadff546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56258749fee0 con 0x5625873ae280 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625873ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625873ac9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54854/0 (socket says 172.21.15.173:54854) 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadfd04c640 1 -- 172.21.15.173:0/4202937012 learned_addr learned my addr 172.21.15.173:0/4202937012 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:18.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.162+0000 7fadfd04c640 1 -- 172.21.15.173:0/4202937012 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625873ae730 con 0x5625873ae280 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadfd04c640 1 --2- 172.21.15.173:0/4202937012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625873ac9b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fadf0084530 tx=0x7fadf008ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f944a5b2aea65091 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7face0ff9640 1 -- 172.21.15.173:0/4202937012 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf008cd20 con 0x5625873ae280 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7face0ff9640 1 -- 172.21.15.173:0/4202937012 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf005b8f0 con 0x5625873ae280 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7face0ff9640 1 -- 172.21.15.173:0/4202937012 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf00680b0 con 0x5625873ae280 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadff546800 1 -- 172.21.15.173:0/4202937012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 msgr2=0x5625873ac9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadff546800 1 --2- 172.21.15.173:0/4202937012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625873ac9b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fadf0084530 tx=0x7fadf008ef90 comp rx=0 tx=0).stop 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadff546800 1 -- 172.21.15.173:0/4202937012 shutdown_connections 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadff546800 1 --2- 172.21.15.173:0/4202937012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625873ac9b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadff546800 1 -- 172.21.15.173:0/4202937012 >> 172.21.15.173:0/4202937012 conn(0x5625874cf0f0 msgr2=0x5625874cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadff546800 1 -- 172.21.15.173:0/4202937012 shutdown_connections 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.163+0000 7fadff546800 1 -- 172.21.15.173:0/4202937012 wait complete. 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadff546800 1 Processor -- start 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadff546800 1 -- start start 2024-05-15T18:09:18.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadff546800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625874dc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadff546800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5625873acef0 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625874dc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadfd04c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625874dc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54862/0 (socket says 172.21.15.173:54862) 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 learned_addr learned my addr 172.21.15.173:0/204588513 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.164+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625874dc8d0 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.165+0000 7fadfd04c640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625874dc390 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fadf005bf90 tx=0x7fadf0065f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.165+0000 7facd2ffd640 1 -- 172.21.15.173:0/204588513 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf00680b0 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.165+0000 7facd2ffd640 1 -- 172.21.15.173:0/204588513 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf00b8070 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.165+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625874dc8d0 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.165+0000 7facd2ffd640 1 -- 172.21.15.173:0/204588513 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadf006c520 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.165+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625874dc8d0 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.165+0000 7facd2ffd640 1 -- 172.21.15.173:0/204588513 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fadf006c790 con 0x5625873ae280 2024-05-15T18:09:18.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.166+0000 7facd2ffd640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facc8036900 0x7facc8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.166+0000 7facd2ffd640 1 -- 172.21.15.173:0/204588513 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5706+0+0 (secure 0 0 0) 0x7fadf0099210 con 0x5625873ae280 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.166+0000 7fadf7fff640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facc8036900 0x7facc8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.166+0000 7fadf7fff640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facc8036900 0x7facc8038dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fade8001b60 tx=0x7fade8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.166+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625874e7ad0 0x5625874e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874ea6e0 con 0x5625874e7ad0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadfd84d640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625874e7ad0 0x5625874e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadfd84d640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625874e7ad0 0x5625874e9f90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 20 realm 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874eaaf0 con 0x5625874e7ad0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.167+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb3c0 con 0x5625874e7ad0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadff546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadff546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874ec4c0 0x5625874ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874eee70 con 0x5625874ec4c0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadfd04c640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874ec4c0 0x5625874ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.168+0000 7fadfd04c640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874ec4c0 0x5625874ee8b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadff546800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadff546800 20 searching for the correct realm 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874f07a0 con 0x5625874ec4c0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadfd04c640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fadf00bdc20 0x7fadf00951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874f07a0 con 0x7fadf00bdc20 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadf7fff640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fadf00bdc20 0x7fadf00951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.169+0000 7fadf7fff640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fadf00bdc20 0x7fadf00951f0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.170+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.170+0000 7fadf7fff640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fade8037040 0x7fade8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.170+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874f07a0 con 0x7fade8037040 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.170+0000 7fadfd84d640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fade8037040 0x7fade8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.171+0000 7fadfd84d640 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fade8037040 0x7fade8036410 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.171+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 29 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fadf800a4a0 con 0x7fade8037040 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.171+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.171+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.171+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.171+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.171+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x7fade8037040 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x7fade8037040 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fadf00bdc20 2024-05-15T18:09:18.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.172+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.173+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.173+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.173+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x7fade8037040 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.173+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.173+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.173+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fadf00bdc20 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x7fade8037040 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.174+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fadf800a4a0 con 0x5625874e7ad0 2024-05-15T18:09:18.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.175+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf8033040 con 0x7fade8037040 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 29 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fadf00bdc20 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.176+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fadf00bdc20 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.177+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874ec4c0 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.178+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.178+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fade8037040 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.178+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.178+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x5625874e7ad0 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.178+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5625874eb760 con 0x7fadf00bdc20 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874ef730 con 0x5625874e7ad0 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874efb20 con 0x5625874e7ad0 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:18.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.179+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874efb20 con 0x7fade8037040 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 zone default found 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 4 Realm: () 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 zonegroup default 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874ef2d0 con 0x7fade8037040 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874ef300 con 0x5625874ec4c0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 20 rados->read ofs=0 len=0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.180+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874f2730 con 0x5625874ec4c0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.181+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.181+0000 7fadff546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:18.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.181+0000 7fadff546800 20 started sync module instance, tier type = 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.181+0000 7fadff546800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.181+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1aa0 con 0x7fadf00bdc20 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.182+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(44 notify.0 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.182+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719183888016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1700 con 0x7fadf00bdc20 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.182+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f3660 con 0x5625874e7ad0 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.183+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719183888016] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.183+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.183+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719183892912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f3a80 con 0x5625874e7ad0 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.183+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f4440 con 0x5625874ec4c0 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.184+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719183892912] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.184+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.184+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719183893968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f39f0 con 0x5625874ec4c0 2024-05-15T18:09:18.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.184+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f5300 con 0x7fadf00bdc20 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.185+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719183893968] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.185+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(50 notify.3 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.185+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719183898672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f5ba0 con 0x7fadf00bdc20 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.185+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f6560 con 0x5625874e7ad0 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.186+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719183898672] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.186+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.186+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719183904944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f6980 con 0x5625874e7ad0 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.186+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f7340 con 0x7fade8037040 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.187+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(54 notify.5 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.187+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719183904944] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.187+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719183908496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f7760 con 0x7fade8037040 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.187+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f64d0 con 0x7fade8037040 2024-05-15T18:09:18.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.188+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719183908496] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.188+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(56 notify.6 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.188+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719183909552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f76d0 con 0x7fade8037040 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.188+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f86d0 con 0x7fade8037040 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719183909552] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(58 notify.7 [create] v29'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719183912272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f86d0 con 0x7fade8037040 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 20 add_watcher() i=0 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 20 add_watcher() i=1 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 20 add_watcher() i=2 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 20 add_watcher() i=3 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 20 add_watcher() i=4 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 20 add_watcher() i=5 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.189+0000 7fadff546800 20 add_watcher() i=6 2024-05-15T18:09:18.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.190+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719183912272] v29'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.190+0000 7fadff546800 20 add_watcher() i=7 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.190+0000 7fadff546800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.190+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625874fbaf0 con 0x5625874e7ad0 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.191+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.191+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719183913328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f8fc0 con 0x5625874e7ad0 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.192+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719183913328] v29'159 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.192+0000 7facb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.192+0000 7fadff546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.192+0000 7fadff546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:18.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.192+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874fb7f0 con 0x5625874e7ad0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.193+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.193+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587504b90 con 0x7fade8037040 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.194+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.194+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587504f70 con 0x5625874ec4c0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.195+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.195+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874fb300 con 0x5625874e7ad0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.196+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'160 uv153 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.196+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875055a0 con 0x7fadf00bdc20 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.197+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.197+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587505e90 con 0x5625874ec4c0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.198+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.198+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587505e90 con 0x5625874e7ad0 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.199+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.199+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587505f20 con 0x7fade8037040 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.200+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.200+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587505fb0 con 0x7fadf00bdc20 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.201+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.201+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875065c0 con 0x5625874ec4c0 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.202+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.202+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875065c0 con 0x7fadf00bdc20 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.203+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.203+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506a70 con 0x7fade8037040 2024-05-15T18:09:18.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.204+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.204+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506a70 con 0x7fadf00bdc20 2024-05-15T18:09:18.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.205+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.205+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506a70 con 0x7fade8037040 2024-05-15T18:09:18.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.206+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'37 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.206+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506a70 con 0x5625874e7ad0 2024-05-15T18:09:18.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.207+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'161 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.207+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506a70 con 0x5625874ec4c0 2024-05-15T18:09:18.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.208+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.208+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506a70 con 0x7fadf00bdc20 2024-05-15T18:09:18.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.209+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.209+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506b00 con 0x5625874ec4c0 2024-05-15T18:09:18.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.210+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.210+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506b00 con 0x5625874e7ad0 2024-05-15T18:09:18.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.212+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.212+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506b00 con 0x5625874e7ad0 2024-05-15T18:09:18.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.213+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'162 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.190 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.213+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506b30 con 0x5625874ec4c0 2024-05-15T18:09:18.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.214+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.191 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.214+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506b30 con 0x7fadf00bdc20 2024-05-15T18:09:18.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.215+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.215+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x5625874ec4c0 2024-05-15T18:09:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.216+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.216+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x5625874ec4c0 2024-05-15T18:09:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.217+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.217+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x5625874ec4c0 2024-05-15T18:09:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.218+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.218+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x5625874ec4c0 2024-05-15T18:09:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.218+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.218+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x7fade8037040 2024-05-15T18:09:18.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.220+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.220+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x5625874ec4c0 2024-05-15T18:09:18.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.221+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.221+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x7fade8037040 2024-05-15T18:09:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.222+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.222+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x5625874ec4c0 2024-05-15T18:09:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.223+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.223+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x7fade8037040 2024-05-15T18:09:18.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.224+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.224+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587506be0 con 0x7fadf00bdc20 2024-05-15T18:09:18.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.225+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.226+0000 7facb27e4640 20 reqs_thread_entry: start 2024-05-15T18:09:18.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.226+0000 7fadff546800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:18.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.226+0000 7fadff546800 20 Filter name: none 2024-05-15T18:09:18.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.226+0000 7fac23fff640 20 reqs_thread_entry: start 2024-05-15T18:09:18.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.226+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-05-15T18:09:18.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.226+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:94 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.227+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(94 gc.21 [call] v29'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.227+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.227+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(95 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.227+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.227+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.227+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(96 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.227+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:97 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.228+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(97 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.228+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.228+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.228+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(98 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.228+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.207 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.228+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:99 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.229+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(99 gc.21 [call] v29'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.229+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-05-15T18:09:18.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.229+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:100 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.208 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.230+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(100 gc.22 [call] v29'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.230+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:101 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.230+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(101 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.230+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.230+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:102 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.230+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(102 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.230+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:103 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.231+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(103 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.231+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.231+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:104 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.231+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(104 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.231+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.231+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:105 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.232+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(105 gc.22 [call] v29'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.232+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.232+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:106 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(106 gc.23 [call] v29'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:107 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(107 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:108 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(108 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:109 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(109 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:110 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(110 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.233+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:111 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.234+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== osd_op_reply(111 gc.23 [call] v29'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.234+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-05-15T18:09:18.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.234+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:112 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.235+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(112 gc.24 [call] v29'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.235+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:113 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.235+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 40 ==== osd_op_reply(113 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.235+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.235+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:114 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 41 ==== osd_op_reply(114 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:115 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 42 ==== osd_op_reply(115 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:116 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 43 ==== osd_op_reply(116 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.236+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:117 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.237+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 44 ==== osd_op_reply(117 gc.24 [call] v29'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.237+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-05-15T18:09:18.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.237+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:118 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 45 ==== osd_op_reply(118 gc.25 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:119 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 46 ==== osd_op_reply(119 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:120 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 47 ==== osd_op_reply(120 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:121 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 48 ==== osd_op_reply(121 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.239+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:122 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.240+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 49 ==== osd_op_reply(122 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.240+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.240+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:123 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.241+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 50 ==== osd_op_reply(123 gc.25 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.241+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-05-15T18:09:18.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.241+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:124 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.242+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(124 gc.26 [call] v29'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.242+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:125 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.242+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(125 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.242+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.242+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:126 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x7fade8037040 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(126 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:127 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(127 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:128 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(128 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.243+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:129 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.244+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(129 gc.26 [call] v29'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.244+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-05-15T18:09:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.244+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:130 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.245+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 51 ==== osd_op_reply(130 gc.27 [call] v29'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.245+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:131 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.245+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 52 ==== osd_op_reply(131 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.245+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.245+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:132 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874ec4c0 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 53 ==== osd_op_reply(132 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:133 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 54 ==== osd_op_reply(133 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:134 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 55 ==== osd_op_reply(134 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.246+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:135 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.247+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 56 ==== osd_op_reply(135 gc.27 [call] v29'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.247+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.247+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:136 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.248+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(136 gc.28 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.248+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:137 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(137 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:138 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x7fade8037040 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(138 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:139 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(139 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.249+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:140 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.250+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(140 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.250+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.250+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:141 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.251+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== osd_op_reply(141 gc.28 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.251+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-05-15T18:09:18.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.251+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:142 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.252+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 57 ==== osd_op_reply(142 gc.29 [call] v29'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.252+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:143 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.252+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 58 ==== osd_op_reply(143 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.252+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.252+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:144 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 59 ==== osd_op_reply(144 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:145 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 60 ==== osd_op_reply(145 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:146 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 61 ==== osd_op_reply(146 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.253+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:147 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.254+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 62 ==== osd_op_reply(147 gc.29 [call] v29'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.255+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-05-15T18:09:18.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.255+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:148 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.256+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(148 gc.30 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.256+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:149 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.256+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(149 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.256+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.256+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:150 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x7fade8037040 2024-05-15T18:09:18.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(150 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:151 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(151 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:152 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(152 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.257+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:153 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.258+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== osd_op_reply(153 gc.30 [call] v29'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.258+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-05-15T18:09:18.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.258+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:154 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.259+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(154 gc.31 [call] v29'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.259+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:155 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(155 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:156 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x7fadf00bdc20 2024-05-15T18:09:18.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(156 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:157 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== osd_op_reply(157 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:158 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(158 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.260+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:159 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fadf00bdc20 2024-05-15T18:09:18.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.261+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(159 gc.31 [call] v29'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.261+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-05-15T18:09:18.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.261+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:160 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(160 gc.0 [call] v29'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:161 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(161 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:162 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(162 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:163 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(163 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.263+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:164 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.264+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(164 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.264+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.264+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:165 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.265+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(165 gc.0 [call] v29'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.265+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-05-15T18:09:18.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.265+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:166 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.266+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== osd_op_reply(166 gc.1 [call] v29'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.266+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:167 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.266+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(167 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.266+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.266+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:168 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x7fade8037040 2024-05-15T18:09:18.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.266+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== osd_op_reply(168 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.266+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:169 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.267+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== osd_op_reply(169 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.267+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.267+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:170 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.267+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 47 ==== osd_op_reply(170 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.267+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.267+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:171 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x7fade8037040 2024-05-15T18:09:18.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.268+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 48 ==== osd_op_reply(171 gc.1 [call] v29'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.269+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-05-15T18:09:18.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.269+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:172 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.269+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 63 ==== osd_op_reply(172 gc.2 [call] v29'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:173 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 64 ==== osd_op_reply(173 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.248 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:174 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874ec4c0 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 65 ==== osd_op_reply(174 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:175 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 66 ==== osd_op_reply(175 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:176 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 67 ==== osd_op_reply(176 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.270+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:177 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874ec4c0 2024-05-15T18:09:18.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.271+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 68 ==== osd_op_reply(177 gc.2 [call] v29'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.271+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-05-15T18:09:18.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.271+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:178 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.272+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(178 gc.3 [call] v29'163 uv163 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.272+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:179 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(179 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:180 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875320c0 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(180 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:181 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(181 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:182 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5625875330d0 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(182 gc.3 [call out=1702b] v0'0 uv163 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-15T18:09:18.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 20 garbage collection: RGWGC::process iterating over entry tag='74ac2443-e34d-4255-b728-cefe496e7fb2.4224.12204784220167793315', time=2024-05-15T18:09:17.887694+0000, chain.objs.size()=7 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_1 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:183 3.3d 3:bcf632d2:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875313b0 con 0x5625874ec4c0 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_2 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:184 3.20 3:05e8e073:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875361a0 con 0x7fadf00bdc20 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_3 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:185 3.21 3:84c89653:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538a60 con 0x7fade8037040 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_4 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.273+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:186 3.1f 3:f9a135b2:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56258753b2d0 con 0x5625874e7ad0 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.274+0000 7fadff546800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_5 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.274+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:187 3.1e 3:7a8ca58f:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56258753dc00 con 0x7fade8037040 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.274+0000 7fadff546800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_6 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.274+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:188 3.5 3:a3de2e92:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56258753dc00 con 0x7fadf00bdc20 2024-05-15T18:09:18.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.274+0000 7fadff546800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_7 2024-05-15T18:09:18.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.274+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:189 3.1b 3:d83f11ff:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874ec4c0 2024-05-15T18:09:18.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.276+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 69 ==== osd_op_reply(189 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_7 [call] v29'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.276+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== osd_op_reply(186 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_4 [call] v29'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.277+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 49 ==== osd_op_reply(185 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_3 [call] v29'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.277+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== osd_op_reply(184 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_2 [call] v29'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.279+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 70 ==== osd_op_reply(183 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_1 [call] v29'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.279+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(188 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_6 [call] v29'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.280+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 50 ==== osd_op_reply(187 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.1__shadow_.NcLNvUTvZaNwr2OkjEroJa3otl7NXZ0_5 [call] v29'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.280+0000 7fadff546800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-15T18:09:18.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.280+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:190 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56258753dc00 con 0x5625874e7ad0 2024-05-15T18:09:18.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.281+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(190 gc.3 [call] v29'164 uv164 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.281+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:191 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56258753dc00 con 0x5625874e7ad0 2024-05-15T18:09:18.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.283+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(191 gc.3 [call] v29'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.283+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-05-15T18:09:18.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.283+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:192 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56258753dc00 con 0x7fadf00bdc20 2024-05-15T18:09:18.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.287+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== osd_op_reply(192 gc.4 [call] v29'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.287+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:193 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.287+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== osd_op_reply(193 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.287+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.287+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:194 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.287+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(194 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.287+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:195 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.288+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 35 ==== osd_op_reply(195 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.288+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.288+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:196 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.288+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 36 ==== osd_op_reply(196 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.288+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.288+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:197 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x7fadf00bdc20 2024-05-15T18:09:18.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.289+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 37 ==== osd_op_reply(197 gc.4 [call] v29'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.289+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.289+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:198 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 71 ==== osd_op_reply(198 gc.5 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:199 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 72 ==== osd_op_reply(199 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:200 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 73 ==== osd_op_reply(200 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:201 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 74 ==== osd_op_reply(201 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.290+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:202 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874ec4c0 2024-05-15T18:09:18.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.291+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 75 ==== osd_op_reply(202 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.291+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.291+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:203 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874ec4c0 2024-05-15T18:09:18.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.291+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 76 ==== osd_op_reply(203 gc.5 [call] v29'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.292+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-05-15T18:09:18.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.292+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:204 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587542bb0 con 0x5625874e7ad0 2024-05-15T18:09:18.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== osd_op_reply(204 gc.6 [call] v29'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:205 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(205 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:206 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(206 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:207 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(207 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.293+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:208 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.294+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 45 ==== osd_op_reply(208 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.294+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.294+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:209 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.295+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 46 ==== osd_op_reply(209 gc.6 [call] v29'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.295+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-05-15T18:09:18.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.295+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:210 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 51 ==== osd_op_reply(210 gc.7 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:211 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 52 ==== osd_op_reply(211 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:212 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 53 ==== osd_op_reply(212 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:213 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 54 ==== osd_op_reply(213 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.296+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:214 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.297+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 55 ==== osd_op_reply(214 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.297+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.297+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:215 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.298+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 56 ==== osd_op_reply(215 gc.7 [call] v29'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.298+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-05-15T18:09:18.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.298+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:216 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 38 ==== osd_op_reply(216 gc.8 [call] v29'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:217 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 39 ==== osd_op_reply(217 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:218 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 40 ==== osd_op_reply(218 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:219 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 41 ==== osd_op_reply(219 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.299+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:220 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.300+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 42 ==== osd_op_reply(220 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.300+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.300+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:221 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.301+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 43 ==== osd_op_reply(221 gc.8 [call] v29'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.301+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.301+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:222 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 77 ==== osd_op_reply(222 gc.9 [call] v29'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:223 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 78 ==== osd_op_reply(223 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:224 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 79 ==== osd_op_reply(224 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:225 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 80 ==== osd_op_reply(225 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:226 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 81 ==== osd_op_reply(226 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.302+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:227 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.303+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 82 ==== osd_op_reply(227 gc.9 [call] v29'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.303+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-05-15T18:09:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.303+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:228 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.284 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.304+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 44 ==== osd_op_reply(228 gc.10 [call] v29'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.304+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:229 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.304+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 45 ==== osd_op_reply(229 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:230 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 46 ==== osd_op_reply(230 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:231 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 47 ==== osd_op_reply(231 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:232 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 48 ==== osd_op_reply(232 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.305+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:233 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.285 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.306+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 49 ==== osd_op_reply(233 gc.10 [call] v29'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.306+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-05-15T18:09:18.286 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.306+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:234 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.307+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 57 ==== osd_op_reply(234 gc.11 [call] v29'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.307+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:235 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 58 ==== osd_op_reply(235 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:236 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 59 ==== osd_op_reply(236 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:237 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 60 ==== osd_op_reply(237 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:238 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 61 ==== osd_op_reply(238 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.308+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:239 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.310+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 62 ==== osd_op_reply(239 gc.11 [call] v29'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.310+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-05-15T18:09:18.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.310+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:240 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.311+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 50 ==== osd_op_reply(240 gc.12 [call] v29'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.311+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:241 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.311+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 51 ==== osd_op_reply(241 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.311+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.311+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:242 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x7fadf00bdc20 2024-05-15T18:09:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.311+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 52 ==== osd_op_reply(242 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.311+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:243 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.312+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 53 ==== osd_op_reply(243 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.312+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.312+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:244 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.312+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 54 ==== osd_op_reply(244 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.312+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.312+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:245 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.313+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 55 ==== osd_op_reply(245 gc.12 [call] v29'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.313+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-05-15T18:09:18.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.313+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:246 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.314+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 63 ==== osd_op_reply(246 gc.13 [call] v29'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.314+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:247 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.314+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 64 ==== osd_op_reply(247 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.314+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.314+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:248 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 65 ==== osd_op_reply(248 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:249 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 66 ==== osd_op_reply(249 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:250 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 67 ==== osd_op_reply(250 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.315+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:251 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.316+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 68 ==== osd_op_reply(251 gc.13 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.316+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-05-15T18:09:18.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.316+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:252 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.317+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 47 ==== osd_op_reply(252 gc.14 [call] v29'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.317+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:253 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.317+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 48 ==== osd_op_reply(253 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.317+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.317+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:254 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 49 ==== osd_op_reply(254 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:255 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 50 ==== osd_op_reply(255 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:256 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 51 ==== osd_op_reply(256 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.318+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:257 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.319+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 52 ==== osd_op_reply(257 gc.14 [call] v29'167 uv167 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.319+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.319+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:258 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.320+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 83 ==== osd_op_reply(258 gc.15 [call] v29'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.320+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:259 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.320+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 84 ==== osd_op_reply(259 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.320+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.320+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:260 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874ec4c0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 85 ==== osd_op_reply(260 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.300 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:261 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 86 ==== osd_op_reply(261 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:262 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 87 ==== osd_op_reply(262 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.301 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.321+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:263 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.323+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 88 ==== osd_op_reply(263 gc.15 [call] v29'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.323+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-05-15T18:09:18.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.323+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:264 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 56 ==== osd_op_reply(264 gc.16 [call] v29'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:265 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 57 ==== osd_op_reply(265 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:266 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 58 ==== osd_op_reply(266 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:267 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 59 ==== osd_op_reply(267 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.324+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:268 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.325+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 60 ==== osd_op_reply(268 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.325+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.325+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:269 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.326+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 61 ==== osd_op_reply(269 gc.16 [call] v29'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.326+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-05-15T18:09:18.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.326+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:270 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 89 ==== osd_op_reply(270 gc.17 [call] v29'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:271 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 90 ==== osd_op_reply(271 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:272 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 91 ==== osd_op_reply(272 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:273 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 92 ==== osd_op_reply(273 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.327+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:274 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.328+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 93 ==== osd_op_reply(274 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.328+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.328+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:275 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.329+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 94 ==== osd_op_reply(275 gc.17 [call] v29'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.329+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-05-15T18:09:18.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.329+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:276 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.330+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 53 ==== osd_op_reply(276 gc.18 [call] v29'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.330+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:277 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.330+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 54 ==== osd_op_reply(277 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.330+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.330+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:278 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.330+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 55 ==== osd_op_reply(278 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.330+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:279 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.331+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 56 ==== osd_op_reply(279 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.331+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.331+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:280 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874e7ad0 2024-05-15T18:09:18.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.331+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 57 ==== osd_op_reply(280 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.331+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.331+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:281 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.332+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 58 ==== osd_op_reply(281 gc.18 [call] v29'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.332+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-05-15T18:09:18.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.332+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:282 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.333+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 59 ==== osd_op_reply(282 gc.19 [call] v29'168 uv168 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.333+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:283 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.333+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 60 ==== osd_op_reply(283 gc.19 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.333+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.333+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:284 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 61 ==== osd_op_reply(284 gc.19 [call out=24b] v0'0 uv168 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:285 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 62 ==== osd_op_reply(285 gc.19 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:286 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 63 ==== osd_op_reply(286 gc.19 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.334+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:287 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874e7ad0 2024-05-15T18:09:18.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.335+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 64 ==== osd_op_reply(287 gc.19 [call] v29'169 uv169 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.335+0000 7fadff546800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-05-15T18:09:18.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.335+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:288 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.336+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 95 ==== osd_op_reply(288 gc.20 [call] v29'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.336+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:289 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 96 ==== osd_op_reply(289 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:290 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587537520 con 0x5625874ec4c0 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 97 ==== osd_op_reply(290 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:291 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 98 ==== osd_op_reply(291 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.337+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:292 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.338+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 99 ==== osd_op_reply(292 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.338+0000 7fadff546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:09:18.316 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.338+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:293 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x562587538530 con 0x5625874ec4c0 2024-05-15T18:09:18.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.339+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 100 ==== osd_op_reply(293 gc.20 [call] v29'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.340+0000 7facb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:18.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.340+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719183913328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625875305f0 con 0x5625874e7ad0 2024-05-15T18:09:18.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.341+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94719183913328] v29'170 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.341+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719183888016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f8170 con 0x7fadf00bdc20 2024-05-15T18:09:18.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.342+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94719183888016] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.342+0000 7fadff546800 20 remove_watcher() i=0 2024-05-15T18:09:18.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.342+0000 7fadff546800 2 removed watcher, disabling cache 2024-05-15T18:09:18.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.342+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719183892912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1e90 con 0x5625874e7ad0 2024-05-15T18:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.343+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94719183892912] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.343+0000 7fadff546800 20 remove_watcher() i=1 2024-05-15T18:09:18.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.343+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719183893968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1e90 con 0x5625874ec4c0 2024-05-15T18:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.344+0000 7fadfd04c640 1 -- 172.21.15.173:0/204588513 <== osd.3 v2:172.21.15.173:6814/3793320597 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94719183893968] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf0075030 con 0x5625874ec4c0 2024-05-15T18:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.344+0000 7fadff546800 20 remove_watcher() i=2 2024-05-15T18:09:18.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.344+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719183898672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1e90 con 0x7fadf00bdc20 2024-05-15T18:09:18.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.345+0000 7fadf7fff640 1 -- 172.21.15.173:0/204588513 <== osd.2 v2:172.21.15.173:6808/3098545592 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94719183898672] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade8009050 con 0x7fadf00bdc20 2024-05-15T18:09:18.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.345+0000 7fadff546800 20 remove_watcher() i=3 2024-05-15T18:09:18.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.345+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719183904944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1e90 con 0x5625874e7ad0 2024-05-15T18:09:18.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.346+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.1 v2:172.21.15.173:6800/3225970667 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94719183904944] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x5625874e7ad0 2024-05-15T18:09:18.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.346+0000 7fadff546800 20 remove_watcher() i=4 2024-05-15T18:09:18.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.346+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719183908496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1e90 con 0x7fade8037040 2024-05-15T18:09:18.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.347+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94719183908496] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.347+0000 7fadff546800 20 remove_watcher() i=5 2024-05-15T18:09:18.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.348+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719183909552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f6e90 con 0x7fade8037040 2024-05-15T18:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.349+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94719183909552] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.349+0000 7fadff546800 20 remove_watcher() i=6 2024-05-15T18:09:18.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.349+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719183912272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5625874f1e90 con 0x7fade8037040 2024-05-15T18:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 <== osd.0 v2:172.21.15.3:6800/774076599 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94719183912272] v29'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf8031040 con 0x7fade8037040 2024-05-15T18:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 20 remove_watcher() i=7 2024-05-15T18:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fade8037040 msgr2=0x7fade8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fade8037040 0x7fade8036410 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625874e7ad0 msgr2=0x5625874e9f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625874e7ad0 0x5625874e9f90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fadf00bdc20 msgr2=0x7fadf00951f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fadf00bdc20 0x7fadf00951f0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874ec4c0 msgr2=0x5625874ee8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874ec4c0 0x5625874ee8b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facc8036900 msgr2=0x7facc8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facc8036900 0x7facc8038dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fade8001b60 tx=0x7fade8010000 comp rx=0 tx=0).stop 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 msgr2=0x5625874dc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625874dc390 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fadf005bf90 tx=0x7fadf0065f10 comp rx=0 tx=0).stop 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadfd84d640 1 -- 172.21.15.173:0/204588513 reap_dead start 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 shutdown_connections 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 --2- 172.21.15.173:0/204588513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873ae280 0x5625874dc390 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 >> 172.21.15.173:0/204588513 conn(0x5625874cf0f0 msgr2=0x5625874cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 shutdown_connections 2024-05-15T18:09:18.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.350+0000 7fadff546800 1 -- 172.21.15.173:0/204588513 wait complete. 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facd40368b0 msgr2=0x7facd4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facd40368b0 0x7facd4038d70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fade800bf50 tx=0x7fade800f000 comp rx=0 tx=0).stop 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625874c5c70 msgr2=0x5625874c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625874c5c70 0x5625874c6090 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fadf008c3c0 tx=0x7fadf005cf90 comp rx=0 tx=0).stop 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 shutdown_connections 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7facd40368b0 0x7facd4038d70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/1035515679 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625874c5c70 0x5625874c6090 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 >> 172.21.15.173:0/1035515679 conn(0x5625874b9d10 msgr2=0x5625874ba110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 shutdown_connections 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/1035515679 wait complete. 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625874b4b70 msgr2=0x5625874b7030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5625874b4b70 0x5625874b7030 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625873b14f0 msgr2=0x5625874ae350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5625873b14f0 0x5625874ae350 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874b0c70 msgr2=0x5625874b3060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5625874b0c70 0x5625874b3060 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7face4036900 msgr2=0x7face4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7face4036900 0x7face4038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fade8000f60 tx=0x7fade80012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 msgr2=0x5625874a7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 --2- 172.21.15.173:0/2805858962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5625873aebc0 0x5625874a7110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fadf0000c00 tx=0x7fadf0003020 comp rx=0 tx=0).stop 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadfd84d640 1 -- 172.21.15.173:0/2805858962 reap_dead start 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 shutdown_connections 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 >> 172.21.15.173:0/2805858962 conn(0x5625873a8550 msgr2=0x562587499770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 shutdown_connections 2024-05-15T18:09:18.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.351+0000 7fadff546800 1 -- 172.21.15.173:0/2805858962 wait complete. 2024-05-15T18:09:18.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-15T18:09:18.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-15T18:09:18.338 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-15T18:09:18.423 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:18.423 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:18.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.445+0000 7f901c40e800 1 Processor -- start 2024-05-15T18:09:18.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f901c40e800 1 -- start start 2024-05-15T18:09:18.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f901c40e800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b0558d59e0 0x55b0558d5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f901c40e800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b05584aa60 con 0x55b0558d6340 2024-05-15T18:09:18.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f901c40e800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55b055768050 con 0x55b0558d59e0 2024-05-15T18:09:18.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f9019f0d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b0558d59e0 0x55b0558d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f901970c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55b0558d6340 0x55b0558d67f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:47166/0 (socket says 172.21.15.173:47166) 2024-05-15T18:09:18.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f901970c640 1 -- 172.21.15.173:0/33984181 learned_addr learned my addr 172.21.15.173:0/33984181 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:18.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.446+0000 7f9019f0d640 1 -- 172.21.15.173:0/33984181 >> v1:172.21.15.3:6789/0 conn(0x55b0558d6340 legacy=0x55b0558d67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.447+0000 7f9019f0d640 1 -- 172.21.15.173:0/33984181 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0558d6f00 con 0x55b0558d59e0 2024-05-15T18:09:18.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.448+0000 7f9019f0d640 1 --2- 172.21.15.173:0/33984181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d59e0 0x55b0558d5e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f900c00a470 tx=0x7f900c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a535c99dc7ba96ae server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.448+0000 7f9018f0b640 1 -- 172.21.15.173:0/33984181 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c057070 con 0x55b0558d59e0 2024-05-15T18:09:18.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f9018f0b640 1 -- 172.21.15.173:0/33984181 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c052570 con 0x55b0558d59e0 2024-05-15T18:09:18.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f9018f0b640 1 -- 172.21.15.173:0/33984181 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c052870 con 0x55b0558d59e0 2024-05-15T18:09:18.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f901c40e800 1 -- 172.21.15.173:0/33984181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d59e0 msgr2=0x55b0558d5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f901c40e800 1 --2- 172.21.15.173:0/33984181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d59e0 0x55b0558d5e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f900c00a470 tx=0x7f900c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:18.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f901c40e800 1 -- 172.21.15.173:0/33984181 shutdown_connections 2024-05-15T18:09:18.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f901c40e800 1 --2- 172.21.15.173:0/33984181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d59e0 0x55b0558d5e00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f901c40e800 1 -- 172.21.15.173:0/33984181 >> 172.21.15.173:0/33984181 conn(0x55b0558d15a0 msgr2=0x55b0558d39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f901c40e800 1 -- 172.21.15.173:0/33984181 shutdown_connections 2024-05-15T18:09:18.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.449+0000 7f901c40e800 1 -- 172.21.15.173:0/33984181 wait complete. 2024-05-15T18:09:18.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f901c40e800 1 Processor -- start 2024-05-15T18:09:18.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f901c40e800 1 -- start start 2024-05-15T18:09:18.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f901c40e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f901c40e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b0558221d0 con 0x55b0558d6340 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54882/0 (socket says 172.21.15.173:54882) 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f9019f0d640 1 -- 172.21.15.173:0/65458971 learned_addr learned my addr 172.21.15.173:0/65458971 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.463+0000 7f9019f0d640 1 -- 172.21.15.173:0/65458971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0559cb230 con 0x55b0558d6340 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.464+0000 7f9019f0d640 1 --2- 172.21.15.173:0/65458971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559cac60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f900c00a470 tx=0x7f900c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7aeaa27d99325b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.464+0000 7f8f07e07640 1 -- 172.21.15.173:0/65458971 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c057040 con 0x55b0558d6340 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.464+0000 7f8f07e07640 1 -- 172.21.15.173:0/65458971 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c052950 con 0x55b0558d6340 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.464+0000 7f8f07e07640 1 -- 172.21.15.173:0/65458971 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c052c70 con 0x55b0558d6340 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 -- 172.21.15.173:0/65458971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 msgr2=0x55b0559cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 --2- 172.21.15.173:0/65458971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559cac60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f900c00a470 tx=0x7f900c04c000 comp rx=0 tx=0).stop 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 -- 172.21.15.173:0/65458971 shutdown_connections 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 --2- 172.21.15.173:0/65458971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559cac60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 -- 172.21.15.173:0/65458971 >> 172.21.15.173:0/65458971 conn(0x55b0558d15a0 msgr2=0x55b0559c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:18.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 -- 172.21.15.173:0/65458971 shutdown_connections 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 -- 172.21.15.173:0/65458971 wait complete. 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 Processor -- start 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 -- start start 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f901c40e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b0558d7430 con 0x55b0558d6340 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:54886/0 (socket says 172.21.15.173:54886) 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.465+0000 7f9019f0d640 1 -- 172.21.15.173:0/728809580 learned_addr learned my addr 172.21.15.173:0/728809580 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.466+0000 7f9019f0d640 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0559d2cf0 con 0x55b0558d6340 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.466+0000 7f9019f0d640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559d27b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f900c044840 tx=0x7f900c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.466+0000 7f8f06604640 1 -- 172.21.15.173:0/728809580 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c057070 con 0x55b0558d6340 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.466+0000 7f8f06604640 1 -- 172.21.15.173:0/728809580 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c05d650 con 0x55b0558d6340 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.466+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0559d2f80 con 0x55b0558d6340 2024-05-15T18:09:18.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.466+0000 7f8f06604640 1 -- 172.21.15.173:0/728809580 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c05d950 con 0x55b0558d6340 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.466+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0559d5b90 con 0x55b0558d6340 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.467+0000 7f8f06604640 1 -- 172.21.15.173:0/728809580 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f900c05daf0 con 0x55b0558d6340 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.467+0000 7f8f06604640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8f00036950 0x7f8f00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.467+0000 7f8f06604640 1 -- 172.21.15.173:0/728809580 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5938+0+0 (secure 0 0 0) 0x7f900c08e1c0 con 0x55b0558d6340 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.467+0000 7f901970c640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8f00036950 0x7f8f00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.467+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b0559d7940 0x55b0559d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.467+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b0559da270 con 0x55b0559d7940 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.467+0000 7f901a70e640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b0559d7940 0x55b0559d9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.468+0000 7f901970c640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8f00036950 0x7f8f00038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9010000f60 tx=0x7f90100012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:18.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:18.468+0000 7f901a70e640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b0559d7940 0x55b0559d9d30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.404+0000 7f8f06604640 1 -- 172.21.15.173:0/728809580 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_map(31..31 src has 1..31) ==== 312+0+0 (crc 0 0 0) 0x7f901400e040 con 0x55b0559d7940 2024-05-15T18:09:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.404+0000 7f901a70e640 1 -- 172.21.15.173:0/728809580 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b0559d7940 2024-05-15T18:09:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.405+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b0559d6f20 con 0x55b0559d7940 2024-05-15T18:09:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.405+0000 7f901a70e640 1 -- 172.21.15.173:0/728809580 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f901400a740 con 0x55b0559d7940 2024-05-15T18:09:19.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.405+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b0559dc5c0 0x55b0559de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.405+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b0559df0f0 con 0x55b0559dc5c0 2024-05-15T18:09:19.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.406+0000 7f9019f0d640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b0559dc5c0 0x55b0559de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.407+0000 7f9019f0d640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b0559dc5c0 0x55b0559de9b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.407+0000 7f9019f0d640 1 -- 172.21.15.173:0/728809580 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f900c076070 con 0x55b0559dc5c0 2024-05-15T18:09:19.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.408+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b0559db570 con 0x55b0559d7940 2024-05-15T18:09:19.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.409+0000 7f901a70e640 1 -- 172.21.15.173:0/728809580 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f901400a740 con 0x55b0559d7940 2024-05-15T18:09:19.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.409+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b0559e05a0 0x55b0559e29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.409+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b0559e3130 con 0x55b0559e05a0 2024-05-15T18:09:19.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.409+0000 7f901970c640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b0559e05a0 0x55b0559e29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.410+0000 7f901970c640 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b0559e05a0 0x55b0559e29d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.410+0000 7f901970c640 1 -- 172.21.15.173:0/728809580 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9010009050 con 0x55b0559e05a0 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.411+0000 7f901c40e800 1 Processor -- start 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.411+0000 7f901c40e800 1 -- start start 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.411+0000 7f901c40e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559f1590 0x55b0559f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.411+0000 7f901c40e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b0557c8cf0 con 0x55b0559f1590 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.411+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559f1590 0x55b0559f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.411+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559f1590 0x55b0559f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49332/0 (socket says 172.21.15.173:49332) 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.411+0000 7f9019f0d640 1 -- 172.21.15.173:0/1591753965 learned_addr learned my addr 172.21.15.173:0/1591753965 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.412+0000 7f9019f0d640 1 -- 172.21.15.173:0/1591753965 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0559f1ef0 con 0x55b0559f1590 2024-05-15T18:09:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.412+0000 7f9019f0d640 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559f1590 0x55b0559f19b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f900c08c610 tx=0x7f900c06ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.412+0000 7f8eff7fe640 1 -- 172.21.15.173:0/1591753965 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c007cd0 con 0x55b0559f1590 2024-05-15T18:09:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.412+0000 7f8eff7fe640 1 -- 172.21.15.173:0/1591753965 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c007e70 con 0x55b0559f1590 2024-05-15T18:09:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.412+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0559f2960 con 0x55b0559f1590 2024-05-15T18:09:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.412+0000 7f8eff7fe640 1 -- 172.21.15.173:0/1591753965 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c08c9c0 con 0x55b0559f1590 2024-05-15T18:09:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.412+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0559f2e60 con 0x55b0559f1590 2024-05-15T18:09:19.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.413+0000 7f8eff7fe640 1 -- 172.21.15.173:0/1591753965 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f900c08cb60 con 0x55b0559f1590 2024-05-15T18:09:19.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.414+0000 7f8eff7fe640 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ef4036900 0x7f8ef4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.414+0000 7f8eff7fe640 1 -- 172.21.15.173:0/1591753965 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f900c05e030 con 0x55b0559f1590 2024-05-15T18:09:19.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.414+0000 7f901970c640 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ef4036900 0x7f8ef4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.414+0000 7f901c40e800 1 Processor -- start 2024-05-15T18:09:19.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.414+0000 7f901c40e800 1 -- start start 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f901c40e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b0559feb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f901970c640 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ef4036900 0x7f8ef4038dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f901000bf50 tx=0x7f901000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f901c40e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b0559cb4f0 con 0x55b0559fe740 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b0559feb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b0559feb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49344/0 (socket says 172.21.15.173:49344) 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f9019f0d640 1 -- 172.21.15.173:0/1089595024 learned_addr learned my addr 172.21.15.173:0/1089595024 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f9019f0d640 1 -- 172.21.15.173:0/1089595024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0559ff110 con 0x55b0559fe740 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.415+0000 7f9019f0d640 1 --2- 172.21.15.173:0/1089595024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b0559feb40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f900c08e010 tx=0x7f900c0065b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac5396169634e0c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f8efd7fa640 1 -- 172.21.15.173:0/1089595024 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c0a6070 con 0x55b0559fe740 2024-05-15T18:09:19.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f8efd7fa640 1 -- 172.21.15.173:0/1089595024 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c0069d0 con 0x55b0559fe740 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f8efd7fa640 1 -- 172.21.15.173:0/1089595024 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c0073e0 con 0x55b0559fe740 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f901c40e800 1 -- 172.21.15.173:0/1089595024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 msgr2=0x55b0559feb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f901c40e800 1 --2- 172.21.15.173:0/1089595024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b0559feb40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f900c08e010 tx=0x7f900c0065b0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f901c40e800 1 -- 172.21.15.173:0/1089595024 shutdown_connections 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f901c40e800 1 --2- 172.21.15.173:0/1089595024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b0559feb40 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f901c40e800 1 -- 172.21.15.173:0/1089595024 >> 172.21.15.173:0/1089595024 conn(0x55b0559faa10 msgr2=0x55b0559f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f901c40e800 1 -- 172.21.15.173:0/1089595024 shutdown_connections 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.416+0000 7f901c40e800 1 -- 172.21.15.173:0/1089595024 wait complete. 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.417+0000 7f901c40e800 1 Processor -- start 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.417+0000 7f901c40e800 1 -- start start 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.417+0000 7f901c40e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b055a05b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.417+0000 7f901c40e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b0559ff800 con 0x55b0559fe740 2024-05-15T18:09:19.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.417+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b055a05b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.417+0000 7f9019f0d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b055a05b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49346/0 (socket says 172.21.15.173:49346) 2024-05-15T18:09:19.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.417+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 learned_addr learned my addr 172.21.15.173:0/3040879028 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.418+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b055a06060 con 0x55b0559fe740 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.418+0000 7f9019f0d640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b055a05b20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f900c006980 tx=0x7f900c051f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.418+0000 7f8eeb7fe640 1 -- 172.21.15.173:0/3040879028 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c0b1020 con 0x55b0559fe740 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.418+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b055a06060 con 0x55b0559fe740 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.418+0000 7f8eeb7fe640 1 -- 172.21.15.173:0/3040879028 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c097570 con 0x55b0559fe740 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.418+0000 7f8eeb7fe640 1 -- 172.21.15.173:0/3040879028 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f900c0a6030 con 0x55b0559fe740 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.418+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b055a06060 con 0x55b0559fe740 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.419+0000 7f8eeb7fe640 1 -- 172.21.15.173:0/3040879028 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f900c0b4020 con 0x55b0559fe740 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.419+0000 7f8eeb7fe640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ee40368b0 0x7f8ee4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.419+0000 7f8eeb7fe640 1 -- 172.21.15.173:0/3040879028 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f900c0a7070 con 0x55b0559fe740 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.419+0000 7f901970c640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ee40368b0 0x7f8ee4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.419+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.420+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b055a110b0 0x55b055a13570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.420+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a13cc0 con 0x55b055a110b0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.420+0000 7f901a70e640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b055a110b0 0x55b055a13570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.420+0000 7f901970c640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ee40368b0 0x7f8ee4038d70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9010001b60 tx=0x7f9010010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.420+0000 7f901a70e640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b055a110b0 0x55b055a13570 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 realm 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a140d0 con 0x55b055a110b0 2024-05-15T18:09:19.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a149a0 con 0x55b055a110b0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x55b055a110b0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b055a15830 0x55b055a17c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.421+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a18380 con 0x55b055a15830 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.422+0000 7f9019f0d640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b055a15830 0x55b055a17c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.422+0000 7f9019f0d640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b055a15830 0x55b055a17c20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.422+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.422+0000 7f901c40e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.422+0000 7f901c40e800 20 searching for the correct realm 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.422+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a19d60 con 0x55b055a15830 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f9019f0d640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f900c0c1040 0x7f900c079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a19d60 con 0x7f900c0c1040 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f901970c640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f900c0c1040 0x7f900c079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f901970c640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f900c0c1040 0x7f900c079980 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010009050 con 0x7f900c0c1040 2024-05-15T18:09:19.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f901970c640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9010038040 0x7f901001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.423+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a19d60 con 0x7f9010038040 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.424+0000 7f901a70e640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9010038040 0x7f901001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.424+0000 7f901a70e640 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9010038040 0x7f901001bab0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.424+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.424+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x55b055a110b0 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x55b055a110b0 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x7f9010038040 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x7f9010038040 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.425+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x7f900c0c1040 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.426+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010009050 con 0x7f900c0c1040 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.426+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x55b055a15830 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.426+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.426+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x55b055a110b0 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.426+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.426+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x7f9010038040 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.427+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.427+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a110b0 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.427+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.427+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f900c0c1040 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.427+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9010009050 con 0x7f900c0c1040 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.427+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.428+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.428+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.428+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.428+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f9010038040 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.428+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.428+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.428+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.429+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.429+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.429+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a110b0 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.429+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.429+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a110b0 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.429+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.429+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f9010038040 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.430+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.430+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a15830 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.430+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.430+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f900c0c1040 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.430+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010009050 con 0x7f900c0c1040 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.430+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a110b0 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.431+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.431+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f9010038040 2024-05-15T18:09:19.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.431+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.431+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a15830 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.431+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.431+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f9010038040 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.432+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.432+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f900c0c1040 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.432+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010009050 con 0x7f900c0c1040 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.432+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a15830 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.432+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.432+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x7f900c0c1040 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.432+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9014032040 con 0x55b055a110b0 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f901403e040 con 0x7f900c0c1040 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a14d40 con 0x55b055a110b0 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.433+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a18d30 con 0x55b055a110b0 2024-05-15T18:09:19.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a18d30 con 0x7f9010038040 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 zone default found 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 4 Realm: () 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 zonegroup default 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a19150 con 0x7f9010038040 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.434+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a19590 con 0x55b055a15830 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f901c40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f901c40e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1bc10 con 0x55b055a15830 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f901c40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f901c40e800 20 started sync module instance, tier type = 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f901c40e800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:19.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.435+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1b0b0 con 0x7f900c0c1040 2024-05-15T18:09:19.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.436+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.436+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94215839263744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1bfb0 con 0x7f900c0c1040 2024-05-15T18:09:19.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.436+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1c800 con 0x55b055a110b0 2024-05-15T18:09:19.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.438+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94215839263744] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.438+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.438+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94215839269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1cc20 con 0x55b055a110b0 2024-05-15T18:09:19.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.438+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1d4d0 con 0x55b055a15830 2024-05-15T18:09:19.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.439+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.439+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94215839272480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1dd70 con 0x55b055a15830 2024-05-15T18:09:19.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.439+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1e840 con 0x7f900c0c1040 2024-05-15T18:09:19.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.439+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94215839269712] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.440+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94215839272480] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.440+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.440+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94215839277872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1ec30 con 0x7f900c0c1040 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.440+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1f500 con 0x55b055a110b0 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.442+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.442+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94215839277872] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.442+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94215839281104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1fda0 con 0x55b055a110b0 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.442+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1c790 con 0x7f9010038040 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.443+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94215839281104] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.444+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.444+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94215839283232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a20390 con 0x7f9010038040 2024-05-15T18:09:19.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.444+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a20d50 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.446+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.446+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94215839287456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a21170 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.446+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a21c10 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.446+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94215839283232] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94215839291104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a21bd0 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901c40e800 20 add_watcher() i=0 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901c40e800 20 add_watcher() i=1 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901c40e800 20 add_watcher() i=2 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901c40e800 20 add_watcher() i=3 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901c40e800 20 add_watcher() i=4 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.447+0000 7f901c40e800 20 add_watcher() i=5 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.448+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94215839287456] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.448+0000 7f901c40e800 20 add_watcher() i=6 2024-05-15T18:09:19.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.448+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94215839291104] v31'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.449+0000 7f901c40e800 20 add_watcher() i=7 2024-05-15T18:09:19.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.449+0000 7f901c40e800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:19.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.449+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1fc40 con 0x55b055a110b0 2024-05-15T18:09:19.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.449+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.449+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94215839288512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1fc40 con 0x55b055a110b0 2024-05-15T18:09:19.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.450+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94215839288512] v31'171 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.450+0000 7f8ecb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:19.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.450+0000 7f901c40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:19.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.450+0000 7f901c40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:19.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.450+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2d1c0 con 0x55b055a110b0 2024-05-15T18:09:19.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.452+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.453+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2d7a0 con 0x7f9010038040 2024-05-15T18:09:19.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.454+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.454+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2dd10 con 0x55b055a15830 2024-05-15T18:09:19.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.455+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.455+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2dda0 con 0x55b055a110b0 2024-05-15T18:09:19.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.456+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'172 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.456+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2dda0 con 0x7f900c0c1040 2024-05-15T18:09:19.434 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.457+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.457+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2e860 con 0x55b055a15830 2024-05-15T18:09:19.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.458+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.458+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2e860 con 0x55b055a110b0 2024-05-15T18:09:19.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.459+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.459+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2e860 con 0x7f9010038040 2024-05-15T18:09:19.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.460+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.461+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2e8a0 con 0x7f900c0c1040 2024-05-15T18:09:19.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.462+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.462+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2eed0 con 0x55b055a15830 2024-05-15T18:09:19.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.463+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.463+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2eed0 con 0x7f900c0c1040 2024-05-15T18:09:19.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.464+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.464+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2f480 con 0x7f9010038040 2024-05-15T18:09:19.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.465+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.465+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2f480 con 0x7f900c0c1040 2024-05-15T18:09:19.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.466+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.466+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2f530 con 0x7f9010038040 2024-05-15T18:09:19.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.467+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.467+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2f530 con 0x55b055a110b0 2024-05-15T18:09:19.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.468+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'173 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.468+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2f530 con 0x55b055a15830 2024-05-15T18:09:19.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.470+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.470+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x7f900c0c1040 2024-05-15T18:09:19.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.471+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.471+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.472+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.472+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a110b0 2024-05-15T18:09:19.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.473+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.473+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a110b0 2024-05-15T18:09:19.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.474+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'174 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.475+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.476+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.476+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x7f900c0c1040 2024-05-15T18:09:19.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.477+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.477+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.478+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.455 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.478+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.479+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.456 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.479+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.480+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.457 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.480+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.481+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.458 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.481+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x7f9010038040 2024-05-15T18:09:19.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.482+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.460 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.482+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.483+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.483+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x7f9010038040 2024-05-15T18:09:19.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.484+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.484+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x55b055a15830 2024-05-15T18:09:19.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.485+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.485+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x7f9010038040 2024-05-15T18:09:19.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.487+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.487+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2fa30 con 0x7f900c0c1040 2024-05-15T18:09:19.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f8eca7fc640 20 reqs_thread_entry: start 2024-05-15T18:09:19.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f901c40e800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f901c40e800 20 Filter name: none 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f8e3bfff640 20 reqs_thread_entry: start 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.489+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a110b0 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.490+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.490+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.490+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.490+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.490+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.490+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f9010038040 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.491+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.491+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.491+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.491+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.492+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a110b0 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.493+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.493+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.493+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.493+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.493+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.493+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f900c0c1040 2024-05-15T18:09:19.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.494+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a110b0 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.495+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.496+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.496+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f9010038040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.496+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.496+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f900c0c1040 2024-05-15T18:09:19.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.497+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.498+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f900c0c1040 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.499+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.499+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.499+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.499+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f9010038040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.500+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f900c0c1040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.501+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.501+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.501+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.501+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.501+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.501+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f9010038040 2024-05-15T18:09:19.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.502+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.502+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.502+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.502+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.502+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.502+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a110b0 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.502+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv167 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.503+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.503+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.503+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.503+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.503+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.503+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.503+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f900c0c1040 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.504+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.505+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.506+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.506+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.506+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.506+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.506+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.506+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv169 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a110b0 2024-05-15T18:09:19.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv169 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.507+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f900c0c1040 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.508+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.509+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.510+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.511+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.512+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.512+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f9010038040 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.512+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.512+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.513+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.513+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.513+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.513+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.513+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.513+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.514+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.514+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.514+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.514+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f9010038040 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.514+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.514+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.515+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.515+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.515+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.515+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x55b055a15830 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.515+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.515+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x55b055a15830 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.516+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.516+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.516+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.516+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f9010038040 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.516+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.516+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f9010038040 2024-05-15T18:09:19.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.517+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.517+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.517+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.517+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5a290 con 0x7f900c0c1040 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.517+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.517+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b055a5b2a0 con 0x7f900c0c1040 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.517+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.518+0000 7f8ecb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:19.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.518+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94215839288512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a2bd00 con 0x55b055a110b0 2024-05-15T18:09:19.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.519+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94215839288512] v31'175 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.519+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94215839263744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a20cc0 con 0x7f900c0c1040 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.520+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94215839263744] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.520+0000 7f901c40e800 20 remove_watcher() i=0 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.520+0000 7f901c40e800 2 removed watcher, disabling cache 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.520+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94215839269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a20cc0 con 0x55b055a110b0 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.522+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94215839269712] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.522+0000 7f901c40e800 20 remove_watcher() i=1 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.522+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94215839272480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1c350 con 0x55b055a15830 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.523+0000 7f9019f0d640 1 -- 172.21.15.173:0/3040879028 <== osd.3 v2:172.21.15.173:6814/3793320597 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94215839272480] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f900c082070 con 0x55b055a15830 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.523+0000 7f901c40e800 20 remove_watcher() i=2 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.523+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94215839277872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a20cc0 con 0x7f900c0c1040 2024-05-15T18:09:19.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.524+0000 7f901970c640 1 -- 172.21.15.173:0/3040879028 <== osd.2 v2:172.21.15.173:6808/3098545592 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94215839277872] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9010045040 con 0x7f900c0c1040 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.524+0000 7f901c40e800 20 remove_watcher() i=3 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.524+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94215839281104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1c350 con 0x55b055a110b0 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.525+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.1 v2:172.21.15.173:6800/3225970667 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94215839281104] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x55b055a110b0 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.525+0000 7f901c40e800 20 remove_watcher() i=4 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.525+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94215839283232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1e330 con 0x7f9010038040 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.526+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94215839283232] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.526+0000 7f901c40e800 20 remove_watcher() i=5 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.526+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94215839287456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a1c350 con 0x7f9010038040 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.527+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94215839287456] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.527+0000 7f901c40e800 20 remove_watcher() i=6 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.527+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94215839291104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b055a20d50 con 0x7f9010038040 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 <== osd.0 v2:172.21.15.3:6800/774076599 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94215839291104] v31'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f901400a740 con 0x7f9010038040 2024-05-15T18:09:19.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 20 remove_watcher() i=7 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9010038040 msgr2=0x7f901001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9010038040 0x7f901001bab0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b055a110b0 msgr2=0x55b055a13570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b055a110b0 0x55b055a13570 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f900c0c1040 msgr2=0x7f900c079980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f900c0c1040 0x7f900c079980 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b055a15830 msgr2=0x55b055a17c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b055a15830 0x55b055a17c20 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ee40368b0 msgr2=0x7f8ee4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ee40368b0 0x7f8ee4038d70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9010001b60 tx=0x7f9010010000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 msgr2=0x55b055a05b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901c40e800 1 --2- 172.21.15.173:0/3040879028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559fe740 0x55b055a05b20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f900c006980 tx=0x7f900c051f20 comp rx=0 tx=0).stop 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 reap_dead start 2024-05-15T18:09:19.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.528+0000 7f901a70e640 1 -- 172.21.15.173:0/3040879028 reap_dead start 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 shutdown_connections 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 >> 172.21.15.173:0/3040879028 conn(0x55b0559faa10 msgr2=0x55b0559f8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 shutdown_connections 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/3040879028 wait complete. 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ef4036900 msgr2=0x7f8ef4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ef4036900 0x7f8ef4038dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f901000bf50 tx=0x7f901000f000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559f1590 msgr2=0x55b0559f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559f1590 0x55b0559f19b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f900c08c610 tx=0x7f900c06ed40 comp rx=0 tx=0).stop 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 shutdown_connections 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8ef4036900 0x7f8ef4038dc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/1591753965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0559f1590 0x55b0559f19b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 >> 172.21.15.173:0/1591753965 conn(0x55b0559e5630 msgr2=0x55b0559e5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 shutdown_connections 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/1591753965 wait complete. 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b0559e05a0 msgr2=0x55b0559e29d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b0559e05a0 0x55b0559e29d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b0559d7940 msgr2=0x55b0559d9d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b0559d7940 0x55b0559d9d30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b0559dc5c0 msgr2=0x55b0559de9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b0559dc5c0 0x55b0559de9b0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8f00036950 msgr2=0x7f8f00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8f00036950 0x7f8f00038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9010000f60 tx=0x7f90100012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 msgr2=0x55b0559d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.529+0000 7f901c40e800 1 --2- 172.21.15.173:0/728809580 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b0558d6340 0x55b0559d27b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f900c044840 tx=0x7f900c002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.530+0000 7f901a70e640 1 -- 172.21.15.173:0/728809580 reap_dead start 2024-05-15T18:09:19.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.530+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 shutdown_connections 2024-05-15T18:09:19.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.530+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 >> 172.21.15.173:0/728809580 conn(0x55b0558d15a0 msgr2=0x55b0559c4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.530+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 shutdown_connections 2024-05-15T18:09:19.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.530+0000 7f901c40e800 1 -- 172.21.15.173:0/728809580 wait complete. 2024-05-15T18:09:19.517 INFO:teuthology.orchestra.run.smithi173.stdout:[] 2024-05-15T18:09:19.517 DEBUG:tasks.util.rgw: json result: [] 2024-05-15T18:09:19.517 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-15T18:09:19.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-15T18:09:19.517 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-15T18:09:19.563 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:19.563 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:19.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.586+0000 7f07c6e62800 1 Processor -- start 2024-05-15T18:09:19.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.586+0000 7f07c6e62800 1 -- start start 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.586+0000 7f07c6e62800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5563b7286a00 0x5563b7286e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.586+0000 7f07c6e62800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563b71fba40 con 0x5563b7287360 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.586+0000 7f07c6e62800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5563b7119050 con 0x5563b7286a00 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.587+0000 7f07c4961640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5563b7286a00 0x5563b7286e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.587+0000 7f07c4961640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5563b7286a00 0x5563b7286e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49362/0 (socket says 172.21.15.173:49362) 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.587+0000 7f07c4961640 1 -- 172.21.15.173:0/2845876803 learned_addr learned my addr 172.21.15.173:0/2845876803 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.587+0000 7f07c4160640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5563b7287360 0x5563b7287810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43250/0 (socket says 172.21.15.173:43250) 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.587+0000 7f07c4961640 1 -- 172.21.15.173:0/2845876803 >> v1:172.21.15.3:6789/0 conn(0x5563b7287360 legacy=0x5563b7287810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.587+0000 7f07c4961640 1 -- 172.21.15.173:0/2845876803 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b7287f20 con 0x5563b7286a00 2024-05-15T18:09:19.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.589+0000 7f07c4961640 1 --2- 172.21.15.173:0/2845876803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7286e20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f07b400a520 tx=0x7f07b401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b3c34e4ee80677 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.589+0000 7f07c395f640 1 -- 172.21.15.173:0/2845876803 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b4057070 con 0x5563b7286a00 2024-05-15T18:09:19.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.589+0000 7f07c395f640 1 -- 172.21.15.173:0/2845876803 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b4052570 con 0x5563b7286a00 2024-05-15T18:09:19.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.589+0000 7f07c395f640 1 -- 172.21.15.173:0/2845876803 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b404ae60 con 0x5563b7286a00 2024-05-15T18:09:19.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.590+0000 7f07c6e62800 1 -- 172.21.15.173:0/2845876803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 msgr2=0x5563b7286e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.590+0000 7f07c6e62800 1 --2- 172.21.15.173:0/2845876803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7286e20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f07b400a520 tx=0x7f07b401d010 comp rx=0 tx=0).stop 2024-05-15T18:09:19.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.590+0000 7f07c6e62800 1 -- 172.21.15.173:0/2845876803 shutdown_connections 2024-05-15T18:09:19.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.590+0000 7f07c6e62800 1 --2- 172.21.15.173:0/2845876803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7286e20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.590+0000 7f07c6e62800 1 -- 172.21.15.173:0/2845876803 >> 172.21.15.173:0/2845876803 conn(0x5563b72825a0 msgr2=0x5563b72849c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.590+0000 7f07c6e62800 1 -- 172.21.15.173:0/2845876803 shutdown_connections 2024-05-15T18:09:19.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.590+0000 7f07c6e62800 1 -- 172.21.15.173:0/2845876803 wait complete. 2024-05-15T18:09:19.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.603+0000 7f07c6e62800 1 Processor -- start 2024-05-15T18:09:19.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.603+0000 7f07c6e62800 1 -- start start 2024-05-15T18:09:19.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.603+0000 7f07c6e62800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b737baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.603+0000 7f07c6e62800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5563b71d31d0 con 0x5563b7286a00 2024-05-15T18:09:19.582 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.604+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b737baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.604+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b737baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49378/0 (socket says 172.21.15.173:49378) 2024-05-15T18:09:19.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.604+0000 7f07c4961640 1 -- 172.21.15.173:0/267478045 learned_addr learned my addr 172.21.15.173:0/267478045 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.604+0000 7f07c4961640 1 -- 172.21.15.173:0/267478045 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b737c070 con 0x5563b7286a00 2024-05-15T18:09:19.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.604+0000 7f07c4961640 1 --2- 172.21.15.173:0/267478045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b737baa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07b401d050 tx=0x7f07b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786d17e0a2c2cdd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.604+0000 7f06b2e0d640 1 -- 172.21.15.173:0/267478045 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b4057040 con 0x5563b7286a00 2024-05-15T18:09:19.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f06b2e0d640 1 -- 172.21.15.173:0/267478045 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b4052720 con 0x5563b7286a00 2024-05-15T18:09:19.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f06b2e0d640 1 -- 172.21.15.173:0/267478045 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b4052a40 con 0x5563b7286a00 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f07c6e62800 1 -- 172.21.15.173:0/267478045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 msgr2=0x5563b737baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f07c6e62800 1 --2- 172.21.15.173:0/267478045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b737baa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f07b401d050 tx=0x7f07b404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f07c6e62800 1 -- 172.21.15.173:0/267478045 shutdown_connections 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f07c6e62800 1 --2- 172.21.15.173:0/267478045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b737baa0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f07c6e62800 1 -- 172.21.15.173:0/267478045 >> 172.21.15.173:0/267478045 conn(0x5563b72825a0 msgr2=0x5563b73773c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f07c6e62800 1 -- 172.21.15.173:0/267478045 shutdown_connections 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.605+0000 7f07c6e62800 1 -- 172.21.15.173:0/267478045 wait complete. 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c6e62800 1 Processor -- start 2024-05-15T18:09:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c6e62800 1 -- start start 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c6e62800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7383530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c6e62800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5563b7288450 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7383530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7383530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49384/0 (socket says 172.21.15.173:49384) 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c4961640 1 -- 172.21.15.173:0/3996707485 learned_addr learned my addr 172.21.15.173:0/3996707485 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c4961640 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b7383a70 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.606+0000 7f07c4961640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7383530 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.607+0000 7f06b160a640 1 -- 172.21.15.173:0/3996707485 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b4073070 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.607+0000 7f06b160a640 1 -- 172.21.15.173:0/3996707485 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b405d440 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.607+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563b7383d00 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.607+0000 7f06b160a640 1 -- 172.21.15.173:0/3996707485 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b4057070 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.607+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b73869b0 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f06b160a640 1 -- 172.21.15.173:0/3996707485 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f07b4076070 con 0x5563b7286a00 2024-05-15T18:09:19.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f06b160a640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f06ac036900 0x7f06ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f06b160a640 1 -- 172.21.15.173:0/3996707485 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f07b408db10 con 0x5563b7286a00 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f07c4160640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f06ac036900 0x7f06ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b7287360 0x5563b738a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b738ad40 con 0x5563b7287360 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f07c5162640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b7287360 0x5563b738a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f07c4160640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f06ac036900 0x7f06ac038dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000f60 tx=0x7f07ac001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.608+0000 7f07c5162640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b7287360 0x5563b738a770 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.609+0000 7f07c5162640 1 -- 172.21.15.173:0/3996707485 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b7287360 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.609+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b7387d40 con 0x5563b7287360 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.609+0000 7f07c5162640 1 -- 172.21.15.173:0/3996707485 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b7287360 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.609+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b738d070 0x5563b738f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.609+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b738fb50 con 0x5563b738d070 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.609+0000 7f07c4961640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b738d070 0x5563b738f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.609+0000 7f07c4961640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b738d070 0x5563b738f460 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.610+0000 7f07c4961640 1 -- 172.21.15.173:0/3996707485 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07b4075030 con 0x5563b738d070 2024-05-15T18:09:19.590 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.610+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b738c020 con 0x5563b7287360 2024-05-15T18:09:19.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.610+0000 7f07c5162640 1 -- 172.21.15.173:0/3996707485 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b7287360 2024-05-15T18:09:19.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.610+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5563b7391000 0x5563b7393450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.610+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b7393bb0 con 0x5563b7391000 2024-05-15T18:09:19.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.610+0000 7f07c4160640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5563b7391000 0x5563b7393450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.611+0000 7f07c4160640 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5563b7391000 0x5563b7393450 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.611+0000 7f07c4160640 1 -- 172.21.15.173:0/3996707485 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07ac00f690 con 0x5563b7391000 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.611+0000 7f07c6e62800 1 Processor -- start 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.611+0000 7f07c6e62800 1 -- start start 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.611+0000 7f07c6e62800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73a2010 0x5563b73a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.611+0000 7f07c6e62800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5563b7179cf0 con 0x5563b73a2010 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73a2010 0x5563b73a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73a2010 0x5563b73a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49390/0 (socket says 172.21.15.173:49390) 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f07c4961640 1 -- 172.21.15.173:0/1408555920 learned_addr learned my addr 172.21.15.173:0/1408555920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f07c4961640 1 -- 172.21.15.173:0/1408555920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b73a2970 con 0x5563b73a2010 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f07c4961640 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73a2010 0x5563b73a2430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f07b408c080 tx=0x7f07b4076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f06aa7fc640 1 -- 172.21.15.173:0/1408555920 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b4076a30 con 0x5563b73a2010 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f06aa7fc640 1 -- 172.21.15.173:0/1408555920 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b4007df0 con 0x5563b73a2010 2024-05-15T18:09:19.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563b73a33e0 con 0x5563b73a2010 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f06aa7fc640 1 -- 172.21.15.173:0/1408555920 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b40080d0 con 0x5563b73a2010 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.612+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b73a38e0 con 0x5563b73a2010 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.613+0000 7f06aa7fc640 1 -- 172.21.15.173:0/1408555920 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f07b4077a70 con 0x5563b73a2010 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.613+0000 7f06aa7fc640 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f069c036900 0x7f069c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.613+0000 7f06aa7fc640 1 -- 172.21.15.173:0/1408555920 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f07b4002000 con 0x5563b73a2010 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.613+0000 7f07c4160640 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f069c036900 0x7f069c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c6e62800 1 Processor -- start 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c6e62800 1 -- start start 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c4160640 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f069c036900 0x7f069c038dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5563b738b620 tx=0x7f07ac00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c6e62800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c6e62800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5563b737c330 con 0x5563b73af110 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49392/0 (socket says 172.21.15.173:49392) 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c4961640 1 -- 172.21.15.173:0/537108868 learned_addr learned my addr 172.21.15.173:0/537108868 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c4961640 1 -- 172.21.15.173:0/537108868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b73afb00 con 0x5563b73af110 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.614+0000 7f07c4961640 1 --2- 172.21.15.173:0/537108868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73af530 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f07b405cfd0 tx=0x7f07b405c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4591634b01d762a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f069bfff640 1 -- 172.21.15.173:0/537108868 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b4079400 con 0x5563b73af110 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f069bfff640 1 -- 172.21.15.173:0/537108868 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b4077d60 con 0x5563b73af110 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f069bfff640 1 -- 172.21.15.173:0/537108868 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b405cc00 con 0x5563b73af110 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 -- 172.21.15.173:0/537108868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 msgr2=0x5563b73af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 --2- 172.21.15.173:0/537108868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73af530 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f07b405cfd0 tx=0x7f07b405c870 comp rx=0 tx=0).stop 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 -- 172.21.15.173:0/537108868 shutdown_connections 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 --2- 172.21.15.173:0/537108868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73af530 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 -- 172.21.15.173:0/537108868 >> 172.21.15.173:0/537108868 conn(0x5563b73ab420 msgr2=0x5563b73a9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 -- 172.21.15.173:0/537108868 shutdown_connections 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 -- 172.21.15.173:0/537108868 wait complete. 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 Processor -- start 2024-05-15T18:09:19.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 -- start start 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.615+0000 7f07c6e62800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c6e62800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5563b73b0190 con 0x5563b73af110 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c4961640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49402/0 (socket says 172.21.15.173:49402) 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 learned_addr learned my addr 172.21.15.173:0/3656942071 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b73b6a60 con 0x5563b73af110 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c4961640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73b6520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f07b404d020 tx=0x7f07b4087f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f069a7fc640 1 -- 172.21.15.173:0/3656942071 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b40ba070 con 0x5563b73af110 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f069a7fc640 1 -- 172.21.15.173:0/3656942071 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b405d720 con 0x5563b73af110 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563b73b6a60 con 0x5563b73af110 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f069a7fc640 1 -- 172.21.15.173:0/3656942071 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07b405da20 con 0x5563b73af110 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.616+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b73b6a60 con 0x5563b73af110 2024-05-15T18:09:19.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.617+0000 7f069a7fc640 1 -- 172.21.15.173:0/3656942071 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f07b40bd070 con 0x5563b73af110 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f069a7fc640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0690036900 0x7f0690038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f069a7fc640 1 -- 172.21.15.173:0/3656942071 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f07b40b6c10 con 0x5563b73af110 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f07c4160640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0690036900 0x7f0690038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f07c4160640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0690036900 0x7f0690038dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5563b7393fb0 tx=0x7f07ac010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b73c1bc0 0x5563b73c4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c47d0 con 0x5563b73c1bc0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f07c5162640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b73c1bc0 0x5563b73c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.618+0000 7f07c5162640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b73c1bc0 0x5563b73c4080 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 realm 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c4be0 con 0x5563b73c1bc0 2024-05-15T18:09:19.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c54b0 con 0x5563b73c1bc0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b73c65b0 0x5563b73c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.619+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c8fb0 con 0x5563b73c65b0 2024-05-15T18:09:19.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c4961640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b73c65b0 0x5563b73c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c4961640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b73c65b0 0x5563b73c89a0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c6e62800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c6e62800 20 searching for the correct realm 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73ca8e0 con 0x5563b73c65b0 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c4961640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07b40bf060 0x7f07b40a2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.620+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73ca8e0 con 0x7f07b40bf060 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.621+0000 7f07c4160640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07b40bf060 0x7f07b40a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.621+0000 7f07c4160640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07b40bf060 0x7f07b40a2450 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.621+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.621+0000 7f07c4160640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07ac00f070 0x7f07ac02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.621+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73ca8e0 con 0x7f07ac00f070 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.621+0000 7f07c5162640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07ac00f070 0x7f07ac02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.622+0000 7f07c5162640 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07ac00f070 0x7f07ac02e910 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.622+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07bc00a4a0 con 0x7f07ac00f070 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.622+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.622+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.622+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.622+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.622+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07ac00f070 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x7f07ac00f070 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07ac00f070 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x7f07ac00f070 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07b40bf060 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.623+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07ac00f070 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x7f07ac00f070 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07b40bf060 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.624+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07ac00f070 2024-05-15T18:09:19.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x7f07ac00f070 2024-05-15T18:09:19.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.625+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07bc00a4a0 con 0x5563b73c1bc0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07ac00f070 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc033040 con 0x7f07ac00f070 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.626+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07b40bf060 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07ac00f070 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.627+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.628+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.628+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07ac00f070 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.628+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.628+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07b40bf060 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.628+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.628+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c65b0 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07b40bf060 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x5563b73c1bc0 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c5850 con 0x7f07b40bf060 2024-05-15T18:09:19.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.629+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c9870 con 0x5563b73c1bc0 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c9c60 con 0x5563b73c1bc0 2024-05-15T18:09:19.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73c9c60 con 0x7f07ac00f070 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 zone default found 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 4 Realm: () 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 zonegroup default 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.630+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cad60 con 0x7f07ac00f070 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cc740 con 0x5563b73c65b0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73ccae0 con 0x5563b73c65b0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 20 started sync module instance, tier type = 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:19.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.631+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cbbe0 con 0x7f07b40bf060 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.632+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.632+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93886764332848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cce80 con 0x7f07b40bf060 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.632+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cd6d0 con 0x5563b73c1bc0 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.633+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93886764332848] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.633+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.633+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93886764339744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cd640 con 0x5563b73c1bc0 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.633+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73ce5c0 con 0x5563b73c65b0 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.635+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93886764339744] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.635+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.635+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93886764342000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73ce5c0 con 0x5563b73c65b0 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.635+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cefc0 con 0x7f07b40bf060 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.636+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.636+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93886764346064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cf860 con 0x7f07b40bf060 2024-05-15T18:09:19.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.636+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d0360 con 0x5563b73c1bc0 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.636+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93886764342000] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.637+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93886764346064] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.637+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.637+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93886764348336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73ce110 con 0x5563b73c1bc0 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.637+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d0d70 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.638+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.638+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93886764353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d1190 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.638+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d1b90 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.638+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93886764348336] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.639+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93886764353728] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.639+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.639+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93886764351056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d0ce0 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.639+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d2220 con 0x7f07ac00f070 2024-05-15T18:09:19.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93886764351056] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93886764357280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d2220 con 0x7f07ac00f070 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 20 add_watcher() i=0 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 20 add_watcher() i=1 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 20 add_watcher() i=2 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 20 add_watcher() i=3 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 20 add_watcher() i=4 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 20 add_watcher() i=5 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.640+0000 7f07c6e62800 20 add_watcher() i=6 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.641+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93886764357280] v31'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.641+0000 7f07c6e62800 20 add_watcher() i=7 2024-05-15T18:09:19.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.641+0000 7f07c6e62800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.641+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d5370 con 0x5563b73c1bc0 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.642+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.642+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93886764359024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d2640 con 0x5563b73c1bc0 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.643+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93886764359024] v31'176 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.643+0000 7f067b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.643+0000 7f07c6e62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.643+0000 7f07c6e62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.643+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d4ba0 con 0x5563b73c1bc0 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.644+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.644+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73de480 con 0x7f07ac00f070 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.645+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.645+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73de880 con 0x5563b73c65b0 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.646+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.646+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73de7d0 con 0x5563b73c1bc0 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.647+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'177 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.647+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73deea0 con 0x7f07b40bf060 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.648+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.648+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73df770 con 0x5563b73c65b0 2024-05-15T18:09:19.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.649+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.649+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73df770 con 0x5563b73c1bc0 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.650+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.650+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73df770 con 0x7f07ac00f070 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.651+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.651+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73df820 con 0x7f07b40bf060 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.652+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.652+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73dfed0 con 0x5563b73c65b0 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.653+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.653+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73dfed0 con 0x7f07b40bf060 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.654+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.654+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07ac00f070 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.655+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.655+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07b40bf060 2024-05-15T18:09:19.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.656+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.656+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07ac00f070 2024-05-15T18:09:19.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.657+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.657+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c1bc0 2024-05-15T18:09:19.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.658+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'178 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.658+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.659+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.659+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07b40bf060 2024-05-15T18:09:19.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.660+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.660+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.661+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.661+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c1bc0 2024-05-15T18:09:19.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.663+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.663+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c1bc0 2024-05-15T18:09:19.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.664+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'179 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.664+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.665+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.665+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07b40bf060 2024-05-15T18:09:19.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.666+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.666+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.667+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.667+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.668+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.668+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.669+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.669+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.669+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.670+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07ac00f070 2024-05-15T18:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.670+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.671+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.671+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.671+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07ac00f070 2024-05-15T18:09:19.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.672+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.672+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x5563b73c65b0 2024-05-15T18:09:19.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.673+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.673+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07ac00f070 2024-05-15T18:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.674+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.674+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73e01b0 con 0x7f07b40bf060 2024-05-15T18:09:19.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.675+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f067a7e4640 20 reqs_thread_entry: start 2024-05-15T18:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f07c6e62800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f07c6e62800 20 Filter name: none 2024-05-15T18:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f06737fe640 20 reqs_thread_entry: start 2024-05-15T18:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f07c6e62800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f07c6e62800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b740b170 con 0x5563b73c1bc0 2024-05-15T18:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.676+0000 7f07c6e62800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.677+0000 7f07c6e62800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.677+0000 7f07c6e62800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:19.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.677+0000 7f07c6e62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.677+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5563b740b0f0 con 0x7f07b40bf060 2024-05-15T18:09:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.677+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-15T18:09:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.678+0000 7f067b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.678+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93886764359024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73bea30 con 0x5563b73c1bc0 2024-05-15T18:09:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.679+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93886764359024] v31'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.679+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93886764332848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d1d70 con 0x7f07b40bf060 2024-05-15T18:09:19.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.680+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93886764332848] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.680+0000 7f07c6e62800 20 remove_watcher() i=0 2024-05-15T18:09:19.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.680+0000 7f07c6e62800 2 removed watcher, disabling cache 2024-05-15T18:09:19.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.680+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93886764339744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d1d70 con 0x5563b73c1bc0 2024-05-15T18:09:19.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.681+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93886764339744] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.681+0000 7f07c6e62800 20 remove_watcher() i=1 2024-05-15T18:09:19.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.681+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93886764342000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d1d70 con 0x5563b73c65b0 2024-05-15T18:09:19.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.682+0000 7f07c4961640 1 -- 172.21.15.173:0/3656942071 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93886764342000] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07b40bc030 con 0x5563b73c65b0 2024-05-15T18:09:19.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.682+0000 7f07c6e62800 20 remove_watcher() i=2 2024-05-15T18:09:19.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.682+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93886764346064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cdaf0 con 0x7f07b40bf060 2024-05-15T18:09:19.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.683+0000 7f07c4160640 1 -- 172.21.15.173:0/3656942071 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93886764346064] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07ac037040 con 0x7f07b40bf060 2024-05-15T18:09:19.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.683+0000 7f07c6e62800 20 remove_watcher() i=3 2024-05-15T18:09:19.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.683+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93886764348336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d1d70 con 0x5563b73c1bc0 2024-05-15T18:09:19.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.684+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93886764348336] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x5563b73c1bc0 2024-05-15T18:09:19.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.684+0000 7f07c6e62800 20 remove_watcher() i=4 2024-05-15T18:09:19.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.684+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93886764353728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cf3b0 con 0x7f07ac00f070 2024-05-15T18:09:19.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.685+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93886764353728] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.685+0000 7f07c6e62800 20 remove_watcher() i=5 2024-05-15T18:09:19.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.685+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93886764351056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73d1d70 con 0x7f07ac00f070 2024-05-15T18:09:19.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.686+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93886764351056] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.686+0000 7f07c6e62800 20 remove_watcher() i=6 2024-05-15T18:09:19.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.686+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93886764357280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5563b73cf3b0 con 0x7f07ac00f070 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93886764357280] v31'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07bc031040 con 0x7f07ac00f070 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 20 remove_watcher() i=7 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07ac00f070 msgr2=0x7f07ac02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07ac00f070 0x7f07ac02e910 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b73c1bc0 msgr2=0x5563b73c4080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b73c1bc0 0x5563b73c4080 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07b40bf060 msgr2=0x7f07b40a2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07b40bf060 0x7f07b40a2450 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b73c65b0 msgr2=0x5563b73c89a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b73c65b0 0x5563b73c89a0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0690036900 msgr2=0x7f0690038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0690036900 0x7f0690038dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5563b7393fb0 tx=0x7f07ac010000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 msgr2=0x5563b73b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3656942071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73af110 0x5563b73b6520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f07b404d020 tx=0x7f07b4087f90 comp rx=0 tx=0).stop 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 reap_dead start 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c5162640 1 -- 172.21.15.173:0/3656942071 reap_dead start 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 shutdown_connections 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 >> 172.21.15.173:0/3656942071 conn(0x5563b73ab420 msgr2=0x5563b73a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 shutdown_connections 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.687+0000 7f07c6e62800 1 -- 172.21.15.173:0/3656942071 wait complete. 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f069c036900 msgr2=0x7f069c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f069c036900 0x7f069c038dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5563b738b620 tx=0x7f07ac00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73a2010 msgr2=0x5563b73a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73a2010 0x5563b73a2430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f07b408c080 tx=0x7f07b4076650 comp rx=0 tx=0).stop 2024-05-15T18:09:19.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 shutdown_connections 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f069c036900 0x7f069c038dc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/1408555920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b73a2010 0x5563b73a2430 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 >> 172.21.15.173:0/1408555920 conn(0x5563b73960b0 msgr2=0x5563b73964b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 shutdown_connections 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/1408555920 wait complete. 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5563b7391000 msgr2=0x5563b7393450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5563b7391000 0x5563b7393450 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b7287360 msgr2=0x5563b738a770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5563b7287360 0x5563b738a770 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b738d070 msgr2=0x5563b738f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5563b738d070 0x5563b738f460 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f06ac036900 msgr2=0x7f06ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f06ac036900 0x7f06ac038dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f07ac000f60 tx=0x7f07ac001370 comp rx=0 tx=0).stop 2024-05-15T18:09:19.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 msgr2=0x5563b7383530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 --2- 172.21.15.173:0/3996707485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5563b7286a00 0x5563b7383530 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f07b4000c00 tx=0x7f07b4003020 comp rx=0 tx=0).stop 2024-05-15T18:09:19.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c5162640 1 -- 172.21.15.173:0/3996707485 reap_dead start 2024-05-15T18:09:19.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 shutdown_connections 2024-05-15T18:09:19.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 >> 172.21.15.173:0/3996707485 conn(0x5563b72825a0 msgr2=0x5563b7375bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 shutdown_connections 2024-05-15T18:09:19.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.688+0000 7f07c6e62800 1 -- 172.21.15.173:0/3996707485 wait complete. 2024-05-15T18:09:19.674 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-15T18:09:19.684 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-05-15T18:09:19.688 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:19.714 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:19.724 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:19.770 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-15T18:09:19.774 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:19.775 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-15T18:09:19.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-15T18:09:19.775 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-15T18:09:19.820 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:19.820 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:19.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.843+0000 7f13a2238800 1 Processor -- start 2024-05-15T18:09:19.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f13a2238800 1 -- start start 2024-05-15T18:09:19.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f13a2238800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b4755d4fe0 0x55b4755d5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f13a2238800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4755d5a80 con 0x55b4755d6240 2024-05-15T18:09:19.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f13a2238800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55b475467050 con 0x55b4755d4fe0 2024-05-15T18:09:19.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f139fd37640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b4755d4fe0 0x55b4755d5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f139fd37640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b4755d4fe0 0x55b4755d5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49404/0 (socket says 172.21.15.173:49404) 2024-05-15T18:09:19.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f139fd37640 1 -- 172.21.15.173:0/543574527 learned_addr learned my addr 172.21.15.173:0/543574527 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f139f536640 1 --1- 172.21.15.173:0/543574527 >> v1:172.21.15.3:6789/0 conn(0x55b4755d6240 0x55b4755d66c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43254/0 (socket says 172.21.15.173:43254) 2024-05-15T18:09:19.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f139fd37640 1 -- 172.21.15.173:0/543574527 >> v1:172.21.15.3:6789/0 conn(0x55b4755d6240 legacy=0x55b4755d66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.844+0000 7f139fd37640 1 -- 172.21.15.173:0/543574527 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4755d6e00 con 0x55b4755d4fe0 2024-05-15T18:09:19.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.846+0000 7f139fd37640 1 --2- 172.21.15.173:0/543574527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4755d5400 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f139000a6b0 tx=0x7f139001eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2259e3fdeda7464f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f139ed35640 1 -- 172.21.15.173:0/543574527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f139004ce60 con 0x55b4755d4fe0 2024-05-15T18:09:19.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f139ed35640 1 -- 172.21.15.173:0/543574527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139000a200 con 0x55b4755d4fe0 2024-05-15T18:09:19.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f139ed35640 1 -- 172.21.15.173:0/543574527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390008590 con 0x55b4755d4fe0 2024-05-15T18:09:19.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f13a2238800 1 -- 172.21.15.173:0/543574527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 msgr2=0x55b4755d5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f13a2238800 1 --2- 172.21.15.173:0/543574527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4755d5400 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f139000a6b0 tx=0x7f139001eed0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f13a2238800 1 -- 172.21.15.173:0/543574527 shutdown_connections 2024-05-15T18:09:19.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f13a2238800 1 --2- 172.21.15.173:0/543574527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4755d5400 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f13a2238800 1 -- 172.21.15.173:0/543574527 >> 172.21.15.173:0/543574527 conn(0x55b4755d05c0 msgr2=0x55b4755d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f13a2238800 1 -- 172.21.15.173:0/543574527 shutdown_connections 2024-05-15T18:09:19.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.847+0000 7f13a2238800 1 -- 172.21.15.173:0/543574527 wait complete. 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.861+0000 7f13a2238800 1 Processor -- start 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.861+0000 7f13a2238800 1 -- start start 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.861+0000 7f13a2238800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.861+0000 7f13a2238800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b4755211c0 con 0x55b4755d4fe0 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.861+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.861+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49408/0 (socket says 172.21.15.173:49408) 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.861+0000 7f139fd37640 1 -- 172.21.15.173:0/2741838312 learned_addr learned my addr 172.21.15.173:0/2741838312 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.862+0000 7f139fd37640 1 -- 172.21.15.173:0/2741838312 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4756ca060 con 0x55b4755d4fe0 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.862+0000 7f139fd37640 1 --2- 172.21.15.173:0/2741838312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756c9a90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1390056040 tx=0x7f139004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e85b261dd0478 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.862+0000 7f128de0b640 1 -- 172.21.15.173:0/2741838312 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f139000a3b0 con 0x55b4755d4fe0 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.862+0000 7f128de0b640 1 -- 172.21.15.173:0/2741838312 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1390063070 con 0x55b4755d4fe0 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.862+0000 7f128de0b640 1 -- 172.21.15.173:0/2741838312 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390007560 con 0x55b4755d4fe0 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 -- 172.21.15.173:0/2741838312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 msgr2=0x55b4756c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 --2- 172.21.15.173:0/2741838312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756c9a90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1390056040 tx=0x7f139004e000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 -- 172.21.15.173:0/2741838312 shutdown_connections 2024-05-15T18:09:19.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 --2- 172.21.15.173:0/2741838312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756c9a90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 -- 172.21.15.173:0/2741838312 >> 172.21.15.173:0/2741838312 conn(0x55b4755d05c0 msgr2=0x55b4756c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 -- 172.21.15.173:0/2741838312 shutdown_connections 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 -- 172.21.15.173:0/2741838312 wait complete. 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 Processor -- start 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 -- start start 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f13a2238800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b475548550 con 0x55b4755d4fe0 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756d14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49410/0 (socket says 172.21.15.173:49410) 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.863+0000 7f139fd37640 1 -- 172.21.15.173:0/398819166 learned_addr learned my addr 172.21.15.173:0/398819166 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.864+0000 7f139fd37640 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4756d1a30 con 0x55b4755d4fe0 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.864+0000 7f139fd37640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756d14f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1390060040 tx=0x7f1390002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.864+0000 7f1287fff640 1 -- 172.21.15.173:0/398819166 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13900077c0 con 0x55b4755d4fe0 2024-05-15T18:09:19.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.864+0000 7f1287fff640 1 -- 172.21.15.173:0/398819166 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1390007980 con 0x55b4755d4fe0 2024-05-15T18:09:19.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.864+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4756d1cc0 con 0x55b4755d4fe0 2024-05-15T18:09:19.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.864+0000 7f1287fff640 1 -- 172.21.15.173:0/398819166 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390007ca0 con 0x55b4755d4fe0 2024-05-15T18:09:19.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.864+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4756d4920 con 0x55b4755d4fe0 2024-05-15T18:09:19.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.865+0000 7f1287fff640 1 -- 172.21.15.173:0/398819166 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f139007a430 con 0x55b4755d4fe0 2024-05-15T18:09:19.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.865+0000 7f1287fff640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1288036950 0x7f1288038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.865+0000 7f1287fff640 1 -- 172.21.15.173:0/398819166 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f139008e880 con 0x55b4755d4fe0 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.865+0000 7f139f536640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1288036950 0x7f1288038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.865+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4755d6240 0x55b4756d86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.865+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4756d8c60 con 0x55b4755d6240 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.865+0000 7f13a0538640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4755d6240 0x55b4756d86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.866+0000 7f139f536640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1288036950 0x7f1288038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1394000f60 tx=0x7f1394001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.866+0000 7f13a0538640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4755d6240 0x55b4756d86e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.866+0000 7f13a0538640 1 -- 172.21.15.173:0/398819166 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f139800a4a0 con 0x55b4755d6240 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.866+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4756d5cb0 con 0x55b4755d6240 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.866+0000 7f13a0538640 1 -- 172.21.15.173:0/398819166 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f139800a4a0 con 0x55b4755d6240 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.866+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4756daf90 0x55b4756dd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.866+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4756dda70 con 0x55b4756daf90 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.867+0000 7f139fd37640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4756daf90 0x55b4756dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.867+0000 7f139fd37640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4756daf90 0x55b4756dd380 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.867+0000 7f139fd37640 1 -- 172.21.15.173:0/398819166 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1390079d00 con 0x55b4756daf90 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.867+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4756d9f40 con 0x55b4755d6240 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.867+0000 7f13a0538640 1 -- 172.21.15.173:0/398819166 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f139800a4a0 con 0x55b4755d6240 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.867+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b4756deed0 0x55b4756e1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.867+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4756e1aa0 con 0x55b4756deed0 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.868+0000 7f139f536640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b4756deed0 0x55b4756e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.868+0000 7f139f536640 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b4756deed0 0x55b4756e1340 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.868+0000 7f139f536640 1 -- 172.21.15.173:0/398819166 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f139400f690 con 0x55b4756deed0 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f13a2238800 1 Processor -- start 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f13a2238800 1 -- start start 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f13a2238800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756eff50 0x55b4756f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f13a2238800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b4754c7cf0 con 0x55b4756eff50 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756eff50 0x55b4756f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756eff50 0x55b4756f0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49414/0 (socket says 172.21.15.173:49414) 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f139fd37640 1 -- 172.21.15.173:0/1336887043 learned_addr learned my addr 172.21.15.173:0/1336887043 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f139fd37640 1 -- 172.21.15.173:0/1336887043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4756f08b0 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.869+0000 7f139fd37640 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756eff50 0x55b4756f0370 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1390067bb0 tx=0x7f139007ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.870+0000 7f12857fa640 1 -- 172.21.15.173:0/1336887043 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390067d50 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.870+0000 7f12857fa640 1 -- 172.21.15.173:0/1336887043 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139008eb90 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.870+0000 7f12857fa640 1 -- 172.21.15.173:0/1336887043 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1390057bb0 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.870+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4756f1320 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.870+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4756f1820 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.870+0000 7f12857fa640 1 -- 172.21.15.173:0/1336887043 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1390057d50 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f12857fa640 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12780368b0 0x7f1278038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f12857fa640 1 -- 172.21.15.173:0/1336887043 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f1390081030 con 0x55b4756eff50 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f139f536640 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12780368b0 0x7f1278038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f13a2238800 1 Processor -- start 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f13a2238800 1 -- start start 2024-05-15T18:09:19.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f139f536640 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12780368b0 0x7f1278038d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b4756d9540 tx=0x7f139400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f13a2238800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b4756fd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f13a2238800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b4756ca320 con 0x55b4756fd170 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b4756fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b4756fd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49430/0 (socket says 172.21.15.173:49430) 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.871+0000 7f139fd37640 1 -- 172.21.15.173:0/233592363 learned_addr learned my addr 172.21.15.173:0/233592363 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f139fd37640 1 -- 172.21.15.173:0/233592363 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4756fdb60 con 0x55b4756fd170 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f139fd37640 1 --2- 172.21.15.173:0/233592363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b4756fd590 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1390067fc0 tx=0x7f1390070490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7decb98c8962d4e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f127effd640 1 -- 172.21.15.173:0/233592363 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13900a7070 con 0x55b4756fd170 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f127effd640 1 -- 172.21.15.173:0/233592363 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1390070ba0 con 0x55b4756fd170 2024-05-15T18:09:19.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f127effd640 1 -- 172.21.15.173:0/233592363 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f139009e040 con 0x55b4756fd170 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f13a2238800 1 -- 172.21.15.173:0/233592363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 msgr2=0x55b4756fd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f13a2238800 1 --2- 172.21.15.173:0/233592363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b4756fd590 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1390067fc0 tx=0x7f1390070490 comp rx=0 tx=0).stop 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f13a2238800 1 -- 172.21.15.173:0/233592363 shutdown_connections 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f13a2238800 1 --2- 172.21.15.173:0/233592363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b4756fd590 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f13a2238800 1 -- 172.21.15.173:0/233592363 >> 172.21.15.173:0/233592363 conn(0x55b4756f94d0 msgr2=0x55b4756f7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f13a2238800 1 -- 172.21.15.173:0/233592363 shutdown_connections 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.872+0000 7f13a2238800 1 -- 172.21.15.173:0/233592363 wait complete. 2024-05-15T18:09:19.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f13a2238800 1 Processor -- start 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f13a2238800 1 -- start start 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f13a2238800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b475704570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f13a2238800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b4756fe210 con 0x55b4756fd170 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b475704570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f139fd37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b475704570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49432/0 (socket says 172.21.15.173:49432) 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 learned_addr learned my addr 172.21.15.173:0/4142254473 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b475704ab0 con 0x55b4756fd170 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.873+0000 7f139fd37640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b475704570 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1390070720 tx=0x7f1390067f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.874+0000 7f127d7fa640 1 -- 172.21.15.173:0/4142254473 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13900b0020 con 0x55b4756fd170 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.874+0000 7f127d7fa640 1 -- 172.21.15.173:0/4142254473 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f139005e910 con 0x55b4756fd170 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.874+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b475704ab0 con 0x55b4756fd170 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.874+0000 7f127d7fa640 1 -- 172.21.15.173:0/4142254473 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13900a7040 con 0x55b4756fd170 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.874+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b475704ab0 con 0x55b4756fd170 2024-05-15T18:09:19.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.874+0000 7f127d7fa640 1 -- 172.21.15.173:0/4142254473 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13900b3020 con 0x55b4756fd170 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f127d7fa640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12680368b0 0x7f1268038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f127d7fa640 1 -- 172.21.15.173:0/4142254473 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f13900b6ba0 con 0x55b4756fd170 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f139f536640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12680368b0 0x7f1268038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f139f536640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12680368b0 0x7f1268038d70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55b4756d9f10 tx=0x7f1394010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b47570fc80 0x55b475712140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475712890 con 0x55b47570fc80 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.875+0000 7f13a0538640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b47570fc80 0x55b475712140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a0538640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b47570fc80 0x55b475712140 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 20 realm 2024-05-15T18:09:19.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475712ca0 con 0x55b47570fc80 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475713570 con 0x55b47570fc80 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.876+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f13a2238800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:19.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b475714670 0x55b475716a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475717020 con 0x55b475714670 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f139fd37640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b475714670 0x55b475716a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f139fd37640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b475714670 0x55b475716a60 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f13a2238800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f13a2238800 20 searching for the correct realm 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.877+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475718930 con 0x55b475714670 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139fd37640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f13900c0040 0x7f1390061350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475718930 con 0x7f13900c0040 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139f536640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f13900c0040 0x7f1390061350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139f536640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f13900c0040 0x7f1390061350 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.872 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139f536640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f139400f070 0x7f139402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475718930 con 0x7f139400f070 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.878+0000 7f13a0538640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f139400f070 0x7f139402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.879+0000 7f13a0538640 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f139400f070 0x7f139402e910 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.879+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f139800a4a0 con 0x7f139400f070 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.879+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f139400f070 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x7f139400f070 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f139400f070 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x7f139400f070 2024-05-15T18:09:19.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.880+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f13900c0040 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f139400f070 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x7f139400f070 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.881+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f13900c0040 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.882+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f139400f070 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.883+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x7f139400f070 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.883+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.883+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.883+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.883+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.883+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f139800a4a0 con 0x55b47570fc80 2024-05-15T18:09:19.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f139400f070 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1398033040 con 0x7f139400f070 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.884+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f13900c0040 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f139400f070 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.885+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f139400f070 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f13900c0040 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b475714670 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f13900c0040 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.886+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x55b47570fc80 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b475713910 con 0x7f13900c0040 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:19.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4757178e0 con 0x55b47570fc80 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475717cd0 con 0x55b47570fc80 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.887+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475717cd0 con 0x7f139400f070 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 zone default found 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 4 Realm: () 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 zonegroup default 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475717460 con 0x7f139400f070 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47571a790 con 0x55b475714670 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.888+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47571ab30 con 0x55b475714670 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.889+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.889+0000 7f13a2238800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.889+0000 7f13a2238800 20 started sync module instance, tier type = 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.889+0000 7f13a2238800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.889+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b475719c30 con 0x7f13900c0040 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.890+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.890+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233552852864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571aed0 con 0x7f13900c0040 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.890+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571b760 con 0x55b47570fc80 2024-05-15T18:09:19.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.891+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233552852864] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.891+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.891+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233552855120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571bb80 con 0x55b47570fc80 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.891+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571c580 con 0x55b475714670 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.892+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233552855120] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.892+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.892+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233552859760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571c9a0 con 0x55b475714670 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.892+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571d3e0 con 0x7f13900c0040 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.893+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.893+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233552869328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571e0a0 con 0x7f13900c0040 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.893+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571eb90 con 0x55b47570fc80 2024-05-15T18:09:19.889 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.894+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233552859760] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.894+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.894+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233552873056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571ef80 con 0x55b47570fc80 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.894+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571f9e0 con 0x7f139400f070 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.894+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233552869328] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.895+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.895+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233552873056] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.895+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233552870384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571f9e0 con 0x7f139400f070 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.895+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571c090 con 0x7f139400f070 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.897+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.897+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233552863376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4757203f0 con 0x7f139400f070 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.897+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b475720df0 con 0x7f139400f070 2024-05-15T18:09:19.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.897+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233552870384] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233552863376] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233552876736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571ff40 con 0x7f139400f070 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 20 add_watcher() i=0 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 20 add_watcher() i=1 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 20 add_watcher() i=2 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 20 add_watcher() i=3 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 20 add_watcher() i=4 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 20 add_watcher() i=5 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.898+0000 7f13a2238800 20 add_watcher() i=6 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.899+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233552876736] v31'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.899+0000 7f13a2238800 20 add_watcher() i=7 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.899+0000 7f13a2238800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.899+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47571ff40 con 0x55b47570fc80 2024-05-15T18:09:19.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.899+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.899+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233552881920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47571ff40 con 0x55b47570fc80 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233552881920] v31'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f1255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f13a2238800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f13a2238800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f13a2238800 5 note: GC not initialized 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f1254fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f13a2238800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f13a2238800 20 Filter name: none 2024-05-15T18:09:19.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.900+0000 7f11ce7fc640 20 reqs_thread_entry: start 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b475757770 con 0x7f13900c0040 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 : miss 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 20 rados->read ofs=0 len=0 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.901+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.1b 8:d9ecf54f:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4757595d0 con 0x7f13900c0040 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(63 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 info.flags=0x17 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 to cache LRU end 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 20 get_obj_state: octx=0x7f139800ab10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b47575bc98 s->prefetch_data=0 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 3.1b 3:dab366ce:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x55b475714670 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 10 manifest: total_size = 5 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.902+0000 7f13a2238800 20 get_obj_state: setting s->obj_tag to _NW1mP7mQoLXfDVtsmzE4-ySIzrMEo5E 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.903+0000 7f1255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.903+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233552881920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x55b47570fc80 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.904+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94233552881920] v31'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.904+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233552852864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x7f13900c0040 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.905+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94233552852864] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.905+0000 7f13a2238800 20 remove_watcher() i=0 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.905+0000 7f13a2238800 2 removed watcher, disabling cache 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.905+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233552855120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x55b47570fc80 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.906+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94233552855120] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.906+0000 7f13a2238800 20 remove_watcher() i=1 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.906+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233552859760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x55b475714670 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.907+0000 7f139fd37640 1 -- 172.21.15.173:0/4142254473 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94233552859760] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13900aa040 con 0x55b475714670 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.907+0000 7f13a2238800 20 remove_watcher() i=2 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.907+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233552869328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x7f13900c0040 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.908+0000 7f139f536640 1 -- 172.21.15.173:0/4142254473 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94233552869328] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1394037040 con 0x7f13900c0040 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.908+0000 7f13a2238800 20 remove_watcher() i=3 2024-05-15T18:09:19.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.908+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233552873056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x55b47570fc80 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.909+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94233552873056] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x55b47570fc80 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.909+0000 7f13a2238800 20 remove_watcher() i=4 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.909+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233552870384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x7f139400f070 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.910+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94233552870384] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.910+0000 7f13a2238800 20 remove_watcher() i=5 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.910+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233552863376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x7f139400f070 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.911+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94233552863376] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.911+0000 7f13a2238800 20 remove_watcher() i=6 2024-05-15T18:09:19.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.911+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233552876736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b47575cdc0 con 0x7f139400f070 2024-05-15T18:09:19.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94233552876736] v31'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1398031040 con 0x7f139400f070 2024-05-15T18:09:19.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 20 remove_watcher() i=7 2024-05-15T18:09:19.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f139400f070 msgr2=0x7f139402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f139400f070 0x7f139402e910 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b47570fc80 msgr2=0x55b475712140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b47570fc80 0x55b475712140 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f13900c0040 msgr2=0x7f1390061350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f13900c0040 0x7f1390061350 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b475714670 msgr2=0x55b475716a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b475714670 0x55b475716a60 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12680368b0 msgr2=0x7f1268038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12680368b0 0x7f1268038d70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55b4756d9f10 tx=0x7f1394010000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 msgr2=0x55b475704570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 --2- 172.21.15.173:0/4142254473 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756fd170 0x55b475704570 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1390070720 tx=0x7f1390067f50 comp rx=0 tx=0).stop 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 reap_dead start 2024-05-15T18:09:19.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a0538640 1 -- 172.21.15.173:0/4142254473 reap_dead start 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.912+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 shutdown_connections 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 >> 172.21.15.173:0/4142254473 conn(0x55b4756f94d0 msgr2=0x55b4756f6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 shutdown_connections 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/4142254473 wait complete. 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12780368b0 msgr2=0x7f1278038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12780368b0 0x7f1278038d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55b4756d9540 tx=0x7f139400f000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756eff50 msgr2=0x55b4756f0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756eff50 0x55b4756f0370 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1390067bb0 tx=0x7f139007ac90 comp rx=0 tx=0).stop 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 shutdown_connections 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f12780368b0 0x7f1278038d70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/1336887043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4756eff50 0x55b4756f0370 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 >> 172.21.15.173:0/1336887043 conn(0x55b4756e3ff0 msgr2=0x55b4756e43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 shutdown_connections 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/1336887043 wait complete. 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b4756deed0 msgr2=0x55b4756e1340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b4756deed0 0x55b4756e1340 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4755d6240 msgr2=0x55b4756d86e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4755d6240 0x55b4756d86e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4756daf90 msgr2=0x55b4756dd380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4756daf90 0x55b4756dd380 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1288036950 msgr2=0x7f1288038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1288036950 0x7f1288038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1394000f60 tx=0x7f1394001370 comp rx=0 tx=0).stop 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 msgr2=0x55b4756d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 --2- 172.21.15.173:0/398819166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b4755d4fe0 0x55b4756d14f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1390060040 tx=0x7f1390002fb0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a0538640 1 -- 172.21.15.173:0/398819166 reap_dead start 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 shutdown_connections 2024-05-15T18:09:19.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.913+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 >> 172.21.15.173:0/398819166 conn(0x55b4755d05c0 msgr2=0x55b4756bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.914+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 shutdown_connections 2024-05-15T18:09:19.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.914+0000 7f13a2238800 1 -- 172.21.15.173:0/398819166 wait complete. 2024-05-15T18:09:19.906 INFO:teuthology.orchestra.run.smithi173.stdout:fooFoofooFooFULL_CONTROL 2024-05-15T18:09:19.907 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-05-15T18:09:19.909 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-05-15T18:09:19.913 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:19.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-15T18:09:19.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-15T18:09:19.914 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-15T18:09:19.958 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:19.958 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:19.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24065a2800 1 Processor -- start 2024-05-15T18:09:19.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24065a2800 1 -- start start 2024-05-15T18:09:19.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24065a2800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x563dc84a7150 0x563dc84a7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24065a2800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563dc84a7bf0 con 0x563dc84a8360 2024-05-15T18:09:19.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24065a2800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x563dc8338050 con 0x563dc84a7150 2024-05-15T18:09:19.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24040a8640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x563dc84a7150 0x563dc84a7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24038a7640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x563dc84a8360 0x563dc84a87e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43264/0 (socket says 172.21.15.173:43264) 2024-05-15T18:09:19.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24038a7640 1 -- 172.21.15.173:0/1231507654 learned_addr learned my addr 172.21.15.173:0/1231507654 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:19.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.982+0000 7f24040a8640 1 -- 172.21.15.173:0/1231507654 >> v1:172.21.15.3:6789/0 conn(0x563dc84a8360 legacy=0x563dc84a87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.983+0000 7f24040a8640 1 -- 172.21.15.173:0/1231507654 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc84a8f20 con 0x563dc84a7150 2024-05-15T18:09:19.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.984+0000 7f24040a8640 1 --2- 172.21.15.173:0/1231507654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc84a7570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f23fc005fd0 tx=0x7f23fc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d241f61c8b5de6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.984+0000 7f24030a6640 1 -- 172.21.15.173:0/1231507654 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc052560 con 0x563dc84a7150 2024-05-15T18:09:19.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.984+0000 7f24030a6640 1 -- 172.21.15.173:0/1231507654 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc052700 con 0x563dc84a7150 2024-05-15T18:09:19.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24030a6640 1 -- 172.21.15.173:0/1231507654 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc052a60 con 0x563dc84a7150 2024-05-15T18:09:19.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24065a2800 1 -- 172.21.15.173:0/1231507654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 msgr2=0x563dc84a7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24065a2800 1 --2- 172.21.15.173:0/1231507654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc84a7570 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f23fc005fd0 tx=0x7f23fc01ccc0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24065a2800 1 -- 172.21.15.173:0/1231507654 shutdown_connections 2024-05-15T18:09:19.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24065a2800 1 --2- 172.21.15.173:0/1231507654 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc84a7570 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24065a2800 1 -- 172.21.15.173:0/1231507654 >> 172.21.15.173:0/1231507654 conn(0x563dc84a2790 msgr2=0x563dc84a4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24065a2800 1 -- 172.21.15.173:0/1231507654 shutdown_connections 2024-05-15T18:09:19.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.985+0000 7f24065a2800 1 -- 172.21.15.173:0/1231507654 wait complete. 2024-05-15T18:09:19.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.999+0000 7f24065a2800 1 Processor -- start 2024-05-15T18:09:19.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.999+0000 7f24065a2800 1 -- start start 2024-05-15T18:09:19.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.999+0000 7f24065a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.999+0000 7f24065a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563dc83f21c0 con 0x563dc84a7150 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.999+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.999+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49460/0 (socket says 172.21.15.173:49460) 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:19.999+0000 7f24040a8640 1 -- 172.21.15.173:0/1902394789 learned_addr learned my addr 172.21.15.173:0/1902394789 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.000+0000 7f24040a8640 1 -- 172.21.15.173:0/1902394789 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc8598da0 con 0x563dc84a7150 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.000+0000 7f24040a8640 1 --2- 172.21.15.173:0/1902394789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85987d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007000 tx=0x7f23fc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeeae1f541b44a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.000+0000 7f22f260c640 1 -- 172.21.15.173:0/1902394789 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc052cd0 con 0x563dc84a7150 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.000+0000 7f22f260c640 1 -- 172.21.15.173:0/1902394789 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc0528b0 con 0x563dc84a7150 2024-05-15T18:09:19.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.000+0000 7f22f260c640 1 -- 172.21.15.173:0/1902394789 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc05c430 con 0x563dc84a7150 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 -- 172.21.15.173:0/1902394789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 msgr2=0x563dc85987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 --2- 172.21.15.173:0/1902394789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85987d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f23fc007000 tx=0x7f23fc04c000 comp rx=0 tx=0).stop 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 -- 172.21.15.173:0/1902394789 shutdown_connections 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 --2- 172.21.15.173:0/1902394789 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85987d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 -- 172.21.15.173:0/1902394789 >> 172.21.15.173:0/1902394789 conn(0x563dc84a2790 msgr2=0x563dc85940f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 -- 172.21.15.173:0/1902394789 shutdown_connections 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 -- 172.21.15.173:0/1902394789 wait complete. 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 Processor -- start 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 -- start start 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24065a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563dc84b0830 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49468/0 (socket says 172.21.15.173:49468) 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.001+0000 7f24040a8640 1 -- 172.21.15.173:0/168188106 learned_addr learned my addr 172.21.15.173:0/168188106 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.002+0000 7f24040a8640 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc85a0770 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.002+0000 7f24040a8640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85a0230 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f23fc01b9b0 tx=0x7f23fc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.002+0000 7f22f0e09640 1 -- 172.21.15.173:0/168188106 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc074070 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.002+0000 7f22f0e09640 1 -- 172.21.15.173:0/168188106 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc06f430 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.002+0000 7f22f0e09640 1 -- 172.21.15.173:0/168188106 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc06f710 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.002+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563dc85a0a00 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.002+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dc85a36b0 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.003+0000 7f22f0e09640 1 -- 172.21.15.173:0/168188106 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23fc077070 con 0x563dc84a7150 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.003+0000 7f22f0e09640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22ec036900 0x7f22ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.003+0000 7f22f0e09640 1 -- 172.21.15.173:0/168188106 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f23fc06c050 con 0x563dc84a7150 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.003+0000 7f24038a7640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22ec036900 0x7f22ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.003+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc84a8360 0x563dc85a7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.003+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85a79b0 con 0x563dc84a8360 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.003+0000 7f24048a9640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc84a8360 0x563dc85a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24038a7640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22ec036900 0x7f22ec038dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000f60 tx=0x7f23ec0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24048a9640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc84a8360 0x563dc85a7470 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24048a9640 1 -- 172.21.15.173:0/168188106 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc84a8360 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85a4a20 con 0x563dc84a8360 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24048a9640 1 -- 172.21.15.173:0/168188106 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc84a8360 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85a9ce0 0x563dc85ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ac7c0 con 0x563dc85a9ce0 2024-05-15T18:09:19.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.004+0000 7f24040a8640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85a9ce0 0x563dc85ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.005+0000 7f24040a8640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85a9ce0 0x563dc85ac0d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.005+0000 7f24040a8640 1 -- 172.21.15.173:0/168188106 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f23fc076030 con 0x563dc85a9ce0 2024-05-15T18:09:19.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.005+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85a8c90 con 0x563dc84a8360 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.005+0000 7f24048a9640 1 -- 172.21.15.173:0/168188106 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc84a8360 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.005+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563dc85adc70 0x563dc85b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.005+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85b0830 con 0x563dc85adc70 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.006+0000 7f24038a7640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563dc85adc70 0x563dc85b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.006+0000 7f24038a7640 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563dc85adc70 0x563dc85b00a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.006+0000 7f24038a7640 1 -- 172.21.15.173:0/168188106 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f23ec009050 con 0x563dc85adc70 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24065a2800 1 Processor -- start 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24065a2800 1 -- start start 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24065a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85bec90 0x563dc85bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24065a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563dc8398cf0 con 0x563dc85bec90 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85bec90 0x563dc85bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85bec90 0x563dc85bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49470/0 (socket says 172.21.15.173:49470) 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24040a8640 1 -- 172.21.15.173:0/583112066 learned_addr learned my addr 172.21.15.173:0/583112066 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24040a8640 1 -- 172.21.15.173:0/583112066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc85bf5f0 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.007+0000 7f24040a8640 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85bec90 0x563dc85bf0b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f23fc08cce0 tx=0x7f23fc05b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.008+0000 7f22e9ffb640 1 -- 172.21.15.173:0/583112066 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc093070 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.008+0000 7f22e9ffb640 1 -- 172.21.15.173:0/583112066 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc0668b0 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.008+0000 7f22e9ffb640 1 -- 172.21.15.173:0/583112066 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc08ea60 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.008+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563dc85c0060 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.008+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dc85c0060 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.008+0000 7f22e9ffb640 1 -- 172.21.15.173:0/583112066 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23fc096070 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f22e9ffb640 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22dc036900 0x7f22dc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f22e9ffb640 1 -- 172.21.15.173:0/583112066 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f23fc084050 con 0x563dc85bec90 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24038a7640 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22dc036900 0x7f22dc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24065a2800 1 Processor -- start 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24065a2800 1 -- start start 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24038a7640 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22dc036900 0x7f22dc038dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00bf50 tx=0x7f23ec00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24065a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24065a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563dc85990c0 con 0x563dc85cbc00 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49486/0 (socket says 172.21.15.173:49486) 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.009+0000 7f24040a8640 1 -- 172.21.15.173:0/2516124242 learned_addr learned my addr 172.21.15.173:0/2516124242 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24040a8640 1 -- 172.21.15.173:0/2516124242 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc85cc5f0 con 0x563dc85cbc00 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24040a8640 1 --2- 172.21.15.173:0/2516124242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85cc020 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f23fc066a80 tx=0x7f23fc06e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941f0a7eb35d3b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f22db7fe640 1 -- 172.21.15.173:0/2516124242 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc0ac070 con 0x563dc85cbc00 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f22db7fe640 1 -- 172.21.15.173:0/2516124242 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc068df0 con 0x563dc85cbc00 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f22db7fe640 1 -- 172.21.15.173:0/2516124242 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc0a3040 con 0x563dc85cbc00 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24065a2800 1 -- 172.21.15.173:0/2516124242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 msgr2=0x563dc85cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24065a2800 1 --2- 172.21.15.173:0/2516124242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85cc020 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f23fc066a80 tx=0x7f23fc06e6d0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24065a2800 1 -- 172.21.15.173:0/2516124242 shutdown_connections 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24065a2800 1 --2- 172.21.15.173:0/2516124242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85cc020 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:19.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24065a2800 1 -- 172.21.15.173:0/2516124242 >> 172.21.15.173:0/2516124242 conn(0x563dc85c7f60 msgr2=0x563dc85c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.010+0000 7f24065a2800 1 -- 172.21.15.173:0/2516124242 shutdown_connections 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24065a2800 1 -- 172.21.15.173:0/2516124242 wait complete. 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24065a2800 1 Processor -- start 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24065a2800 1 -- start start 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24065a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85d3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24065a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563dc85ccca0 con 0x563dc85cbc00 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24040a8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85d3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49492/0 (socket says 172.21.15.173:49492) 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 learned_addr learned my addr 172.21.15.173:0/868914320 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.011+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dc85d3540 con 0x563dc85cbc00 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.012+0000 7f24040a8640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85d3000 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f23fc08efd0 tx=0x7f23fc094ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.012+0000 7f22d9ffb640 1 -- 172.21.15.173:0/868914320 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc0b6020 con 0x563dc85cbc00 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.012+0000 7f22d9ffb640 1 -- 172.21.15.173:0/868914320 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc0ad040 con 0x563dc85cbc00 2024-05-15T18:09:19.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.012+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563dc85d3540 con 0x563dc85cbc00 2024-05-15T18:09:19.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.012+0000 7f22d9ffb640 1 -- 172.21.15.173:0/868914320 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23fc0ac030 con 0x563dc85cbc00 2024-05-15T18:09:19.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.012+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dc85d3540 con 0x563dc85cbc00 2024-05-15T18:09:19.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f22d9ffb640 1 -- 172.21.15.173:0/868914320 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23fc0b9020 con 0x563dc85cbc00 2024-05-15T18:09:19.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f22d9ffb640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22cc0368b0 0x7f22cc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:19.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f22d9ffb640 1 -- 172.21.15.173:0/868914320 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f23fc0bcba0 con 0x563dc85cbc00 2024-05-15T18:09:19.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f24038a7640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22cc0368b0 0x7f22cc038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f24038a7640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22cc0368b0 0x7f22cc038d70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f23ec001b60 tx=0x7f23ec010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc85de7b0 0x563dc85e0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.013+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e13c0 con 0x563dc85de7b0 2024-05-15T18:09:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24048a9640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc85de7b0 0x563dc85e0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24048a9640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc85de7b0 0x563dc85e0c70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 20 realm 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e17d0 con 0x563dc85de7b0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85de7b0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.009 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.014+0000 7f24065a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e2440 con 0x563dc85de7b0 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85e2e00 0x563dc85e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e5840 con 0x563dc85e2e00 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24040a8640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85e2e00 0x563dc85e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24040a8640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85e2e00 0x563dc85e51f0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 20 searching for the correct realm 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.015+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e7150 con 0x563dc85e2e00 2024-05-15T18:09:20.010 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24040a8640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f23fc0c6040 0x7f23fc0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e7150 con 0x7f23fc0c6040 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24038a7640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f23fc0c6040 0x7f23fc0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24038a7640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f23fc0c6040 0x7f23fc0b28a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23ec009050 con 0x7f23fc0c6040 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24038a7640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f23ec038040 0x7f23ec01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.016+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e7150 con 0x7f23ec038040 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.017+0000 7f24048a9640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f23ec038040 0x7f23ec01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.017+0000 7f24048a9640 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f23ec038040 0x7f23ec01bab0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.017+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.017+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85de7b0 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85de7b0 2024-05-15T18:09:20.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x7f23ec038040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x7f23ec038040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.018+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x7f23fc0c6040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23ec009050 con 0x7f23fc0c6040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85e2e00 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85de7b0 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x7f23ec038040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.019+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85de7b0 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x7f23fc0c6040 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f23ec009050 con 0x7f23fc0c6040 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85e2e00 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85e2e00 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.020+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x7f23ec038040 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85e2e00 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85e2e00 2024-05-15T18:09:20.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85de7b0 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85de7b0 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.021+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x7f23ec038040 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85e2e00 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x7f23fc0c6040 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23ec009050 con 0x7f23fc0c6040 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85de7b0 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.022+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x7f23ec038040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.023+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.023+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85e2e00 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.023+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.023+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x7f23ec038040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.023+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.023+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x7f23fc0c6040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.023+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23ec009050 con 0x7f23fc0c6040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85e2e00 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x7f23fc0c6040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x563dc85de7b0 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f23f4026040 con 0x7f23fc0c6040 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.024+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85de7b0 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x563dc85de7b0 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e20a0 con 0x7f23ec038040 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 zone default found 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 4 Realm: () 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 zonegroup default 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e6120 con 0x7f23ec038040 2024-05-15T18:09:20.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.025+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e5c70 con 0x563dc85e2e00 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24065a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e60d0 con 0x563dc85e2e00 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24065a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24065a2800 20 started sync module instance, tier type = 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24065a2800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.026+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e8450 con 0x7f23fc0c6040 2024-05-15T18:09:20.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.027+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.027+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94823354630048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e8e20 con 0x7f23fc0c6040 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.027+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e9910 con 0x563dc85de7b0 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.028+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94823354630048] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.028+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.028+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94823354635232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e9d00 con 0x563dc85de7b0 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.028+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ea780 con 0x563dc85e2e00 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.030+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94823354635232] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.030+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.030+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94823354638960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85eab70 con 0x563dc85e2e00 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.030+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85eb570 con 0x7f23fc0c6040 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.031+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.031+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94823354638960] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.031+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94823354644880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ec260 con 0x7f23fc0c6040 2024-05-15T18:09:20.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.031+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85e8890 con 0x563dc85de7b0 2024-05-15T18:09:20.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.032+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94823354644880] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.032+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.032+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94823354645936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ecc50 con 0x563dc85de7b0 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.032+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ed610 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.033+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.033+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94823354645936] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.033+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94823354650976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ed580 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.033+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ec7a0 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.034+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94823354650976] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.034+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.034+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94823354648480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ee020 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.034+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ee9e0 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94823354648480] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94823354652928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85ee9e0 con 0x7f23ec038040 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 20 add_watcher() i=0 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 20 add_watcher() i=1 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 20 add_watcher() i=2 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 20 add_watcher() i=3 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 20 add_watcher() i=4 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 20 add_watcher() i=5 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.035+0000 7f24065a2800 20 add_watcher() i=6 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.037+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94823354652928] v31'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.037+0000 7f24065a2800 20 add_watcher() i=7 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.037+0000 7f24065a2800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.037+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc85f1d00 con 0x563dc85de7b0 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.037+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.037+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94823354656416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc85eef70 con 0x563dc85de7b0 2024-05-15T18:09:20.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.038+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94823354656416] v31'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.038+0000 7f22ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.038+0000 7f24065a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.038+0000 7f24065a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.038+0000 7f24065a2800 5 note: GC not initialized 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.038+0000 7f22b97e2640 20 reqs_thread_entry: start 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.038+0000 7f24065a2800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 20 Filter name: none 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f222affd640 20 reqs_thread_entry: start 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc8625850 con 0x7f23fc0c6040 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:20.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 : miss 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.1b 8:d9ecf54f:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc8627710 con 0x7f23fc0c6040 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(63 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 info.flags=0x17 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 to cache LRU end 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 20 get_obj_state: octx=0x7f23f4008ce0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563dc8629dd8 s->prefetch_data=0 2024-05-15T18:09:20.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.039+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 3.1b 3:dab366ce:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563dc862af50 con 0x563dc85e2e00 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.040+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.040+0000 7f24065a2800 10 manifest: total_size = 5 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.040+0000 7f24065a2800 20 get_obj_state: setting s->obj_tag to _bKb7jiRbhovYzY5lWVedgKDG64S-xvn 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.041+0000 7f22ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.041+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94823354656416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x563dc85de7b0 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.042+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94823354656416] v31'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.042+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94823354630048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x7f23fc0c6040 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.042+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94823354630048] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.042+0000 7f24065a2800 20 remove_watcher() i=0 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.042+0000 7f24065a2800 2 removed watcher, disabling cache 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.043+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94823354635232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc8627100 con 0x563dc85de7b0 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.044+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94823354635232] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.044+0000 7f24065a2800 20 remove_watcher() i=1 2024-05-15T18:09:20.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.044+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94823354638960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x563dc85e2e00 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.045+0000 7f24040a8640 1 -- 172.21.15.173:0/868914320 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94823354638960] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23fc095030 con 0x563dc85e2e00 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.045+0000 7f24065a2800 20 remove_watcher() i=2 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.045+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94823354644880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x7f23fc0c6040 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.046+0000 7f24038a7640 1 -- 172.21.15.173:0/868914320 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94823354644880] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23ec045040 con 0x7f23fc0c6040 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.046+0000 7f24065a2800 20 remove_watcher() i=3 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.046+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94823354645936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x563dc85de7b0 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.047+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94823354645936] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x563dc85de7b0 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.047+0000 7f24065a2800 20 remove_watcher() i=4 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.047+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94823354650976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x7f23ec038040 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.048+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94823354650976] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.048+0000 7f24065a2800 20 remove_watcher() i=5 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.048+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94823354648480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x7f23ec038040 2024-05-15T18:09:20.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.049+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94823354648480] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.049+0000 7f24065a2800 20 remove_watcher() i=6 2024-05-15T18:09:20.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.049+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94823354652928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563dc86231c0 con 0x7f23ec038040 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94823354652928] v31'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23f40083e0 con 0x7f23ec038040 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 20 remove_watcher() i=7 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f23ec038040 msgr2=0x7f23ec01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f23ec038040 0x7f23ec01bab0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc85de7b0 msgr2=0x563dc85e0c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc85de7b0 0x563dc85e0c70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f23fc0c6040 msgr2=0x7f23fc0b28a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f23fc0c6040 0x7f23fc0b28a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85e2e00 msgr2=0x563dc85e51f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85e2e00 0x563dc85e51f0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22cc0368b0 msgr2=0x7f22cc038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22cc0368b0 0x7f22cc038d70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f23ec001b60 tx=0x7f23ec010000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 msgr2=0x563dc85d3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 --2- 172.21.15.173:0/868914320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85cbc00 0x563dc85d3000 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f23fc08efd0 tx=0x7f23fc094ec0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 reap_dead start 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24048a9640 1 -- 172.21.15.173:0/868914320 reap_dead start 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 shutdown_connections 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 >> 172.21.15.173:0/868914320 conn(0x563dc85c7f60 msgr2=0x563dc85c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 shutdown_connections 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.050+0000 7f24065a2800 1 -- 172.21.15.173:0/868914320 wait complete. 2024-05-15T18:09:20.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22dc036900 msgr2=0x7f22dc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22dc036900 0x7f22dc038dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00bf50 tx=0x7f23ec00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85bec90 msgr2=0x563dc85bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85bec90 0x563dc85bf0b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f23fc08cce0 tx=0x7f23fc05b630 comp rx=0 tx=0).stop 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 shutdown_connections 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22dc036900 0x7f22dc038dc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/583112066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc85bec90 0x563dc85bf0b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 >> 172.21.15.173:0/583112066 conn(0x563dc85b2d30 msgr2=0x563dc85b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 shutdown_connections 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/583112066 wait complete. 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563dc85adc70 msgr2=0x563dc85b00a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x563dc85adc70 0x563dc85b00a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc84a8360 msgr2=0x563dc85a7470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x563dc84a8360 0x563dc85a7470 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85a9ce0 msgr2=0x563dc85ac0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x563dc85a9ce0 0x563dc85ac0d0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22ec036900 msgr2=0x7f22ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f22ec036900 0x7f22ec038dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f23ec000f60 tx=0x7f23ec0012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 msgr2=0x563dc85a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 --2- 172.21.15.173:0/168188106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dc84a7150 0x563dc85a0230 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f23fc01b9b0 tx=0x7f23fc003330 comp rx=0 tx=0).stop 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24048a9640 1 -- 172.21.15.173:0/168188106 reap_dead start 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 shutdown_connections 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 >> 172.21.15.173:0/168188106 conn(0x563dc84a2790 msgr2=0x563dc85928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 shutdown_connections 2024-05-15T18:09:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.051+0000 7f24065a2800 1 -- 172.21.15.173:0/168188106 wait complete. 2024-05-15T18:09:20.040 INFO:teuthology.orchestra.run.smithi173.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-15T18:09:20.040 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-15T18:09:20.042 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-05-15T18:09:20.061 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:20.163 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-15T18:09:20.163 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-15T18:09:20.163 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-15T18:09:20.163 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-15T18:09:20.163 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-15T18:09:20.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-15T18:09:20.164 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-05-15T18:09:20.209 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:20.209 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.232+0000 7f6e2c719800 1 Processor -- start 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.232+0000 7f6e2c719800 1 -- start start 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.232+0000 7f6e2c719800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x556b7d94ac00 0x556b7d94cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.232+0000 7f6e2c719800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b7d951040 con 0x556b7d94d530 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.232+0000 7f6e2c719800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x556b7d7db050 con 0x556b7d94ac00 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.233+0000 7f6e2a218640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x556b7d94ac00 0x556b7d94cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.233+0000 7f6e29a17640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x556b7d94d530 0x556b7d94f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43266/0 (socket says 172.21.15.173:43266) 2024-05-15T18:09:20.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.233+0000 7f6e29a17640 1 -- 172.21.15.173:0/2636048269 learned_addr learned my addr 172.21.15.173:0/2636048269 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.233+0000 7f6e2a218640 1 -- 172.21.15.173:0/2636048269 >> v1:172.21.15.3:6789/0 conn(0x556b7d94d530 legacy=0x556b7d94f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.233+0000 7f6e2a218640 1 -- 172.21.15.173:0/2636048269 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7d952220 con 0x556b7d94ac00 2024-05-15T18:09:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2a218640 1 --2- 172.21.15.173:0/2636048269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7d94cff0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c005fd0 tx=0x7f6e1c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c13f4ccb40abd3f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e29216640 1 -- 172.21.15.173:0/2636048269 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c052560 con 0x556b7d94ac00 2024-05-15T18:09:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e29216640 1 -- 172.21.15.173:0/2636048269 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c052700 con 0x556b7d94ac00 2024-05-15T18:09:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e29216640 1 -- 172.21.15.173:0/2636048269 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c052a60 con 0x556b7d94ac00 2024-05-15T18:09:20.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2c719800 1 -- 172.21.15.173:0/2636048269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 msgr2=0x556b7d94cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2c719800 1 --2- 172.21.15.173:0/2636048269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7d94cff0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c005fd0 tx=0x7f6e1c01ccc0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2c719800 1 -- 172.21.15.173:0/2636048269 shutdown_connections 2024-05-15T18:09:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2c719800 1 --2- 172.21.15.173:0/2636048269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7d94cff0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2c719800 1 -- 172.21.15.173:0/2636048269 >> 172.21.15.173:0/2636048269 conn(0x556b7d9445b0 msgr2=0x556b7d9469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2c719800 1 -- 172.21.15.173:0/2636048269 shutdown_connections 2024-05-15T18:09:20.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.235+0000 7f6e2c719800 1 -- 172.21.15.173:0/2636048269 wait complete. 2024-05-15T18:09:20.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.249+0000 7f6e2c719800 1 Processor -- start 2024-05-15T18:09:20.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.249+0000 7f6e2c719800 1 -- start start 2024-05-15T18:09:20.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.249+0000 7f6e2c719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da3b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.249+0000 7f6e2c719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556b7d8951c0 con 0x556b7d94ac00 2024-05-15T18:09:20.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da3b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da3b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49520/0 (socket says 172.21.15.173:49520) 2024-05-15T18:09:20.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6e2a218640 1 -- 172.21.15.173:0/1077004694 learned_addr learned my addr 172.21.15.173:0/1077004694 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6e2a218640 1 -- 172.21.15.173:0/1077004694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7da3bc20 con 0x556b7d94ac00 2024-05-15T18:09:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6e2a218640 1 --2- 172.21.15.173:0/1077004694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da3b650 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007000 tx=0x7f6e1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec6317c90a01603 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6d18608640 1 -- 172.21.15.173:0/1077004694 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c052cd0 con 0x556b7d94ac00 2024-05-15T18:09:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6d18608640 1 -- 172.21.15.173:0/1077004694 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0528b0 con 0x556b7d94ac00 2024-05-15T18:09:20.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.250+0000 7f6d18608640 1 -- 172.21.15.173:0/1077004694 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c05c430 con 0x556b7d94ac00 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 -- 172.21.15.173:0/1077004694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 msgr2=0x556b7da3b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 --2- 172.21.15.173:0/1077004694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da3b650 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c007000 tx=0x7f6e1c04c000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 -- 172.21.15.173:0/1077004694 shutdown_connections 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 --2- 172.21.15.173:0/1077004694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da3b650 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 -- 172.21.15.173:0/1077004694 >> 172.21.15.173:0/1077004694 conn(0x556b7d9445b0 msgr2=0x556b7da36f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 -- 172.21.15.173:0/1077004694 shutdown_connections 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 -- 172.21.15.173:0/1077004694 wait complete. 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.251+0000 7f6e2c719800 1 Processor -- start 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2c719800 1 -- start start 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2c719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da43190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2c719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556b7d9514b0 con 0x556b7d94ac00 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da43190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da43190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49524/0 (socket says 172.21.15.173:49524) 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2a218640 1 -- 172.21.15.173:0/605163548 learned_addr learned my addr 172.21.15.173:0/605163548 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2a218640 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7da436d0 con 0x556b7d94ac00 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6e2a218640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da43190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c000f80 tx=0x7f6e1c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.252+0000 7f6d16e05640 1 -- 172.21.15.173:0/605163548 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c073020 con 0x556b7d94ac00 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.253+0000 7f6d16e05640 1 -- 172.21.15.173:0/605163548 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c06f3f0 con 0x556b7d94ac00 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.253+0000 7f6d16e05640 1 -- 172.21.15.173:0/605163548 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c06f6f0 con 0x556b7d94ac00 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.253+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b7da43960 con 0x556b7d94ac00 2024-05-15T18:09:20.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.253+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b7da46570 con 0x556b7d94ac00 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.253+0000 7f6d16e05640 1 -- 172.21.15.173:0/605163548 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e1c06f960 con 0x556b7d94ac00 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6d16e05640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d10036900 0x7f6d10038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6d16e05640 1 -- 172.21.15.173:0/605163548 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f6e1c06c050 con 0x556b7d94ac00 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e29a17640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d10036900 0x7f6d10038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7d94d530 0x556b7da4a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da4a900 con 0x556b7d94d530 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e2aa19640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7d94d530 0x556b7da4a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e29a17640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d10036900 0x7f6d10038dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000f60 tx=0x7f6e200012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e2aa19640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7d94d530 0x556b7da4a330 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e2aa19640 1 -- 172.21.15.173:0/605163548 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7d94d530 2024-05-15T18:09:20.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.254+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da478e0 con 0x556b7d94d530 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.255+0000 7f6e2aa19640 1 -- 172.21.15.173:0/605163548 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7d94d530 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.255+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da4cc10 0x556b7da4f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.255+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da4f6f0 con 0x556b7da4cc10 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.255+0000 7f6e2a218640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da4cc10 0x556b7da4f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.255+0000 7f6e2a218640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da4cc10 0x556b7da4f000 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.255+0000 7f6e2a218640 1 -- 172.21.15.173:0/605163548 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e1c080040 con 0x556b7da4cc10 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.255+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da4bb90 con 0x556b7d94d530 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.256+0000 7f6e2aa19640 1 -- 172.21.15.173:0/605163548 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7d94d530 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.256+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556b7da50b50 0x556b7da52f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.256+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da536e0 con 0x556b7da50b50 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.256+0000 7f6e29a17640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556b7da50b50 0x556b7da52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.256+0000 7f6e29a17640 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556b7da50b50 0x556b7da52f80 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e29a17640 1 -- 172.21.15.173:0/605163548 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e20009050 con 0x556b7da50b50 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e2c719800 1 Processor -- start 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e2c719800 1 -- start start 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e2c719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da61b40 0x556b7da61f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e2c719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556b7d83bcf0 con 0x556b7da61b40 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da61b40 0x556b7da61f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da61b40 0x556b7da61f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49530/0 (socket says 172.21.15.173:49530) 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.257+0000 7f6e2a218640 1 -- 172.21.15.173:0/2482531504 learned_addr learned my addr 172.21.15.173:0/2482531504 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.258+0000 7f6e2a218640 1 -- 172.21.15.173:0/2482531504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7da624a0 con 0x556b7da61b40 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.258+0000 7f6e2a218640 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da61b40 0x556b7da61f60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c08cfa0 tx=0x7f6e1c06eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.258+0000 7f6d0ffff640 1 -- 172.21.15.173:0/2482531504 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c05bb00 con 0x556b7da61b40 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.258+0000 7f6d0ffff640 1 -- 172.21.15.173:0/2482531504 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c092070 con 0x556b7da61b40 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.258+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b7da62f10 con 0x556b7da61b40 2024-05-15T18:09:20.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.258+0000 7f6d0ffff640 1 -- 172.21.15.173:0/2482531504 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c05bdd0 con 0x556b7da61b40 2024-05-15T18:09:20.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.258+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b7da63410 con 0x556b7da61b40 2024-05-15T18:09:20.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.259+0000 7f6d0ffff640 1 -- 172.21.15.173:0/2482531504 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e1c078400 con 0x556b7da61b40 2024-05-15T18:09:20.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.259+0000 7f6d0ffff640 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d04036860 0x7f6d04038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.259+0000 7f6d0ffff640 1 -- 172.21.15.173:0/2482531504 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f6e1c097bb0 con 0x556b7da61b40 2024-05-15T18:09:20.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.259+0000 7f6e29a17640 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d04036860 0x7f6d04038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.259+0000 7f6e2c719800 1 Processor -- start 2024-05-15T18:09:20.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e29a17640 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d04036860 0x7f6d04038d20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000bf50 tx=0x7f6e2000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2c719800 1 -- start start 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2c719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da6f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2c719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556b7da3bf40 con 0x556b7da6ecf0 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da6f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da6f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49546/0 (socket says 172.21.15.173:49546) 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2a218640 1 -- 172.21.15.173:0/3495205471 learned_addr learned my addr 172.21.15.173:0/3495205471 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2a218640 1 -- 172.21.15.173:0/3495205471 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7da6f6e0 con 0x556b7da6ecf0 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.260+0000 7f6e2a218640 1 --2- 172.21.15.173:0/3495205471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da6f110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c08eaf0 tx=0x7f6e1c086f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafc07406493dd51 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6d0dffb640 1 -- 172.21.15.173:0/3495205471 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c0513e0 con 0x556b7da6ecf0 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6d0dffb640 1 -- 172.21.15.173:0/3495205471 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c089d80 con 0x556b7da6ecf0 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6d0dffb640 1 -- 172.21.15.173:0/3495205471 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c051800 con 0x556b7da6ecf0 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 -- 172.21.15.173:0/3495205471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 msgr2=0x556b7da6f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3495205471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da6f110 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c08eaf0 tx=0x7f6e1c086f70 comp rx=0 tx=0).stop 2024-05-15T18:09:20.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 -- 172.21.15.173:0/3495205471 shutdown_connections 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3495205471 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da6f110 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 -- 172.21.15.173:0/3495205471 >> 172.21.15.173:0/3495205471 conn(0x556b7da6afc0 msgr2=0x556b7da69020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 -- 172.21.15.173:0/3495205471 shutdown_connections 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 -- 172.21.15.173:0/3495205471 wait complete. 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 Processor -- start 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.261+0000 7f6e2c719800 1 -- start start 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.262+0000 7f6e2c719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da75ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.262+0000 7f6e2c719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556b7da6fd40 con 0x556b7da6ecf0 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.262+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da75ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.262+0000 7f6e2a218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da75ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49562/0 (socket says 172.21.15.173:49562) 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.262+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 learned_addr learned my addr 172.21.15.173:0/3739068221 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.262+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b7da76530 con 0x556b7da6ecf0 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.262+0000 7f6e2a218640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da75ff0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c08ec70 tx=0x7f6e1c091fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.263+0000 7f6cfbfff640 1 -- 172.21.15.173:0/3739068221 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c0bb070 con 0x556b7da6ecf0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.263+0000 7f6cfbfff640 1 -- 172.21.15.173:0/3739068221 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c051ac0 con 0x556b7da6ecf0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.263+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b7da76530 con 0x556b7da6ecf0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.263+0000 7f6cfbfff640 1 -- 172.21.15.173:0/3739068221 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c004600 con 0x556b7da6ecf0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.263+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b7da76530 con 0x556b7da6ecf0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.263+0000 7f6cfbfff640 1 -- 172.21.15.173:0/3739068221 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e1c0be070 con 0x556b7da6ecf0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6cfbfff640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6cf4036900 0x7f6cf4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6cfbfff640 1 -- 172.21.15.173:0/3739068221 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f6e1c0a7070 con 0x556b7da6ecf0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6e29a17640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6cf4036900 0x7f6cf4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6e29a17640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6cf4036900 0x7f6cf4038dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e20001b60 tx=0x7f6e20010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7da81860 0x556b7da83d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da84470 con 0x556b7da81860 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.264+0000 7f6e2aa19640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7da81860 0x556b7da83d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2aa19640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7da81860 0x556b7da83d20 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 20 realm 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da848a0 con 0x556b7da81860 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da81860 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.265+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85510 con 0x556b7da81860 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2c719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da85ed0 0x556b7da882c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da888d0 con 0x556b7da85ed0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2a218640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da85ed0 0x556b7da882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2a218640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da85ed0 0x556b7da882c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2c719800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2c719800 20 searching for the correct realm 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8a1c0 con 0x556b7da85ed0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.266+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e2a218640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6e1c0c0060 0x7f6e1c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8a1c0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e29a17640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6e1c0c0060 0x7f6e1c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e29a17640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6e1c0c0060 0x7f6e1c0b2540 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20009050 con 0x7f6e1c0c0060 2024-05-15T18:09:20.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e29a17640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6e20038040 0x7f6e2001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8a1c0 con 0x7f6e20038040 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.267+0000 7f6e2aa19640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6e20038040 0x7f6e2001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.268+0000 7f6e2aa19640 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6e20038040 0x7f6e2001bab0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.268+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.268+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da81860 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.268+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.268+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da81860 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.268+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.268+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x7f6e20038040 2024-05-15T18:09:20.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x7f6e20038040 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x7f6e1c0c0060 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20009050 con 0x7f6e1c0c0060 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da85ed0 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da81860 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.269+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.270+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x7f6e20038040 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.270+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.270+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da81860 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.270+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.270+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x7f6e1c0c0060 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.270+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e20009050 con 0x7f6e1c0c0060 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.270+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da85ed0 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da85ed0 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x7f6e20038040 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da85ed0 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.271+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da85ed0 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da81860 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da81860 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x7f6e20038040 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.272+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da85ed0 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20009050 con 0x7f6e1c0c0060 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da81860 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x7f6e20038040 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.273+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da85ed0 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.274+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.274+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x7f6e20038040 2024-05-15T18:09:20.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.274+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.274+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.274+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20009050 con 0x7f6e1c0c0060 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.274+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da85ed0 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x556b7da81860 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f6e24026040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da81860 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.275+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da85170 con 0x556b7da81860 2024-05-15T18:09:20.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da88c70 con 0x7f6e20038040 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 zone default found 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 4 Realm: () 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 zonegroup default 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da890a0 con 0x7f6e20038040 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.276+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da894e0 con 0x556b7da85ed0 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8c020 con 0x556b7da85ed0 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2c719800 20 started sync module instance, tier type = 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2c719800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.277+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da890a0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.278+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.278+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920158068752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8ba20 con 0x7f6e1c0c0060 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.278+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8c8b0 con 0x556b7da81860 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.279+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920158068752] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.279+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.279+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920158070064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8cca0 con 0x556b7da81860 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.279+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8d6e0 con 0x556b7da85ed0 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.280+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.280+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920158077360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8df80 con 0x556b7da85ed0 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.280+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8ea80 con 0x7f6e1c0c0060 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.281+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920158070064] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.281+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920158077360] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.282+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.282+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920158082416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8ee70 con 0x7f6e1c0c0060 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.282+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8f720 con 0x556b7da81860 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.283+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.283+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920158085648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8ffc0 con 0x556b7da81860 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.283+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da90aa0 con 0x7f6e20038040 2024-05-15T18:09:20.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.283+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920158082416] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.283+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920158085648] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.284+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.284+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920158090672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8fa40 con 0x7f6e20038040 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.284+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da91340 con 0x7f6e20038040 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.285+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920158090672] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.285+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.285+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920158073792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da8fa40 con 0x7f6e20038040 2024-05-15T18:09:20.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.285+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da91960 con 0x7f6e20038040 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920158073792] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920158092864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da91960 con 0x7f6e20038040 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 20 add_watcher() i=0 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 20 add_watcher() i=1 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 20 add_watcher() i=2 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 20 add_watcher() i=3 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 20 add_watcher() i=4 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 20 add_watcher() i=5 2024-05-15T18:09:20.288 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.286+0000 7f6e2c719800 20 add_watcher() i=6 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.287+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920158092864] v31'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.287+0000 7f6e2c719800 20 add_watcher() i=7 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.287+0000 7f6e2c719800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.287+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7da94d60 con 0x556b7da81860 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.287+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.287+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920158094976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da92220 con 0x556b7da81860 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.289+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920158094976] v31'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.289+0000 7f6ce0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.289+0000 7f6e2c719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:20.289 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.289+0000 7f6e2c719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.289+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da94a40 con 0x556b7da81860 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.290+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.290+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9ddd0 con 0x7f6e20038040 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.291+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.291+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9ddd0 con 0x556b7da85ed0 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.292+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.292+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9e280 con 0x556b7da81860 2024-05-15T18:09:20.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.293+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'186 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.293+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9e7f0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.294+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.294+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9f040 con 0x556b7da85ed0 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.295+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.295+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9f040 con 0x556b7da81860 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.297+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.297+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9f0d0 con 0x7f6e20038040 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.298+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.298+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9f160 con 0x7f6e1c0c0060 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.299+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.299+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9f6d0 con 0x556b7da85ed0 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.300+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.300+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fb10 con 0x7f6e1c0c0060 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.301+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.301+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fdb0 con 0x7f6e20038040 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.302+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.302+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fdb0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.303+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.303+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fe40 con 0x7f6e20038040 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.304+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.304+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fe40 con 0x556b7da81860 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.305+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'187 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.305+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fe40 con 0x556b7da85ed0 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.306+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.306+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fe40 con 0x7f6e1c0c0060 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.307+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.307+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fe40 con 0x556b7da85ed0 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.308+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.308+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fe40 con 0x556b7da81860 2024-05-15T18:09:20.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.309+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.309+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fdb0 con 0x556b7da81860 2024-05-15T18:09:20.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.310+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'188 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.310+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fdb0 con 0x556b7da85ed0 2024-05-15T18:09:20.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.311+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.311+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x7f6e1c0c0060 2024-05-15T18:09:20.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.312+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.312+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x556b7da85ed0 2024-05-15T18:09:20.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.313+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.313+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x556b7da85ed0 2024-05-15T18:09:20.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.314+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.314+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x556b7da85ed0 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.315+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.315+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x556b7da85ed0 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.316+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.316+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x7f6e20038040 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.317+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.317+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x556b7da85ed0 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.318+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.318+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x7f6e20038040 2024-05-15T18:09:20.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.319+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.319+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x556b7da85ed0 2024-05-15T18:09:20.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.321+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.321+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x7f6e20038040 2024-05-15T18:09:20.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.322+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.322+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7da9fd60 con 0x7f6e1c0c0060 2024-05-15T18:09:20.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6c5b7fe640 20 reqs_thread_entry: start 2024-05-15T18:09:20.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6e2c719800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:20.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6e2c719800 20 Filter name: none 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6c597fa640 20 reqs_thread_entry: start 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6e2c719800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.323+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacaef0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 : miss 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 8.1b 8:d9ecf54f:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacc9c0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(95 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 info.flags=0x17 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 to cache LRU end 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:96 4.15 4:ab62f562:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x556b7da85ed0 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(96 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.324+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:97 4.4 4:220e892c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x7f6e20038040 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.325+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(97 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.325+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:98 4.17 4:ebf38d48:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x7f6e20038040 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.326+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(98 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2 [call out=425b] v0'0 uv8 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.326+0000 7f6e2c719800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-05-15T18:09:20.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.326+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:99 4.17 4:ea7b565c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x7f6e20038040 2024-05-15T18:09:20.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.326+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(99 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e240083e0 con 0x7f6e20038040 2024-05-15T18:09:20.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.326+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 4.22 4:46e46c33:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x556b7da81860 2024-05-15T18:09:20.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.326+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(100 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.326+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:101 4.12 4:4913bb4b:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x556b7da81860 2024-05-15T18:09:20.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.327+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(101 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e240083e0 con 0x556b7da81860 2024-05-15T18:09:20.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.327+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:102 4.1f 4:f9c6bb09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x556b7da85ed0 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.327+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(102 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.327+0000 7f6e2c719800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.327+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 4.1e 4:78d346d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x7f6e20038040 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.328+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(103 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.328+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:104 4.11 4:8884d3d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x7f6e20038040 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.328+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(104 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8 [call out=426b] v0'0 uv15 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.328+0000 7f6e2c719800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.328+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:105 4.3b 4:df3d92ea:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x556b7da85ed0 2024-05-15T18:09:20.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.328+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(105 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.328+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:106 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db4a1f0 con 0x556b7da81860 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(106 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:107 3.20 3:07729ef1:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db47f20 con 0x7f6e1c0c0060 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(107 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 10 manifest: total_size = 6 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.4727462597584296057 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 20 prepare_atomic_modification: state is not atomic. state=0x556b7db49a28 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.329+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:108 4.17 4:ebf38d48:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad1f90 con 0x7f6e20038040 2024-05-15T18:09:20.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.330+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(108 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2 [stat,call,call] v31'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.330+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:109 3.20 3:07729ef1:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad1f90 con 0x7f6e1c0c0060 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.331+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(109 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_9c8454ddf7aa50116496bac348d7550d [call] v31'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.331+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:110 4.17 4:ebf38d48:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2410 con 0x7f6e20038040 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:111 3.3f 3:fd73c0f3:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2410 con 0x7f6e1c0c0060 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(111 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 10 manifest: total_size = 3 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.3312706560669868728 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 20 prepare_atomic_modification: state is not atomic. state=0x556b7db49a28 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.332+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:112 4.1f 4:f9c6bb09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad6f30 con 0x556b7da85ed0 2024-05-15T18:09:20.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.333+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(110 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2 [stat,call,call] v31'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.333+0000 7f6d0dffb640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-05-15T18:09:20.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.333+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(112 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.333+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:113 3.3f 3:fd73c0f3:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dace8c0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(113 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_b1b9a972ccd8c962a473909b97007eb4 [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:114 4.1f 4:f9c6bb09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2ef0 con 0x556b7da85ed0 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:115 3.15 3:ab7280c3:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2ef0 con 0x7f6e1c0c0060 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(115 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 10 manifest: total_size = 4 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.16780577285391682773 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 20 prepare_atomic_modification: state is not atomic. state=0x556b7db49a28 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.334+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:116 4.11 4:8884d3d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2ef0 con 0x7f6e20038040 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.335+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(114 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.335+0000 7f6d0d7fa640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-05-15T18:09:20.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.336+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(116 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8 [stat,call,call] v31'16 uv16 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.336+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:117 3.15 3:ab7280c3:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2a40 con 0x7f6e1c0c0060 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(117 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v31'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:118 4.11 4:8884d3d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2ef0 con 0x7f6e20038040 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:119 3.11 3:8814ead1:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad2ef0 con 0x556b7da85ed0 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(119 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 10 manifest: total_size = 5 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.4470100020757203719 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 20 prepare_atomic_modification: state is not atomic. state=0x556b7db49a28 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.337+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:120 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad84c0 con 0x556b7da81860 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.338+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(118 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8 [stat,call,call] v31'17 uv17 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.338+0000 7f6d0dffb640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.338+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(120 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [stat,call,call] v31'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.338+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:121 3.11 3:8814ead1:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad8480 con 0x556b7da85ed0 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.339+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(121 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_24d27c169c2c881eb09a065116f2aa5c [call] v31'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.339+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:122 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacf8d0 con 0x556b7da81860 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.339+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.339+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:123 3.1b 3:dab366ce:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacf8d0 con 0x556b7da85ed0 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.340+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(123 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.340+0000 7f6e2c719800 10 manifest: total_size = 5 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.340+0000 7f6e2c719800 20 get_obj_state: setting s->obj_tag to _bKb7jiRbhovYzY5lWVedgKDG64S-xvn 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.340+0000 7f6e2c719800 20 get_obj_state: octx=0x7f6e24008d00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x556b7db49a28 s->prefetch_data=0 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.340+0000 7f6e2c719800 20 prepare_atomic_modification: state is not atomic. state=0x556b7db49a28 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.340+0000 7f6e2c719800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 2024-05-15T18:09:20.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.340+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:124 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacf8d0 con 0x556b7da81860 2024-05-15T18:09:20.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.341+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(122 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [stat,call,call] v31'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.341+0000 7f6d0d7fa640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.341+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(124 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [stat,call,call] v31'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.341+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:125 3.1b 3:dab366ce:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacfe90 con 0x556b7da85ed0 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(125 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5_bb3aec0fdcdbc2974890f805c585d432 [call] v31'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:126 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacfe90 con 0x556b7da81860 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 20 list_objects_ordered: starting attempt 1 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:127 4.15 4:ab62f562:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad0540 con 0x556b7da85ed0 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:128 4.4 4:220e892c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dacfcf0 con 0x7f6e20038040 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:129 4.17 4:ebf38d48:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db49cf0 con 0x7f6e20038040 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:130 4.17 4:ea7b565c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad0540 con 0x7f6e20038040 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:131 4.22 4:46e46c33:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dae04a0 con 0x556b7da81860 2024-05-15T18:09:20.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:132 4.12 4:4913bb4b:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dae2e00 con 0x556b7da81860 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:133 4.1f 4:f9c6bb09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dae58b0 con 0x556b7da85ed0 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:134 4.1e 4:78d346d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dae58b0 con 0x7f6e20038040 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:135 4.11 4:8884d3d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x7f6e20038040 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:136 4.3b 4:df3d92ea:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7daed570 con 0x556b7da85ed0 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.342+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:137 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x556b7da81860 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(131 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(127 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(128 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(133 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(129 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== osd_op_reply(136 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(132 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(134 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== osd_op_reply(135 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8 [call out=124b] v0'0 uv17 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(130 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(126 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [stat,call,call] v31'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.343+0000 7f6d0d7fa640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(137 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5])"; uploads.size()=0; is_truncated=0 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:138 4.15 4:ab62f562:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x556b7da85ed0 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:139 4.4 4:220e892c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e20038040 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:140 4.17 4:ebf38d48:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dae3290 con 0x7f6e20038040 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:141 4.17 4:ea7b565c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x7f6e20038040 2024-05-15T18:09:20.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:142 4.22 4:46e46c33:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da81860 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:143 4.12 4:4913bb4b:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x556b7da81860 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:144 4.1f 4:f9c6bb09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da85ed0 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:145 4.1e 4:78d346d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x7f6e20038040 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:146 4.11 4:8884d3d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dae3290 con 0x7f6e20038040 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:147 4.3b 4:df3d92ea:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dadc460 con 0x556b7da85ed0 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:148 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7dadede0 con 0x556b7da81860 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(138 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(139 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(140 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(145 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(142 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(141 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 40 ==== osd_op_reply(144 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== osd_op_reply(146 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8 [call out=124b] v0'0 uv17 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 41 ==== osd_op_reply(147 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== osd_op_reply(143 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(148 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.344+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.346+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== osd_op_reply(149 foo.buckets [call] v31'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.346+0000 7f6e2c719800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.346+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(150 myfoo [call,call,delete] v31'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e2c719800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e2c719800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:09:20.333 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93920158459760 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== watch-notify(notify (1) cookie 93920158073792 notify 133143986201 ret 0) ==== 191+0+0 (crc 0 0 0) 0x556b7da9eb90 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6d0dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986201 cookie 93920158073792 notifier 4643 bl.length()=149 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6d0dffb640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6cf0003d60 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(151 notify.6 [notify cookie 93920158459760 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.347+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== watch-notify(notify_complete (2) cookie 93920158459760 notify 133143986201 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b7da62f10 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.348+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:153 8.1b 8:d9ecf54f:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.348+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(153 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 [call,call,delete] v31'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 from cache 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5, ofs0, ns] 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 93920158459760 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 47 ==== watch-notify(notify (1) cookie 93920158092864 notify 133143986202 ret 0) ==== 248+0+0 (crc 0 0 0) 0x556b7da62f10 con 0x7f6e20038040 2024-05-15T18:09:20.334 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6d0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 93920158092864 notifier 4643 bl.length()=206 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6d0d7fa640 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f6c600032c0 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 48 ==== osd_op_reply(154 notify.7 [notify cookie 93920158459760 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 49 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 50 ==== watch-notify(notify_complete (2) cookie 93920158459760 notify 133143986202 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b7da94bd0 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:156 4.15 4:ab62f562:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da85ed0 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:157 4.4 4:220e892c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad0390 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:158 4.17 4:ebf38d48:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:159 4.17 4:ea7b565c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:160 4.22 4:46e46c33:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad0390 con 0x556b7da81860 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:161 4.12 4:4913bb4b:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da81860 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:162 4.1f 4:f9c6bb09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x556b7da85ed0 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:163 4.1e 4:78d346d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad0390 con 0x7f6e20038040 2024-05-15T18:09:20.335 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:164 4.11 4:8884d3d2:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7daea770 con 0x7f6e20038040 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:165 4.3b 4:df3d92ea:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da85ed0 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.349+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:166 4.32 4:4ffce811:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7dad0390 con 0x556b7da81860 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.351+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 51 ==== osd_op_reply(157 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.1 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.351+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(161 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.5 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.351+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== osd_op_reply(160 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.4 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.351+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 52 ==== osd_op_reply(164 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.8 [delete] v31'18 uv18 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.351+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 53 ==== osd_op_reply(158 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.2 [delete] v31'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.351+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 54 ==== osd_op_reply(163 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.7 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.336 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.351+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(166 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.10 [delete] v31'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.353+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 55 ==== osd_op_reply(159 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.3 [delete] v31'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.353+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 42 ==== osd_op_reply(165 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.9 [delete] v31'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.353+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 43 ==== osd_op_reply(156 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.0 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.353+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 44 ==== osd_op_reply(162 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5.6 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.353+0000 7f6e2c719800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 : miss 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.353+0000 7f6e2c719800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.353+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:167 6.5 6:a080bf76:::pubsub..bucket.myfoo%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.354+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== osd_op_reply(167 pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.354+0000 7f6e2c719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.354+0000 7f6e2c719800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 info.flags=0x0 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.354+0000 7f6e2c719800 10 adding default.rgw.log++pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 to cache LRU end 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.354+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:168 6.5 6:a080bf76:::pubsub..bucket.myfoo%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.355+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(168 pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.5 [delete] v31'16 uv15 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.355+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.356+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== osd_op_reply(169 foo.buckets [call] v31'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.357+0000 7f6ce0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.357+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920158094976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da81860 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.358+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93920158094976] v31'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.358+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920158068752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.359+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93920158068752] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.359+0000 7f6e2c719800 20 remove_watcher() i=0 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.359+0000 7f6e2c719800 2 removed watcher, disabling cache 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.359+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920158070064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da81860 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.360+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93920158070064] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.360+0000 7f6e2c719800 20 remove_watcher() i=1 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.360+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920158077360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da85ed0 2024-05-15T18:09:20.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.361+0000 7f6e2a218640 1 -- 172.21.15.173:0/3739068221 <== osd.3 v2:172.21.15.173:6814/3793320597 45 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93920158077360] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e1c0bd030 con 0x556b7da85ed0 2024-05-15T18:09:20.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.361+0000 7f6e2c719800 20 remove_watcher() i=2 2024-05-15T18:09:20.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.361+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920158082416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e1c0c0060 2024-05-15T18:09:20.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.362+0000 7f6e29a17640 1 -- 172.21.15.173:0/3739068221 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93920158082416] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e20045040 con 0x7f6e1c0c0060 2024-05-15T18:09:20.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.362+0000 7f6e2c719800 20 remove_watcher() i=3 2024-05-15T18:09:20.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.362+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920158085648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x556b7da81860 2024-05-15T18:09:20.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.363+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.1 v2:172.21.15.173:6800/3225970667 45 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93920158085648] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x556b7da81860 2024-05-15T18:09:20.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.363+0000 7f6e2c719800 20 remove_watcher() i=4 2024-05-15T18:09:20.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.363+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920158090672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e20038040 2024-05-15T18:09:20.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.364+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 56 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93920158090672] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.364+0000 7f6e2c719800 20 remove_watcher() i=5 2024-05-15T18:09:20.346 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.364+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920158073792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e20038040 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.365+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 57 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93920158073792] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.365+0000 7f6e2c719800 20 remove_watcher() i=6 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.365+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920158092864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556b7db48240 con 0x7f6e20038040 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 <== osd.0 v2:172.21.15.3:6800/774076599 58 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93920158092864] v31'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2403d060 con 0x7f6e20038040 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 20 remove_watcher() i=7 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6e20038040 msgr2=0x7f6e2001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f6e20038040 0x7f6e2001bab0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7da81860 msgr2=0x556b7da83d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7da81860 0x556b7da83d20 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6e1c0c0060 msgr2=0x7f6e1c0b2540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f6e1c0c0060 0x7f6e1c0b2540 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da85ed0 msgr2=0x556b7da882c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da85ed0 0x556b7da882c0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.347 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6cf4036900 msgr2=0x7f6cf4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6cf4036900 0x7f6cf4038dc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e20001b60 tx=0x7f6e20010000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 msgr2=0x556b7da75ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2aa19640 1 -- 172.21.15.173:0/3739068221 reap_dead start 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da75ff0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c08ec70 tx=0x7f6e1c091fc0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 shutdown_connections 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/3739068221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da6ecf0 0x556b7da75ff0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 >> 172.21.15.173:0/3739068221 conn(0x556b7da6afc0 msgr2=0x556b7da68620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 shutdown_connections 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/3739068221 wait complete. 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d04036860 msgr2=0x7f6d04038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.366+0000 7f6e2c719800 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d04036860 0x7f6d04038d20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e2000bf50 tx=0x7f6e2000f000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da61b40 msgr2=0x556b7da61f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da61b40 0x556b7da61f60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c08cfa0 tx=0x7f6e1c06eeb0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.348 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 shutdown_connections 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d04036860 0x7f6d04038d20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/2482531504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7da61b40 0x556b7da61f60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 >> 172.21.15.173:0/2482531504 conn(0x556b7da55be0 msgr2=0x556b7da55fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 shutdown_connections 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/2482531504 wait complete. 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556b7da50b50 msgr2=0x556b7da52f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556b7da50b50 0x556b7da52f80 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7d94d530 msgr2=0x556b7da4a330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556b7d94d530 0x556b7da4a330 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da4cc10 msgr2=0x556b7da4f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556b7da4cc10 0x556b7da4f000 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d10036900 msgr2=0x7f6d10038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6d10036900 0x7f6d10038dc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000f60 tx=0x7f6e200012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 msgr2=0x556b7da43190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 --2- 172.21.15.173:0/605163548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b7d94ac00 0x556b7da43190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c000f80 tx=0x7f6e1c003330 comp rx=0 tx=0).stop 2024-05-15T18:09:20.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2aa19640 1 -- 172.21.15.173:0/605163548 reap_dead start 2024-05-15T18:09:20.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 shutdown_connections 2024-05-15T18:09:20.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 >> 172.21.15.173:0/605163548 conn(0x556b7d9445b0 msgr2=0x556b7da35770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 shutdown_connections 2024-05-15T18:09:20.350 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.367+0000 7f6e2c719800 1 -- 172.21.15.173:0/605163548 wait complete. 2024-05-15T18:09:20.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-15T18:09:20.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-15T18:09:20.354 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-05-15T18:09:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:20.401 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:20.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe7a4727800 1 Processor -- start 2024-05-15T18:09:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe7a4727800 1 -- start start 2024-05-15T18:09:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe7a4727800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b48636e710 0x55b486370b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe7a4727800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b486371040 con 0x55b48636ac00 2024-05-15T18:09:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe7a4727800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55b4861fb050 con 0x55b48636e710 2024-05-15T18:09:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe797fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55b48636e710 0x55b486370b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe7a03a7640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55b48636ac00 0x55b48636cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43270/0 (socket says 172.21.15.173:43270) 2024-05-15T18:09:20.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.425+0000 7fe7a03a7640 1 -- 172.21.15.173:0/4050384848 learned_addr learned my addr 172.21.15.173:0/4050384848 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.426+0000 7fe797fff640 1 -- 172.21.15.173:0/4050384848 >> v1:172.21.15.3:6789/0 conn(0x55b48636ac00 legacy=0x55b48636cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.426+0000 7fe797fff640 1 -- 172.21.15.173:0/4050384848 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b486372220 con 0x55b48636e710 2024-05-15T18:09:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.427+0000 7fe797fff640 1 --2- 172.21.15.173:0/4050384848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636e710 0x55b486370b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe78800a470 tx=0x7fe78801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd4742ceae01217 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe79fba6640 1 -- 172.21.15.173:0/4050384848 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe788057070 con 0x55b48636e710 2024-05-15T18:09:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe79fba6640 1 -- 172.21.15.173:0/4050384848 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe788052570 con 0x55b48636e710 2024-05-15T18:09:20.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe79fba6640 1 -- 172.21.15.173:0/4050384848 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe788052870 con 0x55b48636e710 2024-05-15T18:09:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe7a4727800 1 -- 172.21.15.173:0/4050384848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636e710 msgr2=0x55b486370b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4050384848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636e710 0x55b486370b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe78800a470 tx=0x7fe78801ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:20.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe7a4727800 1 -- 172.21.15.173:0/4050384848 shutdown_connections 2024-05-15T18:09:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4050384848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636e710 0x55b486370b00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe7a4727800 1 -- 172.21.15.173:0/4050384848 >> 172.21.15.173:0/4050384848 conn(0x55b4863645b0 msgr2=0x55b4863669d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe7a4727800 1 -- 172.21.15.173:0/4050384848 shutdown_connections 2024-05-15T18:09:20.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.428+0000 7fe7a4727800 1 -- 172.21.15.173:0/4050384848 wait complete. 2024-05-15T18:09:20.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.441+0000 7fe7a4727800 1 Processor -- start 2024-05-15T18:09:20.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.442+0000 7fe7a4727800 1 -- start start 2024-05-15T18:09:20.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.442+0000 7fe7a4727800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48645b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.442+0000 7fe7a4727800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b4862b51c0 con 0x55b48636ac00 2024-05-15T18:09:20.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.442+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48645b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.442+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48645b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49572/0 (socket says 172.21.15.173:49572) 2024-05-15T18:09:20.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.442+0000 7fe7a03a7640 1 -- 172.21.15.173:0/3908645121 learned_addr learned my addr 172.21.15.173:0/3908645121 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.420 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.442+0000 7fe7a03a7640 1 -- 172.21.15.173:0/3908645121 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b48645bcf0 con 0x55b48636ac00 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/3908645121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48645b720 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe790001de0 tx=0x7fe79000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272412e6c61a1593 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe68e60c640 1 -- 172.21.15.173:0/3908645121 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe790012020 con 0x55b48636ac00 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe68e60c640 1 -- 172.21.15.173:0/3908645121 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79000e5a0 con 0x55b48636ac00 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe68e60c640 1 -- 172.21.15.173:0/3908645121 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe79000e8c0 con 0x55b48636ac00 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a4727800 1 -- 172.21.15.173:0/3908645121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 msgr2=0x55b48645b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a4727800 1 --2- 172.21.15.173:0/3908645121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48645b720 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe790001de0 tx=0x7fe79000b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a4727800 1 -- 172.21.15.173:0/3908645121 shutdown_connections 2024-05-15T18:09:20.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a4727800 1 --2- 172.21.15.173:0/3908645121 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48645b720 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a4727800 1 -- 172.21.15.173:0/3908645121 >> 172.21.15.173:0/3908645121 conn(0x55b4863645b0 msgr2=0x55b486457040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a4727800 1 -- 172.21.15.173:0/3908645121 shutdown_connections 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.443+0000 7fe7a4727800 1 -- 172.21.15.173:0/3908645121 wait complete. 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a4727800 1 Processor -- start 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a4727800 1 -- start start 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a4727800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48636a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a4727800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b486371510 con 0x55b48636ac00 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48636a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48636a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49586/0 (socket says 172.21.15.173:49586) 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a03a7640 1 -- 172.21.15.173:0/4245206548 learned_addr learned my addr 172.21.15.173:0/4245206548 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.444+0000 7fe7a03a7640 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b486368c30 con 0x55b48636ac00 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.445+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48636a540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe790001de0 tx=0x7fe790000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.445+0000 7fe68ce09640 1 -- 172.21.15.173:0/4245206548 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe790012030 con 0x55b48636ac00 2024-05-15T18:09:20.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.445+0000 7fe68ce09640 1 -- 172.21.15.173:0/4245206548 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79001a7a0 con 0x55b48636ac00 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.445+0000 7fe68ce09640 1 -- 172.21.15.173:0/4245206548 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe79001aac0 con 0x55b48636ac00 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.445+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b486368ec0 con 0x55b48636ac00 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.445+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4863693e0 con 0x55b48636ac00 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe68ce09640 1 -- 172.21.15.173:0/4245206548 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe790015020 con 0x55b48636ac00 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe68ce09640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe688036950 0x7fe688038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe68ce09640 1 -- 172.21.15.173:0/4245206548 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fe790020070 con 0x55b48636ac00 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe797fff640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe688036950 0x7fe688038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b48636e710 0x55b48646c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b48646cbe0 con 0x55b48636e710 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe7a0ba8640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b48636e710 0x55b48646c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe797fff640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe688036950 0x7fe688038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe788054000 tx=0x7fe78804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.446+0000 7fe7a0ba8640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b48636e710 0x55b48646c660 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.447+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/4245206548 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b48636e710 2024-05-15T18:09:20.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.447+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b48646d4f0 con 0x55b48636e710 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.447+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/4245206548 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b48636e710 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.447+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b48646ef70 0x55b486471430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.447+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b486471bc0 con 0x55b48646ef70 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.447+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b48646ef70 0x55b486471430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.447+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b48646ef70 0x55b486471430 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.448+0000 7fe7a03a7640 1 -- 172.21.15.173:0/4245206548 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe790024980 con 0x55b48646ef70 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.448+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b48646dd70 con 0x55b48636e710 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.448+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/4245206548 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b48636e710 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.448+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b486473070 0x55b4864754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.448+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b486475c40 con 0x55b486473070 2024-05-15T18:09:20.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.448+0000 7fe797fff640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b486473070 0x55b4864754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.448+0000 7fe797fff640 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b486473070 0x55b4864754e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe797fff640 1 -- 172.21.15.173:0/4245206548 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe78805a040 con 0x55b486473070 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe7a4727800 1 Processor -- start 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe7a4727800 1 -- start start 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe7a4727800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486484050 0x55b486484470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe7a4727800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b48636aa80 con 0x55b486484050 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486484050 0x55b486484470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486484050 0x55b486484470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49596/0 (socket says 172.21.15.173:49596) 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.449+0000 7fe7a03a7640 1 -- 172.21.15.173:0/3143021640 learned_addr learned my addr 172.21.15.173:0/3143021640 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.450+0000 7fe7a03a7640 1 -- 172.21.15.173:0/3143021640 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4864849b0 con 0x55b486484050 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.450+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486484050 0x55b486484470 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe79001a6f0 tx=0x7fe790044500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.450+0000 7fe685ffb640 1 -- 172.21.15.173:0/3143021640 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe79003c070 con 0x55b486484050 2024-05-15T18:09:20.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.450+0000 7fe685ffb640 1 -- 172.21.15.173:0/3143021640 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe790044ac0 con 0x55b486484050 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.450+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b486485420 con 0x55b486484050 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.450+0000 7fe685ffb640 1 -- 172.21.15.173:0/3143021640 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7900166e0 con 0x55b486484050 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.450+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b486485920 con 0x55b486484050 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.451+0000 7fe685ffb640 1 -- 172.21.15.173:0/3143021640 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe79003f070 con 0x55b486484050 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.451+0000 7fe685ffb640 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe6780369c0 0x7fe678038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.451+0000 7fe685ffb640 1 -- 172.21.15.173:0/3143021640 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fe790039080 con 0x55b486484050 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.451+0000 7fe797fff640 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe6780369c0 0x7fe678038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.451+0000 7fe7a4727800 1 Processor -- start 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.451+0000 7fe7a4727800 1 -- start start 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.451+0000 7fe797fff640 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe6780369c0 0x7fe678038e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55b486369900 tx=0x7fe788005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe7a4727800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486491560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe7a4727800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b48625bcf0 con 0x55b486491140 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486491560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486491560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49608/0 (socket says 172.21.15.173:49608) 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe7a03a7640 1 -- 172.21.15.173:0/1436504392 learned_addr learned my addr 172.21.15.173:0/1436504392 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe7a03a7640 1 -- 172.21.15.173:0/1436504392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b486491b30 con 0x55b486491140 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/1436504392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486491560 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe79001dfd0 tx=0x7fe790022a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedf1ffb19e0664d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe67f7fe640 1 -- 172.21.15.173:0/1436504392 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe790022360 con 0x55b486491140 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe67f7fe640 1 -- 172.21.15.173:0/1436504392 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79004ddf0 con 0x55b486491140 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.452+0000 7fe67f7fe640 1 -- 172.21.15.173:0/1436504392 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe79004c770 con 0x55b486491140 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 -- 172.21.15.173:0/1436504392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 msgr2=0x55b486491560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 --2- 172.21.15.173:0/1436504392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486491560 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe79001dfd0 tx=0x7fe790022a10 comp rx=0 tx=0).stop 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 -- 172.21.15.173:0/1436504392 shutdown_connections 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 --2- 172.21.15.173:0/1436504392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486491560 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 -- 172.21.15.173:0/1436504392 >> 172.21.15.173:0/1436504392 conn(0x55b48648d4a0 msgr2=0x55b48648b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 -- 172.21.15.173:0/1436504392 shutdown_connections 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 -- 172.21.15.173:0/1436504392 wait complete. 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 Processor -- start 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 -- start start 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486498360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a4727800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b486492060 con 0x55b486491140 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486498360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a03a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486498360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49610/0 (socket says 172.21.15.173:49610) 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.453+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 learned_addr learned my addr 172.21.15.173:0/801582218 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.454+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4864988a0 con 0x55b486491140 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.454+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486498360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe790000fb0 tx=0x7fe790050f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.454+0000 7fe67dffb640 1 -- 172.21.15.173:0/801582218 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe790022b80 con 0x55b486491140 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.454+0000 7fe67dffb640 1 -- 172.21.15.173:0/801582218 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe790022d60 con 0x55b486491140 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.454+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4864988a0 con 0x55b486491140 2024-05-15T18:09:20.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.454+0000 7fe67dffb640 1 -- 172.21.15.173:0/801582218 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7900169f0 con 0x55b486491140 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.454+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4864988a0 con 0x55b486491140 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.455+0000 7fe67dffb640 1 -- 172.21.15.173:0/801582218 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe790068070 con 0x55b486491140 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.455+0000 7fe67dffb640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe670036950 0x7fe670038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.455+0000 7fe67dffb640 1 -- 172.21.15.173:0/801582218 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fe790065050 con 0x55b486491140 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.455+0000 7fe797fff640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe670036950 0x7fe670038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe797fff640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe670036950 0x7fe670038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55b486476040 tx=0x7fe78804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4864a3b50 0x55b4864a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a6760 con 0x55b4864a3b50 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a0ba8640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4864a3b50 0x55b4864a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a0ba8640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4864a3b50 0x55b4864a6010 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a4727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a4727800 20 realm 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.456+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a6b70 con 0x55b4864a3b50 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a7440 con 0x55b4864a3b50 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x55b4864a3b50 2024-05-15T18:09:20.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4864a8540 0x55b4864aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864aaf40 con 0x55b4864a8540 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4864a8540 0x55b4864aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.457+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4864a8540 0x55b4864aa930 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe7a4727800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe7a4727800 20 searching for the correct realm 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ac870 con 0x55b4864a8540 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe7a03a7640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe79004cc20 0x7fe79006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ac870 con 0x7fe79004cc20 2024-05-15T18:09:20.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe797fff640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe79004cc20 0x7fe79006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.458+0000 7fe797fff640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe79004cc20 0x7fe79006a8e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.459+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.459+0000 7fe797fff640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe788074040 0x7fe788081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.459+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ac870 con 0x7fe788074040 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.459+0000 7fe7a0ba8640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe788074040 0x7fe788081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.459+0000 7fe7a0ba8640 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe788074040 0x7fe788081410 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.459+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe79800a4a0 con 0x7fe788074040 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.459+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x55b4864a3b50 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x55b4864a3b50 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x7fe788074040 2024-05-15T18:09:20.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x7fe788074040 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x7fe788074040 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x7fe788074040 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.460+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x7fe79004cc20 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x55b4864a8540 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x55b4864a3b50 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x7fe788074040 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x7fe788074040 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x55b4864a3b50 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.461+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b4864a77e0 con 0x7fe79004cc20 2024-05-15T18:09:20.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe788074040 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x7fe788074040 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.462+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a3b50 2024-05-15T18:09:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a3b50 2024-05-15T18:09:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe79800a4a0 con 0x55b4864a3b50 2024-05-15T18:09:20.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.463+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe788074040 2024-05-15T18:09:20.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.464+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe798033040 con 0x7fe788074040 2024-05-15T18:09:20.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.464+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a8540 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.464+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.464+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe79004cc20 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.464+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.464+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a3b50 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.464+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.465+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe788074040 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.465+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.465+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a8540 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.465+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.465+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe788074040 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.465+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.465+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe79004cc20 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a8540 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe79004cc20 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x55b4864a3b50 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.466+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fe78808e060 con 0x7fe79004cc20 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:20.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ab800 con 0x55b4864a3b50 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864abbf0 con 0x55b4864a3b50 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864abbf0 con 0x7fe788074040 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 zone default found 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 4 Realm: () 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 zonegroup default 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.467+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ab380 con 0x7fe788074040 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ab380 con 0x55b4864a8540 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ae770 con 0x55b4864a8540 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 20 started sync module instance, tier type = 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.468+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864adb70 con 0x7fe79004cc20 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.469+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.469+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233835528032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ad7d0 con 0x7fe79004cc20 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.469+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864af6a0 con 0x55b4864a3b50 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.470+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233835528032] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.470+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.470+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233835532784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864afac0 con 0x55b4864a3b50 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.470+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b0480 con 0x55b4864a8540 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.472+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.472+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233835536336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b0d20 con 0x55b4864a8540 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.472+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b1820 con 0x7fe79004cc20 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.472+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233835532784] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.473+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.473+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233835533840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b20c0 con 0x7fe79004cc20 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.473+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b2a80 con 0x55b4864a3b50 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.474+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233835533840] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.475+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233835536336] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.475+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.475+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233835543568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b2a80 con 0x55b4864a3b50 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.475+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b3310 con 0x7fe788074040 2024-05-15T18:09:20.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.476+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.476+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233835543568] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.476+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233835547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b2ea0 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.476+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b25f0 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.477+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233835547264] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.477+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.477+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233835546096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b3d50 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.477+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4710 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233835553376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4b30 con 0x7fe788074040 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a4727800 20 add_watcher() i=0 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a4727800 20 add_watcher() i=1 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a4727800 20 add_watcher() i=2 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a4727800 20 add_watcher() i=3 2024-05-15T18:09:20.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a4727800 20 add_watcher() i=4 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.478+0000 7fe7a4727800 20 add_watcher() i=5 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.480+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233835546096] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.480+0000 7fe7a4727800 20 add_watcher() i=6 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.480+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233835553376] v31'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.480+0000 7fe7a4727800 20 add_watcher() i=7 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.480+0000 7fe7a4727800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.480+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4b30 con 0x55b4864a3b50 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.481+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.481+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233835554432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4aa0 con 0x55b4864a3b50 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233835554432] v31'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe6567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a4727800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:20.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a4727800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a4727800 5 note: GC not initialized 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe6557e2640 20 reqs_thread_entry: start 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a4727800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a4727800 20 Filter name: none 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe5c6ffd640 20 reqs_thread_entry: start 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a4727800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.482+0000 7fe7a4727800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.483+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864eb040 con 0x55b4864a3b50 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.483+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.483+0000 7fe7a4727800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.483+0000 7fe7a4727800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.483+0000 7fe7a4727800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.483+0000 7fe7a4727800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:20.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.483+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864f0f30 con 0x55b4864a3b50 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v31'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe7a4727800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe7a4727800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe7a4727800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94233835801152 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b4864ec960 con 0x55b4864a3b50 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94233835543568 notify 133143986192 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7fe79801e040 con 0x55b4864a3b50 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe67f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94233835543568 notifier 4650 bl.length()=579 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(64 notify.4 [notify cookie 94233835801152 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe67f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe67f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.484+0000 7fe67f7fe640 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe664003ea0 con 0x55b4864a3b50 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.485+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.485+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94233835801152 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe798018dd0 con 0x55b4864a3b50 2024-05-15T18:09:20.473 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:09:20.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.486+0000 7fe6567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.486+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233835554432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864efe80 con 0x55b4864a3b50 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.487+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94233835554432] v31'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.487+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233835528032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4680 con 0x7fe79004cc20 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.488+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94233835528032] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.488+0000 7fe7a4727800 20 remove_watcher() i=0 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.488+0000 7fe7a4727800 2 removed watcher, disabling cache 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.488+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233835532784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4680 con 0x55b4864a3b50 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.489+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94233835532784] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.489+0000 7fe7a4727800 20 remove_watcher() i=1 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.489+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233835536336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864af1f0 con 0x55b4864a8540 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.490+0000 7fe7a03a7640 1 -- 172.21.15.173:0/801582218 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94233835536336] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe790071020 con 0x55b4864a8540 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.490+0000 7fe7a4727800 20 remove_watcher() i=2 2024-05-15T18:09:20.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.490+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233835533840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4680 con 0x7fe79004cc20 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.491+0000 7fe797fff640 1 -- 172.21.15.173:0/801582218 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94233835533840] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe78807f070 con 0x7fe79004cc20 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.491+0000 7fe7a4727800 20 remove_watcher() i=3 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.491+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233835543568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4680 con 0x55b4864a3b50 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.492+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94233835543568] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x55b4864a3b50 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.492+0000 7fe7a4727800 20 remove_watcher() i=4 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.492+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233835547264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b1c10 con 0x7fe788074040 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.493+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94233835547264] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.493+0000 7fe7a4727800 20 remove_watcher() i=5 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.493+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233835546096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864af6a0 con 0x7fe788074040 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.494+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94233835546096] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.494+0000 7fe7a4727800 20 remove_watcher() i=6 2024-05-15T18:09:20.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.494+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233835553376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b4864b4680 con 0x7fe788074040 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94233835553376] v31'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe798031040 con 0x7fe788074040 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 20 remove_watcher() i=7 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe788074040 msgr2=0x7fe788081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fe788074040 0x7fe788081410 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4864a3b50 msgr2=0x55b4864a6010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b4864a3b50 0x55b4864a6010 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe79004cc20 msgr2=0x7fe79006a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fe79004cc20 0x7fe79006a8e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4864a8540 msgr2=0x55b4864aa930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b4864a8540 0x55b4864aa930 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe670036950 msgr2=0x7fe670038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe670036950 0x7fe670038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55b486476040 tx=0x7fe78804f000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/801582218 reap_dead start 2024-05-15T18:09:20.481 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 msgr2=0x55b486498360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486498360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe790000fb0 tx=0x7fe790050f90 comp rx=0 tx=0).stop 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 shutdown_connections 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 --2- 172.21.15.173:0/801582218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486491140 0x55b486498360 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 >> 172.21.15.173:0/801582218 conn(0x55b48648d4a0 msgr2=0x55b48648ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 shutdown_connections 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.495+0000 7fe7a4727800 1 -- 172.21.15.173:0/801582218 wait complete. 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe6780369c0 msgr2=0x7fe678038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe6780369c0 0x7fe678038e80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55b486369900 tx=0x7fe788005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486484050 msgr2=0x55b486484470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486484050 0x55b486484470 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe79001a6f0 tx=0x7fe790044500 comp rx=0 tx=0).stop 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 shutdown_connections 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe6780369c0 0x7fe678038e80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/3143021640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b486484050 0x55b486484470 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 >> 172.21.15.173:0/3143021640 conn(0x55b4864780f0 msgr2=0x55b4864784f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 shutdown_connections 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/3143021640 wait complete. 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b486473070 msgr2=0x55b4864754e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55b486473070 0x55b4864754e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b48636e710 msgr2=0x55b48646c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55b48636e710 0x55b48646c660 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b48646ef70 msgr2=0x55b486471430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55b48646ef70 0x55b486471430 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe688036950 msgr2=0x7fe688038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe688036950 0x7fe688038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe788054000 tx=0x7fe78804e000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 msgr2=0x55b48636a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 --2- 172.21.15.173:0/4245206548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b48636ac00 0x55b48636a540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe790001de0 tx=0x7fe790000ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a0ba8640 1 -- 172.21.15.173:0/4245206548 reap_dead start 2024-05-15T18:09:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 shutdown_connections 2024-05-15T18:09:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 >> 172.21.15.173:0/4245206548 conn(0x55b4863645b0 msgr2=0x55b486455840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 shutdown_connections 2024-05-15T18:09:20.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.496+0000 7fe7a4727800 1 -- 172.21.15.173:0/4245206548 wait complete. 2024-05-15T18:09:20.485 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:09:20.485 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-15T18:09:20.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-15T18:09:20.485 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-05-15T18:09:20.531 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:20.531 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.554+0000 7feae791f800 1 Processor -- start 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.554+0000 7feae791f800 1 -- start start 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.554+0000 7feae791f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558b8e8e7b70 0x558b8e8e9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.554+0000 7feae791f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b8e8edfb0 con 0x558b8e8ea4a0 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.554+0000 7feae791f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x558b8e778050 con 0x558b8e8e7b70 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.555+0000 7feae35ca640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558b8e8e7b70 0x558b8e8e9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.555+0000 7feadadc9640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x558b8e8ea4a0 0x558b8e8ec890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43284/0 (socket says 172.21.15.173:43284) 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.555+0000 7feadadc9640 1 -- 172.21.15.173:0/2155498525 learned_addr learned my addr 172.21.15.173:0/2155498525 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.555+0000 7feae35ca640 1 -- 172.21.15.173:0/2155498525 >> v1:172.21.15.3:6789/0 conn(0x558b8e8ea4a0 legacy=0x558b8e8ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.555+0000 7feae35ca640 1 -- 172.21.15.173:0/2155498525 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8e8ef190 con 0x558b8e8e7b70 2024-05-15T18:09:20.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.557+0000 7feae35ca640 1 --2- 172.21.15.173:0/2155498525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e9f60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fead400a470 tx=0x7fead401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf3b6a76aef8f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.557+0000 7feae2dc9640 1 -- 172.21.15.173:0/2155498525 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4057070 con 0x558b8e8e7b70 2024-05-15T18:09:20.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.557+0000 7feae2dc9640 1 -- 172.21.15.173:0/2155498525 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead4052570 con 0x558b8e8e7b70 2024-05-15T18:09:20.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.557+0000 7feae2dc9640 1 -- 172.21.15.173:0/2155498525 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4052870 con 0x558b8e8e7b70 2024-05-15T18:09:20.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.557+0000 7feae791f800 1 -- 172.21.15.173:0/2155498525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 msgr2=0x558b8e8e9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.557+0000 7feae791f800 1 --2- 172.21.15.173:0/2155498525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e9f60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fead400a470 tx=0x7fead401ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:20.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.558+0000 7feae791f800 1 -- 172.21.15.173:0/2155498525 shutdown_connections 2024-05-15T18:09:20.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.558+0000 7feae791f800 1 --2- 172.21.15.173:0/2155498525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e9f60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.558+0000 7feae791f800 1 -- 172.21.15.173:0/2155498525 >> 172.21.15.173:0/2155498525 conn(0x558b8e8e15c0 msgr2=0x558b8e8e39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.558+0000 7feae791f800 1 -- 172.21.15.173:0/2155498525 shutdown_connections 2024-05-15T18:09:20.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.558+0000 7feae791f800 1 -- 172.21.15.173:0/2155498525 wait complete. 2024-05-15T18:09:20.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.571+0000 7feae791f800 1 Processor -- start 2024-05-15T18:09:20.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.571+0000 7feae791f800 1 -- start start 2024-05-15T18:09:20.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.571+0000 7feae791f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e9d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.571+0000 7feae791f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558b8e8321c0 con 0x558b8e8e7b70 2024-05-15T18:09:20.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e9d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.550 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e9d86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49622/0 (socket says 172.21.15.173:49622) 2024-05-15T18:09:20.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7feae35ca640 1 -- 172.21.15.173:0/4117779847 learned_addr learned my addr 172.21.15.173:0/4117779847 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7feae35ca640 1 -- 172.21.15.173:0/4117779847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8e9d8cc0 con 0x558b8e8e7b70 2024-05-15T18:09:20.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7feae35ca640 1 --2- 172.21.15.173:0/4117779847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e9d86f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fead4055040 tx=0x7fead404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d66e0a8c4c79b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7fe9d160a640 1 -- 172.21.15.173:0/4117779847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4057040 con 0x558b8e8e7b70 2024-05-15T18:09:20.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7fe9d160a640 1 -- 172.21.15.173:0/4117779847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead4052990 con 0x558b8e8e7b70 2024-05-15T18:09:20.551 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.572+0000 7fe9d160a640 1 -- 172.21.15.173:0/4117779847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4052c70 con 0x558b8e8e7b70 2024-05-15T18:09:20.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 -- 172.21.15.173:0/4117779847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 msgr2=0x558b8e9d86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 --2- 172.21.15.173:0/4117779847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e9d86f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fead4055040 tx=0x7fead404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 -- 172.21.15.173:0/4117779847 shutdown_connections 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 --2- 172.21.15.173:0/4117779847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e9d86f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 -- 172.21.15.173:0/4117779847 >> 172.21.15.173:0/4117779847 conn(0x558b8e8e15c0 msgr2=0x558b8e9d4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 -- 172.21.15.173:0/4117779847 shutdown_connections 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 -- 172.21.15.173:0/4117779847 wait complete. 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 Processor -- start 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.573+0000 7feae791f800 1 -- start start 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.574+0000 7feae791f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.574+0000 7feae791f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558b8e8ee420 con 0x558b8e8e7b70 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.574+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.574+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49628/0 (socket says 172.21.15.173:49628) 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.574+0000 7feae35ca640 1 -- 172.21.15.173:0/389775733 learned_addr learned my addr 172.21.15.173:0/389775733 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.574+0000 7feae35ca640 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8e8e5ba0 con 0x558b8e8e7b70 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.574+0000 7feae35ca640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e74b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fead400a470 tx=0x7fead4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.575+0000 7fe9cfe07640 1 -- 172.21.15.173:0/389775733 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4073070 con 0x558b8e8e7b70 2024-05-15T18:09:20.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.575+0000 7fe9cfe07640 1 -- 172.21.15.173:0/389775733 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead405d650 con 0x558b8e8e7b70 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.575+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b8e8e5e30 con 0x558b8e8e7b70 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.575+0000 7fe9cfe07640 1 -- 172.21.15.173:0/389775733 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4057070 con 0x558b8e8e7b70 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.575+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8e8e6350 con 0x558b8e8e7b70 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.575+0000 7fe9cfe07640 1 -- 172.21.15.173:0/389775733 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fead4076070 con 0x558b8e8e7b70 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7fe9cfe07640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9c8036900 0x7fe9c8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7fe9cfe07640 1 -- 172.21.15.173:0/389775733 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fead408df50 con 0x558b8e8e7b70 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feadadc9640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9c8036900 0x7fe9c8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8e8ea4a0 0x558b8e9e9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8e9e9b40 con 0x558b8e8ea4a0 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feae3dcb640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8e8ea4a0 0x558b8e9e9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feadadc9640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9c8036900 0x7fe9c8038dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feacc000f60 tx=0x7feacc0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feae3dcb640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8e8ea4a0 0x558b8e9e9560 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feae3dcb640 1 -- 172.21.15.173:0/389775733 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8e8ea4a0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.576+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8e9ea420 con 0x558b8e8ea4a0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.577+0000 7feae3dcb640 1 -- 172.21.15.173:0/389775733 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8e8ea4a0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.577+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8e9ebea0 0x558b8e9ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.577+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8e9eeaf0 con 0x558b8e9ebea0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.577+0000 7feae35ca640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8e9ebea0 0x558b8e9ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.577+0000 7feae35ca640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8e9ebea0 0x558b8e9ee360 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.577+0000 7feae35ca640 1 -- 172.21.15.173:0/389775733 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fead4075030 con 0x558b8e9ebea0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.577+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8e9eaca0 con 0x558b8e8ea4a0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.578+0000 7feae3dcb640 1 -- 172.21.15.173:0/389775733 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8e8ea4a0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.578+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558b8e9effa0 0x558b8e9f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.578+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8e9f2b70 con 0x558b8e9effa0 2024-05-15T18:09:20.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.578+0000 7feadadc9640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558b8e9effa0 0x558b8e9f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.578+0000 7feadadc9640 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558b8e9effa0 0x558b8e9f2410 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.579+0000 7feadadc9640 1 -- 172.21.15.173:0/389775733 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feacc009050 con 0x558b8e9effa0 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.579+0000 7feae791f800 1 Processor -- start 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.579+0000 7feae791f800 1 -- start start 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.579+0000 7feae791f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea00fd0 0x558b8ea013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.579+0000 7feae791f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558b8e8e79f0 con 0x558b8ea00fd0 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea00fd0 0x558b8ea013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea00fd0 0x558b8ea013f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49638/0 (socket says 172.21.15.173:49638) 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7feae35ca640 1 -- 172.21.15.173:0/2035698641 learned_addr learned my addr 172.21.15.173:0/2035698641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7feae35ca640 1 -- 172.21.15.173:0/2035698641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8ea01930 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7feae35ca640 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea00fd0 0x558b8ea013f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fead4066fd0 tx=0x7fead405cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7fe9cd602640 1 -- 172.21.15.173:0/2035698641 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4006950 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b8ea023a0 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7fe9cd602640 1 -- 172.21.15.173:0/2035698641 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead405ea70 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7fe9cd602640 1 -- 172.21.15.173:0/2035698641 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead405ed50 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.580+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8ea028a0 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.581+0000 7fe9cd602640 1 -- 172.21.15.173:0/2035698641 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fead40773b0 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.581+0000 7fe9cd602640 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9bc036900 0x7fe9bc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.581+0000 7fe9cd602640 1 -- 172.21.15.173:0/2035698641 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fead404b190 con 0x558b8ea00fd0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.581+0000 7feadadc9640 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9bc036900 0x7fe9bc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae791f800 1 Processor -- start 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feadadc9640 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9bc036900 0x7fe9bc038dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feacc00bf50 tx=0x7feacc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae791f800 1 -- start start 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae791f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea0e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae791f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558b8e7d8cf0 con 0x558b8ea0e060 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea0e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea0e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49654/0 (socket says 172.21.15.173:49654) 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae35ca640 1 -- 172.21.15.173:0/4179694181 learned_addr learned my addr 172.21.15.173:0/4179694181 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae35ca640 1 -- 172.21.15.173:0/4179694181 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8ea0ea50 con 0x558b8ea0e060 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.582+0000 7feae35ca640 1 --2- 172.21.15.173:0/4179694181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea0e480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fead4006f60 tx=0x7fead406faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130763b648298b6d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7fe9c6ffd640 1 -- 172.21.15.173:0/4179694181 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead40a9020 con 0x558b8ea0e060 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7fe9c6ffd640 1 -- 172.21.15.173:0/4179694181 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead40777d0 con 0x558b8ea0e060 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7fe9c6ffd640 1 -- 172.21.15.173:0/4179694181 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead408c8b0 con 0x558b8ea0e060 2024-05-15T18:09:20.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 -- 172.21.15.173:0/4179694181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 msgr2=0x558b8ea0e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 --2- 172.21.15.173:0/4179694181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea0e480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fead4006f60 tx=0x7fead406faf0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 -- 172.21.15.173:0/4179694181 shutdown_connections 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 --2- 172.21.15.173:0/4179694181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea0e480 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 -- 172.21.15.173:0/4179694181 >> 172.21.15.173:0/4179694181 conn(0x558b8ea0a3c0 msgr2=0x558b8ea08420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 -- 172.21.15.173:0/4179694181 shutdown_connections 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 -- 172.21.15.173:0/4179694181 wait complete. 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.583+0000 7feae791f800 1 Processor -- start 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae791f800 1 -- start start 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae791f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea15300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae791f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558b8ea0ef80 con 0x558b8ea0e060 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea15300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae35ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea15300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49670/0 (socket says 172.21.15.173:49670) 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 learned_addr learned my addr 172.21.15.173:0/2098372192 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8ea15840 con 0x558b8ea0e060 2024-05-15T18:09:20.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.584+0000 7feae35ca640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea15300 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fead4069f90 tx=0x7fead4080e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.585+0000 7fe9c57fa640 1 -- 172.21.15.173:0/2098372192 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead40be070 con 0x558b8ea0e060 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.585+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b8ea15840 con 0x558b8ea0e060 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.585+0000 7fe9c57fa640 1 -- 172.21.15.173:0/2098372192 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead4084410 con 0x558b8ea0e060 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.585+0000 7fe9c57fa640 1 -- 172.21.15.173:0/2098372192 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fead4084860 con 0x558b8ea0e060 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.585+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8ea15ce0 con 0x558b8ea0e060 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.585+0000 7fe9c57fa640 1 -- 172.21.15.173:0/2098372192 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fead40c1070 con 0x558b8ea0e060 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7fe9c57fa640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9ac036900 0x7fe9ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7fe9c57fa640 1 -- 172.21.15.173:0/2098372192 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fead40b4030 con 0x558b8ea0e060 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7feadadc9640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9ac036900 0x7fe9ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7feadadc9640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9ac036900 0x7fe9ac038dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feacc001b60 tx=0x7feacc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8ea20aa0 0x558b8ea22f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea236b0 con 0x558b8ea20aa0 2024-05-15T18:09:20.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.586+0000 7feae3dcb640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8ea20aa0 0x558b8ea22f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae3dcb640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8ea20aa0 0x558b8ea22f60 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 20 realm 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea23ac0 con 0x558b8ea20aa0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24390 con 0x558b8ea20aa0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.587+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae791f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8ea25490 0x558b8ea27880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea27e90 con 0x558b8ea25490 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae35ca640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8ea25490 0x558b8ea27880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae35ca640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8ea25490 0x558b8ea27880 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae791f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae791f800 20 searching for the correct realm 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.588+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea297c0 con 0x558b8ea25490 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feae35ca640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fead40c3060 0x7fead407f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea297c0 con 0x7fead40c3060 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feadadc9640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fead40c3060 0x7fead407f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feadadc9640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fead40c3060 0x7fead407f2a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feacc009050 con 0x7fead40c3060 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feadadc9640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feacc038040 0x7feacc01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.589+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea297c0 con 0x7feacc038040 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.590+0000 7feae3dcb640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feacc038040 0x7feacc01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.590+0000 7feae3dcb640 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feacc038040 0x7feacc01bab0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.590+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feadc00a4a0 con 0x7feacc038040 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.590+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.590+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.590+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7feacc038040 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x7feacc038040 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7feacc038040 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x7feacc038040 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7fead40c3060 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feacc009050 con 0x7fead40c3060 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.591+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7feacc038040 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x7feacc038040 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.592+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7fead40c3060 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feacc009050 con 0x7fead40c3060 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7feacc038040 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x7feacc038040 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.593+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feadc00a4a0 con 0x558b8ea20aa0 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.594+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7feacc038040 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc033040 con 0x7feacc038040 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7fead40c3060 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feacc009050 con 0x7fead40c3060 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.593 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.595+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7feacc038040 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.596+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.596+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.596+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.596+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7feacc038040 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.596+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.596+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7fead40c3060 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feacc009050 con 0x7fead40c3060 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea25490 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7fead40c3060 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x558b8ea20aa0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea24730 con 0x7fead40c3060 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.597+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea28750 con 0x558b8ea20aa0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea28b40 con 0x558b8ea20aa0 2024-05-15T18:09:20.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea28b40 con 0x7feacc038040 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 zone default found 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 4 Realm: () 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:20.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 zonegroup default 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.598+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea29c40 con 0x7feacc038040 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2b620 con 0x558b8ea25490 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2b9c0 con 0x558b8ea25490 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 20 started sync module instance, tier type = 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.599+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2aac0 con 0x7fead40c3060 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.600+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.600+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057881839120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2bd60 con 0x7fead40c3060 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.600+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2c630 con 0x558b8ea20aa0 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.601+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057881839120] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.602+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.602+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057881846016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2ca20 con 0x558b8ea20aa0 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.602+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2d4a0 con 0x558b8ea25490 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.603+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057881846016] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.603+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.603+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057881849744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2d890 con 0x558b8ea25490 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.603+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2e2e0 con 0x7fead40c3060 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.604+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057881849744] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.604+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.604+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057881841376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2eb80 con 0x7fead40c3060 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.604+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2f540 con 0x558b8ea20aa0 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.605+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057881841376] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.605+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.605+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057881858192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2f960 con 0x558b8ea20aa0 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.605+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea30320 con 0x7feacc038040 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.606+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.606+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057881858192] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.606+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057881861744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea30740 con 0x7feacc038040 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.606+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2f4d0 con 0x7feacc038040 2024-05-15T18:09:20.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.607+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057881861744] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.607+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.607+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057881862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea306b0 con 0x7feacc038040 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea316d0 con 0x7feacc038040 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057881866720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea31af0 con 0x7feacc038040 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057881862800] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 20 add_watcher() i=0 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 20 add_watcher() i=1 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 20 add_watcher() i=2 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 20 add_watcher() i=3 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 20 add_watcher() i=4 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.608+0000 7feae791f800 20 add_watcher() i=5 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.609+0000 7feae791f800 20 add_watcher() i=6 2024-05-15T18:09:20.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.609+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057881866720] v31'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.609+0000 7feae791f800 20 add_watcher() i=7 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.609+0000 7feae791f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.609+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea30df0 con 0x558b8ea20aa0 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.610+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.610+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057881867776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea30df0 con 0x558b8ea20aa0 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057881867776] v31'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7fe999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7feae791f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7feae791f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7feae791f800 5 note: GC not initialized 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7fe998fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7feae791f800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.611+0000 7feae791f800 20 Filter name: none 2024-05-15T18:09:20.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7fe9127fc640 20 reqs_thread_entry: start 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea67ff0 con 0x558b8ea20aa0 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 20 rados_obj.operate() r=0 bl.length=403 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.612+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea6df20 con 0x558b8ea20aa0 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7feae791f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7feae791f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7feae791f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94057882114544 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea69910 con 0x558b8ea20aa0 2024-05-15T18:09:20.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify (1) cookie 94057881858192 notify 133143986193 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7feadc01e040 con 0x558b8ea20aa0 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7fe9c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94057881858192 notifier 4657 bl.length()=567 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7fe9c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7fe9c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7fe9c6ffd640 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe9a8003ea0 con 0x558b8ea20aa0 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.613+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(64 notify.4 [notify cookie 94057882114544 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.614+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.614+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== watch-notify(notify_complete (2) cookie 94057882114544 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7feadc018d90 con 0x558b8ea20aa0 2024-05-15T18:09:20.603 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-15T18:08:56.039944Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:08:56.039928Z","tags":[],"group_ids":[]} 2024-05-15T18:09:20.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.615+0000 7fe999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.615+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057881867776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea6d220 con 0x558b8ea20aa0 2024-05-15T18:09:20.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.616+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94057881867776] v31'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.616+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057881839120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea31600 con 0x7fead40c3060 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.617+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94057881839120] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.617+0000 7feae791f800 20 remove_watcher() i=0 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.617+0000 7feae791f800 2 removed watcher, disabling cache 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.617+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057881846016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2a610 con 0x558b8ea20aa0 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.618+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94057881846016] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.618+0000 7feae791f800 20 remove_watcher() i=1 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.618+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057881849744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2a610 con 0x558b8ea25490 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.619+0000 7feae35ca640 1 -- 172.21.15.173:0/2098372192 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94057881849744] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fead40c0030 con 0x558b8ea25490 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.619+0000 7feae791f800 20 remove_watcher() i=2 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.619+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057881841376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2cf90 con 0x7fead40c3060 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.620+0000 7feadadc9640 1 -- 172.21.15.173:0/2098372192 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94057881841376] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feacc045040 con 0x7fead40c3060 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.620+0000 7feae791f800 20 remove_watcher() i=3 2024-05-15T18:09:20.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.620+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057881858192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2cf90 con 0x558b8ea20aa0 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.621+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94057881858192] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x558b8ea20aa0 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.621+0000 7feae791f800 20 remove_watcher() i=4 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.621+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057881861744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2f090 con 0x7feacc038040 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.622+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94057881861744] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.622+0000 7feae791f800 20 remove_watcher() i=5 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.622+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057881862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2f090 con 0x7feacc038040 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.623+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94057881862800] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.623+0000 7feae791f800 20 remove_watcher() i=6 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.623+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057881866720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558b8ea2f090 con 0x7feacc038040 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94057881866720] v31'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feadc031040 con 0x7feacc038040 2024-05-15T18:09:20.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 20 remove_watcher() i=7 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feacc038040 msgr2=0x7feacc01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7feacc038040 0x7feacc01bab0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8ea20aa0 msgr2=0x558b8ea22f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8ea20aa0 0x558b8ea22f60 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fead40c3060 msgr2=0x7fead407f2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fead40c3060 0x7fead407f2a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8ea25490 msgr2=0x558b8ea27880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8ea25490 0x558b8ea27880 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9ac036900 msgr2=0x7fe9ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9ac036900 0x7fe9ac038dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7feacc001b60 tx=0x7feacc010000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 msgr2=0x558b8ea15300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea15300 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fead4069f90 tx=0x7fead4080e90 comp rx=0 tx=0).stop 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.624+0000 7feae3dcb640 1 -- 172.21.15.173:0/2098372192 reap_dead start 2024-05-15T18:09:20.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 shutdown_connections 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/2098372192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea0e060 0x558b8ea15300 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 >> 172.21.15.173:0/2098372192 conn(0x558b8ea0a3c0 msgr2=0x558b8ea07a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 shutdown_connections 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2098372192 wait complete. 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9bc036900 msgr2=0x7fe9bc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9bc036900 0x7fe9bc038dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feacc00bf50 tx=0x7feacc00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea00fd0 msgr2=0x558b8ea013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea00fd0 0x558b8ea013f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fead4066fd0 tx=0x7fead405cef0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 shutdown_connections 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9bc036900 0x7fe9bc038dc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/2035698641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8ea00fd0 0x558b8ea013f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 >> 172.21.15.173:0/2035698641 conn(0x558b8e9f5070 msgr2=0x558b8e9f5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 shutdown_connections 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/2035698641 wait complete. 2024-05-15T18:09:20.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558b8e9effa0 msgr2=0x558b8e9f2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558b8e9effa0 0x558b8e9f2410 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8e8ea4a0 msgr2=0x558b8e9e9560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558b8e8ea4a0 0x558b8e9e9560 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8e9ebea0 msgr2=0x558b8e9ee360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.625+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558b8e9ebea0 0x558b8e9ee360 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9c8036900 msgr2=0x7fe9c8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fe9c8036900 0x7fe9c8038dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feacc000f60 tx=0x7feacc0012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 msgr2=0x558b8e8e74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 --2- 172.21.15.173:0/389775733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558b8e8e7b70 0x558b8e8e74b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fead400a470 tx=0x7fead4003020 comp rx=0 tx=0).stop 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae3dcb640 1 -- 172.21.15.173:0/389775733 reap_dead start 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 shutdown_connections 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 >> 172.21.15.173:0/389775733 conn(0x558b8e8e15c0 msgr2=0x558b8e9d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 shutdown_connections 2024-05-15T18:09:20.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.626+0000 7feae791f800 1 -- 172.21.15.173:0/389775733 wait complete. 2024-05-15T18:09:20.614 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-15T18:08:56.039944Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:08:56.039928Z', 'tags': [], 'group_ids': []} 2024-05-15T18:09:20.624 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:20.624 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-15T18:09:20.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-15T18:09:20.624 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-15T18:09:20.668 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:20.668 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:20.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f8815205800 1 Processor -- start 2024-05-15T18:09:20.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f8815205800 1 -- start start 2024-05-15T18:09:20.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f8815205800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55a7143db540 0x55a7143e4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f8815205800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a71434e900 con 0x55a7143d9a00 2024-05-15T18:09:20.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f8815205800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55a71426c050 con 0x55a7143db540 2024-05-15T18:09:20.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f880bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55a7143db540 0x55a7143e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f8812d04640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55a7143d9a00 0x55a7143d9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43300/0 (socket says 172.21.15.173:43300) 2024-05-15T18:09:20.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.692+0000 7f8812d04640 1 -- 172.21.15.173:0/1526138233 learned_addr learned my addr 172.21.15.173:0/1526138233 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:20.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.693+0000 7f8812503640 1 -- 172.21.15.173:0/1526138233 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283512661 0 0) 0x55a71434e900 con 0x55a7143d9a00 2024-05-15T18:09:20.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.693+0000 7f8812503640 1 -- 172.21.15.173:0/1526138233 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8800001e10 con 0x55a7143d9a00 2024-05-15T18:09:20.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.693+0000 7f880bfff640 1 -- 172.21.15.173:0/1526138233 >> v1:172.21.15.3:6789/0 conn(0x55a7143d9a00 legacy=0x55a7143d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.693+0000 7f880bfff640 1 -- 172.21.15.173:0/1526138233 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a71434ead0 con 0x55a7143db540 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f880bfff640 1 --2- 172.21.15.173:0/1526138233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143db540 0x55a7143e4040 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00a470 tx=0x7f87fc01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1a1ced7a5b9f5c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8812503640 1 -- 172.21.15.173:0/1526138233 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87fc057070 con 0x55a7143db540 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8812503640 1 -- 172.21.15.173:0/1526138233 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87fc052570 con 0x55a7143db540 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8812503640 1 -- 172.21.15.173:0/1526138233 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87fc052850 con 0x55a7143db540 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8815205800 1 -- 172.21.15.173:0/1526138233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143db540 msgr2=0x55a7143e4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8815205800 1 --2- 172.21.15.173:0/1526138233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143db540 0x55a7143e4040 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00a470 tx=0x7f87fc01cdb0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8815205800 1 -- 172.21.15.173:0/1526138233 shutdown_connections 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8815205800 1 --2- 172.21.15.173:0/1526138233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143db540 0x55a7143e4040 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8815205800 1 -- 172.21.15.173:0/1526138233 >> 172.21.15.173:0/1526138233 conn(0x55a7143d5560 msgr2=0x55a7143d7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8815205800 1 -- 172.21.15.173:0/1526138233 shutdown_connections 2024-05-15T18:09:20.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.695+0000 7f8815205800 1 -- 172.21.15.173:0/1526138233 wait complete. 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.709+0000 7f8815205800 1 Processor -- start 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.709+0000 7f8815205800 1 -- start start 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.709+0000 7f8815205800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.709+0000 7f8815205800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a7143261d0 con 0x55a7143d9a00 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.710+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.710+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49694/0 (socket says 172.21.15.173:49694) 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.710+0000 7f8812d04640 1 -- 172.21.15.173:0/3707612831 learned_addr learned my addr 172.21.15.173:0/3707612831 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.710+0000 7f8812d04640 1 -- 172.21.15.173:0/3707612831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7144cec30 con 0x55a7143d9a00 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.710+0000 7f8812d04640 1 --2- 172.21.15.173:0/3707612831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144ce660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8804001d60 tx=0x7f880400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdea821a665ffb28 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8700e09640 1 -- 172.21.15.173:0/3707612831 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8804012020 con 0x55a7143d9a00 2024-05-15T18:09:20.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8700e09640 1 -- 172.21.15.173:0/3707612831 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880400e470 con 0x55a7143d9a00 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8700e09640 1 -- 172.21.15.173:0/3707612831 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f880400e810 con 0x55a7143d9a00 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8815205800 1 -- 172.21.15.173:0/3707612831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 msgr2=0x55a7144ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8815205800 1 --2- 172.21.15.173:0/3707612831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144ce660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8804001d60 tx=0x7f880400b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8815205800 1 -- 172.21.15.173:0/3707612831 shutdown_connections 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8815205800 1 --2- 172.21.15.173:0/3707612831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144ce660 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8815205800 1 -- 172.21.15.173:0/3707612831 >> 172.21.15.173:0/3707612831 conn(0x55a7143d5560 msgr2=0x55a7144c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8815205800 1 -- 172.21.15.173:0/3707612831 shutdown_connections 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.711+0000 7f8815205800 1 -- 172.21.15.173:0/3707612831 wait complete. 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8815205800 1 Processor -- start 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8815205800 1 -- start start 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8815205800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144d61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8815205800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a7143e4850 con 0x55a7143d9a00 2024-05-15T18:09:20.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144d61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144d61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49704/0 (socket says 172.21.15.173:49704) 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8812d04640 1 -- 172.21.15.173:0/2148836920 learned_addr learned my addr 172.21.15.173:0/2148836920 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8812d04640 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7144d6710 con 0x55a7143d9a00 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.712+0000 7f8812d04640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144d61d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8804001d60 tx=0x7f8804000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.713+0000 7f86ff606640 1 -- 172.21.15.173:0/2148836920 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8804012030 con 0x55a7143d9a00 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.713+0000 7f86ff606640 1 -- 172.21.15.173:0/2148836920 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880401a7a0 con 0x55a7143d9a00 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.713+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7144d69a0 con 0x55a7143d9a00 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.713+0000 7f86ff606640 1 -- 172.21.15.173:0/2148836920 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f880401aaa0 con 0x55a7143d9a00 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.713+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7144d9650 con 0x55a7143d9a00 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.713+0000 7f86ff606640 1 -- 172.21.15.173:0/2148836920 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8804015020 con 0x55a7143d9a00 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f86ff606640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86f8036900 0x7f86f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f86ff606640 1 -- 172.21.15.173:0/2148836920 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8804020030 con 0x55a7143d9a00 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f880bfff640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86f8036900 0x7f86f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a7143db540 0x55a7144dd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a7144dd990 con 0x55a7143db540 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f8813505640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a7143db540 0x55a7144dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f880bfff640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86f8036900 0x7f86f8038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87fc054000 tx=0x7f87fc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.714+0000 7f8813505640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a7143db540 0x55a7144dd410 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.715+0000 7f8813505640 1 -- 172.21.15.173:0/2148836920 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a7143db540 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.715+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a7144da9e0 con 0x55a7143db540 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.715+0000 7f8813505640 1 -- 172.21.15.173:0/2148836920 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a7143db540 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.715+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a7144dfcc0 0x55a7144e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.715+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a7144e27a0 con 0x55a7144dfcc0 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.715+0000 7f8812d04640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a7144dfcc0 0x55a7144e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.715+0000 7f8812d04640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a7144dfcc0 0x55a7144e20b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.716+0000 7f8812d04640 1 -- 172.21.15.173:0/2148836920 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f880400dcd0 con 0x55a7144dfcc0 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.716+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a7144dec70 con 0x55a7143db540 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.716+0000 7f8813505640 1 -- 172.21.15.173:0/2148836920 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a7143db540 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.716+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a7144e3c50 0x55a7144e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.716+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a7144e6800 con 0x55a7144e3c50 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.716+0000 7f880bfff640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a7144e3c50 0x55a7144e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.717+0000 7f880bfff640 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a7144e3c50 0x55a7144e60a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.717+0000 7f880bfff640 1 -- 172.21.15.173:0/2148836920 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87fc05a040 con 0x55a7144e3c50 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.717+0000 7f8815205800 1 Processor -- start 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.717+0000 7f8815205800 1 -- start start 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.717+0000 7f8815205800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7144f4c60 0x55a7144f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.717+0000 7f8815205800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a7142cccf0 con 0x55a7144f4c60 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7144f4c60 0x55a7144f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7144f4c60 0x55a7144f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49710/0 (socket says 172.21.15.173:49710) 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f8812d04640 1 -- 172.21.15.173:0/30852633 learned_addr learned my addr 172.21.15.173:0/30852633 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f8812d04640 1 -- 172.21.15.173:0/30852633 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7144f55c0 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f8812d04640 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7144f4c60 0x55a7144f5080 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f880404ac40 tx=0x7f8804016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f86fce01640 1 -- 172.21.15.173:0/30852633 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8804016530 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f86fce01640 1 -- 172.21.15.173:0/30852633 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880404c0c0 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7144f6030 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f86fce01640 1 -- 172.21.15.173:0/30852633 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f880404c3e0 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.718+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7144f6530 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.719+0000 7f86fce01640 1 -- 172.21.15.173:0/30852633 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f88040459e0 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.719+0000 7f86fce01640 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86ec036900 0x7f86ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.719+0000 7f86fce01640 1 -- 172.21.15.173:0/30852633 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8804043040 con 0x55a7144f4c60 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.719+0000 7f880bfff640 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86ec036900 0x7f86ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8815205800 1 Processor -- start 2024-05-15T18:09:20.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8815205800 1 -- start start 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f880bfff640 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86ec036900 0x7f86ec038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a7144de270 tx=0x7f87fc005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8815205800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a714502230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8815205800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a7144cefb0 con 0x55a714501e10 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a714502230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a714502230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49724/0 (socket says 172.21.15.173:49724) 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8812d04640 1 -- 172.21.15.173:0/2695943220 learned_addr learned my addr 172.21.15.173:0/2695943220 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8812d04640 1 -- 172.21.15.173:0/2695943220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a714502800 con 0x55a714501e10 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f8812d04640 1 --2- 172.21.15.173:0/2695943220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a714502230 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f880404bfd0 tx=0x7f880404c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc5ce94dfe6b375 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.720+0000 7f86f67fc640 1 -- 172.21.15.173:0/2695943220 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f880405d070 con 0x55a714501e10 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f86f67fc640 1 -- 172.21.15.173:0/2695943220 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8804044270 con 0x55a714501e10 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f86f67fc640 1 -- 172.21.15.173:0/2695943220 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8804052040 con 0x55a714501e10 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 -- 172.21.15.173:0/2695943220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 msgr2=0x55a714502230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 --2- 172.21.15.173:0/2695943220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a714502230 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f880404bfd0 tx=0x7f880404c580 comp rx=0 tx=0).stop 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 -- 172.21.15.173:0/2695943220 shutdown_connections 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 --2- 172.21.15.173:0/2695943220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a714502230 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 -- 172.21.15.173:0/2695943220 >> 172.21.15.173:0/2695943220 conn(0x55a7144fe090 msgr2=0x55a7144fc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 -- 172.21.15.173:0/2695943220 shutdown_connections 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 -- 172.21.15.173:0/2695943220 wait complete. 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 Processor -- start 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 -- start start 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.721+0000 7f8815205800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a7145091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8815205800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a714502e70 con 0x55a714501e10 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a7145091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8812d04640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a7145091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:49732/0 (socket says 172.21.15.173:49732) 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 learned_addr learned my addr 172.21.15.173:0/3986598752 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7145096e0 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8812d04640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a7145091a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8804034b00 tx=0x7f8804046740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f86f4ff9640 1 -- 172.21.15.173:0/3986598752 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f880405d030 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f86f4ff9640 1 -- 172.21.15.173:0/3986598752 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8804069070 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7145096e0 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f86f4ff9640 1 -- 172.21.15.173:0/3986598752 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8804024420 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.722+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7145096e0 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.723+0000 7f86f4ff9640 1 -- 172.21.15.173:0/3986598752 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f88040099f0 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.723+0000 7f86f4ff9640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86dc036900 0x7f86dc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.723+0000 7f86f4ff9640 1 -- 172.21.15.173:0/3986598752 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f880405e070 con 0x55a714501e10 2024-05-15T18:09:20.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.723+0000 7f880bfff640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86dc036900 0x7f86dc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.724+0000 7f880bfff640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86dc036900 0x7f86dc038dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55a7144e6c00 tx=0x7f87fc04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.724+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.724+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a714514780 0x55a714516c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.724+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a714517390 con 0x55a714514780 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.724+0000 7f8813505640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a714514780 0x55a714516c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.724+0000 7f8813505640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a714514780 0x55a714516c40 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 realm 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a7145177a0 con 0x55a714514780 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a714518070 con 0x55a714514780 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x55a714514780 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a714519170 0x55a71451b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71451bb70 con 0x55a714519170 2024-05-15T18:09:20.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.725+0000 7f8812d04640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a714519170 0x55a71451b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8812d04640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a714519170 0x55a71451b560 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8815205800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8815205800 20 searching for the correct realm 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a71451d4a0 con 0x55a714519170 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8812d04640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8804017050 0x7f8804024780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a71451d4a0 con 0x7f8804017050 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.726+0000 7f880bfff640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8804017050 0x7f8804024780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.727+0000 7f880bfff640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8804017050 0x7f8804024780 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.727+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.727+0000 7f880bfff640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f87fc074040 0x7f87fc081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.727+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a71451d4a0 con 0x7f87fc074040 2024-05-15T18:09:20.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.727+0000 7f8813505640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f87fc074040 0x7f87fc081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.727+0000 7f8813505640 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f87fc074040 0x7f87fc081410 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f880c00a4a0 con 0x7f87fc074040 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x55a714514780 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x55a714514780 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x7f87fc074040 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x7f87fc074040 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.728+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x7f87fc074040 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x7f87fc074040 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x7f8804017050 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x55a714519170 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x55a714514780 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.729+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x7f87fc074040 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x7f87fc074040 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x55a714514780 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a714518410 con 0x7f8804017050 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714519170 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714519170 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.730+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.731+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f87fc074040 2024-05-15T18:09:20.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.731+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x7f87fc074040 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.731+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714519170 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.731+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.731+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714519170 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.731+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714514780 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714514780 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f880c00a4a0 con 0x55a714514780 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f87fc074040 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c033040 con 0x7f87fc074040 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714519170 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.732+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f8804017050 2024-05-15T18:09:20.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714514780 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f87fc074040 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714519170 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.733+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f87fc074040 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f8804017050 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714519170 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f8804017050 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.734+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x55a714514780 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f87fc08e060 con 0x7f8804017050 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71451c430 con 0x55a714514780 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71451c820 con 0x55a714514780 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.735+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71451c820 con 0x7f87fc074040 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 20 zone default found 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 4 Realm: () 2024-05-15T18:09:20.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 20 zonegroup default 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71451d920 con 0x7f87fc074040 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71451f300 con 0x55a714519170 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.736+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8815205800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.738 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71451f6a0 con 0x55a714519170 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8815205800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8815205800 20 started sync module instance, tier type = 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8815205800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.737+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a71451e7a0 con 0x7f8804017050 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.738+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.738+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94176088810224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a71451fa40 con 0x7f8804017050 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.738+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714520290 con 0x55a714514780 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.739+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94176088810224] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.739+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.739+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94176088817120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714520200 con 0x55a714514780 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.739+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714521150 con 0x55a714519170 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.740+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94176088817120] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.740+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.740+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94176088820896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714521540 con 0x55a714519170 2024-05-15T18:09:20.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.740+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714521f40 con 0x7f8804017050 2024-05-15T18:09:20.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.741+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94176088820896] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.741+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.741+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94176088819328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714522330 con 0x7f8804017050 2024-05-15T18:09:20.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.741+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714522d90 con 0x55a714514780 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.742+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94176088819328] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.743+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.743+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94176088824400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714523180 con 0x55a714514780 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.743+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714523be0 con 0x7f87fc074040 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.744+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.744+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94176088831680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714523be0 con 0x7f87fc074040 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.744+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714524b40 con 0x7f87fc074040 2024-05-15T18:09:20.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.744+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94176088824400] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.745+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94176088831680] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.745+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.745+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94176088834000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714524620 con 0x7f87fc074040 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.745+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714524ff0 con 0x7f87fc074040 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94176088834000] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94176088828016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714524ff0 con 0x7f87fc074040 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 20 add_watcher() i=0 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 20 add_watcher() i=1 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 20 add_watcher() i=2 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 20 add_watcher() i=3 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 20 add_watcher() i=4 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 20 add_watcher() i=5 2024-05-15T18:09:20.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.746+0000 7f8815205800 20 add_watcher() i=6 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.747+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94176088828016] v31'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.747+0000 7f8815205800 20 add_watcher() i=7 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.747+0000 7f8815205800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.747+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a714528330 con 0x55a714514780 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.747+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.747+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94176088849744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714525160 con 0x55a714514780 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.748+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94176088849744] v31'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.748+0000 7f86c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.748+0000 7f8815205800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.748+0000 7f8815205800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.748+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714527650 con 0x55a714514780 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.749+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.749+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145313f0 con 0x7f87fc074040 2024-05-15T18:09:20.749 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.750+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.750+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145313f0 con 0x55a714519170 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.751+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.751+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145318a0 con 0x55a714514780 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.752+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'195 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.752+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714531e10 con 0x7f8804017050 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.753+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.753+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145322c0 con 0x55a714519170 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.754+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.754+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145322c0 con 0x55a714514780 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.756+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.756+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145321e0 con 0x7f87fc074040 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.757+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.757+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145322c0 con 0x7f8804017050 2024-05-15T18:09:20.750 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.758+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.758+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145328a0 con 0x55a714519170 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.758+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.758+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a7145328a0 con 0x7f8804017050 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.759+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.759+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f87fc074040 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.761+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.761+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f8804017050 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.762+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.762+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f87fc074040 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.763+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.763+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714514780 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.764+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'196 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.764+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.751 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.765+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.765+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f8804017050 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.766+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.766+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.767+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.767+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714514780 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.768+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.768+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714514780 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.769+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'197 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.752 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.769+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.770+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.770+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f8804017050 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.771+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.771+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.772+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.772+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.773+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.773+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.774+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.774+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.775+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.775+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f87fc074040 2024-05-15T18:09:20.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.776+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.776+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.777+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.777+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f87fc074040 2024-05-15T18:09:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.778+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.778+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x55a714519170 2024-05-15T18:09:20.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.779+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.779+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f87fc074040 2024-05-15T18:09:20.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.780+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.780+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714532e30 con 0x7f8804017050 2024-05-15T18:09:20.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.781+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.781+0000 7f8643fff640 20 reqs_thread_entry: start 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 20 Filter name: none 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8641ffb640 20 reqs_thread_entry: start 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 20 rados->read ofs=0 len=0 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71455de80 con 0x55a714514780 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:09:20.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:09:20.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:20.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.782+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a71455d960 con 0x7f8804017050 2024-05-15T18:09:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.783+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv42 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-15T18:09:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.783+0000 7f86c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.783+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94176088849744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714530a60 con 0x55a714514780 2024-05-15T18:09:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.784+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94176088849744] v31'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.784+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94176088810224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714527d50 con 0x7f8804017050 2024-05-15T18:09:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.785+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94176088810224] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.785+0000 7f8815205800 20 remove_watcher() i=0 2024-05-15T18:09:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.785+0000 7f8815205800 2 removed watcher, disabling cache 2024-05-15T18:09:20.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.785+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94176088817120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a71451e2f0 con 0x55a714514780 2024-05-15T18:09:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.787+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94176088817120] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.787+0000 7f8815205800 20 remove_watcher() i=1 2024-05-15T18:09:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.787+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94176088820896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a71451fde0 con 0x55a714519170 2024-05-15T18:09:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.788+0000 7f8812d04640 1 -- 172.21.15.173:0/3986598752 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94176088820896] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8804055040 con 0x55a714519170 2024-05-15T18:09:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.788+0000 7f8815205800 20 remove_watcher() i=2 2024-05-15T18:09:20.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.788+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94176088819328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a71451fde0 con 0x7f8804017050 2024-05-15T18:09:20.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.789+0000 7f880bfff640 1 -- 172.21.15.173:0/3986598752 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94176088819328] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87fc07f070 con 0x7f8804017050 2024-05-15T18:09:20.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.789+0000 7f8815205800 20 remove_watcher() i=3 2024-05-15T18:09:20.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.789+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94176088824400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714520680 con 0x55a714514780 2024-05-15T18:09:20.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.790+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94176088824400] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x55a714514780 2024-05-15T18:09:20.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.790+0000 7f8815205800 20 remove_watcher() i=4 2024-05-15T18:09:20.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.790+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94176088831680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a71451fde0 con 0x7f87fc074040 2024-05-15T18:09:20.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.791+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94176088831680] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.791+0000 7f8815205800 20 remove_watcher() i=5 2024-05-15T18:09:20.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.791+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94176088834000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714521a50 con 0x7f87fc074040 2024-05-15T18:09:20.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.792+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94176088834000] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.792+0000 7f8815205800 20 remove_watcher() i=6 2024-05-15T18:09:20.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.792+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94176088828016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a714520680 con 0x7f87fc074040 2024-05-15T18:09:20.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94176088828016] v31'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f880c031040 con 0x7f87fc074040 2024-05-15T18:09:20.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 20 remove_watcher() i=7 2024-05-15T18:09:20.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f87fc074040 msgr2=0x7f87fc081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f87fc074040 0x7f87fc081410 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a714514780 msgr2=0x55a714516c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a714514780 0x55a714516c40 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8804017050 msgr2=0x7f8804024780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8804017050 0x7f8804024780 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a714519170 msgr2=0x55a71451b560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a714519170 0x55a71451b560 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86dc036900 msgr2=0x7f86dc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86dc036900 0x7f86dc038dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55a7144e6c00 tx=0x7f87fc04f000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 msgr2=0x55a7145091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8813505640 1 -- 172.21.15.173:0/3986598752 reap_dead start 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a7145091a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8804034b00 tx=0x7f8804046740 comp rx=0 tx=0).stop 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 shutdown_connections 2024-05-15T18:09:20.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 --2- 172.21.15.173:0/3986598752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a714501e10 0x55a7145091a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.793+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 >> 172.21.15.173:0/3986598752 conn(0x55a7144fe090 msgr2=0x55a7144fb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 shutdown_connections 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/3986598752 wait complete. 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86ec036900 msgr2=0x7f86ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86ec036900 0x7f86ec038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55a7144de270 tx=0x7f87fc005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7144f4c60 msgr2=0x55a7144f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7144f4c60 0x55a7144f5080 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f880404ac40 tx=0x7f8804016b00 comp rx=0 tx=0).stop 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 shutdown_connections 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86ec036900 0x7f86ec038dc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/30852633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7144f4c60 0x55a7144f5080 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 >> 172.21.15.173:0/30852633 conn(0x55a7144e8d00 msgr2=0x55a7144e9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 shutdown_connections 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/30852633 wait complete. 2024-05-15T18:09:20.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a7144e3c50 msgr2=0x55a7144e60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55a7144e3c50 0x55a7144e60a0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a7143db540 msgr2=0x55a7144dd410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55a7143db540 0x55a7144dd410 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a7144dfcc0 msgr2=0x55a7144e20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55a7144dfcc0 0x55a7144e20b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86f8036900 msgr2=0x7f86f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f86f8036900 0x7f86f8038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87fc054000 tx=0x7f87fc04e000 comp rx=0 tx=0).stop 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 msgr2=0x55a7144d61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 --2- 172.21.15.173:0/2148836920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7143d9a00 0x55a7144d61d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8804001d60 tx=0x7f8804000bc0 comp rx=0 tx=0).stop 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8813505640 1 -- 172.21.15.173:0/2148836920 reap_dead start 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 shutdown_connections 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.794+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 >> 172.21.15.173:0/2148836920 conn(0x55a7143d5560 msgr2=0x55a7144c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.795+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 shutdown_connections 2024-05-15T18:09:20.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:20.795+0000 7f8815205800 1 -- 172.21.15.173:0/2148836920 wait complete. 2024-05-15T18:09:20.780 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-15T18:09:20.799 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:20.803 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-15T18:09:55.804 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-05-15T18:09:55.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-05-15T18:09:55.805 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-05-15T18:09:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:55.859 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.883+0000 7fbe37946800 1 Processor -- start 2024-05-15T18:09:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.883+0000 7fbe37946800 1 -- start start 2024-05-15T18:09:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.883+0000 7fbe37946800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5579a4d97670 0x5579a4d99a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.883+0000 7fbe37946800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579a4d99fa0 con 0x5579a4d93b60 2024-05-15T18:09:55.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.883+0000 7fbe37946800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5579a4c24050 con 0x5579a4d97670 2024-05-15T18:09:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.884+0000 7fbe34c4b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5579a4d97670 0x5579a4d99a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.884+0000 7fbe3544c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5579a4d93b60 0x5579a4d95f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60416/0 (socket says 172.21.15.173:60416) 2024-05-15T18:09:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.884+0000 7fbe3544c640 1 -- 172.21.15.173:0/118639233 learned_addr learned my addr 172.21.15.173:0/118639233 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.884+0000 7fbe34c4b640 1 -- 172.21.15.173:0/118639233 >> v1:172.21.15.3:6789/0 conn(0x5579a4d93b60 legacy=0x5579a4d95f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.884+0000 7fbe34c4b640 1 -- 172.21.15.173:0/118639233 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a4d9b180 con 0x5579a4d97670 2024-05-15T18:09:55.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.886+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/118639233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d97670 0x5579a4d99a60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00a470 tx=0x7fbe2c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0fff436a42252f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.886+0000 7fbe27fff640 1 -- 172.21.15.173:0/118639233 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c057070 con 0x5579a4d97670 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe27fff640 1 -- 172.21.15.173:0/118639233 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2c052570 con 0x5579a4d97670 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe27fff640 1 -- 172.21.15.173:0/118639233 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c052870 con 0x5579a4d97670 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe37946800 1 -- 172.21.15.173:0/118639233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d97670 msgr2=0x5579a4d99a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe37946800 1 --2- 172.21.15.173:0/118639233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d97670 0x5579a4d99a60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00a470 tx=0x7fbe2c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe37946800 1 -- 172.21.15.173:0/118639233 shutdown_connections 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe37946800 1 --2- 172.21.15.173:0/118639233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d97670 0x5579a4d99a60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe37946800 1 -- 172.21.15.173:0/118639233 >> 172.21.15.173:0/118639233 conn(0x5579a4d8d5b0 msgr2=0x5579a4d8f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe37946800 1 -- 172.21.15.173:0/118639233 shutdown_connections 2024-05-15T18:09:55.864 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.887+0000 7fbe37946800 1 -- 172.21.15.173:0/118639233 wait complete. 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.903+0000 7fbe37946800 1 Processor -- start 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.903+0000 7fbe37946800 1 -- start start 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.903+0000 7fbe37946800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e84770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.903+0000 7fbe37946800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579a4cde1d0 con 0x5579a4d93b60 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.904+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e84770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.904+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e84770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38146/0 (socket says 172.21.15.173:38146) 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.904+0000 7fbe3544c640 1 -- 172.21.15.173:0/638795022 learned_addr learned my addr 172.21.15.173:0/638795022 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.904+0000 7fbe3544c640 1 -- 172.21.15.173:0/638795022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a4e84d40 con 0x5579a4d93b60 2024-05-15T18:09:55.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.904+0000 7fbe3544c640 1 --2- 172.21.15.173:0/638795022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e84770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbe280017a0 tx=0x7fbe28001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a9ed07996d25b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.905+0000 7fbd23606640 1 -- 172.21.15.173:0/638795022 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28004520 con 0x5579a4d93b60 2024-05-15T18:09:55.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.905+0000 7fbd23606640 1 -- 172.21.15.173:0/638795022 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe280046c0 con 0x5579a4d93b60 2024-05-15T18:09:55.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.905+0000 7fbd23606640 1 -- 172.21.15.173:0/638795022 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28004a00 con 0x5579a4d93b60 2024-05-15T18:09:55.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.905+0000 7fbe37946800 1 -- 172.21.15.173:0/638795022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 msgr2=0x5579a4e84770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.905+0000 7fbe37946800 1 --2- 172.21.15.173:0/638795022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e84770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbe280017a0 tx=0x7fbe28001c60 comp rx=0 tx=0).stop 2024-05-15T18:09:55.884 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 -- 172.21.15.173:0/638795022 shutdown_connections 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 --2- 172.21.15.173:0/638795022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e84770 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 -- 172.21.15.173:0/638795022 >> 172.21.15.173:0/638795022 conn(0x5579a4d8d5b0 msgr2=0x5579a4e80090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 -- 172.21.15.173:0/638795022 shutdown_connections 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 -- 172.21.15.173:0/638795022 wait complete. 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 Processor -- start 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 -- start start 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e8c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe37946800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579a4d9a470 con 0x5579a4d93b60 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.906+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e8c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e8c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38156/0 (socket says 172.21.15.173:38156) 2024-05-15T18:09:55.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbe3544c640 1 -- 172.21.15.173:0/1844345117 learned_addr learned my addr 172.21.15.173:0/1844345117 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbe3544c640 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a4e8c7f0 con 0x5579a4d93b60 2024-05-15T18:09:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbe3544c640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e8c2b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000f80 tx=0x7fbe28001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbd21e03640 1 -- 172.21.15.173:0/1844345117 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28022020 con 0x5579a4d93b60 2024-05-15T18:09:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbd21e03640 1 -- 172.21.15.173:0/1844345117 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28014980 con 0x5579a4d93b60 2024-05-15T18:09:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbd21e03640 1 -- 172.21.15.173:0/1844345117 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28014d00 con 0x5579a4d93b60 2024-05-15T18:09:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579a4e8ca80 con 0x5579a4d93b60 2024-05-15T18:09:55.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.907+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579a4e8f730 con 0x5579a4d93b60 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.908+0000 7fbd21e03640 1 -- 172.21.15.173:0/1844345117 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe28025020 con 0x5579a4d93b60 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.908+0000 7fbd21e03640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd1c036900 0x7fbd1c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.908+0000 7fbd21e03640 1 -- 172.21.15.173:0/1844345117 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fbe28018030 con 0x5579a4d93b60 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd1c036900 0x7fbd1c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4d97670 0x5579a4e934f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4e93a70 con 0x5579a4d97670 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe35c4d640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4d97670 0x5579a4e934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd1c036900 0x7fbd1c038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c054000 tx=0x7fbe2c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe35c4d640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4d97670 0x5579a4e934f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe35c4d640 1 -- 172.21.15.173:0/1844345117 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4d97670 2024-05-15T18:09:55.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.909+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4e90aa0 con 0x5579a4d97670 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.910+0000 7fbe35c4d640 1 -- 172.21.15.173:0/1844345117 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4d97670 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.910+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4e95d80 0x5579a4e98170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.910+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4e98860 con 0x5579a4e95d80 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.910+0000 7fbe3544c640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4e95d80 0x5579a4e98170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.910+0000 7fbe3544c640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4e95d80 0x5579a4e98170 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.911+0000 7fbe3544c640 1 -- 172.21.15.173:0/1844345117 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4e95d80 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.911+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4e94d30 con 0x5579a4d97670 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.911+0000 7fbe35c4d640 1 -- 172.21.15.173:0/1844345117 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4d97670 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.911+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579a4e99d10 0x5579a4e9c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.911+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4e9c8d0 con 0x5579a4e99d10 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.911+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579a4e99d10 0x5579a4e9c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.912+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579a4e99d10 0x5579a4e9c140 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.912+0000 7fbe34c4b640 1 -- 172.21.15.173:0/1844345117 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe2c05a040 con 0x5579a4e99d10 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.912+0000 7fbe37946800 1 Processor -- start 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.912+0000 7fbe37946800 1 -- start start 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbe37946800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eaad30 0x5579a4eab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbe37946800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579a4c84cf0 con 0x5579a4eaad30 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eaad30 0x5579a4eab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eaad30 0x5579a4eab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38166/0 (socket says 172.21.15.173:38166) 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbe3544c640 1 -- 172.21.15.173:0/124473985 learned_addr learned my addr 172.21.15.173:0/124473985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbe3544c640 1 -- 172.21.15.173:0/124473985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a4eab690 con 0x5579a4eaad30 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbe3544c640 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eaad30 0x5579a4eab150 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbe2801efd0 tx=0x7fbe2801df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.913+0000 7fbd1affd640 1 -- 172.21.15.173:0/124473985 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2801e5d0 con 0x5579a4eaad30 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.914+0000 7fbd1affd640 1 -- 172.21.15.173:0/124473985 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2801e770 con 0x5579a4eaad30 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.914+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579a4eac100 con 0x5579a4eaad30 2024-05-15T18:09:55.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.914+0000 7fbd1affd640 1 -- 172.21.15.173:0/124473985 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2801ea90 con 0x5579a4eaad30 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.914+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579a4eac600 con 0x5579a4eaad30 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.914+0000 7fbd1affd640 1 -- 172.21.15.173:0/124473985 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe28010070 con 0x5579a4eaad30 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbd1affd640 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd10036900 0x7fbd10038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbd1affd640 1 -- 172.21.15.173:0/124473985 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fbe2803abc0 con 0x5579a4eaad30 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd10036900 0x7fbd10038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbe37946800 1 Processor -- start 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbe37946800 1 -- start start 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd10036900 0x7fbd10038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5579a4e93f20 tx=0x7fbe2c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbe37946800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4eb8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbe37946800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579a4e850c0 con 0x5579a4eb7ee0 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.915+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4eb8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.916+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4eb8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38170/0 (socket says 172.21.15.173:38170) 2024-05-15T18:09:55.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.916+0000 7fbe3544c640 1 -- 172.21.15.173:0/1541797805 learned_addr learned my addr 172.21.15.173:0/1541797805 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.916+0000 7fbe3544c640 1 -- 172.21.15.173:0/1541797805 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a4eb88d0 con 0x5579a4eb7ee0 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.916+0000 7fbe3544c640 1 --2- 172.21.15.173:0/1541797805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4eb8300 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe28012fd0 tx=0x7fbe280081a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d051e684a0a5d5f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.916+0000 7fbd18ff9640 1 -- 172.21.15.173:0/1541797805 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2803e070 con 0x5579a4eb7ee0 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.916+0000 7fbd18ff9640 1 -- 172.21.15.173:0/1541797805 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28005070 con 0x5579a4eb7ee0 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.916+0000 7fbd18ff9640 1 -- 172.21.15.173:0/1541797805 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe280443c0 con 0x5579a4eb7ee0 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 -- 172.21.15.173:0/1541797805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 msgr2=0x5579a4eb8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 --2- 172.21.15.173:0/1541797805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4eb8300 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe28012fd0 tx=0x7fbe280081a0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 -- 172.21.15.173:0/1541797805 shutdown_connections 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 --2- 172.21.15.173:0/1541797805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4eb8300 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 -- 172.21.15.173:0/1541797805 >> 172.21.15.173:0/1541797805 conn(0x5579a4eb41b0 msgr2=0x5579a4eb2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 -- 172.21.15.173:0/1541797805 shutdown_connections 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 -- 172.21.15.173:0/1541797805 wait complete. 2024-05-15T18:09:55.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 Processor -- start 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 -- start start 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4d93400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe37946800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579a4eb8fa0 con 0x5579a4eb7ee0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4d93400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe3544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4d93400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38176/0 (socket says 172.21.15.173:38176) 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.917+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 learned_addr learned my addr 172.21.15.173:0/3777971489 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.918+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579a4d93940 con 0x5579a4eb7ee0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.918+0000 7fbe3544c640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4d93400 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbe28047010 tx=0x7fbe28031ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.918+0000 7fbd06ffd640 1 -- 172.21.15.173:0/3777971489 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2804ca60 con 0x5579a4eb7ee0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.918+0000 7fbd06ffd640 1 -- 172.21.15.173:0/3777971489 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2804cc00 con 0x5579a4eb7ee0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.918+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579a4d91af0 con 0x5579a4eb7ee0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.918+0000 7fbd06ffd640 1 -- 172.21.15.173:0/3777971489 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2802e780 con 0x5579a4eb7ee0 2024-05-15T18:09:55.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.918+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579a4d91af0 con 0x5579a4eb7ee0 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.919+0000 7fbd06ffd640 1 -- 172.21.15.173:0/3777971489 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe2802e920 con 0x5579a4eb7ee0 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.919+0000 7fbd06ffd640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd00036900 0x7fbd00038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbd06ffd640 1 -- 172.21.15.173:0/3777971489 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fbe280501b0 con 0x5579a4eb7ee0 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd00036900 0x7fbd00038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4eccc30 0x5579a4ecf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ecf820 con 0x5579a4eccc30 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe35c4d640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4eccc30 0x5579a4ecf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd00036900 0x7fbd00038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5579a4e9ccd0 tx=0x7fbe2c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe35c4d640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4eccc30 0x5579a4ecf0d0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.920+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 realm 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ecfc30 con 0x5579a4eccc30 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x5579a4eccc30 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed0870 con 0x5579a4eccc30 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4ed1230 0x5579a4ed3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed3ba0 con 0x5579a4ed1230 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.921+0000 7fbe3544c640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4ed1230 0x5579a4ed3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe3544c640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4ed1230 0x5579a4ed3620 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe37946800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe37946800 20 searching for the correct realm 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed55b0 con 0x5579a4ed1230 2024-05-15T18:09:55.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe3544c640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbe28027020 0x7fbe2803a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.922+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed55b0 con 0x7fbe28027020 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.923+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbe28027020 0x7fbe2803a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.923+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbe28027020 0x7fbe2803a050 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.923+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.923+0000 7fbe34c4b640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbe2c074040 0x7fbe2c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.923+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed55b0 con 0x7fbe2c074040 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.923+0000 7fbe35c4d640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbe2c074040 0x7fbe2c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.924+0000 7fbe35c4d640 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbe2c074040 0x7fbe2c081410 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:55.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.924+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.924+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x5579a4eccc30 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x5579a4eccc30 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x7fbe2c074040 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x7fbe2c074040 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.925+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x7fbe28027020 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.926+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.926+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x5579a4ed1230 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.926+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.926+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x5579a4eccc30 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.926+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.926+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe30026040 con 0x7fbe2c074040 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe30026040 con 0x5579a4eccc30 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe30026040 con 0x7fbe28027020 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4ed1230 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.927+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4ed1230 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.928+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.928+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe2c074040 2024-05-15T18:09:55.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.928+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.928+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4ed1230 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4ed1230 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4eccc30 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4eccc30 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.929+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe2c074040 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.930+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.930+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4ed1230 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.930+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.930+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe28027020 2024-05-15T18:09:55.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.930+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.930+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4eccc30 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.931+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.931+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe2c074040 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.931+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.931+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4ed1230 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.931+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.931+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe2c074040 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe28027020 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4ed1230 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe28027020 2024-05-15T18:09:55.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.932+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x5579a4eccc30 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fbe2c08e060 con 0x7fbe28027020 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed04d0 con 0x5579a4eccc30 2024-05-15T18:09:55.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed4540 con 0x5579a4eccc30 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.933+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed4540 con 0x7fbe2c074040 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 20 zone default found 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 4 Realm: () 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:55.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 20 zonegroup default 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed4960 con 0x7fbe2c074040 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.934+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed4da0 con 0x5579a4ed1230 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe37946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe37946800 20 rados->read ofs=0 len=0 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed7460 con 0x5579a4ed1230 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe37946800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:55.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe37946800 20 started sync module instance, tier type = 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe37946800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.935+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed6900 con 0x7fbe28027020 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.936+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.936+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93980946424912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed7800 con 0x7fbe28027020 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.936+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed8050 con 0x5579a4eccc30 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.937+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93980946424912] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.937+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.937+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93980946430880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed8470 con 0x5579a4eccc30 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.937+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed8cc0 con 0x5579a4ed1230 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.939+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93980946430880] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.939+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.939+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93980946432448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed9060 con 0x5579a4ed1230 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.939+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed9aa0 con 0x7fbe28027020 2024-05-15T18:09:55.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.940+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93980946432448] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.940+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.940+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93980946433568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4eda340 con 0x7fbe28027020 2024-05-15T18:09:55.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.940+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edad00 con 0x5579a4eccc30 2024-05-15T18:09:55.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.941+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93980946433568] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.942+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.942+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93980946442320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edb120 con 0x5579a4eccc30 2024-05-15T18:09:55.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.942+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edbae0 con 0x7fbe2c074040 2024-05-15T18:09:55.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.943+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93980946442320] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.943+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.943+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93980946443856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edbae0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.943+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edc4a0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.944+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.944+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93980946448368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edc8c0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.944+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edd3a0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.944+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93980946443856] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93980946448368] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93980946452144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edc410 con 0x7fbe2c074040 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 20 add_watcher() i=0 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 20 add_watcher() i=1 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 20 add_watcher() i=2 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 20 add_watcher() i=3 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 20 add_watcher() i=4 2024-05-15T18:09:55.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 20 add_watcher() i=5 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.945+0000 7fbe37946800 20 add_watcher() i=6 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.946+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93980946452144] v31'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.946+0000 7fbe37946800 20 add_watcher() i=7 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.946+0000 7fbe37946800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.946+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ee04a0 con 0x5579a4eccc30 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.947+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.947+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93980946445872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edd920 con 0x5579a4eccc30 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93980946445872] v31'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbcebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbe37946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbe37946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbe37946800 5 note: GC not initialized 2024-05-15T18:09:55.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbceafe5640 20 reqs_thread_entry: start 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbe37946800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbe37946800 20 Filter name: none 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.948+0000 7fbce8fe1640 20 reqs_thread_entry: start 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f13cf0 con 0x5579a4eccc30 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f13cf0 con 0x7fbe28027020 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4eccc30 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4ed1230 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.949+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4ed1230 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4ed1230 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4eccc30 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4eccc30 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.950+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4ed1230 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.951+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.951+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x5579a4ed1230 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.951+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.951+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f14170 con 0x7fbe2c074040 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4eccc30 2024-05-15T18:09:55.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe28027020 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4ed1230 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.952+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe2c074040 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.953+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.953+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe2c074040 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.953+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.953+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4ed1230 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.953+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.953+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe2c074040 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4eccc30 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4ed1230 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe2c074040 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.954+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe28027020 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe2c074040 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4eccc30 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4eccc30 2024-05-15T18:09:55.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.955+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4eccc30 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4eccc30 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.956+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.957+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.957+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.957+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.957+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5579a4f159e0 con 0x7fbe2c074040 2024-05-15T18:09:55.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.957+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.958+0000 7fbcebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.958+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93980946445872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ec66d0 con 0x5579a4eccc30 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.959+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93980946445872] v31'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.959+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93980946424912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edb630 con 0x7fbe28027020 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.960+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93980946424912] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.960+0000 7fbe37946800 20 remove_watcher() i=0 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.960+0000 7fbe37946800 2 removed watcher, disabling cache 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.960+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93980946430880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed6450 con 0x5579a4eccc30 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.961+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93980946430880] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.961+0000 7fbe37946800 20 remove_watcher() i=1 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.961+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93980946432448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed6450 con 0x5579a4ed1230 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.963+0000 7fbe3544c640 1 -- 172.21.15.173:0/3777971489 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93980946432448] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2801b070 con 0x5579a4ed1230 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.963+0000 7fbe37946800 20 remove_watcher() i=2 2024-05-15T18:09:55.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.963+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93980946433568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed81c0 con 0x7fbe28027020 2024-05-15T18:09:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.964+0000 7fbe34c4b640 1 -- 172.21.15.173:0/3777971489 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93980946433568] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2c07f070 con 0x7fbe28027020 2024-05-15T18:09:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.964+0000 7fbe37946800 20 remove_watcher() i=3 2024-05-15T18:09:55.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.964+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93980946442320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed6450 con 0x5579a4eccc30 2024-05-15T18:09:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.965+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93980946442320] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x5579a4eccc30 2024-05-15T18:09:55.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.965+0000 7fbe37946800 20 remove_watcher() i=4 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.965+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93980946443856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4eda850 con 0x7fbe2c074040 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.966+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93980946443856] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.966+0000 7fbe37946800 20 remove_watcher() i=5 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.966+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93980946448368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4ed6450 con 0x7fbe2c074040 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.967+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93980946448368] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.967+0000 7fbe37946800 20 remove_watcher() i=6 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.967+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93980946452144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5579a4edae50 con 0x7fbe2c074040 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93980946452144] v31'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe300083e0 con 0x7fbe2c074040 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 20 remove_watcher() i=7 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbe2c074040 msgr2=0x7fbe2c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fbe2c074040 0x7fbe2c081410 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4eccc30 msgr2=0x5579a4ecf0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4eccc30 0x5579a4ecf0d0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbe28027020 msgr2=0x7fbe2803a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fbe28027020 0x7fbe2803a050 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4ed1230 msgr2=0x5579a4ed3620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4ed1230 0x5579a4ed3620 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd00036900 msgr2=0x7fbd00038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd00036900 0x7fbd00038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5579a4e9ccd0 tx=0x7fbe2c04f000 comp rx=0 tx=0).stop 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 msgr2=0x5579a4d93400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe37946800 1 --2- 172.21.15.173:0/3777971489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eb7ee0 0x5579a4d93400 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fbe28047010 tx=0x7fbe28031ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 reap_dead start 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.969+0000 7fbe35c4d640 1 -- 172.21.15.173:0/3777971489 reap_dead start 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 shutdown_connections 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 >> 172.21.15.173:0/3777971489 conn(0x5579a4eb41b0 msgr2=0x5579a4eb1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 shutdown_connections 2024-05-15T18:09:55.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/3777971489 wait complete. 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd10036900 msgr2=0x7fbd10038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd10036900 0x7fbd10038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5579a4e93f20 tx=0x7fbe2c005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eaad30 msgr2=0x5579a4eab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eaad30 0x5579a4eab150 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbe2801efd0 tx=0x7fbe2801df40 comp rx=0 tx=0).stop 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 shutdown_connections 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd10036900 0x7fbd10038dc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/124473985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4eaad30 0x5579a4eab150 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 >> 172.21.15.173:0/124473985 conn(0x5579a4e9edd0 msgr2=0x5579a4e9f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 shutdown_connections 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/124473985 wait complete. 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579a4e99d10 msgr2=0x5579a4e9c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5579a4e99d10 0x5579a4e9c140 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4d97670 msgr2=0x5579a4e934f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5579a4d97670 0x5579a4e934f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4e95d80 msgr2=0x5579a4e98170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5579a4e95d80 0x5579a4e98170 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd1c036900 msgr2=0x7fbd1c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbd1c036900 0x7fbd1c038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c054000 tx=0x7fbe2c04e000 comp rx=0 tx=0).stop 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 msgr2=0x5579a4e8c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 --2- 172.21.15.173:0/1844345117 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5579a4d93b60 0x5579a4e8c2b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000f80 tx=0x7fbe28001250 comp rx=0 tx=0).stop 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe35c4d640 1 -- 172.21.15.173:0/1844345117 reap_dead start 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 shutdown_connections 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.970+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 >> 172.21.15.173:0/1844345117 conn(0x5579a4d8d5b0 msgr2=0x5579a4e7e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.971+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 shutdown_connections 2024-05-15T18:09:55.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:55.971+0000 7fbe37946800 1 -- 172.21.15.173:0/1844345117 wait complete. 2024-05-15T18:09:55.957 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-05-15T18:09:55.958 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-05-15T18:09:55.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-15T18:09:55.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-15T18:09:55.958 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-15T18:09:56.000 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:56.001 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f7ec11800 1 Processor -- start 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f7ec11800 1 -- start start 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f7ec11800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56470a6ddfb0 0x56470a6de3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f7ec11800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56470a6dea50 con 0x56470a6df210 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f7ec11800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56470a570050 con 0x56470a6ddfb0 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f7a221640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x56470a6ddfb0 0x56470a6de3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f79a20640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x56470a6df210 0x56470a6df690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60422/0 (socket says 172.21.15.173:60422) 2024-05-15T18:09:56.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.025+0000 7f5f79a20640 1 -- 172.21.15.173:0/3789513356 learned_addr learned my addr 172.21.15.173:0/3789513356 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.026+0000 7f5f7921f640 1 -- 172.21.15.173:0/3789513356 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507068999 0 0) 0x56470a6dea50 con 0x56470a6df210 2024-05-15T18:09:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.026+0000 7f5f7921f640 1 -- 172.21.15.173:0/3789513356 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f68001e10 con 0x56470a6df210 2024-05-15T18:09:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.026+0000 7f5f7a221640 1 -- 172.21.15.173:0/3789513356 >> v1:172.21.15.3:6789/0 conn(0x56470a6df210 legacy=0x56470a6df690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.026+0000 7f5f7a221640 1 -- 172.21.15.173:0/3789513356 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a6dfdd0 con 0x56470a6ddfb0 2024-05-15T18:09:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7a221640 1 --2- 172.21.15.173:0/3789513356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a6de3d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5f74005fd0 tx=0x7f5f7401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c035479ad31ec30 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7921f640 1 -- 172.21.15.173:0/3789513356 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f7404adc0 con 0x56470a6ddfb0 2024-05-15T18:09:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7921f640 1 -- 172.21.15.173:0/3789513356 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f74052430 con 0x56470a6ddfb0 2024-05-15T18:09:56.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7921f640 1 -- 172.21.15.173:0/3789513356 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74052790 con 0x56470a6ddfb0 2024-05-15T18:09:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7ec11800 1 -- 172.21.15.173:0/3789513356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 msgr2=0x56470a6de3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/3789513356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a6de3d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5f74005fd0 tx=0x7f5f7401cbe0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7ec11800 1 -- 172.21.15.173:0/3789513356 shutdown_connections 2024-05-15T18:09:56.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/3789513356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a6de3d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7ec11800 1 -- 172.21.15.173:0/3789513356 >> 172.21.15.173:0/3789513356 conn(0x56470a6d9590 msgr2=0x56470a6db9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7ec11800 1 -- 172.21.15.173:0/3789513356 shutdown_connections 2024-05-15T18:09:56.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.028+0000 7f5f7ec11800 1 -- 172.21.15.173:0/3789513356 wait complete. 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7ec11800 1 Processor -- start 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7ec11800 1 -- start start 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7ec11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a7cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7ec11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56470a62a1c0 con 0x56470a6ddfb0 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a7cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a7cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38184/0 (socket says 172.21.15.173:38184) 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7a221640 1 -- 172.21.15.173:0/2648011625 learned_addr learned my addr 172.21.15.173:0/2648011625 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.042+0000 7f5f7a221640 1 -- 172.21.15.173:0/2648011625 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a7cf9f0 con 0x56470a6ddfb0 2024-05-15T18:09:56.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.043+0000 7f5f7a221640 1 --2- 172.21.15.173:0/2648011625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a7cf420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5f74007000 tx=0x7f5f7404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8614f806fcfd9c1a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.043+0000 7f5e68608640 1 -- 172.21.15.173:0/2648011625 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74063070 con 0x56470a6ddfb0 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.043+0000 7f5e68608640 1 -- 172.21.15.173:0/2648011625 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f74052980 con 0x56470a6ddfb0 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.043+0000 7f5e68608640 1 -- 172.21.15.173:0/2648011625 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74052c60 con 0x56470a6ddfb0 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2648011625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 msgr2=0x56470a7cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/2648011625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a7cf420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5f74007000 tx=0x7f5f7404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2648011625 shutdown_connections 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/2648011625 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a7cf420 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2648011625 >> 172.21.15.173:0/2648011625 conn(0x56470a6d9590 msgr2=0x56470a7cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2648011625 shutdown_connections 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2648011625 wait complete. 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 Processor -- start 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 -- start start 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a652700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7ec11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56470a6e76e0 con 0x56470a6ddfb0 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a652700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a652700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38198/0 (socket says 172.21.15.173:38198) 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.044+0000 7f5f7a221640 1 -- 172.21.15.173:0/1086291711 learned_addr learned my addr 172.21.15.173:0/1086291711 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.045+0000 7f5f7a221640 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a7dac10 con 0x56470a6ddfb0 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.045+0000 7f5f7a221640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a652700 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5f74061040 tx=0x7f5f74003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.045+0000 7f5e66e05640 1 -- 172.21.15.173:0/1086291711 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f7406b070 con 0x56470a6ddfb0 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.045+0000 7f5e66e05640 1 -- 172.21.15.173:0/1086291711 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f7405e8f0 con 0x56470a6ddfb0 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.045+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56470a7dade0 con 0x56470a6ddfb0 2024-05-15T18:09:56.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.045+0000 7f5e66e05640 1 -- 172.21.15.173:0/1086291711 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74063040 con 0x56470a6ddfb0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.045+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470a7db300 con 0x56470a6ddfb0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.046+0000 7f5e66e05640 1 -- 172.21.15.173:0/1086291711 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f74070450 con 0x56470a6ddfb0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.046+0000 7f5e66e05640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e60036900 0x7f5e60038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.046+0000 7f5e66e05640 1 -- 172.21.15.173:0/1086291711 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5f7408dd50 con 0x56470a6ddfb0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.046+0000 7f5f79a20640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e60036900 0x7f5e60038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.046+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a6df210 0x56470a7df120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.046+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a7df720 con 0x56470a6df210 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.046+0000 7f5f7aa22640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a6df210 0x56470a7df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f79a20640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e60036900 0x7f5e60038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f64001db0 tx=0x7f5f64001350 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f7aa22640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a6df210 0x56470a7df120 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f7aa22640 1 -- 172.21.15.173:0/1086291711 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a6df210 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a7dc6d0 con 0x56470a6df210 2024-05-15T18:09:56.026 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f7aa22640 1 -- 172.21.15.173:0/1086291711 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a6df210 2024-05-15T18:09:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a7e1a10 0x56470a7e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a7e44f0 con 0x56470a7e1a10 2024-05-15T18:09:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.047+0000 7f5f7a221640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a7e1a10 0x56470a7e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.048+0000 7f5f7a221640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a7e1a10 0x56470a7e3e00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.048+0000 7f5f7a221640 1 -- 172.21.15.173:0/1086291711 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f7406d070 con 0x56470a7e1a10 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.048+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a7e09c0 con 0x56470a6df210 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.048+0000 7f5f7aa22640 1 -- 172.21.15.173:0/1086291711 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a6df210 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.048+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56470a7e5950 0x56470a7e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.048+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a7e8520 con 0x56470a7e5950 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.048+0000 7f5f79a20640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56470a7e5950 0x56470a7e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.049+0000 7f5f79a20640 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56470a7e5950 0x56470a7e7dc0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.049+0000 7f5f79a20640 1 -- 172.21.15.173:0/1086291711 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f64009050 con 0x56470a7e5950 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.049+0000 7f5f7ec11800 1 Processor -- start 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7ec11800 1 -- start start 2024-05-15T18:09:56.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7ec11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7f69d0 0x56470a7f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7ec11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56470a5d0cf0 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7f69d0 0x56470a7f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7f69d0 0x56470a7f6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38210/0 (socket says 172.21.15.173:38210) 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7a221640 1 -- 172.21.15.173:0/1571734054 learned_addr learned my addr 172.21.15.173:0/1571734054 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7a221640 1 -- 172.21.15.173:0/1571734054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a7f7330 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.050+0000 7f5f7a221640 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7f69d0 0x56470a7f6df0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5f74054010 tx=0x7f5f74070f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.051+0000 7f5e5ffff640 1 -- 172.21.15.173:0/1571734054 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74081070 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.051+0000 7f5e5ffff640 1 -- 172.21.15.173:0/1571734054 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f740853b0 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.051+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56470a7f7da0 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.051+0000 7f5e5ffff640 1 -- 172.21.15.173:0/1571734054 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74051ac0 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.051+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470a7f7da0 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.051+0000 7f5e5ffff640 1 -- 172.21.15.173:0/1571734054 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f74084070 con 0x56470a7f69d0 2024-05-15T18:09:56.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5e5ffff640 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e54036900 0x7f5e54038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5e5ffff640 1 -- 172.21.15.173:0/1571734054 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5f74097bd0 con 0x56470a7f69d0 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f79a20640 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e54036900 0x7f5e54038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f7ec11800 1 Processor -- start 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f7ec11800 1 -- start start 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f79a20640 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e54036900 0x7f5e54038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56470a7dffc0 tx=0x7f5f6400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f7ec11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a7d8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f7ec11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56470a7cfd10 con 0x56470a7d8270 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a7d8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a7d8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38218/0 (socket says 172.21.15.173:38218) 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.052+0000 7f5f7a221640 1 -- 172.21.15.173:0/2074291424 learned_addr learned my addr 172.21.15.173:0/2074291424 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5f7a221640 1 -- 172.21.15.173:0/2074291424 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a7d6a80 con 0x56470a7d8270 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5f7a221640 1 --2- 172.21.15.173:0/2074291424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a7d8690 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f74056040 tx=0x7f5f74085d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed3c4e326f86a12 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5e5dffb640 1 -- 172.21.15.173:0/2074291424 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f740a4020 con 0x56470a7d8270 2024-05-15T18:09:56.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5e5dffb640 1 -- 172.21.15.173:0/2074291424 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f74067dd0 con 0x56470a7d8270 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5e5dffb640 1 -- 172.21.15.173:0/2074291424 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f7408c550 con 0x56470a7d8270 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2074291424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 msgr2=0x56470a7d8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/2074291424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a7d8690 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f74056040 tx=0x7f5f74085d30 comp rx=0 tx=0).stop 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2074291424 shutdown_connections 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/2074291424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a7d8690 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.053+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2074291424 >> 172.21.15.173:0/2074291424 conn(0x56470a7ffc80 msgr2=0x56470a7fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2074291424 shutdown_connections 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7ec11800 1 -- 172.21.15.173:0/2074291424 wait complete. 2024-05-15T18:09:56.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7ec11800 1 Processor -- start 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7ec11800 1 -- start start 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7ec11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a80cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7ec11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56470a7d6e90 con 0x56470a7d8270 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a80cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7a221640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a80cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38222/0 (socket says 172.21.15.173:38222) 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.054+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 learned_addr learned my addr 172.21.15.173:0/385343973 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.055+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470a80d490 con 0x56470a7d8270 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.055+0000 7f5f7a221640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a80cf50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5f7404cfb0 tx=0x7f5f7408eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.055+0000 7f5e4bfff640 1 -- 172.21.15.173:0/385343973 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f740b9070 con 0x56470a7d8270 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.055+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56470a80d490 con 0x56470a7d8270 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.055+0000 7f5e4bfff640 1 -- 172.21.15.173:0/385343973 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f7407b470 con 0x56470a7d8270 2024-05-15T18:09:56.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.055+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470a80d490 con 0x56470a7d8270 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.055+0000 7f5e4bfff640 1 -- 172.21.15.173:0/385343973 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f74051c60 con 0x56470a7d8270 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5e4bfff640 1 -- 172.21.15.173:0/385343973 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f740bc070 con 0x56470a7d8270 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5e4bfff640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e44036900 0x7f5e44038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5e4bfff640 1 -- 172.21.15.173:0/385343973 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5f740af030 con 0x56470a7d8270 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5f79a20640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e44036900 0x7f5e44038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a818500 0x56470a81a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81b0f0 con 0x56470a818500 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.056+0000 7f5f7aa22640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a818500 0x56470a81a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f79a20640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e44036900 0x7f5e44038dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400efd0 tx=0x7f5f64010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7aa22640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a818500 0x56470a81a9a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 20 realm 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81b520 con 0x56470a818500 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81bdc0 con 0x56470a818500 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.057+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81c160 con 0x56470a818500 2024-05-15T18:09:56.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7ec11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a81cb20 0x56470a81ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81f450 con 0x56470a81cb20 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7a221640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a81cb20 0x56470a81ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7a221640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a81cb20 0x56470a81ef10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7ec11800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7ec11800 20 searching for the correct realm 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.058+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56470a820e70 con 0x56470a81cb20 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f7a221640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5f740be060 0x7f5f7404c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56470a820e70 con 0x7f5f740be060 2024-05-15T18:09:56.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f79a20640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5f740be060 0x7f5f7404c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f79a20640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5f740be060 0x7f5f7404c0e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f79a20640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5f64037040 0x7f5f64036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56470a820e70 con 0x7f5f64037040 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.059+0000 7f5f7aa22640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5f64037040 0x7f5f64036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.060+0000 7f5f7aa22640 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5f64037040 0x7f5f64036410 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.060+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.060+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56470a81bdc0 con 0x56470a818500 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.060+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.060+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56470a81bdc0 con 0x56470a818500 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.060+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.060+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56470a81bdc0 con 0x7f5f64037040 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.061+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.061+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f64037040 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.061+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.061+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f740be060 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.061+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.061+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a818500 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f64037040 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a818500 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.062+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f740be060 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f64037040 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.063+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a818500 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a818500 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.064+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f64037040 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f740be060 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a818500 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.065+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f64037040 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f64037040 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f740be060 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.066+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a81cb20 2024-05-15T18:09:56.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f740be060 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x56470a818500 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5f6c026040 con 0x7f5f740be060 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.067+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81bdc0 con 0x56470a818500 2024-05-15T18:09:56.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81fe00 con 0x56470a818500 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a81fe00 con 0x7f5f64037040 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 zone default found 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 4 Realm: () 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:56.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 zonegroup default 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.068+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a820220 con 0x7f5f64037040 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a820640 con 0x56470a81cb20 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a822d20 con 0x56470a81cb20 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 20 started sync module instance, tier type = 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.069+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a8221c0 con 0x7f5f740be060 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.070+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.070+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863118966032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a8230c0 con 0x7f5f740be060 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.070+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a823910 con 0x56470a818500 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.071+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863118966032] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.071+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.071+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863118972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a823d30 con 0x56470a818500 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.071+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a8245e0 con 0x56470a81cb20 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.073+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863118972000] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.073+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.073+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863118973536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a824a00 con 0x56470a81cb20 2024-05-15T18:09:56.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.073+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a825440 con 0x7f5f740be060 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.074+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.074+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863118973536] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.074+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863118981088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a8260b0 con 0x7f5f740be060 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.074+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a826980 con 0x56470a818500 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.075+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863118981088] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.075+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.075+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863118982144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a826990 con 0x56470a818500 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.075+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a827470 con 0x7f5f64037040 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.076+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863118982144] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.077+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.077+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863118984352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a827430 con 0x7f5f64037040 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.077+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a827e50 con 0x7f5f64037040 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.078+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863118984352] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.078+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.078+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863118989632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a827e10 con 0x7f5f64037040 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.078+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a828840 con 0x7f5f64037040 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863118989632] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863118987136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a828800 con 0x7f5f64037040 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 20 add_watcher() i=0 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 20 add_watcher() i=1 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 20 add_watcher() i=2 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 20 add_watcher() i=3 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 20 add_watcher() i=4 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 20 add_watcher() i=5 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.079+0000 7f5f7ec11800 20 add_watcher() i=6 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.080+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863118987136] v31'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.080+0000 7f5f7ec11800 20 add_watcher() i=7 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.080+0000 7f5f7ec11800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.080+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a82bc90 con 0x56470a818500 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.080+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.080+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863118992672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a8291b0 con 0x56470a818500 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.081+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863118992672] v31'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.081+0000 7f5e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7ec11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7ec11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7ec11800 5 note: GC not initialized 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5dab7fe640 20 reqs_thread_entry: start 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7ec11800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7ec11800 20 Filter name: none 2024-05-15T18:09:56.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5da97fa640 20 reqs_thread_entry: start 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85f740 con 0x56470a818500 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.082+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85f740 con 0x7f5f740be060 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a818500 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a81cb20 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a81cb20 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.083+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a81cb20 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a818500 2024-05-15T18:09:56.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a818500 2024-05-15T18:09:56.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a81cb20 2024-05-15T18:09:56.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x56470a81cb20 2024-05-15T18:09:56.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.084+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a85fbc0 con 0x7f5f64037040 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.085+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.085+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a818500 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.085+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.085+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f740be060 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a81cb20 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f64037040 2024-05-15T18:09:56.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f64037040 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.086+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a81cb20 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.087+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.087+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f64037040 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.087+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.087+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a818500 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.087+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.087+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a81cb20 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.088+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.088+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f64037040 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.088+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.088+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f740be060 2024-05-15T18:09:56.083 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.088+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.088+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f64037040 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a81cb20 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.089+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a81cb20 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a81cb20 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x56470a81cb20 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.090+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56470a861790 con 0x7f5f64037040 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.091+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.092+0000 7f5e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.092+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863118992672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a8612e0 con 0x56470a818500 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.093+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94863118992672] v31'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.093+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863118966032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a8284f0 con 0x7f5f740be060 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.094+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94863118966032] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.094+0000 7f5f7ec11800 20 remove_watcher() i=0 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.094+0000 7f5f7ec11800 2 removed watcher, disabling cache 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.094+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863118972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a821d10 con 0x56470a818500 2024-05-15T18:09:56.085 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.095+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94863118972000] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.095+0000 7f5f7ec11800 20 remove_watcher() i=1 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.095+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863118973536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a821d10 con 0x56470a81cb20 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.096+0000 7f5f7a221640 1 -- 172.21.15.173:0/385343973 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94863118973536] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f740bb030 con 0x56470a81cb20 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.096+0000 7f5f7ec11800 20 remove_watcher() i=2 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.096+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863118981088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a823a60 con 0x7f5f740be060 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.097+0000 7f5f79a20640 1 -- 172.21.15.173:0/385343973 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94863118981088] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f64009050 con 0x7f5f740be060 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.097+0000 7f5f7ec11800 20 remove_watcher() i=3 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.097+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863118982144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a821d10 con 0x56470a818500 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.099+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94863118982144] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x56470a818500 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.099+0000 7f5f7ec11800 20 remove_watcher() i=4 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.099+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863118984352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a825c90 con 0x7f5f64037040 2024-05-15T18:09:56.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.100+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94863118984352] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.100+0000 7f5f7ec11800 20 remove_watcher() i=5 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.100+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863118989632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a823a60 con 0x7f5f64037040 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.101+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94863118989632] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.101+0000 7f5f7ec11800 20 remove_watcher() i=6 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.101+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863118987136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56470a821d10 con 0x7f5f64037040 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94863118987136] v31'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f6c0083e0 con 0x7f5f64037040 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 20 remove_watcher() i=7 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5f64037040 msgr2=0x7f5f64036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5f64037040 0x7f5f64036410 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a818500 msgr2=0x56470a81a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a818500 0x56470a81a9a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5f740be060 msgr2=0x7f5f7404c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5f740be060 0x7f5f7404c0e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a81cb20 msgr2=0x56470a81ef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a81cb20 0x56470a81ef10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e44036900 msgr2=0x7f5e44038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e44036900 0x7f5e44038dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400efd0 tx=0x7f5f64010000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 msgr2=0x56470a80cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7aa22640 1 -- 172.21.15.173:0/385343973 reap_dead start 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a80cf50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5f7404cfb0 tx=0x7f5f7408eb30 comp rx=0 tx=0).stop 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 shutdown_connections 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/385343973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7d8270 0x56470a80cf50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 >> 172.21.15.173:0/385343973 conn(0x56470a7ffc80 msgr2=0x56470a7fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 shutdown_connections 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.102+0000 7f5f7ec11800 1 -- 172.21.15.173:0/385343973 wait complete. 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e54036900 msgr2=0x7f5e54038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e54036900 0x7f5e54038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56470a7dffc0 tx=0x7f5f6400f000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7f69d0 msgr2=0x56470a7f6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7f69d0 0x56470a7f6df0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5f74054010 tx=0x7f5f74070f30 comp rx=0 tx=0).stop 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 shutdown_connections 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e54036900 0x7f5e54038dc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1571734054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a7f69d0 0x56470a7f6df0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 >> 172.21.15.173:0/1571734054 conn(0x56470a7eaa70 msgr2=0x56470a7eae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 shutdown_connections 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1571734054 wait complete. 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56470a7e5950 msgr2=0x56470a7e7dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56470a7e5950 0x56470a7e7dc0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a6df210 msgr2=0x56470a7df120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x56470a6df210 0x56470a7df120 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a7e1a10 msgr2=0x56470a7e3e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x56470a7e1a10 0x56470a7e3e00 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e60036900 msgr2=0x7f5e60038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5e60036900 0x7f5e60038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f64001db0 tx=0x7f5f64001350 comp rx=0 tx=0).stop 2024-05-15T18:09:56.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 msgr2=0x56470a652700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 --2- 172.21.15.173:0/1086291711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56470a6ddfb0 0x56470a652700 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5f74061040 tx=0x7f5f74003330 comp rx=0 tx=0).stop 2024-05-15T18:09:56.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7aa22640 1 -- 172.21.15.173:0/1086291711 reap_dead start 2024-05-15T18:09:56.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 shutdown_connections 2024-05-15T18:09:56.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 >> 172.21.15.173:0/1086291711 conn(0x56470a6d9590 msgr2=0x56470a7c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 shutdown_connections 2024-05-15T18:09:56.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.103+0000 7f5f7ec11800 1 -- 172.21.15.173:0/1086291711 wait complete. 2024-05-15T18:09:56.091 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-05-15T18:09:56.091 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-05-15T18:09:56.092 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-15T18:09:56.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-15T18:09:56.092 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-15T18:09:56.176 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:56.176 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:56.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.200+0000 7fc4f4498800 1 Processor -- start 2024-05-15T18:09:56.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.200+0000 7fc4f4498800 1 -- start start 2024-05-15T18:09:56.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.200+0000 7fc4f4498800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55eeade71fd0 0x55eeade723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.200+0000 7fc4f4498800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eeade72a70 con 0x55eeade73230 2024-05-15T18:09:56.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.200+0000 7fc4f4498800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55eeadd04050 con 0x55eeade71fd0 2024-05-15T18:09:56.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.201+0000 7fc4f1f9e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55eeade71fd0 0x55eeade723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.201+0000 7fc4f1f9e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55eeade71fd0 0x55eeade723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38226/0 (socket says 172.21.15.173:38226) 2024-05-15T18:09:56.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.201+0000 7fc4f179d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55eeade73230 0x55eeade736b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60434/0 (socket says 172.21.15.173:60434) 2024-05-15T18:09:56.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.201+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/3970511327 learned_addr learned my addr 172.21.15.173:0/3970511327 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.201+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/3970511327 >> v1:172.21.15.3:6789/0 conn(0x55eeade73230 legacy=0x55eeade736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.201+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/3970511327 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeade73df0 con 0x55eeade71fd0 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/3970511327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeade723f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005fd0 tx=0x7fc4e401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e804e77196a61f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f0f9c640 1 -- 172.21.15.173:0/3970511327 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4052540 con 0x55eeade71fd0 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f0f9c640 1 -- 172.21.15.173:0/3970511327 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e404e070 con 0x55eeade71fd0 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f0f9c640 1 -- 172.21.15.173:0/3970511327 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4052890 con 0x55eeade71fd0 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f4498800 1 -- 172.21.15.173:0/3970511327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 msgr2=0x55eeade723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f4498800 1 --2- 172.21.15.173:0/3970511327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeade723f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005fd0 tx=0x7fc4e401cd80 comp rx=0 tx=0).stop 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f4498800 1 -- 172.21.15.173:0/3970511327 shutdown_connections 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f4498800 1 --2- 172.21.15.173:0/3970511327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeade723f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f4498800 1 -- 172.21.15.173:0/3970511327 >> 172.21.15.173:0/3970511327 conn(0x55eeade6d5b0 msgr2=0x55eeade6f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f4498800 1 -- 172.21.15.173:0/3970511327 shutdown_connections 2024-05-15T18:09:56.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.203+0000 7fc4f4498800 1 -- 172.21.15.173:0/3970511327 wait complete. 2024-05-15T18:09:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.217+0000 7fc4f4498800 1 Processor -- start 2024-05-15T18:09:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.217+0000 7fc4f4498800 1 -- start start 2024-05-15T18:09:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.217+0000 7fc4f4498800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf60520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.217+0000 7fc4f4498800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55eeaddbe1d0 con 0x55eeade71fd0 2024-05-15T18:09:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.218+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf60520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.218+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf60520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38228/0 (socket says 172.21.15.173:38228) 2024-05-15T18:09:56.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.218+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/965508802 learned_addr learned my addr 172.21.15.173:0/965508802 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.218+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/965508802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeadf5eae0 con 0x55eeade71fd0 2024-05-15T18:09:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.218+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/965508802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf60520 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400a190 tx=0x7fc4e404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6025b8b7986ef669 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc3dfe07640 1 -- 172.21.15.173:0/965508802 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4052410 con 0x55eeade71fd0 2024-05-15T18:09:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc3dfe07640 1 -- 172.21.15.173:0/965508802 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4062070 con 0x55eeade71fd0 2024-05-15T18:09:56.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc3dfe07640 1 -- 172.21.15.173:0/965508802 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4052700 con 0x55eeade71fd0 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc4f4498800 1 -- 172.21.15.173:0/965508802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 msgr2=0x55eeadf60520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc4f4498800 1 --2- 172.21.15.173:0/965508802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf60520 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400a190 tx=0x7fc4e404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc4f4498800 1 -- 172.21.15.173:0/965508802 shutdown_connections 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc4f4498800 1 --2- 172.21.15.173:0/965508802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf60520 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc4f4498800 1 -- 172.21.15.173:0/965508802 >> 172.21.15.173:0/965508802 conn(0x55eeade6d5b0 msgr2=0x55eeadf62bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc4f4498800 1 -- 172.21.15.173:0/965508802 shutdown_connections 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.219+0000 7fc4f4498800 1 -- 172.21.15.173:0/965508802 wait complete. 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f4498800 1 Processor -- start 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f4498800 1 -- start start 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f4498800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf6e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f4498800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55eeade7b700 con 0x55eeade71fd0 2024-05-15T18:09:56.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf6e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf6e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38232/0 (socket says 172.21.15.173:38232) 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1801472573 learned_addr learned my addr 172.21.15.173:0/1801472573 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.220+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeadf6e9a0 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.221+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf6e460 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400a190 tx=0x7fc4e4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.221+0000 7fc3de604640 1 -- 172.21.15.173:0/1801472573 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e405d630 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.221+0000 7fc3de604640 1 -- 172.21.15.173:0/1801472573 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4058040 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.221+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeadf6ec30 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.221+0000 7fc3de604640 1 -- 172.21.15.173:0/1801472573 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e405d920 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.221+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeadf718e0 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc3de604640 1 -- 172.21.15.173:0/1801472573 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc4e4050070 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc3de604640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3d8036900 0x7fc3d8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc3de604640 1 -- 172.21.15.173:0/1801472573 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc4e408e4b0 con 0x55eeade71fd0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3d8036900 0x7fc3d8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeade73230 0x55eeadf756a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadf75be0 con 0x55eeade73230 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc4f279f640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeade73230 0x55eeadf756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.222+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3d8036900 0x7fc3d8038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8000f60 tx=0x7fc4e8001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.223+0000 7fc4f279f640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeade73230 0x55eeadf756a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.223+0000 7fc4f279f640 1 -- 172.21.15.173:0/1801472573 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeade73230 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.223+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadf72c50 con 0x55eeade73230 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.223+0000 7fc4f279f640 1 -- 172.21.15.173:0/1801472573 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeade73230 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.223+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadf77ed0 0x55eeadf7a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.223+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadf7a9b0 con 0x55eeadf77ed0 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.223+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadf77ed0 0x55eeadf7a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.224+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadf77ed0 0x55eeadf7a2c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.224+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1801472573 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4e4077020 con 0x55eeadf77ed0 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.224+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadf76e80 con 0x55eeade73230 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.224+0000 7fc4f279f640 1 -- 172.21.15.173:0/1801472573 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeade73230 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.224+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55eeadf7be10 0x55eeadf7e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.224+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadf7ea10 con 0x55eeadf7be10 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.224+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55eeadf7be10 0x55eeadf7e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.225+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55eeadf7be10 0x55eeadf7e280 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.225+0000 7fc4f179d640 1 -- 172.21.15.173:0/1801472573 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4e800f690 con 0x55eeadf7be10 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.225+0000 7fc4f4498800 1 Processor -- start 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f4498800 1 -- start start 2024-05-15T18:09:56.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f4498800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf8cec0 0x55eeadf8d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f4498800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55eeadd64cf0 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf8cec0 0x55eeadf8d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf8cec0 0x55eeadf8d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38246/0 (socket says 172.21.15.173:38246) 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/3464107339 learned_addr learned my addr 172.21.15.173:0/3464107339 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/3464107339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeadf8d820 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.226+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf8cec0 0x55eeadf8d2e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4052a80 tx=0x7fc4e407ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.227+0000 7fc3d77fe640 1 -- 172.21.15.173:0/3464107339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4093070 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.227+0000 7fc3d77fe640 1 -- 172.21.15.173:0/3464107339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4070e60 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.227+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeadf8e290 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.227+0000 7fc3d77fe640 1 -- 172.21.15.173:0/3464107339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4051860 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.227+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeadf8e790 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.227+0000 7fc3d77fe640 1 -- 172.21.15.173:0/3464107339 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc4e4096070 con 0x55eeadf8cec0 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc3d77fe640 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3cc036900 0x7fc3cc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc3d77fe640 1 -- 172.21.15.173:0/3464107339 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc4e4099be0 con 0x55eeadf8cec0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f179d640 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3cc036900 0x7fc3cc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f4498800 1 Processor -- start 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f4498800 1 -- start start 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f179d640 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3cc036900 0x7fc3cc038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55eeadf7ad80 tx=0x7fc4e800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f4498800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadf9a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f4498800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55eeadf5eda0 con 0x55eeadf9a0c0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadf9a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadf9a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38250/0 (socket says 172.21.15.173:38250) 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.228+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/70257699 learned_addr learned my addr 172.21.15.173:0/70257699 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/70257699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeadf9aab0 con 0x55eeadf9a0c0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/70257699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadf9a4e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40516c0 tx=0x7fc4e4071730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01f24f1f8eb97dd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc3d57fa640 1 -- 172.21.15.173:0/70257699 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4088cd0 con 0x55eeadf9a0c0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc3d57fa640 1 -- 172.21.15.173:0/70257699 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4066cd0 con 0x55eeadf9a0c0 2024-05-15T18:09:56.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc3d57fa640 1 -- 172.21.15.173:0/70257699 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e408cae0 con 0x55eeadf9a0c0 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc4f4498800 1 -- 172.21.15.173:0/70257699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 msgr2=0x55eeadf9a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc4f4498800 1 --2- 172.21.15.173:0/70257699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadf9a4e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40516c0 tx=0x7fc4e4071730 comp rx=0 tx=0).stop 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc4f4498800 1 -- 172.21.15.173:0/70257699 shutdown_connections 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc4f4498800 1 --2- 172.21.15.173:0/70257699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadf9a4e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.229+0000 7fc4f4498800 1 -- 172.21.15.173:0/70257699 >> 172.21.15.173:0/70257699 conn(0x55eeadf963e0 msgr2=0x55eeadf94440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f4498800 1 -- 172.21.15.173:0/70257699 shutdown_connections 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f4498800 1 -- 172.21.15.173:0/70257699 wait complete. 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f4498800 1 Processor -- start 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f4498800 1 -- start start 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f4498800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadfa14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f4498800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55eeadf9b050 con 0x55eeadf9a0c0 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadfa14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f1f9e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadfa14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38260/0 (socket says 172.21.15.173:38260) 2024-05-15T18:09:56.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 learned_addr learned my addr 172.21.15.173:0/1146694739 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.230+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeadfa1a20 con 0x55eeadf9a0c0 2024-05-15T18:09:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.231+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadfa14e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc4e407ac70 tx=0x7fc4e4076ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.231+0000 7fc3c37fe640 1 -- 172.21.15.173:0/1146694739 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4088cd0 con 0x55eeadf9a0c0 2024-05-15T18:09:56.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.231+0000 7fc3c37fe640 1 -- 172.21.15.173:0/1146694739 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e404be80 con 0x55eeadf9a0c0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.231+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eeadfa1a20 con 0x55eeadf9a0c0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.231+0000 7fc3c37fe640 1 -- 172.21.15.173:0/1146694739 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e40719d0 con 0x55eeadf9a0c0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.231+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeadfa1a20 con 0x55eeadf9a0c0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.232+0000 7fc3c37fe640 1 -- 172.21.15.173:0/1146694739 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc4e4086040 con 0x55eeadf9a0c0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.232+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.232+0000 7fc3c37fe640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3bc036900 0x7fc3bc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.232+0000 7fc3c37fe640 1 -- 172.21.15.173:0/1146694739 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc4e40a3070 con 0x55eeadf9a0c0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.232+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3bc036900 0x7fc3bc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.232+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeadfaca70 0x55eeadfaef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.232+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfaf660 con 0x55eeadfaca70 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f279f640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeadfaca70 0x55eeadfaef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3bc036900 0x7fc3bc038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55eeadf76e50 tx=0x7fc4e8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.219 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f279f640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeadfaca70 0x55eeadfaef10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 20 realm 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfafa70 con 0x55eeadfaca70 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x55eeadfaca70 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.233+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb06b0 con 0x55eeadfaca70 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f4498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadfb1070 0x55eeadfb3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb39a0 con 0x55eeadfb1070 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadfb1070 0x55eeadfb3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadfb1070 0x55eeadfb3460 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f4498800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f4498800 20 searching for the correct realm 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.234+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb53b0 con 0x55eeadfb1070 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f1f9e640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4e40b1040 0x7fc4e4093210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb53b0 con 0x7fc4e40b1040 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4e40b1040 0x7fc4e4093210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4e40b1040 0x7fc4e4093210 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f179d640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4e800f070 0x7fc4e802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.235+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb53b0 con 0x7fc4e800f070 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.236+0000 7fc4f279f640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4e800f070 0x7fc4e802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.236+0000 7fc4f279f640 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4e800f070 0x7fc4e802e910 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.236+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.236+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x55eeadfaca70 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.236+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.237+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x55eeadfaca70 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.237+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.237+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x7fc4e800f070 2024-05-15T18:09:56.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.237+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.237+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x7fc4e800f070 2024-05-15T18:09:56.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.237+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.237+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x7fc4e40b1040 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.238+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.238+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x55eeadfb1070 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.238+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.238+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x55eeadfaca70 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.238+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.238+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e800f070 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.238+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfaca70 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e40b1040 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.239+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e800f070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfaca70 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.240+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfaca70 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.241+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.241+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e800f070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.241+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.241+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfb1070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.241+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.241+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e40b1040 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfaca70 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e800f070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfb1070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.242+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e800f070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.243+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.243+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e40b1040 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.243+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.243+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfb1070 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e40b1040 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x55eeadfaca70 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc4ec026040 con 0x7fc4e40b1040 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:56.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb0310 con 0x55eeadfaca70 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.244+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb4340 con 0x55eeadfaca70 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb4340 con 0x7fc4e800f070 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 zone default found 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 4 Realm: () 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 zonegroup default 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb4760 con 0x7fc4e800f070 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.245+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb4ba0 con 0x55eeadfb1070 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f4498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb7260 con 0x55eeadfb1070 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f4498800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f4498800 20 started sync module instance, tier type = 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f4498800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.246+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb6700 con 0x7fc4e40b1040 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.247+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.247+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94483609510480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb7600 con 0x7fc4e40b1040 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.247+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb7e50 con 0x55eeadfaca70 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.248+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94483609510480] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.248+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.248+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94483609516448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb8270 con 0x55eeadfaca70 2024-05-15T18:09:56.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.248+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb8ac0 con 0x55eeadfb1070 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.250+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94483609516448] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.250+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.250+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94483609517984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb8eb0 con 0x55eeadfb1070 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.250+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb98b0 con 0x7fc4e40b1040 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.251+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94483609517984] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.251+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.251+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94483609519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfba150 con 0x7fc4e40b1040 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.251+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbab10 con 0x55eeadfaca70 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.252+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94483609519104] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.252+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.252+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94483609527904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbaf30 con 0x55eeadfaca70 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.252+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbb8f0 con 0x7fc4e800f070 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.254+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.254+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94483609527904] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.254+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94483609531456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbb860 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.254+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbc330 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.255+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94483609531456] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.255+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.255+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94483609528960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbc330 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.255+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbccf0 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94483609536576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbcc60 con 0x7fc4e800f070 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 20 add_watcher() i=0 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 20 add_watcher() i=1 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 20 add_watcher() i=2 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 20 add_watcher() i=3 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 20 add_watcher() i=4 2024-05-15T18:09:56.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 20 add_watcher() i=5 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94483609528960] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.256+0000 7fc4f4498800 20 add_watcher() i=6 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.257+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94483609536576] v31'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.257+0000 7fc4f4498800 20 add_watcher() i=7 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.257+0000 7fc4f4498800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.257+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbbce0 con 0x55eeadfaca70 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.257+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.257+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94483609538608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbbce0 con 0x55eeadfaca70 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.258+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94483609538608] v31'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.258+0000 7fc3a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.258+0000 7fc4f4498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.258+0000 7fc4f4498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.258+0000 7fc4f4498800 5 note: GC not initialized 2024-05-15T18:09:56.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc3a27fc640 20 reqs_thread_entry: start 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc4f4498800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc4f4498800 20 Filter name: none 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc313fff640 20 reqs_thread_entry: start 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc4f4498800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadff31b0 con 0x55eeadfaca70 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc4f4498800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.259+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55eeadff45a0 con 0x7fc4e800f070 2024-05-15T18:09:56.247 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.260+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.261+0000 7fc3a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.261+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94483609538608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbdb30 con 0x55eeadfaca70 2024-05-15T18:09:56.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.262+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94483609538608] v31'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.262+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94483609510480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbd030 con 0x7fc4e40b1040 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.263+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94483609510480] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.263+0000 7fc4f4498800 20 remove_watcher() i=0 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.263+0000 7fc4f4498800 2 removed watcher, disabling cache 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.263+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94483609516448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb6250 con 0x55eeadfaca70 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.264+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94483609516448] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.264+0000 7fc4f4498800 20 remove_watcher() i=1 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.264+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94483609517984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb79a0 con 0x55eeadfb1070 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.265+0000 7fc4f1f9e640 1 -- 172.21.15.173:0/1146694739 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94483609517984] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e4095030 con 0x55eeadfb1070 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.265+0000 7fc4f4498800 20 remove_watcher() i=2 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.265+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94483609519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb7fa0 con 0x7fc4e40b1040 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.266+0000 7fc4f179d640 1 -- 172.21.15.173:0/1146694739 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94483609519104] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4e8037040 con 0x7fc4e40b1040 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.266+0000 7fc4f4498800 20 remove_watcher() i=3 2024-05-15T18:09:56.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.266+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94483609527904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfb7fa0 con 0x55eeadfaca70 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.267+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94483609527904] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x55eeadfaca70 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.267+0000 7fc4f4498800 20 remove_watcher() i=4 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.267+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94483609531456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfba660 con 0x7fc4e800f070 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.268+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94483609531456] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.268+0000 7fc4f4498800 20 remove_watcher() i=5 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.268+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94483609528960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfba660 con 0x7fc4e800f070 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.269+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94483609528960] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.269+0000 7fc4f4498800 20 remove_watcher() i=6 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.269+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94483609536576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55eeadfbb440 con 0x7fc4e800f070 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94483609536576] v31'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4ec0083e0 con 0x7fc4e800f070 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 20 remove_watcher() i=7 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4e800f070 msgr2=0x7fc4e802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc4e800f070 0x7fc4e802e910 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeadfaca70 msgr2=0x55eeadfaef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeadfaca70 0x55eeadfaef10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4e40b1040 msgr2=0x7fc4e4093210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc4e40b1040 0x7fc4e4093210 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadfb1070 msgr2=0x55eeadfb3460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadfb1070 0x55eeadfb3460 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3bc036900 msgr2=0x7fc3bc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3bc036900 0x7fc3bc038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55eeadf76e50 tx=0x7fc4e8010000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 msgr2=0x55eeadfa14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1146694739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf9a0c0 0x55eeadfa14e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc4e407ac70 tx=0x7fc4e4076ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 reap_dead start 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f279f640 1 -- 172.21.15.173:0/1146694739 reap_dead start 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 shutdown_connections 2024-05-15T18:09:56.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 >> 172.21.15.173:0/1146694739 conn(0x55eeadf963e0 msgr2=0x55eeadf93a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 shutdown_connections 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/1146694739 wait complete. 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3cc036900 msgr2=0x7fc3cc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3cc036900 0x7fc3cc038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55eeadf7ad80 tx=0x7fc4e800f000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf8cec0 msgr2=0x55eeadf8d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf8cec0 0x55eeadf8d2e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4052a80 tx=0x7fc4e407ac00 comp rx=0 tx=0).stop 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 shutdown_connections 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3cc036900 0x7fc3cc038dc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 --2- 172.21.15.173:0/3464107339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeadf8cec0 0x55eeadf8d2e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 >> 172.21.15.173:0/3464107339 conn(0x55eeadf80f60 msgr2=0x55eeadf81360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 shutdown_connections 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.271+0000 7fc4f4498800 1 -- 172.21.15.173:0/3464107339 wait complete. 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55eeadf7be10 msgr2=0x55eeadf7e280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55eeadf7be10 0x55eeadf7e280 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeade73230 msgr2=0x55eeadf756a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55eeade73230 0x55eeadf756a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadf77ed0 msgr2=0x55eeadf7a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55eeadf77ed0 0x55eeadf7a2c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3d8036900 msgr2=0x7fc3d8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc3d8036900 0x7fc3d8038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8000f60 tx=0x7fc4e8001370 comp rx=0 tx=0).stop 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 msgr2=0x55eeadf6e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 --2- 172.21.15.173:0/1801472573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eeade71fd0 0x55eeadf6e460 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400a190 tx=0x7fc4e4003330 comp rx=0 tx=0).stop 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f279f640 1 -- 172.21.15.173:0/1801472573 reap_dead start 2024-05-15T18:09:56.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 shutdown_connections 2024-05-15T18:09:56.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 >> 172.21.15.173:0/1801472573 conn(0x55eeade6d5b0 msgr2=0x55eeadf5e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 shutdown_connections 2024-05-15T18:09:56.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.272+0000 7fc4f4498800 1 -- 172.21.15.173:0/1801472573 wait complete. 2024-05-15T18:09:56.259 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-05-15T18:09:56.259 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-05-15T18:09:56.259 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-15T18:09:56.259 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-15T18:09:56.259 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-05-15T18:09:56.306 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:56.306 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:56.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c6f27800 1 Processor -- start 2024-05-15T18:09:56.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c6f27800 1 -- start start 2024-05-15T18:09:56.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c6f27800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562b137fe020 0x562b1388dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c6f27800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b13891f60 con 0x562b1388e210 2024-05-15T18:09:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c6f27800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x562b1371c050 con 0x562b137fe020 2024-05-15T18:09:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c2ba7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562b137fe020 0x562b1388dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c23a6640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x562b1388e210 0x562b138906d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60442/0 (socket says 172.21.15.173:60442) 2024-05-15T18:09:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c2ba7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562b137fe020 0x562b1388dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38272/0 (socket says 172.21.15.173:38272) 2024-05-15T18:09:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.330+0000 7ff5c23a6640 1 -- 172.21.15.173:0/2495727145 learned_addr learned my addr 172.21.15.173:0/2495727145 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.331+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/2495727145 >> v1:172.21.15.3:6789/0 conn(0x562b1388e210 legacy=0x562b138906d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.331+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/2495727145 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b13893190 con 0x562b137fe020 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/2495727145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1388dca0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dd6f4935f521e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c1ba5640 1 -- 172.21.15.173:0/2495727145 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4052560 con 0x562b137fe020 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c1ba5640 1 -- 172.21.15.173:0/2495727145 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4052700 con 0x562b137fe020 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c1ba5640 1 -- 172.21.15.173:0/2495727145 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4052a60 con 0x562b137fe020 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c6f27800 1 -- 172.21.15.173:0/2495727145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 msgr2=0x562b1388dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/2495727145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1388dca0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005fd0 tx=0x7ff5b401ccc0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c6f27800 1 -- 172.21.15.173:0/2495727145 shutdown_connections 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/2495727145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1388dca0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c6f27800 1 -- 172.21.15.173:0/2495727145 >> 172.21.15.173:0/2495727145 conn(0x562b138855c0 msgr2=0x562b138879e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c6f27800 1 -- 172.21.15.173:0/2495727145 shutdown_connections 2024-05-15T18:09:56.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.333+0000 7ff5c6f27800 1 -- 172.21.15.173:0/2495727145 wait complete. 2024-05-15T18:09:56.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.347+0000 7ff5c6f27800 1 Processor -- start 2024-05-15T18:09:56.324 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.347+0000 7ff5c6f27800 1 -- start start 2024-05-15T18:09:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.347+0000 7ff5c6f27800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1397c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.347+0000 7ff5c6f27800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b137d61c0 con 0x562b137fe020 2024-05-15T18:09:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1397c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1397c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38276/0 (socket says 172.21.15.173:38276) 2024-05-15T18:09:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/3191577584 learned_addr learned my addr 172.21.15.173:0/3191577584 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/3191577584 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b1397cce0 con 0x562b137fe020 2024-05-15T18:09:56.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/3191577584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1397c710 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4007000 tx=0x7ff5b404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb9ad4c855e049f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff4b0e09640 1 -- 172.21.15.173:0/3191577584 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4052cd0 con 0x562b137fe020 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff4b0e09640 1 -- 172.21.15.173:0/3191577584 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b40528b0 con 0x562b137fe020 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.348+0000 7ff4b0e09640 1 -- 172.21.15.173:0/3191577584 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b405c430 con 0x562b137fe020 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 -- 172.21.15.173:0/3191577584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 msgr2=0x562b1397c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/3191577584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1397c710 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4007000 tx=0x7ff5b404c000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 -- 172.21.15.173:0/3191577584 shutdown_connections 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/3191577584 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b1397c710 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 -- 172.21.15.173:0/3191577584 >> 172.21.15.173:0/3191577584 conn(0x562b138855c0 msgr2=0x562b13978030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 -- 172.21.15.173:0/3191577584 shutdown_connections 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 -- 172.21.15.173:0/3191577584 wait complete. 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.349+0000 7ff5c6f27800 1 Processor -- start 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c6f27800 1 -- start start 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c6f27800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b13984140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c6f27800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b138923d0 con 0x562b137fe020 2024-05-15T18:09:56.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b13984140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b13984140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38280/0 (socket says 172.21.15.173:38280) 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/193898906 learned_addr learned my addr 172.21.15.173:0/193898906 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b13984680 con 0x562b137fe020 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.350+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b13984140 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4000f80 tx=0x7ff5b4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.351+0000 7ff4af606640 1 -- 172.21.15.173:0/193898906 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4073020 con 0x562b137fe020 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.351+0000 7ff4af606640 1 -- 172.21.15.173:0/193898906 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b406f520 con 0x562b137fe020 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.351+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b13984910 con 0x562b137fe020 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.351+0000 7ff4af606640 1 -- 172.21.15.173:0/193898906 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b406f800 con 0x562b137fe020 2024-05-15T18:09:56.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.351+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b139875c0 con 0x562b137fe020 2024-05-15T18:09:56.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff4af606640 1 -- 172.21.15.173:0/193898906 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff5b406fbb0 con 0x562b137fe020 2024-05-15T18:09:56.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff4af606640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff4a8036900 0x7ff4a8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff4af606640 1 -- 172.21.15.173:0/193898906 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7ff5b406c050 con 0x562b137fe020 2024-05-15T18:09:56.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff4a8036900 0x7ff4a8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b1388e210 0x562b1398b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b1398b950 con 0x562b1388e210 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff5c33a8640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b1388e210 0x562b1398b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff4a8036900 0x7ff4a8038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8000f60 tx=0x7ff5b80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.352+0000 7ff5c33a8640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b1388e210 0x562b1398b380 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.353+0000 7ff5c33a8640 1 -- 172.21.15.173:0/193898906 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b1388e210 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.353+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b13988930 con 0x562b1388e210 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.353+0000 7ff5c33a8640 1 -- 172.21.15.173:0/193898906 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b1388e210 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.353+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b1398dc60 0x562b13990050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.353+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b13990740 con 0x562b1398dc60 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.353+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b1398dc60 0x562b13990050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.353+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b1398dc60 0x562b13990050 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.354+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/193898906 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff5b4075020 con 0x562b1398dc60 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.354+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b1398cbe0 con 0x562b1388e210 2024-05-15T18:09:56.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.354+0000 7ff5c33a8640 1 -- 172.21.15.173:0/193898906 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b1388e210 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.354+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562b13991ba0 0x562b13993fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.354+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b13994730 con 0x562b13991ba0 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.354+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562b13991ba0 0x562b13993fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.354+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562b13991ba0 0x562b13993fd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c23a6640 1 -- 172.21.15.173:0/193898906 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5b8009050 con 0x562b13991ba0 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c6f27800 1 Processor -- start 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c6f27800 1 -- start start 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c6f27800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139a2b90 0x562b139a2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c6f27800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b1377ccf0 con 0x562b139a2b90 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139a2b90 0x562b139a2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139a2b90 0x562b139a2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38282/0 (socket says 172.21.15.173:38282) 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.355+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/904793729 learned_addr learned my addr 172.21.15.173:0/904793729 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.356+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/904793729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b139a34f0 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.356+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139a2b90 0x562b139a2fb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff5b408cf50 tx=0x7ff5b405bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.356+0000 7ff4ace01640 1 -- 172.21.15.173:0/904793729 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4092020 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.356+0000 7ff4ace01640 1 -- 172.21.15.173:0/904793729 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4076a80 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.356+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b139a3f60 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.356+0000 7ff4ace01640 1 -- 172.21.15.173:0/904793729 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4076d60 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.356+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b139a4460 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.357+0000 7ff4ace01640 1 -- 172.21.15.173:0/904793729 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff5b408e3d0 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.357+0000 7ff4ace01640 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff49c036900 0x7ff49c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.357+0000 7ff4ace01640 1 -- 172.21.15.173:0/904793729 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7ff5b40071c0 con 0x562b139a2b90 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.357+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff49c036900 0x7ff49c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.357+0000 7ff5c6f27800 1 Processor -- start 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.357+0000 7ff5c6f27800 1 -- start start 2024-05-15T18:09:56.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff49c036900 0x7ff49c038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800bf50 tx=0x7ff5b800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c6f27800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c6f27800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b1397d000 con 0x562b139afcb0 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38298/0 (socket says 172.21.15.173:38298) 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/213701525 learned_addr learned my addr 172.21.15.173:0/213701525 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/213701525 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b139b06a0 con 0x562b139afcb0 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/213701525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b00d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4078bf0 tx=0x7ff5b4078620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfd35f7a9d2f3d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff4a67fc640 1 -- 172.21.15.173:0/213701525 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b4080150 con 0x562b139afcb0 2024-05-15T18:09:56.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff4a67fc640 1 -- 172.21.15.173:0/213701525 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4078c60 con 0x562b139afcb0 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.358+0000 7ff4a67fc640 1 -- 172.21.15.173:0/213701525 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b404de60 con 0x562b139afcb0 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 -- 172.21.15.173:0/213701525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 msgr2=0x562b139b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/213701525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b00d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4078bf0 tx=0x7ff5b4078620 comp rx=0 tx=0).stop 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 -- 172.21.15.173:0/213701525 shutdown_connections 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/213701525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b00d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 -- 172.21.15.173:0/213701525 >> 172.21.15.173:0/213701525 conn(0x562b139ac010 msgr2=0x562b139aa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 -- 172.21.15.173:0/213701525 shutdown_connections 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 -- 172.21.15.173:0/213701525 wait complete. 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 Processor -- start 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 -- start start 2024-05-15T18:09:56.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.359+0000 7ff5c6f27800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b139b0d50 con 0x562b139afcb0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff5c2ba7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38310/0 (socket says 172.21.15.173:38310) 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 learned_addr learned my addr 172.21.15.173:0/1875114735 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b139b7610 con 0x562b139afcb0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b70d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4078bf0 tx=0x7ff5b4085f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff4a4ff9640 1 -- 172.21.15.173:0/1875114735 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b40af040 con 0x562b139afcb0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff4a4ff9640 1 -- 172.21.15.173:0/1875114735 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b40ba070 con 0x562b139afcb0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b139b7610 con 0x562b139afcb0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff4a4ff9640 1 -- 172.21.15.173:0/1875114735 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5b408e9d0 con 0x562b139afcb0 2024-05-15T18:09:56.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.360+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b139b7610 con 0x562b139afcb0 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.361+0000 7ff4a4ff9640 1 -- 172.21.15.173:0/1875114735 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff5b406ecc0 con 0x562b139afcb0 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.361+0000 7ff4a4ff9640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff48c036aa0 0x7ff48c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.361+0000 7ff4a4ff9640 1 -- 172.21.15.173:0/1875114735 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7ff5b40ae270 con 0x562b139afcb0 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff48c036aa0 0x7ff48c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b139c27e0 0x562b139c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139c53f0 con 0x562b139c27e0 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c33a8640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b139c27e0 0x562b139c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff48c036aa0 0x7ff48c038f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8001b60 tx=0x7ff5b8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c33a8640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b139c27e0 0x562b139c4ca0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c6f27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c6f27800 20 realm 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.362+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139c5820 con 0x562b139c27e0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x562b139c27e0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139c6490 con 0x562b139c27e0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b139c6e50 0x562b139c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139c9780 con 0x562b139c6e50 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b139c6e50 0x562b139c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.363+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b139c6e50 0x562b139c9240 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c6f27800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c6f27800 20 searching for the correct realm 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139cb0f0 con 0x562b139c6e50 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c2ba7640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5b4097020 0x7ff5b40575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139cb0f0 con 0x7ff5b4097020 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5b4097020 0x7ff5b40575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.364+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5b4097020 0x7ff5b40575b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.365+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b8009050 con 0x7ff5b4097020 2024-05-15T18:09:56.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.365+0000 7ff5c23a6640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff5b8038040 0x7ff5b801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.365+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139cb0f0 con 0x7ff5b8038040 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.365+0000 7ff5c33a8640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff5b8038040 0x7ff5b801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.366+0000 7ff5c33a8640 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff5b8038040 0x7ff5b801bab0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.366+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.366+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x562b139c27e0 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.366+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.366+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x562b139c27e0 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.366+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.366+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x7ff5b8038040 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x7ff5b8038040 2024-05-15T18:09:56.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x7ff5b4097020 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b8009050 con 0x7ff5b4097020 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x562b139c6e50 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.367+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60f0 con 0x562b139c27e0 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b8038040 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c27e0 2024-05-15T18:09:56.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b4097020 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff5b8009050 con 0x7ff5b4097020 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.368+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c6e50 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c6e50 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b8038040 2024-05-15T18:09:56.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c6e50 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.369+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c6e50 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c27e0 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c27e0 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b8038040 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.370+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c6e50 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b4097020 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b8009050 con 0x7ff5b4097020 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c27e0 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b8038040 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.371+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c6e50 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.372+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.372+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b8038040 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.372+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.372+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b4097020 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.372+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b8009050 con 0x7ff5b4097020 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.372+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c6e50 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b4097020 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x562b139c27e0 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7ff5bc026040 con 0x7ff5b4097020 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:56.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139c60d0 con 0x562b139c27e0 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.373+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139ca0c0 con 0x562b139c27e0 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139ca0c0 con 0x7ff5b8038040 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 zone default found 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 4 Realm: () 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 zonegroup default 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139ca4e0 con 0x7ff5b8038040 2024-05-15T18:09:56.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.374+0000 7ff5c6f27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139ca900 con 0x562b139c6e50 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139ccfa0 con 0x562b139c6e50 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 20 started sync module instance, tier type = 2024-05-15T18:09:56.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.375+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cc440 con 0x7ff5b4097020 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.376+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.376+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743012622224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cd340 con 0x7ff5b4097020 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.376+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cdb90 con 0x562b139c27e0 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.377+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743012622224] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.377+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.377+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743012628192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cdfb0 con 0x562b139c27e0 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.377+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139ce970 con 0x562b139c6e50 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.379+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.379+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743012631744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cf1c0 con 0x562b139c6e50 2024-05-15T18:09:56.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.379+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cfc20 con 0x7ff5b4097020 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.379+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743012628192] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.380+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.380+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743012629248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d04c0 con 0x7ff5b4097020 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.380+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d0e80 con 0x562b139c27e0 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.380+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743012631744] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.381+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.381+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743012641232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d12a0 con 0x562b139c27e0 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.381+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d1c60 con 0x7ff5b8038040 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.381+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743012629248] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.382+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743012641232] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.382+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.382+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743012642288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d1210 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.382+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d2110 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.383+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743012642288] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.383+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.383+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743012644784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d2080 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.383+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d2ae0 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743012644784] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743012648384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d2cc0 con 0x7ff5b8038040 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 20 add_watcher() i=0 2024-05-15T18:09:56.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 20 add_watcher() i=1 2024-05-15T18:09:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 20 add_watcher() i=2 2024-05-15T18:09:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 20 add_watcher() i=3 2024-05-15T18:09:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 20 add_watcher() i=4 2024-05-15T18:09:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 20 add_watcher() i=5 2024-05-15T18:09:56.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.385+0000 7ff5c6f27800 20 add_watcher() i=6 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.386+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743012648384] v31'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.386+0000 7ff5c6f27800 20 add_watcher() i=7 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.386+0000 7ff5c6f27800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.386+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b139d6090 con 0x562b139c27e0 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.386+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.386+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743012649904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d3480 con 0x562b139c27e0 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.387+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743012649904] v31'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.387+0000 7ff4797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.387+0000 7ff5c6f27800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.387+0000 7ff5c6f27800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.387+0000 7ff5c6f27800 5 note: GC not initialized 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.387+0000 7ff3f3fff640 20 reqs_thread_entry: start 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff5c6f27800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff5c6f27800 20 Filter name: none 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff3f1ffb640 20 reqs_thread_entry: start 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff5c6f27800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b13a08f20 con 0x562b139c27e0 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff5c6f27800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:56.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.388+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562b13a0a310 con 0x7ff5b8038040 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.389+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.390+0000 7ff4797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.390+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743012649904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b13a07b70 con 0x562b139c27e0 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.391+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94743012649904] v31'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.391+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743012622224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139d2bb0 con 0x7ff5b4097020 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.392+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94743012622224] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.392+0000 7ff5c6f27800 20 remove_watcher() i=0 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.392+0000 7ff5c6f27800 2 removed watcher, disabling cache 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.392+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743012628192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cbf90 con 0x562b139c27e0 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.393+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94743012628192] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.393+0000 7ff5c6f27800 20 remove_watcher() i=1 2024-05-15T18:09:56.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.393+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743012631744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cbf90 con 0x562b139c6e50 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.394+0000 7ff5c2ba7640 1 -- 172.21.15.173:0/1875114735 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94743012631744] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b4094020 con 0x562b139c6e50 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.394+0000 7ff5c6f27800 20 remove_watcher() i=2 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.394+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743012629248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139ce4c0 con 0x7ff5b4097020 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.395+0000 7ff5c23a6640 1 -- 172.21.15.173:0/1875114735 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94743012629248] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5b8045040 con 0x7ff5b4097020 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.395+0000 7ff5c6f27800 20 remove_watcher() i=3 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.395+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743012641232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139cdb90 con 0x562b139c27e0 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.397+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94743012641232] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x562b139c27e0 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.397+0000 7ff5c6f27800 20 remove_watcher() i=4 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.397+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743012642288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139ce4c0 con 0x7ff5b8038040 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.398+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94743012642288] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.398+0000 7ff5c6f27800 20 remove_watcher() i=5 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.398+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743012644784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139ce4c0 con 0x7ff5b8038040 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.399+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94743012644784] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.399+0000 7ff5c6f27800 20 remove_watcher() i=6 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.399+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743012648384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562b139ce4c0 con 0x7ff5b8038040 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94743012648384] v31'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5bc0083e0 con 0x7ff5b8038040 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 20 remove_watcher() i=7 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff5b8038040 msgr2=0x7ff5b801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7ff5b8038040 0x7ff5b801bab0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b139c27e0 msgr2=0x562b139c4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b139c27e0 0x562b139c4ca0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5b4097020 msgr2=0x7ff5b40575b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7ff5b4097020 0x7ff5b40575b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b139c6e50 msgr2=0x562b139c9240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b139c6e50 0x562b139c9240 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff48c036aa0 msgr2=0x7ff48c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff48c036aa0 0x7ff48c038f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8001b60 tx=0x7ff5b8010000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 msgr2=0x562b139b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b70d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4078bf0 tx=0x7ff5b4085f20 comp rx=0 tx=0).stop 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c33a8640 1 -- 172.21.15.173:0/1875114735 reap_dead start 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 shutdown_connections 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/1875114735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139afcb0 0x562b139b70d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 >> 172.21.15.173:0/1875114735 conn(0x562b139ac010 msgr2=0x562b139a9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 shutdown_connections 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/1875114735 wait complete. 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff49c036900 msgr2=0x7ff49c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff49c036900 0x7ff49c038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800bf50 tx=0x7ff5b800f000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139a2b90 msgr2=0x562b139a2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139a2b90 0x562b139a2fb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff5b408cf50 tx=0x7ff5b405bf90 comp rx=0 tx=0).stop 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 shutdown_connections 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff49c036900 0x7ff49c038dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/904793729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b139a2b90 0x562b139a2fb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 >> 172.21.15.173:0/904793729 conn(0x562b13996c30 msgr2=0x562b13997030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 shutdown_connections 2024-05-15T18:09:56.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.400+0000 7ff5c6f27800 1 -- 172.21.15.173:0/904793729 wait complete. 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562b13991ba0 msgr2=0x562b13993fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562b13991ba0 0x562b13993fd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b1388e210 msgr2=0x562b1398b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562b1388e210 0x562b1398b380 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b1398dc60 msgr2=0x562b13990050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562b1398dc60 0x562b13990050 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff4a8036900 msgr2=0x7ff4a8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7ff4a8036900 0x7ff4a8038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8000f60 tx=0x7ff5b80012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 msgr2=0x562b13984140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 --2- 172.21.15.173:0/193898906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b137fe020 0x562b13984140 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4000f80 tx=0x7ff5b4003330 comp rx=0 tx=0).stop 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c33a8640 1 -- 172.21.15.173:0/193898906 reap_dead start 2024-05-15T18:09:56.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 shutdown_connections 2024-05-15T18:09:56.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 >> 172.21.15.173:0/193898906 conn(0x562b138855c0 msgr2=0x562b13976830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 shutdown_connections 2024-05-15T18:09:56.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.401+0000 7ff5c6f27800 1 -- 172.21.15.173:0/193898906 wait complete. 2024-05-15T18:09:56.397 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-05-15T18:09:56.397 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-05-15T18:09:56.397 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-15T18:09:56.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-15T18:09:56.397 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-05-15T18:09:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:56.444 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:56.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.468+0000 7f0b3782f800 1 Processor -- start 2024-05-15T18:09:56.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.468+0000 7f0b3782f800 1 -- start start 2024-05-15T18:09:56.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.468+0000 7f0b3782f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5588f2ac63f0 0x5588f2ac8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.468+0000 7f0b3782f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5588f2ac8f10 con 0x5588f2a358d0 2024-05-15T18:09:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.468+0000 7f0b3782f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5588f2953050 con 0x5588f2ac63f0 2024-05-15T18:09:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.469+0000 7f0b323bf640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5588f2ac63f0 0x5588f2ac8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.469+0000 7f0b32bc0640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5588f2a358d0 0x5588f2ac4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60450/0 (socket says 172.21.15.173:60450) 2024-05-15T18:09:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.469+0000 7f0b32bc0640 1 -- 172.21.15.173:0/964390084 learned_addr learned my addr 172.21.15.173:0/964390084 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.469+0000 7f0b323bf640 1 -- 172.21.15.173:0/964390084 >> v1:172.21.15.3:6789/0 conn(0x5588f2a358d0 legacy=0x5588f2ac4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.469+0000 7f0b323bf640 1 -- 172.21.15.173:0/964390084 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f2aca140 con 0x5588f2ac63f0 2024-05-15T18:09:56.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.471+0000 7f0b323bf640 1 --2- 172.21.15.173:0/964390084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac63f0 0x5588f2ac8890 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800a470 tx=0x7f0b2801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7642cc7c5e4620 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.471+0000 7f0b31bbe640 1 -- 172.21.15.173:0/964390084 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28057070 con 0x5588f2ac63f0 2024-05-15T18:09:56.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.471+0000 7f0b31bbe640 1 -- 172.21.15.173:0/964390084 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b28052570 con 0x5588f2ac63f0 2024-05-15T18:09:56.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.471+0000 7f0b31bbe640 1 -- 172.21.15.173:0/964390084 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b28052870 con 0x5588f2ac63f0 2024-05-15T18:09:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.472+0000 7f0b3782f800 1 -- 172.21.15.173:0/964390084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac63f0 msgr2=0x5588f2ac8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.472+0000 7f0b3782f800 1 --2- 172.21.15.173:0/964390084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac63f0 0x5588f2ac8890 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800a470 tx=0x7f0b2801ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.472+0000 7f0b3782f800 1 -- 172.21.15.173:0/964390084 shutdown_connections 2024-05-15T18:09:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.472+0000 7f0b3782f800 1 --2- 172.21.15.173:0/964390084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac63f0 0x5588f2ac8890 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.472+0000 7f0b3782f800 1 -- 172.21.15.173:0/964390084 >> 172.21.15.173:0/964390084 conn(0x5588f2abc570 msgr2=0x5588f2abe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.472+0000 7f0b3782f800 1 -- 172.21.15.173:0/964390084 shutdown_connections 2024-05-15T18:09:56.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.472+0000 7f0b3782f800 1 -- 172.21.15.173:0/964390084 wait complete. 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.485+0000 7f0b3782f800 1 Processor -- start 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.485+0000 7f0b3782f800 1 -- start start 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.485+0000 7f0b3782f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bb36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.485+0000 7f0b3782f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5588f2a0d1c0 con 0x5588f2a358d0 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bb36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bb36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38336/0 (socket says 172.21.15.173:38336) 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0b32bc0640 1 -- 172.21.15.173:0/3248493033 learned_addr learned my addr 172.21.15.173:0/3248493033 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0b32bc0640 1 -- 172.21.15.173:0/3248493033 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f2bb3c90 con 0x5588f2a358d0 2024-05-15T18:09:56.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/3248493033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bb36c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0b24001d50 tx=0x7f0b2400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6069fbf89a94aa79 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0a20e09640 1 -- 172.21.15.173:0/3248493033 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b24013030 con 0x5588f2a358d0 2024-05-15T18:09:56.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0a20e09640 1 -- 172.21.15.173:0/3248493033 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2400e470 con 0x5588f2a358d0 2024-05-15T18:09:56.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.486+0000 7f0a20e09640 1 -- 172.21.15.173:0/3248493033 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b2400e810 con 0x5588f2a358d0 2024-05-15T18:09:56.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 -- 172.21.15.173:0/3248493033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 msgr2=0x5588f2bb36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 --2- 172.21.15.173:0/3248493033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bb36c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0b24001d50 tx=0x7f0b2400b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 -- 172.21.15.173:0/3248493033 shutdown_connections 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 --2- 172.21.15.173:0/3248493033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bb36c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 -- 172.21.15.173:0/3248493033 >> 172.21.15.173:0/3248493033 conn(0x5588f2abc570 msgr2=0x5588f2baefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 -- 172.21.15.173:0/3248493033 shutdown_connections 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 -- 172.21.15.173:0/3248493033 wait complete. 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.487+0000 7f0b3782f800 1 Processor -- start 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b3782f800 1 -- start start 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b3782f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bbb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b3782f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5588f2ac93e0 con 0x5588f2a358d0 2024-05-15T18:09:56.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bbb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bbb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38342/0 (socket says 172.21.15.173:38342) 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b32bc0640 1 -- 172.21.15.173:0/179634983 learned_addr learned my addr 172.21.15.173:0/179634983 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b32bc0640 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f2bbb780 con 0x5588f2a358d0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.488+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bbb240 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x5588f2bb4450 tx=0x7f0b24000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.489+0000 7f0a1f606640 1 -- 172.21.15.173:0/179634983 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b24027070 con 0x5588f2a358d0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.489+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588f2bbba10 con 0x5588f2a358d0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.489+0000 7f0a1f606640 1 -- 172.21.15.173:0/179634983 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b24019900 con 0x5588f2a358d0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.489+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f2bbe6c0 con 0x5588f2a358d0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.489+0000 7f0a1f606640 1 -- 172.21.15.173:0/179634983 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b24019c20 con 0x5588f2a358d0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0a1f606640 1 -- 172.21.15.173:0/179634983 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b2402a070 con 0x5588f2a358d0 2024-05-15T18:09:56.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0a1f606640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a18036900 0x7f0a18038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0a1f606640 1 -- 172.21.15.173:0/179634983 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f0b2401f070 con 0x5588f2a358d0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0b323bf640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a18036900 0x7f0a18038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2ac63f0 0x5588f2bc2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bc2aa0 con 0x5588f2ac63f0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0b333c1640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2ac63f0 0x5588f2bc2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0b323bf640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a18036900 0x7f0a18038dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b28054000 tx=0x7f0b2804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.490+0000 7f0b333c1640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2ac63f0 0x5588f2bc2480 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.491+0000 7f0b333c1640 1 -- 172.21.15.173:0/179634983 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2ac63f0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.491+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bbfa50 con 0x5588f2ac63f0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.491+0000 7f0b333c1640 1 -- 172.21.15.173:0/179634983 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2ac63f0 2024-05-15T18:09:56.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.491+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2bc4db0 0x5588f2bc71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.491+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bc7840 con 0x5588f2bc4db0 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.491+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2bc4db0 0x5588f2bc71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.491+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2bc4db0 0x5588f2bc71a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.492+0000 7f0b32bc0640 1 -- 172.21.15.173:0/179634983 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2bc4db0 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.492+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bc3d60 con 0x5588f2ac63f0 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.492+0000 7f0b333c1640 1 -- 172.21.15.173:0/179634983 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2ac63f0 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.492+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5588f2bc8cf0 0x5588f2bcb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.492+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bcb8a0 con 0x5588f2bc8cf0 2024-05-15T18:09:56.472 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.492+0000 7f0b323bf640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5588f2bc8cf0 0x5588f2bcb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.493+0000 7f0b323bf640 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5588f2bc8cf0 0x5588f2bcb140 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.493+0000 7f0b323bf640 1 -- 172.21.15.173:0/179634983 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0b2805a040 con 0x5588f2bc8cf0 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b3782f800 1 Processor -- start 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b3782f800 1 -- start start 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b3782f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2bd9d00 0x5588f2bda120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b3782f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5588f29b3cf0 con 0x5588f2bd9d00 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2bd9d00 0x5588f2bda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2bd9d00 0x5588f2bda120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38346/0 (socket says 172.21.15.173:38346) 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1350208458 learned_addr learned my addr 172.21.15.173:0/1350208458 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.494+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1350208458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f2bda660 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.495+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2bd9d00 0x5588f2bda120 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b2404c010 tx=0x7f0b2402aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.495+0000 7f0a1ce01640 1 -- 172.21.15.173:0/1350208458 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b240446a0 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.495+0000 7f0a1ce01640 1 -- 172.21.15.173:0/1350208458 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b240458d0 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.495+0000 7f0a1ce01640 1 -- 172.21.15.173:0/1350208458 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b24045bf0 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.495+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588f2bdb0d0 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.495+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f2bdb5d0 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0a1ce01640 1 -- 172.21.15.173:0/1350208458 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b24016070 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0a1ce01640 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a0c036900 0x7f0a0c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0a1ce01640 1 -- 172.21.15.173:0/1350208458 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f0b24014070 con 0x5588f2bd9d00 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0b323bf640 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a0c036900 0x7f0a0c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0b3782f800 1 Processor -- start 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0b3782f800 1 -- start start 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0b323bf640 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a0c036900 0x7f0a0c038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5588f2bbf970 tx=0x7f0b28005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0b3782f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2ac0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.496+0000 7f0b3782f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5588f2bb4010 con 0x5588f2ac2320 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2ac0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2ac0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38352/0 (socket says 172.21.15.173:38352) 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1392238848 learned_addr learned my addr 172.21.15.173:0/1392238848 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1392238848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f2ac27d0 con 0x5588f2ac2320 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/1392238848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2ac0a50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b24041fd0 tx=0x7f0b24008370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7b8622c55c44b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0a167fc640 1 -- 172.21.15.173:0/1392238848 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b2403d070 con 0x5588f2ac2320 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0a167fc640 1 -- 172.21.15.173:0/1392238848 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b24049130 con 0x5588f2ac2320 2024-05-15T18:09:56.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.497+0000 7f0a167fc640 1 -- 172.21.15.173:0/1392238848 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b240431f0 con 0x5588f2ac2320 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 -- 172.21.15.173:0/1392238848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 msgr2=0x5588f2ac0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1392238848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2ac0a50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b24041fd0 tx=0x7f0b24008370 comp rx=0 tx=0).stop 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 -- 172.21.15.173:0/1392238848 shutdown_connections 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1392238848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2ac0a50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 -- 172.21.15.173:0/1392238848 >> 172.21.15.173:0/1392238848 conn(0x5588f2be3180 msgr2=0x5588f2be11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 -- 172.21.15.173:0/1392238848 shutdown_connections 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 -- 172.21.15.173:0/1392238848 wait complete. 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 Processor -- start 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 -- start start 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2bf0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.498+0000 7f0b3782f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5588f2ac0f90 con 0x5588f2ac2320 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.499+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2bf0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.499+0000 7f0b32bc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2bf0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38368/0 (socket says 172.21.15.173:38368) 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.499+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 learned_addr learned my addr 172.21.15.173:0/1720835561 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.499+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588f2bf09b0 con 0x5588f2ac2320 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.499+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2bf0470 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0b24041fd0 tx=0x7f0b2402ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.500+0000 7f0a14ff9640 1 -- 172.21.15.173:0/1720835561 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b2404ca10 con 0x5588f2ac2320 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.500+0000 7f0a14ff9640 1 -- 172.21.15.173:0/1720835561 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b24065070 con 0x5588f2ac2320 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.500+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588f2bf09b0 con 0x5588f2ac2320 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.500+0000 7f0a14ff9640 1 -- 172.21.15.173:0/1720835561 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b2404cd60 con 0x5588f2ac2320 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.500+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588f2bf09b0 con 0x5588f2ac2320 2024-05-15T18:09:56.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0a14ff9640 1 -- 172.21.15.173:0/1720835561 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0b2405c040 con 0x5588f2ac2320 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0a14ff9640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f09fc036900 0x7f09fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0a14ff9640 1 -- 172.21.15.173:0/1720835561 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f0b2405a020 con 0x5588f2ac2320 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0b323bf640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f09fc036900 0x7f09fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2bfbaf0 0x5588f2bfdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bfe6e0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0b333c1640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2bfbaf0 0x5588f2bfdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.501+0000 7f0b323bf640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f09fc036900 0x7f09fc038dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5588f2bcbca0 tx=0x7f0b2804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b333c1640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2bfbaf0 0x5588f2bfdf90 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 realm 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bfeaf0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff390 con 0x5588f2bfbaf0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x5588f2bfbaf0 2024-05-15T18:09:56.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2c00490 0x5588f2c02880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.502+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c02dc0 con 0x5588f2c00490 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.503+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2c00490 0x5588f2c02880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.503+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2c00490 0x5588f2c02880 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.503+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.503+0000 7f0b3782f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.503+0000 7f0b3782f800 20 searching for the correct realm 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.503+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c04770 con 0x5588f2c00490 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.503+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.501 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b32bc0640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b2402c060 0x7f0b24060440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c04770 con 0x7f0b2402c060 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b323bf640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b2402c060 0x7f0b24060440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b323bf640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b2402c060 0x7f0b24060440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b323bf640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b28074040 0x7f0b28081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c04770 con 0x7f0b28074040 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.504+0000 7f0b333c1640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b28074040 0x7f0b28081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.505+0000 7f0b333c1640 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b28074040 0x7f0b28081410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.505+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.505+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x5588f2bfbaf0 2024-05-15T18:09:56.502 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.505+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.505+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x5588f2bfbaf0 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x7f0b28074040 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x7f0b28074040 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x7f0b2402c060 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.506+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x5588f2c00490 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.503 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x5588f2bfbaf0 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x7f0b28074040 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x5588f2bfbaf0 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.507+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bff730 con 0x7f0b2402c060 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2c00490 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2c00490 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.504 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b28074040 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.508+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2c00490 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2c00490 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2bfbaf0 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2bfbaf0 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.509+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b28074040 2024-05-15T18:09:56.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2c00490 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b2402c060 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2bfbaf0 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.510+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b28074040 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2c00490 2024-05-15T18:09:56.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b28074040 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b2402c060 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.511+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2c00490 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b2402c060 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x5588f2bfbaf0 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.507 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f0b2808e060 con 0x7f0b2402c060 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.512+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c03740 con 0x5588f2bfbaf0 2024-05-15T18:09:56.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c03b30 con 0x5588f2bfbaf0 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c03b30 con 0x7f0b28074040 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 zone default found 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 4 Realm: () 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:56.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 zonegroup default 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.513+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c03f50 con 0x7f0b28074040 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c04370 con 0x5588f2c00490 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c06620 con 0x5588f2c00490 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 20 started sync module instance, tier type = 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.514+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c05ac0 con 0x7f0b2402c060 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.515+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.515+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94046676606640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c06e70 con 0x7f0b2402c060 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.515+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c076c0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.516+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94046676606640] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.517+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.517+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94046676611600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c07ae0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.517+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c08330 con 0x5588f2c00490 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.518+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94046676611600] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.518+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.518+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94046676613136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c08720 con 0x5588f2c00490 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.518+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c090e0 con 0x7f0b2402c060 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.519+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.519+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94046676618288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c099b0 con 0x7f0b2402c060 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.519+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0a4b0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.519+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94046676613136] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.520+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.520+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94046676623264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0a8a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.520+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0b2e0 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.520+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94046676618288] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.521+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.522+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94046676626864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0b2a0 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.522+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0bcf0 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.522+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94046676623264] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.523+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94046676626864] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.523+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.523+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94046676620544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0b840 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.523+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0c590 con 0x7f0b28074040 2024-05-15T18:09:56.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94046676620544] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94046676614256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0b840 con 0x7f0b28074040 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 20 add_watcher() i=0 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 20 add_watcher() i=1 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 20 add_watcher() i=2 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 20 add_watcher() i=3 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 20 add_watcher() i=4 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 20 add_watcher() i=5 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.524+0000 7f0b3782f800 20 add_watcher() i=6 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.525+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94046676614256] v31'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.525+0000 7f0b3782f800 20 add_watcher() i=7 2024-05-15T18:09:56.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.525+0000 7f0b3782f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.525+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0f5c0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.526+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.526+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94046676631776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0ca80 con 0x5588f2bfbaf0 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94046676631776] v31'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f09e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0b3782f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0b3782f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0b3782f800 5 note: GC not initialized 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0963fff640 20 reqs_thread_entry: start 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0b3782f800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:56.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0b3782f800 20 Filter name: none 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.527+0000 7f0961ffb640 20 reqs_thread_entry: start 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.528+0000 7f0b3782f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.528+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c425c0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.528+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.528+0000 7f0b3782f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.528+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c439b0 con 0x7f0b28074040 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.528+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.529+0000 7f09e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.529+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94046676631776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2bf55a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.530+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94046676631776] v31'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.530+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94046676606640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0c0e0 con 0x7f0b2402c060 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.531+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94046676606640] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.531+0000 7f0b3782f800 20 remove_watcher() i=0 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.531+0000 7f0b3782f800 2 removed watcher, disabling cache 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.531+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94046676611600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0c0e0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.532+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94046676611600] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.532+0000 7f0b3782f800 20 remove_watcher() i=1 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.532+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94046676613136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c07210 con 0x5588f2c00490 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.533+0000 7f0b32bc0640 1 -- 172.21.15.173:0/1720835561 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94046676613136] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b24029030 con 0x5588f2c00490 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.534+0000 7f0b3782f800 20 remove_watcher() i=2 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.534+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94046676618288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0c0e0 con 0x7f0b2402c060 2024-05-15T18:09:56.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.534+0000 7f0b323bf640 1 -- 172.21.15.173:0/1720835561 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94046676618288] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2807f070 con 0x7f0b2402c060 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.534+0000 7f0b3782f800 20 remove_watcher() i=3 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.534+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94046676623264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c07210 con 0x5588f2bfbaf0 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.536+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94046676623264] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x5588f2bfbaf0 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.536+0000 7f0b3782f800 20 remove_watcher() i=4 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.536+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94046676626864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c0c0e0 con 0x7f0b28074040 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.537+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94046676626864] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.537+0000 7f0b3782f800 20 remove_watcher() i=5 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.537+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94046676620544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c09fa0 con 0x7f0b28074040 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.538+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94046676620544] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.538+0000 7f0b3782f800 20 remove_watcher() i=6 2024-05-15T18:09:56.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.538+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94046676614256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5588f2c09fa0 con 0x7f0b28074040 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94046676614256] v31'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0b2c00a4a0 con 0x7f0b28074040 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 20 remove_watcher() i=7 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b28074040 msgr2=0x7f0b28081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f0b28074040 0x7f0b28081410 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2bfbaf0 msgr2=0x5588f2bfdf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2bfbaf0 0x5588f2bfdf90 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b2402c060 msgr2=0x7f0b24060440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f0b2402c060 0x7f0b24060440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2c00490 msgr2=0x5588f2c02880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2c00490 0x5588f2c02880 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f09fc036900 msgr2=0x7f09fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f09fc036900 0x7f09fc038dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5588f2bcbca0 tx=0x7f0b2804f000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 msgr2=0x5588f2bf0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1720835561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2ac2320 0x5588f2bf0470 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0b24041fd0 tx=0x7f0b2402ff00 comp rx=0 tx=0).stop 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 reap_dead start 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b333c1640 1 -- 172.21.15.173:0/1720835561 reap_dead start 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 shutdown_connections 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 >> 172.21.15.173:0/1720835561 conn(0x5588f2be3180 msgr2=0x5588f2be07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 shutdown_connections 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.539+0000 7f0b3782f800 1 -- 172.21.15.173:0/1720835561 wait complete. 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a0c036900 msgr2=0x7f0a0c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a0c036900 0x7f0a0c038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5588f2bbf970 tx=0x7f0b28005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:56.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2bd9d00 msgr2=0x5588f2bda120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2bd9d00 0x5588f2bda120 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b2404c010 tx=0x7f0b2402aab0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 shutdown_connections 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a0c036900 0x7f0a0c038dc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/1350208458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2bd9d00 0x5588f2bda120 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 >> 172.21.15.173:0/1350208458 conn(0x5588f2bcdda0 msgr2=0x5588f2bce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 shutdown_connections 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/1350208458 wait complete. 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5588f2bc8cf0 msgr2=0x5588f2bcb140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5588f2bc8cf0 0x5588f2bcb140 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2ac63f0 msgr2=0x5588f2bc2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5588f2ac63f0 0x5588f2bc2480 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2bc4db0 msgr2=0x5588f2bc71a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5588f2bc4db0 0x5588f2bc71a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a18036900 msgr2=0x7f0a18038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0a18036900 0x7f0a18038dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0b28054000 tx=0x7f0b2804e000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 msgr2=0x5588f2bbb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 --2- 172.21.15.173:0/179634983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5588f2a358d0 0x5588f2bbb240 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x5588f2bb4450 tx=0x7f0b24000bc0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b333c1640 1 -- 172.21.15.173:0/179634983 reap_dead start 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 shutdown_connections 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 >> 172.21.15.173:0/179634983 conn(0x5588f2abc570 msgr2=0x5588f2bad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 shutdown_connections 2024-05-15T18:09:56.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.540+0000 7f0b3782f800 1 -- 172.21.15.173:0/179634983 wait complete. 2024-05-15T18:09:56.534 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-05-15T18:09:56.535 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-05-15T18:09:56.535 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-15T18:09:56.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-15T18:09:56.535 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-05-15T18:09:56.582 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:56.582 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.606+0000 7f8b2aa0e800 1 Processor -- start 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.606+0000 7f8b2aa0e800 1 -- start start 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.606+0000 7f8b2aa0e800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555d0dab6680 0x555d0dab8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.606+0000 7f8b2aa0e800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d0dab8fb0 con 0x555d0dab2b70 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.606+0000 7f8b2aa0e800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x555d0d943050 con 0x555d0dab6680 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.606+0000 7f8b27d0c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555d0dab6680 0x555d0dab8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.607+0000 7f8b2850d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x555d0dab2b70 0x555d0dab4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60452/0 (socket says 172.21.15.173:60452) 2024-05-15T18:09:56.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.607+0000 7f8b2850d640 1 -- 172.21.15.173:0/3608843787 learned_addr learned my addr 172.21.15.173:0/3608843787 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.607+0000 7f8b27d0c640 1 -- 172.21.15.173:0/3608843787 >> v1:172.21.15.3:6789/0 conn(0x555d0dab2b70 legacy=0x555d0dab4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.607+0000 7f8b27d0c640 1 -- 172.21.15.173:0/3608843787 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0daba190 con 0x555d0dab6680 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/3608843787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab6680 0x555d0dab8a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a470 tx=0x7f8b1c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5792ce6f70141b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2750b640 1 -- 172.21.15.173:0/3608843787 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c057070 con 0x555d0dab6680 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2750b640 1 -- 172.21.15.173:0/3608843787 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1c052570 con 0x555d0dab6680 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2750b640 1 -- 172.21.15.173:0/3608843787 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c052870 con 0x555d0dab6680 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3608843787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab6680 msgr2=0x555d0dab8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/3608843787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab6680 0x555d0dab8a70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00a470 tx=0x7f8b1c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3608843787 shutdown_connections 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/3608843787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab6680 0x555d0dab8a70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3608843787 >> 172.21.15.173:0/3608843787 conn(0x555d0daac5c0 msgr2=0x555d0daae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3608843787 shutdown_connections 2024-05-15T18:09:56.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.609+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3608843787 wait complete. 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.623+0000 7f8b2aa0e800 1 Processor -- start 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.623+0000 7f8b2aa0e800 1 -- start start 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.623+0000 7f8b2aa0e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dba36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.623+0000 7f8b2aa0e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555d0d9fd1c0 con 0x555d0dab2b70 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dba36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dba36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38388/0 (socket says 172.21.15.173:38388) 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8b2850d640 1 -- 172.21.15.173:0/2348486039 learned_addr learned my addr 172.21.15.173:0/2348486039 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8b2850d640 1 -- 172.21.15.173:0/2348486039 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0dba3cc0 con 0x555d0dab2b70 2024-05-15T18:09:56.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8b2850d640 1 --2- 172.21.15.173:0/2348486039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dba36f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8b18001d50 tx=0x7f8b1800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434584ff85287bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8a1660c640 1 -- 172.21.15.173:0/2348486039 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18013030 con 0x555d0dab2b70 2024-05-15T18:09:56.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8a1660c640 1 -- 172.21.15.173:0/2348486039 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1800e470 con 0x555d0dab2b70 2024-05-15T18:09:56.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.624+0000 7f8a1660c640 1 -- 172.21.15.173:0/2348486039 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1800e810 con 0x555d0dab2b70 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2348486039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 msgr2=0x555d0dba36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/2348486039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dba36f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8b18001d50 tx=0x7f8b1800b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2348486039 shutdown_connections 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/2348486039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dba36f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2348486039 >> 172.21.15.173:0/2348486039 conn(0x555d0daac5c0 msgr2=0x555d0db9f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2348486039 shutdown_connections 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2348486039 wait complete. 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 Processor -- start 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.625+0000 7f8b2aa0e800 1 -- start start 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8b2aa0e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dbab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8b2aa0e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555d0dab9480 con 0x555d0dab2b70 2024-05-15T18:09:56.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dbab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dbab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38398/0 (socket says 172.21.15.173:38398) 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8b2850d640 1 -- 172.21.15.173:0/534078866 learned_addr learned my addr 172.21.15.173:0/534078866 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8b2850d640 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0dbab7b0 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8b2850d640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dbab270 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x555d0dba4480 tx=0x7f8b18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.626+0000 7f8a14e09640 1 -- 172.21.15.173:0/534078866 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18027070 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.627+0000 7f8a14e09640 1 -- 172.21.15.173:0/534078866 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18019900 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.627+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d0dbaba40 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.627+0000 7f8a14e09640 1 -- 172.21.15.173:0/534078866 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18019c40 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.627+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0dbae6f0 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.627+0000 7f8a14e09640 1 -- 172.21.15.173:0/534078866 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b1802a070 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8a14e09640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a10036900 0x7f8a10038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8a14e09640 1 -- 172.21.15.173:0/534078866 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8b1801f070 con 0x555d0dab2b70 2024-05-15T18:09:56.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a10036900 0x7f8a10038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dab6680 0x555d0dbb24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbb2a80 con 0x555d0dab6680 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b28d0e640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dab6680 0x555d0dbb24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a10036900 0x7f8a10038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c054000 tx=0x7f8b1c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b28d0e640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dab6680 0x555d0dbb24b0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b28d0e640 1 -- 172.21.15.173:0/534078866 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dab6680 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.628+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbafa80 con 0x555d0dab6680 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.629+0000 7f8b28d0e640 1 -- 172.21.15.173:0/534078866 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dab6680 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.629+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbb4d90 0x555d0dbb7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.629+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbb7820 con 0x555d0dbb4d90 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.629+0000 7f8b2850d640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbb4d90 0x555d0dbb7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.629+0000 7f8b2850d640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbb4d90 0x555d0dbb7180 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.629+0000 7f8b2850d640 1 -- 172.21.15.173:0/534078866 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b18029030 con 0x555d0dbb4d90 2024-05-15T18:09:56.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.629+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbb3d40 con 0x555d0dab6680 2024-05-15T18:09:56.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.630+0000 7f8b28d0e640 1 -- 172.21.15.173:0/534078866 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dab6680 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.630+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555d0dbb8cd0 0x555d0dbbb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.630+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbbb8a0 con 0x555d0dbb8cd0 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.630+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555d0dbb8cd0 0x555d0dbbb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.630+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555d0dbb8cd0 0x555d0dbbb140 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b27d0c640 1 -- 172.21.15.173:0/534078866 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b1c05a040 con 0x555d0dbb8cd0 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b2aa0e800 1 Processor -- start 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b2aa0e800 1 -- start start 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b2aa0e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbc9cd0 0x555d0dbca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b2aa0e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555d0d9a3cf0 con 0x555d0dbc9cd0 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbc9cd0 0x555d0dbca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbc9cd0 0x555d0dbca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38404/0 (socket says 172.21.15.173:38404) 2024-05-15T18:09:56.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.631+0000 7f8b2850d640 1 -- 172.21.15.173:0/2288003719 learned_addr learned my addr 172.21.15.173:0/2288003719 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.632+0000 7f8b2850d640 1 -- 172.21.15.173:0/2288003719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0dbca630 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.632+0000 7f8b2850d640 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbc9cd0 0x555d0dbca0f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8b1804ab40 tx=0x7f8b180177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.632+0000 7f8a0dffb640 1 -- 172.21.15.173:0/2288003719 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1803b030 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.632+0000 7f8a0dffb640 1 -- 172.21.15.173:0/2288003719 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b180446a0 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.632+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d0dbcb0a0 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.632+0000 7f8a0dffb640 1 -- 172.21.15.173:0/2288003719 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18044a00 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.632+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0dbcb5a0 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.633+0000 7f8a0dffb640 1 -- 172.21.15.173:0/2288003719 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b1803e070 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.633+0000 7f8a0dffb640 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a00036900 0x7f8a00038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.633+0000 7f8a0dffb640 1 -- 172.21.15.173:0/2288003719 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8b1803c070 con 0x555d0dbc9cd0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.633+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a00036900 0x7f8a00038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.633+0000 7f8b2aa0e800 1 Processor -- start 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.633+0000 7f8b2aa0e800 1 -- start start 2024-05-15T18:09:56.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a00036900 0x7f8a00038dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x555d0dbaf9a0 tx=0x7f8b1c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b2aa0e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbd72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b2aa0e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555d0dba4040 con 0x555d0dbd6ed0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbd72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbd72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38418/0 (socket says 172.21.15.173:38418) 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b2850d640 1 -- 172.21.15.173:0/3746923753 learned_addr learned my addr 172.21.15.173:0/3746923753 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b2850d640 1 -- 172.21.15.173:0/3746923753 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0dbd78c0 con 0x555d0dbd6ed0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8b2850d640 1 --2- 172.21.15.173:0/3746923753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbd72f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8b18021820 tx=0x7f8b18047780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13eca721dbef0beb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8a077fe640 1 -- 172.21.15.173:0/3746923753 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18060070 con 0x555d0dbd6ed0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8a077fe640 1 -- 172.21.15.173:0/3746923753 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18049130 con 0x555d0dbd6ed0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.634+0000 7f8a077fe640 1 -- 172.21.15.173:0/3746923753 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18057040 con 0x555d0dbd6ed0 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3746923753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 msgr2=0x555d0dbd72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/3746923753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbd72f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8b18021820 tx=0x7f8b18047780 comp rx=0 tx=0).stop 2024-05-15T18:09:56.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3746923753 shutdown_connections 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/3746923753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbd72f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3746923753 >> 172.21.15.173:0/3746923753 conn(0x555d0dbd3230 msgr2=0x555d0dbd1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3746923753 shutdown_connections 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/3746923753 wait complete. 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 Processor -- start 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 -- start start 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbde2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.635+0000 7f8b2aa0e800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555d0dbd7f70 con 0x555d0dbd6ed0 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbde2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8b2850d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbde2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38428/0 (socket says 172.21.15.173:38428) 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 learned_addr learned my addr 172.21.15.173:0/674588089 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d0dbde820 con 0x555d0dbd6ed0 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8b2850d640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbde2e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8b18049960 tx=0x7f8b180474d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8a05ffb640 1 -- 172.21.15.173:0/674588089 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18069020 con 0x555d0dbd6ed0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8a05ffb640 1 -- 172.21.15.173:0/674588089 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18047180 con 0x555d0dbd6ed0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d0dbde820 con 0x555d0dbd6ed0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8a05ffb640 1 -- 172.21.15.173:0/674588089 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18060040 con 0x555d0dbd6ed0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.636+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0dbde820 con 0x555d0dbd6ed0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.637+0000 7f8a05ffb640 1 -- 172.21.15.173:0/674588089 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b1806c020 con 0x555d0dbd6ed0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.637+0000 7f8a05ffb640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f89f8036900 0x7f89f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.637+0000 7f8a05ffb640 1 -- 172.21.15.173:0/674588089 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8b18014070 con 0x555d0dbd6ed0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.637+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.637+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f89f8036900 0x7f89f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dbe9a40 0x555d0dbebf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbec650 con 0x555d0dbe9a40 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b28d0e640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dbe9a40 0x555d0dbebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f89f8036900 0x7f89f8038dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x555d0dbb40e0 tx=0x7f8b1c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b28d0e640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dbe9a40 0x555d0dbebf00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 20 realm 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbeca60 con 0x555d0dbe9a40 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.638+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed300 con 0x555d0dbe9a40 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2aa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbee1d0 0x555d0dbf05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf0d00 con 0x555d0dbee1d0 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2850d640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbee1d0 0x555d0dbf05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.639+0000 7f8b2850d640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbee1d0 0x555d0dbf05c0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b2aa0e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b2aa0e800 20 searching for the correct realm 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf26d0 con 0x555d0dbee1d0 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b2850d640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8b18079040 0x7f8b18026390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf26d0 con 0x7f8b18079040 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8b18079040 0x7f8b18026390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.640+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8b18079040 0x7f8b18026390 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.641+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.641+0000 7f8b27d0c640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8b1c074040 0x7f8b1c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.641+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf26d0 con 0x7f8b1c074040 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.641+0000 7f8b28d0e640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8b1c074040 0x7f8b1c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.641+0000 7f8b28d0e640 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8b1c074040 0x7f8b1c081410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.641+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1c074040 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.641+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x7f8b1c074040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1c074040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x7f8b1c074040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1c074040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.642+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x7f8b18079040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x555d0dbee1d0 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x7f8b1c074040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1c074040 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.643+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbed6a0 con 0x7f8b18079040 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.644+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b1c074040 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x7f8b1c074040 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbe9a40 2024-05-15T18:09:56.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.645+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbe9a40 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b2000a4a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b1c074040 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b20033040 con 0x7f8b1c074040 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbee1d0 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b18079040 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.646+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbe9a40 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.647+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.647+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b1c074040 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.647+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.647+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbee1d0 2024-05-15T18:09:56.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.647+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.647+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b1c074040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b18079040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbee1d0 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b18079040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.648+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x555d0dbe9a40 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8b1c08e060 con 0x7f8b18079040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf16a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf1a90 con 0x555d0dbe9a40 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.649+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf1a90 con 0x7f8b1c074040 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 zone default found 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 4 Realm: () 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 zonegroup default 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf1eb0 con 0x7f8b1c074040 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf22d0 con 0x555d0dbee1d0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.650+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf4580 con 0x555d0dbee1d0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.651+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.651+0000 7f8b2aa0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.651+0000 7f8b2aa0e800 20 started sync module instance, tier type = 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.651+0000 7f8b2aa0e800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.651+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf3a20 con 0x7f8b18079040 2024-05-15T18:09:56.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.652+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.652+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93858150956560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf4dd0 con 0x7f8b18079040 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.652+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf5620 con 0x555d0dbe9a40 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.653+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93858150956560] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.653+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.653+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93858150959392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf56a0 con 0x555d0dbe9a40 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.653+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf61c0 con 0x555d0dbee1d0 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.654+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.654+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93858150964368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf6a60 con 0x555d0dbee1d0 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.654+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf7530 con 0x7f8b18079040 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.654+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93858150959392] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.655+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93858150964368] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.655+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.655+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93858150961520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf6a60 con 0x7f8b18079040 2024-05-15T18:09:56.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.655+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf7e00 con 0x555d0dbe9a40 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.657+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93858150961520] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.657+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.657+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93858150971728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf7d70 con 0x555d0dbe9a40 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.657+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf8cc0 con 0x7f8b1c074040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.658+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93858150971728] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.658+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.658+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93858150973856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf8cc0 con 0x7f8b1c074040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.658+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf9680 con 0x7f8b1c074040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.659+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.659+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93858150978000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf9aa0 con 0x7f8b1c074040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.659+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbfa500 con 0x7f8b1c074040 2024-05-15T18:09:56.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.659+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93858150973856] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93858150978000] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93858150975504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf95f0 con 0x7f8b1c074040 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 20 add_watcher() i=0 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 20 add_watcher() i=1 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 20 add_watcher() i=2 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 20 add_watcher() i=3 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 20 add_watcher() i=4 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 20 add_watcher() i=5 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.660+0000 7f8b2aa0e800 20 add_watcher() i=6 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.661+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93858150975504] v31'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.661+0000 7f8b2aa0e800 20 add_watcher() i=7 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.661+0000 7f8b2aa0e800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:56.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.661+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf95f0 con 0x555d0dbe9a40 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.662+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.662+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93858150981648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf95f0 con 0x555d0dbe9a40 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93858150981648] v31'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f89de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b2aa0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b2aa0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b2aa0e800 5 note: GC not initialized 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f89dd7e2640 20 reqs_thread_entry: start 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b2aa0e800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b2aa0e800 20 Filter name: none 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f894effd640 20 reqs_thread_entry: start 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b2aa0e800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.663+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dc30480 con 0x555d0dbe9a40 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.664+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.664+0000 7f8b2aa0e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.664+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555d0dc31870 con 0x7f8b1c074040 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.665+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.666+0000 7f89de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.666+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93858150981648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dc06670 con 0x555d0dbe9a40 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.667+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93858150981648] v31'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.667+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93858150956560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbfa010 con 0x7f8b18079040 2024-05-15T18:09:56.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.668+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93858150956560] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.668+0000 7f8b2aa0e800 20 remove_watcher() i=0 2024-05-15T18:09:56.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.668+0000 7f8b2aa0e800 2 removed watcher, disabling cache 2024-05-15T18:09:56.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.668+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93858150959392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbfa010 con 0x555d0dbe9a40 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.669+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93858150959392] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.669+0000 7f8b2aa0e800 20 remove_watcher() i=1 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.669+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93858150964368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf4920 con 0x555d0dbee1d0 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.670+0000 7f8b2850d640 1 -- 172.21.15.173:0/674588089 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93858150964368] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b18063040 con 0x555d0dbee1d0 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.670+0000 7f8b2aa0e800 20 remove_watcher() i=2 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.670+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93858150961520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbfa010 con 0x7f8b18079040 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.671+0000 7f8b27d0c640 1 -- 172.21.15.173:0/674588089 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93858150961520] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1c07f070 con 0x7f8b18079040 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.671+0000 7f8b2aa0e800 20 remove_watcher() i=3 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.671+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93858150971728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf5c90 con 0x555d0dbe9a40 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.672+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93858150971728] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x555d0dbe9a40 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.672+0000 7f8b2aa0e800 20 remove_watcher() i=4 2024-05-15T18:09:56.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.672+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93858150973856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf4920 con 0x7f8b1c074040 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.674+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93858150973856] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.674+0000 7f8b2aa0e800 20 remove_watcher() i=5 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.674+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93858150978000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbfa010 con 0x7f8b1c074040 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.675+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93858150978000] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.675+0000 7f8b2aa0e800 20 remove_watcher() i=6 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.675+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93858150975504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555d0dbf7950 con 0x7f8b1c074040 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93858150975504] v31'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b20031040 con 0x7f8b1c074040 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 20 remove_watcher() i=7 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8b1c074040 msgr2=0x7f8b1c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f8b1c074040 0x7f8b1c081410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dbe9a40 msgr2=0x555d0dbebf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dbe9a40 0x555d0dbebf00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8b18079040 msgr2=0x7f8b18026390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f8b18079040 0x7f8b18026390 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbee1d0 msgr2=0x555d0dbf05c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbee1d0 0x555d0dbf05c0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f89f8036900 msgr2=0x7f89f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f89f8036900 0x7f89f8038dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x555d0dbb40e0 tx=0x7f8b1c04f000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 msgr2=0x555d0dbde2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b28d0e640 1 -- 172.21.15.173:0/674588089 reap_dead start 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.676+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbde2e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8b18049960 tx=0x7f8b180474d0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 shutdown_connections 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/674588089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbd6ed0 0x555d0dbde2e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 >> 172.21.15.173:0/674588089 conn(0x555d0dbd3230 msgr2=0x555d0dbd0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 shutdown_connections 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/674588089 wait complete. 2024-05-15T18:09:56.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a00036900 msgr2=0x7f8a00038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a00036900 0x7f8a00038dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x555d0dbaf9a0 tx=0x7f8b1c005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbc9cd0 msgr2=0x555d0dbca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbc9cd0 0x555d0dbca0f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8b1804ab40 tx=0x7f8b180177a0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 shutdown_connections 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a00036900 0x7f8a00038dc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/2288003719 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dbc9cd0 0x555d0dbca0f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 >> 172.21.15.173:0/2288003719 conn(0x555d0dbbdd70 msgr2=0x555d0dbbe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 shutdown_connections 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/2288003719 wait complete. 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555d0dbb8cd0 msgr2=0x555d0dbbb140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555d0dbb8cd0 0x555d0dbbb140 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dab6680 msgr2=0x555d0dbb24b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555d0dab6680 0x555d0dbb24b0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbb4d90 msgr2=0x555d0dbb7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555d0dbb4d90 0x555d0dbb7180 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a10036900 msgr2=0x7f8a10038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8a10036900 0x7f8a10038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c054000 tx=0x7f8b1c04e000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 msgr2=0x555d0dbab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b2aa0e800 1 --2- 172.21.15.173:0/534078866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555d0dab2b70 0x555d0dbab270 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x555d0dba4480 tx=0x7f8b18000bc0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.677+0000 7f8b28d0e640 1 -- 172.21.15.173:0/534078866 reap_dead start 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.678+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 shutdown_connections 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.678+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 >> 172.21.15.173:0/534078866 conn(0x555d0daac5c0 msgr2=0x555d0db9d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.678+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 shutdown_connections 2024-05-15T18:09:56.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.678+0000 7f8b2aa0e800 1 -- 172.21.15.173:0/534078866 wait complete. 2024-05-15T18:09:56.663 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-05-15T18:09:56.663 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-05-15T18:09:56.664 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-15T18:09:56.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-15T18:09:56.664 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-05-15T18:09:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:56.710 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.734+0000 7f261ca2f800 1 Processor -- start 2024-05-15T18:09:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.734+0000 7f261ca2f800 1 -- start start 2024-05-15T18:09:56.711 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.734+0000 7f261ca2f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560db4477400 0x560db44798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.734+0000 7f261ca2f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560db4479f20 con 0x560db43e6040 2024-05-15T18:09:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.734+0000 7f261ca2f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x560db4304050 con 0x560db4477400 2024-05-15T18:09:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.735+0000 7f26175bf640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560db4477400 0x560db44798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.735+0000 7f2617dc0640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x560db43e6040 0x560db4475c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60454/0 (socket says 172.21.15.173:60454) 2024-05-15T18:09:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.735+0000 7f2617dc0640 1 -- 172.21.15.173:0/3924388108 learned_addr learned my addr 172.21.15.173:0/3924388108 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.735+0000 7f26175bf640 1 -- 172.21.15.173:0/3924388108 >> v1:172.21.15.3:6789/0 conn(0x560db43e6040 legacy=0x560db4475c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.735+0000 7f26175bf640 1 -- 172.21.15.173:0/3924388108 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db447b150 con 0x560db4477400 2024-05-15T18:09:56.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.737+0000 7f26175bf640 1 --2- 172.21.15.173:0/3924388108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4477400 0x560db44798a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f260c00a470 tx=0x7f260c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4269a857c3b0ba83 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.737+0000 7f2616dbe640 1 -- 172.21.15.173:0/3924388108 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f260c057070 con 0x560db4477400 2024-05-15T18:09:56.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.737+0000 7f2616dbe640 1 -- 172.21.15.173:0/3924388108 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260c052570 con 0x560db4477400 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.737+0000 7f2616dbe640 1 -- 172.21.15.173:0/3924388108 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f260c052870 con 0x560db4477400 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.738+0000 7f261ca2f800 1 -- 172.21.15.173:0/3924388108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4477400 msgr2=0x560db44798a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.738+0000 7f261ca2f800 1 --2- 172.21.15.173:0/3924388108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4477400 0x560db44798a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f260c00a470 tx=0x7f260c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.738+0000 7f261ca2f800 1 -- 172.21.15.173:0/3924388108 shutdown_connections 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.738+0000 7f261ca2f800 1 --2- 172.21.15.173:0/3924388108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4477400 0x560db44798a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.738+0000 7f261ca2f800 1 -- 172.21.15.173:0/3924388108 >> 172.21.15.173:0/3924388108 conn(0x560db446d5c0 msgr2=0x560db446f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.738+0000 7f261ca2f800 1 -- 172.21.15.173:0/3924388108 shutdown_connections 2024-05-15T18:09:56.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.738+0000 7f261ca2f800 1 -- 172.21.15.173:0/3924388108 wait complete. 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.751+0000 7f261ca2f800 1 Processor -- start 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.751+0000 7f261ca2f800 1 -- start start 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.751+0000 7f261ca2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db4564760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.751+0000 7f261ca2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560db43be1c0 con 0x560db43e6040 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db4564760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db4564760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38434/0 (socket says 172.21.15.173:38434) 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2617dc0640 1 -- 172.21.15.173:0/1447429107 learned_addr learned my addr 172.21.15.173:0/1447429107 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2617dc0640 1 -- 172.21.15.173:0/1447429107 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db4564d30 con 0x560db43e6040 2024-05-15T18:09:56.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2617dc0640 1 --2- 172.21.15.173:0/1447429107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db4564760 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2608001de0 tx=0x7f260800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b34c3fafd8d161 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2505e0b640 1 -- 172.21.15.173:0/1447429107 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2608012020 con 0x560db43e6040 2024-05-15T18:09:56.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2505e0b640 1 -- 172.21.15.173:0/1447429107 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260800e5a0 con 0x560db43e6040 2024-05-15T18:09:56.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.752+0000 7f2505e0b640 1 -- 172.21.15.173:0/1447429107 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f260800e8c0 con 0x560db43e6040 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.753+0000 7f261ca2f800 1 -- 172.21.15.173:0/1447429107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 msgr2=0x560db4564760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.753+0000 7f261ca2f800 1 --2- 172.21.15.173:0/1447429107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db4564760 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2608001de0 tx=0x7f260800b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.753+0000 7f261ca2f800 1 -- 172.21.15.173:0/1447429107 shutdown_connections 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.753+0000 7f261ca2f800 1 --2- 172.21.15.173:0/1447429107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db4564760 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.753+0000 7f261ca2f800 1 -- 172.21.15.173:0/1447429107 >> 172.21.15.173:0/1447429107 conn(0x560db446d5c0 msgr2=0x560db4560080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.753+0000 7f261ca2f800 1 -- 172.21.15.173:0/1447429107 shutdown_connections 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.753+0000 7f261ca2f800 1 -- 172.21.15.173:0/1447429107 wait complete. 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f261ca2f800 1 Processor -- start 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f261ca2f800 1 -- start start 2024-05-15T18:09:56.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f261ca2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db456c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f261ca2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560db447a3f0 con 0x560db43e6040 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db456c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db456c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38450/0 (socket says 172.21.15.173:38450) 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f2617dc0640 1 -- 172.21.15.173:0/987771545 learned_addr learned my addr 172.21.15.173:0/987771545 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.754+0000 7f2617dc0640 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db456c7e0 con 0x560db43e6040 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.755+0000 7f2617dc0640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db456c2a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f260800c010 tx=0x7f2608000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.755+0000 7f24fffff640 1 -- 172.21.15.173:0/987771545 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2608012070 con 0x560db43e6040 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.755+0000 7f24fffff640 1 -- 172.21.15.173:0/987771545 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260801a7a0 con 0x560db43e6040 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.755+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560db456ca70 con 0x560db43e6040 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.755+0000 7f24fffff640 1 -- 172.21.15.173:0/987771545 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f260801aa80 con 0x560db43e6040 2024-05-15T18:09:56.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.755+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db456f720 con 0x560db43e6040 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.756+0000 7f24fffff640 1 -- 172.21.15.173:0/987771545 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2608015020 con 0x560db43e6040 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.756+0000 7f24fffff640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2500036950 0x7f2500038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.756+0000 7f24fffff640 1 -- 172.21.15.173:0/987771545 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f2608020070 con 0x560db43e6040 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.756+0000 7f26175bf640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2500036950 0x7f2500038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.756+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db4477400 0x560db45734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.756+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db4573a20 con 0x560db4477400 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.756+0000 7f26185c1640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db4477400 0x560db45734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f26175bf640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2500036950 0x7f2500038e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f260c054000 tx=0x7f260c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f26185c1640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db4477400 0x560db45734e0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.742 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f26185c1640 1 -- 172.21.15.173:0/987771545 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db4477400 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db4570ab0 con 0x560db4477400 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f26185c1640 1 -- 172.21.15.173:0/987771545 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f261000a4a0 con 0x560db4477400 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db4575dc0 0x560db45781b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db4578850 con 0x560db4575dc0 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.757+0000 7f2617dc0640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db4575dc0 0x560db45781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.758+0000 7f2617dc0640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db4575dc0 0x560db45781b0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.758+0000 7f2617dc0640 1 -- 172.21.15.173:0/987771545 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f260802b070 con 0x560db4575dc0 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.758+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db4574d70 con 0x560db4477400 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.758+0000 7f26185c1640 1 -- 172.21.15.173:0/987771545 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f261000a4a0 con 0x560db4477400 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.758+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560db4579d00 0x560db457c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.758+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db457c8b0 con 0x560db4579d00 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.758+0000 7f26175bf640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560db4579d00 0x560db457c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.759+0000 7f26175bf640 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560db4579d00 0x560db457c150 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.743 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.759+0000 7f26175bf640 1 -- 172.21.15.173:0/987771545 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f260c05a040 con 0x560db4579d00 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f261ca2f800 1 Processor -- start 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f261ca2f800 1 -- start start 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f261ca2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db458acc0 0x560db458b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f261ca2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560db4364cf0 con 0x560db458acc0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db458acc0 0x560db458b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db458acc0 0x560db458b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38464/0 (socket says 172.21.15.173:38464) 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f2617dc0640 1 -- 172.21.15.173:0/2155214848 learned_addr learned my addr 172.21.15.173:0/2155214848 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f2617dc0640 1 -- 172.21.15.173:0/2155214848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db458b620 con 0x560db458acc0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.760+0000 7f2617dc0640 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db458acc0 0x560db458b0e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f260804aa30 tx=0x7f260802caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.761+0000 7f24fd7fa640 1 -- 172.21.15.173:0/2155214848 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26080494e0 con 0x560db458acc0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.761+0000 7f24fd7fa640 1 -- 172.21.15.173:0/2155214848 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2608044000 con 0x560db458acc0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.761+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560db458c090 con 0x560db458acc0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.761+0000 7f24fd7fa640 1 -- 172.21.15.173:0/2155214848 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26080442e0 con 0x560db458acc0 2024-05-15T18:09:56.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.761+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db458c590 con 0x560db458acc0 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.761+0000 7f24fd7fa640 1 -- 172.21.15.173:0/2155214848 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f260800d3d0 con 0x560db458acc0 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f24fd7fa640 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24f00369c0 0x7f24f0038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f24fd7fa640 1 -- 172.21.15.173:0/2155214848 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f2608039bd0 con 0x560db458acc0 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f26175bf640 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24f00369c0 0x7f24f0038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f261ca2f800 1 Processor -- start 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f261ca2f800 1 -- start start 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f26175bf640 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24f00369c0 0x7f24f0038e80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x560db45709d0 tx=0x7f260c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f261ca2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db4473680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f261ca2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560db45650b0 con 0x560db4473260 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db4473680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db4473680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38468/0 (socket says 172.21.15.173:38468) 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.762+0000 7f2617dc0640 1 -- 172.21.15.173:0/715804214 learned_addr learned my addr 172.21.15.173:0/715804214 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.763+0000 7f2617dc0640 1 -- 172.21.15.173:0/715804214 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db4471a60 con 0x560db4473260 2024-05-15T18:09:56.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.763+0000 7f2617dc0640 1 --2- 172.21.15.173:0/715804214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db4473680 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f260801a6f0 tx=0x7f2608039f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875184a1d4715187 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.763+0000 7f24f6ffd640 1 -- 172.21.15.173:0/715804214 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f260805c070 con 0x560db4473260 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.763+0000 7f24f6ffd640 1 -- 172.21.15.173:0/715804214 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260803fe40 con 0x560db4473260 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.763+0000 7f24f6ffd640 1 -- 172.21.15.173:0/715804214 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2608044480 con 0x560db4473260 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 -- 172.21.15.173:0/715804214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 msgr2=0x560db4473680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 --2- 172.21.15.173:0/715804214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db4473680 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f260801a6f0 tx=0x7f2608039f70 comp rx=0 tx=0).stop 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 -- 172.21.15.173:0/715804214 shutdown_connections 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 --2- 172.21.15.173:0/715804214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db4473680 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 -- 172.21.15.173:0/715804214 >> 172.21.15.173:0/715804214 conn(0x560db45941a0 msgr2=0x560db4592200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 -- 172.21.15.173:0/715804214 shutdown_connections 2024-05-15T18:09:56.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 -- 172.21.15.173:0/715804214 wait complete. 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 Processor -- start 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 -- start start 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db45a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f261ca2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560db4471e70 con 0x560db4473260 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db45a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f2617dc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db45a1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38482/0 (socket says 172.21.15.173:38482) 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.764+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 learned_addr learned my addr 172.21.15.173:0/2034922477 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.765+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db45a19b0 con 0x560db4473260 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.765+0000 7f2617dc0640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db45a1470 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f260801a6f0 tx=0x7f260803fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.765+0000 7f24f57fa640 1 -- 172.21.15.173:0/2034922477 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2608067020 con 0x560db4473260 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.765+0000 7f24f57fa640 1 -- 172.21.15.173:0/2034922477 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2608044ae0 con 0x560db4473260 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.765+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560db45a19b0 con 0x560db4473260 2024-05-15T18:09:56.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.765+0000 7f24f57fa640 1 -- 172.21.15.173:0/2034922477 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f260805c030 con 0x560db4473260 2024-05-15T18:09:56.748 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.765+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db45a19b0 con 0x560db4473260 2024-05-15T18:09:56.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.766+0000 7f24f57fa640 1 -- 172.21.15.173:0/2034922477 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f260806a020 con 0x560db4473260 2024-05-15T18:09:56.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.766+0000 7f24f57fa640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24e0036900 0x7f24e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.766+0000 7f24f57fa640 1 -- 172.21.15.173:0/2034922477 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f260805d070 con 0x560db4473260 2024-05-15T18:09:56.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.766+0000 7f26175bf640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24e0036900 0x7f24e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.766+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.766+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db45acba0 0x560db45af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45af7b0 con 0x560db45acba0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f26185c1640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db45acba0 0x560db45af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f26175bf640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24e0036900 0x7f24e0038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x560db457ccb0 tx=0x7f260c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f26185c1640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db45acba0 0x560db45af060 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 20 realm 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45afbc0 con 0x560db45acba0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.767+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0460 con 0x560db45acba0 2024-05-15T18:09:56.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f261ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x560db45acba0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f261ca2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db45b1560 0x560db45b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b3e90 con 0x560db45b1560 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f2617dc0640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db45b1560 0x560db45b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f2617dc0640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db45b1560 0x560db45b3950 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.768+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f261ca2f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f261ca2f800 20 searching for the correct realm 2024-05-15T18:09:56.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b5840 con 0x560db45b1560 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f2617dc0640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2608077040 0x7f2608032150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b5840 con 0x7f2608077040 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f26175bf640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2608077040 0x7f2608032150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.769+0000 7f26175bf640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2608077040 0x7f2608032150 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.770+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.770+0000 7f26175bf640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f260c074040 0x7f260c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.770+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b5840 con 0x7f260c074040 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.770+0000 7f26185c1640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f260c074040 0x7f260c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.770+0000 7f26185c1640 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f260c074040 0x7f260c081410 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x560db45acba0 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x560db45acba0 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x7f260c074040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.771+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x7f260c074040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x7f2608077040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x560db45b1560 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x560db45acba0 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.772+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x7f260c074040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.773+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.773+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x560db45acba0 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.773+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.773+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560db45b0800 con 0x7f2608077040 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f260c074040 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.774+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45acba0 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45acba0 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.775+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f260c074040 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45b1560 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f2608077040 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45acba0 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.776+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f260c074040 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.777+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.777+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45b1560 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.777+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.777+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f260c074040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.777+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.777+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f2608077040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45b1560 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f2608077040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x560db45acba0 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.778+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f260c08e060 con 0x7f2608077040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.769 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b4810 con 0x560db45acba0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b4c00 con 0x560db45acba0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.770 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b4c00 con 0x7f260c074040 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.779+0000 7f261ca2f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 zone default found 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 4 Realm: () 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 zonegroup default 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b5020 con 0x7f260c074040 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b5440 con 0x560db45b1560 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45b76f0 con 0x560db45b1560 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 started sync module instance, tier type = 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.780+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b6b90 con 0x7f2608077040 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.781+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.781+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94616860454784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b7f40 con 0x7f2608077040 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.781+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b8790 con 0x560db45acba0 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.782+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94616860454784] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.783+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.783+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94616860459744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b8bb0 con 0x560db45acba0 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.783+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b9400 con 0x560db45b1560 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.784+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94616860459744] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.784+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.784+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94616860461280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b97f0 con 0x560db45b1560 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.784+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45ba210 con 0x7f2608077040 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.785+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.785+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94616860468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45baed0 con 0x7f2608077040 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.785+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bb920 con 0x560db45acba0 2024-05-15T18:09:56.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.785+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94616860461280] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.786+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94616860468736] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.786+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.787+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94616860469792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b8d40 con 0x560db45acba0 2024-05-15T18:09:56.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.787+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bc1c0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.788+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94616860469792] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.788+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.788+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94616860472336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bc170 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.788+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bcbd0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.789+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.789+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94616860477216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bcff0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.789+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bdab0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.789+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94616860472336] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94616860477216] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94616860480896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bcb40 con 0x7f260c074040 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 20 add_watcher() i=0 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 20 add_watcher() i=1 2024-05-15T18:09:56.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 20 add_watcher() i=2 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 20 add_watcher() i=3 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 20 add_watcher() i=4 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 20 add_watcher() i=5 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.790+0000 7f261ca2f800 20 add_watcher() i=6 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.791+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94616860480896] v31'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.791+0000 7f261ca2f800 20 add_watcher() i=7 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.791+0000 7f261ca2f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.791+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45c0bb0 con 0x560db45acba0 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.792+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.792+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94616860474560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45be030 con 0x560db45acba0 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94616860474560] v31'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f24cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f261ca2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f261ca2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:56.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f261ca2f800 5 note: GC not initialized 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f24ccfe1640 20 reqs_thread_entry: start 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f261ca2f800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f261ca2f800 20 Filter name: none 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f24467fc640 20 reqs_thread_entry: start 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f261ca2f800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.793+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45f39a0 con 0x560db45acba0 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.794+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.794+0000 7f261ca2f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.794+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560db45f4d90 con 0x7f260c074040 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.795+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.795+0000 7f24cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.795+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94616860474560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bdb80 con 0x560db45acba0 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.796+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94616860474560] v31'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.796+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94616860454784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bbcc0 con 0x7f2608077040 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.797+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94616860454784] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.798+0000 7f261ca2f800 20 remove_watcher() i=0 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.798+0000 7f261ca2f800 2 removed watcher, disabling cache 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.798+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94616860459744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bbcc0 con 0x560db45acba0 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.799+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94616860459744] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.799+0000 7f261ca2f800 20 remove_watcher() i=1 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.799+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94616860461280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b82e0 con 0x560db45b1560 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.800+0000 7f2617dc0640 1 -- 172.21.15.173:0/2034922477 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94616860461280] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260802b070 con 0x560db45b1560 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.800+0000 7f261ca2f800 20 remove_watcher() i=2 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.800+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94616860468736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bbcc0 con 0x7f2608077040 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.801+0000 7f26175bf640 1 -- 172.21.15.173:0/2034922477 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94616860468736] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f260c07f070 con 0x7f2608077040 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.801+0000 7f261ca2f800 20 remove_watcher() i=3 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.801+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94616860469792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b82e0 con 0x560db45acba0 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.802+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94616860469792] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x560db45acba0 2024-05-15T18:09:56.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.802+0000 7f261ca2f800 20 remove_watcher() i=4 2024-05-15T18:09:56.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.802+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94616860472336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bbcc0 con 0x7f260c074040 2024-05-15T18:09:56.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.803+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94616860472336] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.803+0000 7f261ca2f800 20 remove_watcher() i=5 2024-05-15T18:09:56.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.803+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94616860477216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45b82e0 con 0x7f260c074040 2024-05-15T18:09:56.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.804+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94616860477216] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.805+0000 7f261ca2f800 20 remove_watcher() i=6 2024-05-15T18:09:56.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.805+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94616860480896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560db45bb410 con 0x7f260c074040 2024-05-15T18:09:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94616860480896] v31'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f261000a4a0 con 0x7f260c074040 2024-05-15T18:09:56.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 20 remove_watcher() i=7 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f260c074040 msgr2=0x7f260c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f260c074040 0x7f260c081410 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db45acba0 msgr2=0x560db45af060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db45acba0 0x560db45af060 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2608077040 msgr2=0x7f2608032150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2608077040 0x7f2608032150 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db45b1560 msgr2=0x560db45b3950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db45b1560 0x560db45b3950 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24e0036900 msgr2=0x7f24e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24e0036900 0x7f24e0038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x560db457ccb0 tx=0x7f260c04f000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 msgr2=0x560db45a1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2034922477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db4473260 0x560db45a1470 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f260801a6f0 tx=0x7f260803fa90 comp rx=0 tx=0).stop 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 reap_dead start 2024-05-15T18:09:56.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f26185c1640 1 -- 172.21.15.173:0/2034922477 reap_dead start 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 shutdown_connections 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 >> 172.21.15.173:0/2034922477 conn(0x560db45941a0 msgr2=0x560db4591800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 shutdown_connections 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2034922477 wait complete. 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.806+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24f00369c0 msgr2=0x7f24f0038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24f00369c0 0x7f24f0038e80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x560db45709d0 tx=0x7f260c005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db458acc0 msgr2=0x560db458b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db458acc0 0x560db458b0e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f260804aa30 tx=0x7f260802caa0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 shutdown_connections 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f24f00369c0 0x7f24f0038e80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/2155214848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db458acc0 0x560db458b0e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 >> 172.21.15.173:0/2155214848 conn(0x560db457ed60 msgr2=0x560db457f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 shutdown_connections 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/2155214848 wait complete. 2024-05-15T18:09:56.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560db4579d00 msgr2=0x560db457c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x560db4579d00 0x560db457c150 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db4477400 msgr2=0x560db45734e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560db4477400 0x560db45734e0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db4575dc0 msgr2=0x560db45781b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x560db4575dc0 0x560db45781b0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2500036950 msgr2=0x7f2500038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2500036950 0x7f2500038e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f260c054000 tx=0x7f260c04e000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 msgr2=0x560db456c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 --2- 172.21.15.173:0/987771545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560db43e6040 0x560db456c2a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f260800c010 tx=0x7f2608000ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f26185c1640 1 -- 172.21.15.173:0/987771545 reap_dead start 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 shutdown_connections 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 >> 172.21.15.173:0/987771545 conn(0x560db446d5c0 msgr2=0x560db455e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 shutdown_connections 2024-05-15T18:09:56.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.807+0000 7f261ca2f800 1 -- 172.21.15.173:0/987771545 wait complete. 2024-05-15T18:09:56.793 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-15T18:00:00.000000Z","epoch":1715796000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-05-15T18:09:56.794 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-05-15T18:09:56.794 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-15T18:09:56.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-15T18:09:56.795 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-05-15T18:09:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:56.846 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc7b46800 1 Processor -- start 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc7b46800 1 -- start start 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc7b46800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55761924ec30 0x557619251020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc7b46800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557619255070 con 0x557619251560 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc7b46800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5576190df050 con 0x55761924ec30 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc5645640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55761924ec30 0x557619251020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc4e44640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x557619251560 0x557619253950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60458/0 (socket says 172.21.15.173:60458) 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.871+0000 7f9bc4e44640 1 -- 172.21.15.173:0/2042367799 learned_addr learned my addr 172.21.15.173:0/2042367799 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:56.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.872+0000 7f9bc5645640 1 -- 172.21.15.173:0/2042367799 >> v1:172.21.15.3:6789/0 conn(0x557619251560 legacy=0x557619253950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.872+0000 7f9bc5645640 1 -- 172.21.15.173:0/2042367799 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557619256250 con 0x55761924ec30 2024-05-15T18:09:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bc5645640 1 --2- 172.21.15.173:0/2042367799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619251020 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a470 tx=0x7f9bb801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c6fa259f86ca6f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bb7fff640 1 -- 172.21.15.173:0/2042367799 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8057070 con 0x55761924ec30 2024-05-15T18:09:56.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bb7fff640 1 -- 172.21.15.173:0/2042367799 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8052570 con 0x55761924ec30 2024-05-15T18:09:56.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bb7fff640 1 -- 172.21.15.173:0/2042367799 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8052870 con 0x55761924ec30 2024-05-15T18:09:56.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2042367799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 msgr2=0x557619251020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2042367799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619251020 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a470 tx=0x7f9bb801ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:56.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2042367799 shutdown_connections 2024-05-15T18:09:56.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2042367799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619251020 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.874+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2042367799 >> 172.21.15.173:0/2042367799 conn(0x5576192485e0 msgr2=0x55761924aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.875+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2042367799 shutdown_connections 2024-05-15T18:09:56.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.875+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2042367799 wait complete. 2024-05-15T18:09:56.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.888+0000 7f9bc7b46800 1 Processor -- start 2024-05-15T18:09:56.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.888+0000 7f9bc7b46800 1 -- start start 2024-05-15T18:09:56.865 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.889+0000 7f9bc7b46800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x55761933f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.889+0000 7f9bc7b46800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576191991f0 con 0x55761924ec30 2024-05-15T18:09:56.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.889+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x55761933f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.889+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x55761933f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38512/0 (socket says 172.21.15.173:38512) 2024-05-15T18:09:56.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.889+0000 7f9bc5645640 1 -- 172.21.15.173:0/2776578712 learned_addr learned my addr 172.21.15.173:0/2776578712 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.889+0000 7f9bc5645640 1 -- 172.21.15.173:0/2776578712 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55761933fd80 con 0x55761924ec30 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.889+0000 7f9bc5645640 1 --2- 172.21.15.173:0/2776578712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x55761933f7b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8055040 tx=0x7f9bb804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da052c04ab08b892 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9ab3606640 1 -- 172.21.15.173:0/2776578712 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8057040 con 0x55761924ec30 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9ab3606640 1 -- 172.21.15.173:0/2776578712 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8052990 con 0x55761924ec30 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9ab3606640 1 -- 172.21.15.173:0/2776578712 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8052c70 con 0x55761924ec30 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2776578712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 msgr2=0x55761933f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2776578712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x55761933f7b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8055040 tx=0x7f9bb804c000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2776578712 shutdown_connections 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2776578712 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x55761933f7b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2776578712 >> 172.21.15.173:0/2776578712 conn(0x5576192485e0 msgr2=0x55761933b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2776578712 shutdown_connections 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.890+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2776578712 wait complete. 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc7b46800 1 Processor -- start 2024-05-15T18:09:56.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc7b46800 1 -- start start 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc7b46800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619347230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc7b46800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576192554e0 con 0x55761924ec30 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619347230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619347230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38516/0 (socket says 172.21.15.173:38516) 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc5645640 1 -- 172.21.15.173:0/2177149864 learned_addr learned my addr 172.21.15.173:0/2177149864 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.891+0000 7f9bc5645640 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557619347770 con 0x55761924ec30 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.892+0000 7f9bc5645640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619347230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a470 tx=0x7f9bb8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.892+0000 7f9ab1e03640 1 -- 172.21.15.173:0/2177149864 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8073070 con 0x55761924ec30 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.892+0000 7f9ab1e03640 1 -- 172.21.15.173:0/2177149864 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb805d650 con 0x55761924ec30 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.892+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557619347a00 con 0x55761924ec30 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.892+0000 7f9ab1e03640 1 -- 172.21.15.173:0/2177149864 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8057070 con 0x55761924ec30 2024-05-15T18:09:56.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.892+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55761934a6b0 con 0x55761924ec30 2024-05-15T18:09:56.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9ab1e03640 1 -- 172.21.15.173:0/2177149864 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9bb8076070 con 0x55761924ec30 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9ab1e03640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9aac036950 0x7f9aac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9ab1e03640 1 -- 172.21.15.173:0/2177149864 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f9bb808df00 con 0x55761924ec30 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9aac036950 0x7f9aac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619251560 0x55761934e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761934e9b0 con 0x557619251560 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9bc5e46640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619251560 0x55761934e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.893+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9aac036950 0x7f9aac038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc000f60 tx=0x7f9bbc0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc5e46640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619251560 0x55761934e470 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc5e46640 1 -- 172.21.15.173:0/2177149864 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619251560 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761934ba20 con 0x557619251560 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc5e46640 1 -- 172.21.15.173:0/2177149864 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619251560 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557619350c80 0x557619353070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557619353760 con 0x557619350c80 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc5645640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557619350c80 0x557619353070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.894+0000 7f9bc5645640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557619350c80 0x557619353070 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.895+0000 7f9bc5645640 1 -- 172.21.15.173:0/2177149864 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9bb8075030 con 0x557619350c80 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.895+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761934fc30 con 0x557619251560 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.895+0000 7f9bc5e46640 1 -- 172.21.15.173:0/2177149864 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619251560 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.895+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557619354c10 0x557619357060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.895+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576193577c0 con 0x557619354c10 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.895+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557619354c10 0x557619357060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.896+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557619354c10 0x557619357060 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.896+0000 7f9bc4e44640 1 -- 172.21.15.173:0/2177149864 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9bbc009050 con 0x557619354c10 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.896+0000 7f9bc7b46800 1 Processor -- start 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.896+0000 7f9bc7b46800 1 -- start start 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.896+0000 7f9bc7b46800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619365c20 0x557619366040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.879 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.896+0000 7f9bc7b46800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55761913fcf0 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619365c20 0x557619366040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619365c20 0x557619366040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38526/0 (socket says 172.21.15.173:38526) 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9bc5645640 1 -- 172.21.15.173:0/4077082652 learned_addr learned my addr 172.21.15.173:0/4077082652 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9bc5645640 1 -- 172.21.15.173:0/4077082652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557619366580 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9bc5645640 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619365c20 0x557619366040 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8006e60 tx=0x7f9bb8006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4077082652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8076db0 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4077082652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8088070 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557619366ff0 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4077082652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb805cb90 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.897+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576193674f0 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.898+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4077082652 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9bb808a020 con 0x557619365c20 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.898+0000 7f9aaaffd640 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a9c036950 0x7f9a9c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.880 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.898+0000 7f9aaaffd640 1 -- 172.21.15.173:0/4077082652 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f9bb808f030 con 0x557619365c20 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.898+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a9c036950 0x7f9a9c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc7b46800 1 Processor -- start 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc7b46800 1 -- start start 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a9c036950 0x7f9a9c038e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00bf50 tx=0x7f9bbc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc7b46800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x5576193730d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc7b46800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557619340040 con 0x557619372cb0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x5576193730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x5576193730d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38528/0 (socket says 172.21.15.173:38528) 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc5645640 1 -- 172.21.15.173:0/1172871182 learned_addr learned my addr 172.21.15.173:0/1172871182 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.899+0000 7f9bc5645640 1 -- 172.21.15.173:0/1172871182 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576193736a0 con 0x557619372cb0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc5645640 1 --2- 172.21.15.173:0/1172871182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x5576193730d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8079fd0 tx=0x7f9bb806e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260c1fab33b652c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9aa8ff9640 1 -- 172.21.15.173:0/1172871182 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8078860 con 0x557619372cb0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9aa8ff9640 1 -- 172.21.15.173:0/1172871182 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8084d10 con 0x557619372cb0 2024-05-15T18:09:56.881 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9aa8ff9640 1 -- 172.21.15.173:0/1172871182 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb805de40 con 0x557619372cb0 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1172871182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 msgr2=0x5576193730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1172871182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x5576193730d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8079fd0 tx=0x7f9bb806e880 comp rx=0 tx=0).stop 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1172871182 shutdown_connections 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1172871182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x5576193730d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1172871182 >> 172.21.15.173:0/1172871182 conn(0x55761936f010 msgr2=0x55761936d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1172871182 shutdown_connections 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.900+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1172871182 wait complete. 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc7b46800 1 Processor -- start 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc7b46800 1 -- start start 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc7b46800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x55761937a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc7b46800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557619373d50 con 0x557619372cb0 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x55761937a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.882 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc5645640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x55761937a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38534/0 (socket says 172.21.15.173:38534) 2024-05-15T18:09:56.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 learned_addr learned my addr 172.21.15.173:0/1696307959 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:56.883 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.901+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55761937a5e0 con 0x557619372cb0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.902+0000 7f9bc5645640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x55761937a0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80764d0 tx=0x7f9bb8002390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.902+0000 7f9a9affd640 1 -- 172.21.15.173:0/1696307959 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb80b8070 con 0x557619372cb0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.902+0000 7f9a9affd640 1 -- 172.21.15.173:0/1696307959 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8002000 con 0x557619372cb0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.902+0000 7f9a9affd640 1 -- 172.21.15.173:0/1696307959 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9bb8078440 con 0x557619372cb0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.902+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55761937a5e0 con 0x557619372cb0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.902+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55761937a5e0 con 0x557619372cb0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.902+0000 7f9a9affd640 1 -- 172.21.15.173:0/1696307959 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9bb80bb070 con 0x557619372cb0 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9a9affd640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a900368b0 0x7f9a90038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9a9affd640 1 -- 172.21.15.173:0/1696307959 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f9bb80af030 con 0x557619372cb0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a900368b0 0x7f9a90038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a900368b0 0x7f9a90038d70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc001b60 tx=0x7f9bbc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619385760 0x557619387c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557619388370 con 0x557619385760 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.903+0000 7f9bc5e46640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619385760 0x557619387c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc5e46640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619385760 0x557619387c20 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 20 realm 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557619388780 con 0x557619385760 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557619389050 con 0x557619385760 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.904+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55761938a150 0x55761938c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761938cb50 con 0x55761938a150 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc5645640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55761938a150 0x55761938c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc5645640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55761938a150 0x55761938c540 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc7b46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc7b46800 20 searching for the correct realm 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.905+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55761938e460 con 0x55761938a150 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.902 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc5645640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9bb80bd060 0x7f9bb80024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55761938e460 con 0x7f9bb80bd060 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9bb80bd060 0x7f9bb80024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9bb80bd060 0x7f9bb80024e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc009050 con 0x7f9bb80bd060 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc4e44640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9bbc038040 0x7f9bbc01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.906+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55761938e460 con 0x7f9bbc038040 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.907+0000 7f9bc5e46640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9bbc038040 0x7f9bbc01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.907+0000 7f9bc5e46640 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9bbc038040 0x7f9bbc01bab0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.907+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9bc000a4a0 con 0x7f9bbc038040 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.907+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.903 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bbc038040 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x7f9bbc038040 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bbc038040 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x7f9bbc038040 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.908+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bb80bd060 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.909+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc009050 con 0x7f9bb80bd060 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.909+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.909+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.909+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.909+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.909+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bbc038040 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x7f9bbc038040 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bb80bd060 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9bbc009050 con 0x7f9bb80bd060 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.910+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.905 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.911+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.911+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bbc038040 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.911+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x7f9bbc038040 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.911+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.911+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.911+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9bc000a4a0 con 0x557619385760 2024-05-15T18:09:56.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bbc038040 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc0033040 con 0x7f9bbc038040 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.912+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bb80bd060 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc009050 con 0x7f9bb80bd060 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bbc038040 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.913+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bbc038040 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bb80bd060 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc009050 con 0x7f9bb80bd060 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x55761938a150 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.914+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bb80bd060 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x557619385760 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5576193893f0 con 0x7f9bb80bd060 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761938d410 con 0x557619385760 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.915+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761938d800 con 0x557619385760 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761938d800 con 0x7f9bbc038040 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 20 zone default found 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 4 Realm: () 2024-05-15T18:09:56.910 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 20 zonegroup default 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.916+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55761938e8e0 con 0x7f9bbc038040 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576193902c0 con 0x55761938a150 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.911 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557619390660 con 0x55761938a150 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 20 started sync module instance, tier type = 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.917+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55761938f760 con 0x7f9bb80bd060 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.918+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.918+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93965717664432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619390a00 con 0x7f9bb80bd060 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.918+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619391250 con 0x557619385760 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.919+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93965717664432] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.920+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.920+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93965717671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576193911c0 con 0x557619385760 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.920+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619392140 con 0x55761938a150 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.921+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93965717671328] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.921+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.921+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93965717675152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576193924e0 con 0x55761938a150 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.921+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619392ea0 con 0x7f9bb80bd060 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.922+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.922+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93965717680784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619393b60 con 0x7f9bb80bd060 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.922+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619394610 con 0x557619385760 2024-05-15T18:09:56.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.922+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93965717675152] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.923+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.923+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93965717673584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619394a30 con 0x557619385760 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.923+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619395450 con 0x7f9bbc038040 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.923+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93965717680784] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.924+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93965717673584] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.924+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.924+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93965717684512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619395410 con 0x7f9bbc038040 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.924+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619395d20 con 0x7f9bbc038040 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.925+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.925+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93965717690480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619395410 con 0x7f9bbc038040 2024-05-15T18:09:56.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.925+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619396820 con 0x7f9bbc038040 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93965717684512] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93965717690480] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93965717693200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576193967e0 con 0x7f9bbc038040 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 20 add_watcher() i=0 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 20 add_watcher() i=1 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 20 add_watcher() i=2 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 20 add_watcher() i=3 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 20 add_watcher() i=4 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 20 add_watcher() i=5 2024-05-15T18:09:56.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.926+0000 7f9bc7b46800 20 add_watcher() i=6 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.927+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93965717693200] v31'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.927+0000 7f9bc7b46800 20 add_watcher() i=7 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.927+0000 7f9bc7b46800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.927+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557619395c90 con 0x557619385760 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.928+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.928+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93965717688128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619395c90 con 0x557619385760 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93965717688128] v31'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9a7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9bc7b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9bc7b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:56.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9bc7b46800 5 note: GC not initialized 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9a7a7e4640 20 reqs_thread_entry: start 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9bc7b46800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f9bc7b46800 20 Filter name: none 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.929+0000 7f99ebfff640 20 reqs_thread_entry: start 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576193ccc50 con 0x7f9bbc038040 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-05-15T18:09:56.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 20 rados->read ofs=0 len=0 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576193cb3f0 con 0x557619385760 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.930+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576193cb930 con 0x7f9bbc038040 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v31'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9bc7b46800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9bc7b46800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9bc7b46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-15T18:09:56.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93965717915296 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576193cc020 con 0x7f9bbc038040 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== watch-notify(notify (1) cookie 93965717693200 notify 133143986207 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5576193cbcd0 con 0x7f9bbc038040 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9aa8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 93965717693200 notifier 4720 bl.length()=556 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9aa8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9aa8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9aa8ff9640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9a88003ea0 con 0x7f9bbc038040 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.932+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(65 notify.7 [notify cookie 93965717915296 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.933+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.933+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== watch-notify(notify_complete (2) cookie 93965717915296 notify 133143986207 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5576193cb460 con 0x7f9bbc038040 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.933+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576193cc6a0 con 0x557619385760 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc7b46800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc7b46800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-15T18:09:56.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc7b46800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93965717913344 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5576193cc6a0 con 0x7f9bbc038040 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== watch-notify(notify (1) cookie 93965717684512 notify 133143986208 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5576193cb460 con 0x7f9bbc038040 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9a9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986208 cookie 93965717684512 notifier 4720 bl.length()=177 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9a9bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9a9bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9a9bfff640 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f99f8003400 con 0x7f9bbc038040 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(68 notify.5 [notify cookie 93965717913344 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.934+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.935+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== watch-notify(notify_complete (2) cookie 93965717913344 notify 133143986208 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9bc001e040 con 0x7f9bbc038040 2024-05-15T18:09:56.927 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-15T18:09:56.931160Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:09:56.931147Z","tags":[],"group_ids":[]} 2024-05-15T18:09:56.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.936+0000 7f9a7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.936+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93965717688128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5576193825d0 con 0x557619385760 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.937+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93965717688128] v31'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.937+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93965717664432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619394f40 con 0x7f9bb80bd060 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.938+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93965717664432] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.938+0000 7f9bc7b46800 20 remove_watcher() i=0 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.938+0000 7f9bc7b46800 2 removed watcher, disabling cache 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.938+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93965717671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55761938f2b0 con 0x557619385760 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.939+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93965717671328] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.939+0000 7f9bc7b46800 20 remove_watcher() i=1 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.939+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93965717675152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55761938f2b0 con 0x55761938a150 2024-05-15T18:09:56.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.941+0000 7f9bc5645640 1 -- 172.21.15.173:0/1696307959 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93965717675152] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bb80ba030 con 0x55761938a150 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.941+0000 7f9bc7b46800 20 remove_watcher() i=2 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.941+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93965717680784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619391c90 con 0x7f9bb80bd060 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.942+0000 7f9bc4e44640 1 -- 172.21.15.173:0/1696307959 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93965717680784] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bbc045040 con 0x7f9bb80bd060 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.942+0000 7f9bc7b46800 20 remove_watcher() i=3 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.942+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93965717673584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55761938f2b0 con 0x557619385760 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.943+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93965717673584] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x557619385760 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.943+0000 7f9bc7b46800 20 remove_watcher() i=4 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.943+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93965717684512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619393290 con 0x7f9bbc038040 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.944+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93965717684512] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.944+0000 7f9bc7b46800 20 remove_watcher() i=5 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.944+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93965717690480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619391c90 con 0x7f9bbc038040 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.945+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93965717690480] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.945+0000 7f9bc7b46800 20 remove_watcher() i=6 2024-05-15T18:09:56.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.945+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93965717693200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557619391670 con 0x7f9bbc038040 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93965717693200] v31'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9bc0031040 con 0x7f9bbc038040 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 20 remove_watcher() i=7 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9bbc038040 msgr2=0x7f9bbc01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f9bbc038040 0x7f9bbc01bab0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619385760 msgr2=0x557619387c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619385760 0x557619387c20 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9bb80bd060 msgr2=0x7f9bb80024e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f9bb80bd060 0x7f9bb80024e0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55761938a150 msgr2=0x55761938c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55761938a150 0x55761938c540 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a900368b0 msgr2=0x7f9a90038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a900368b0 0x7f9a90038d70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc001b60 tx=0x7f9bbc010000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 msgr2=0x55761937a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc5e46640 1 -- 172.21.15.173:0/1696307959 reap_dead start 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x55761937a0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80764d0 tx=0x7f9bb8002390 comp rx=0 tx=0).stop 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 shutdown_connections 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/1696307959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619372cb0 0x55761937a0a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.946+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 >> 172.21.15.173:0/1696307959 conn(0x55761936f010 msgr2=0x55761936c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 shutdown_connections 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/1696307959 wait complete. 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a9c036950 msgr2=0x7f9a9c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a9c036950 0x7f9a9c038e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00bf50 tx=0x7f9bbc00f000 comp rx=0 tx=0).stop 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619365c20 msgr2=0x557619366040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619365c20 0x557619366040 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8006e60 tx=0x7f9bb8006650 comp rx=0 tx=0).stop 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 shutdown_connections 2024-05-15T18:09:56.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9a9c036950 0x7f9a9c038e10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/4077082652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557619365c20 0x557619366040 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 >> 172.21.15.173:0/4077082652 conn(0x557619359cc0 msgr2=0x55761935a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 shutdown_connections 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/4077082652 wait complete. 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557619354c10 msgr2=0x557619357060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557619354c10 0x557619357060 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619251560 msgr2=0x55761934e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557619251560 0x55761934e470 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557619350c80 msgr2=0x557619353070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557619350c80 0x557619353070 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9aac036950 msgr2=0x7f9aac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9aac036950 0x7f9aac038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc000f60 tx=0x7f9bbc0012b0 comp rx=0 tx=0).stop 2024-05-15T18:09:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 msgr2=0x557619347230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 --2- 172.21.15.173:0/2177149864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55761924ec30 0x557619347230 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800a470 tx=0x7f9bb8003020 comp rx=0 tx=0).stop 2024-05-15T18:09:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc5e46640 1 -- 172.21.15.173:0/2177149864 reap_dead start 2024-05-15T18:09:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 shutdown_connections 2024-05-15T18:09:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.947+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 >> 172.21.15.173:0/2177149864 conn(0x5576192485e0 msgr2=0x5576193398d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.948+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 shutdown_connections 2024-05-15T18:09:56.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:56.948+0000 7f9bc7b46800 1 -- 172.21.15.173:0/2177149864 wait complete. 2024-05-15T18:09:56.939 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-15T18:09:56.931160Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:09:56.931147Z', 'tags': [], 'group_ids': []} 2024-05-15T18:09:56.952 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:09:56.957 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-05-15T18:09:56.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-15T18:09:56.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-15T18:09:56.957 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-05-15T18:09:57.003 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:09:57.003 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dd7c87800 1 Processor -- start 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dd7c87800 1 -- start start 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dd7c87800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558c2f5dc6f0 0x558c2f5deae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dd7c87800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c2f5df020 con 0x558c2f5d8be0 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dd7c87800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x558c2f469050 con 0x558c2f5dc6f0 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dccf85640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558c2f5dc6f0 0x558c2f5deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dd5786640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x558c2f5d8be0 0x558c2f5dafd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:60464/0 (socket says 172.21.15.173:60464) 2024-05-15T18:09:57.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dccf85640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558c2f5dc6f0 0x558c2f5deae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38542/0 (socket says 172.21.15.173:38542) 2024-05-15T18:09:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dd5786640 1 -- 172.21.15.173:0/4140537193 learned_addr learned my addr 172.21.15.173:0/4140537193 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:09:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dccf85640 1 -- 172.21.15.173:0/4140537193 >> v1:172.21.15.3:6789/0 conn(0x558c2f5d8be0 legacy=0x558c2f5dafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.028+0000 7f3dccf85640 1 -- 172.21.15.173:0/4140537193 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c2f5e0200 con 0x558c2f5dc6f0 2024-05-15T18:09:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.030+0000 7f3dccf85640 1 --2- 172.21.15.173:0/4140537193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5dc6f0 0x558c2f5deae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000a470 tx=0x7f3dc001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cceeebf98296c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.030+0000 7f3dd4f85640 1 -- 172.21.15.173:0/4140537193 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc0057070 con 0x558c2f5dc6f0 2024-05-15T18:09:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.030+0000 7f3dd4f85640 1 -- 172.21.15.173:0/4140537193 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc0052570 con 0x558c2f5dc6f0 2024-05-15T18:09:57.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.030+0000 7f3dd4f85640 1 -- 172.21.15.173:0/4140537193 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc0052870 con 0x558c2f5dc6f0 2024-05-15T18:09:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.031+0000 7f3dd7c87800 1 -- 172.21.15.173:0/4140537193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5dc6f0 msgr2=0x558c2f5deae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.031+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/4140537193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5dc6f0 0x558c2f5deae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000a470 tx=0x7f3dc001ce90 comp rx=0 tx=0).stop 2024-05-15T18:09:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.031+0000 7f3dd7c87800 1 -- 172.21.15.173:0/4140537193 shutdown_connections 2024-05-15T18:09:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.031+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/4140537193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5dc6f0 0x558c2f5deae0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.031+0000 7f3dd7c87800 1 -- 172.21.15.173:0/4140537193 >> 172.21.15.173:0/4140537193 conn(0x558c2f5d25b0 msgr2=0x558c2f5d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.031+0000 7f3dd7c87800 1 -- 172.21.15.173:0/4140537193 shutdown_connections 2024-05-15T18:09:57.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.031+0000 7f3dd7c87800 1 -- 172.21.15.173:0/4140537193 wait complete. 2024-05-15T18:09:57.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.044+0000 7f3dd7c87800 1 Processor -- start 2024-05-15T18:09:57.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.045+0000 7f3dd7c87800 1 -- start start 2024-05-15T18:09:57.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.045+0000 7f3dd7c87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f6c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.045+0000 7f3dd7c87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558c2f5231c0 con 0x558c2f5d8be0 2024-05-15T18:09:57.022 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.045+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f6c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.045+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f6c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38556/0 (socket says 172.21.15.173:38556) 2024-05-15T18:09:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.045+0000 7f3dd5786640 1 -- 172.21.15.173:0/1096220641 learned_addr learned my addr 172.21.15.173:0/1096220641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.045+0000 7f3dd5786640 1 -- 172.21.15.173:0/1096220641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c2f6c9cc0 con 0x558c2f5d8be0 2024-05-15T18:09:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3dd5786640 1 --2- 172.21.15.173:0/1096220641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f6c96f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8001de0 tx=0x7f3dc800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29339f495372278 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3cc3606640 1 -- 172.21.15.173:0/1096220641 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc8012020 con 0x558c2f5d8be0 2024-05-15T18:09:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3cc3606640 1 -- 172.21.15.173:0/1096220641 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc800e5a0 con 0x558c2f5d8be0 2024-05-15T18:09:57.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3cc3606640 1 -- 172.21.15.173:0/1096220641 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc800e8c0 con 0x558c2f5d8be0 2024-05-15T18:09:57.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1096220641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 msgr2=0x558c2f6c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1096220641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f6c96f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8001de0 tx=0x7f3dc800b6c0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1096220641 shutdown_connections 2024-05-15T18:09:57.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1096220641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f6c96f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1096220641 >> 172.21.15.173:0/1096220641 conn(0x558c2f5d25b0 msgr2=0x558c2f6c5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.046+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1096220641 shutdown_connections 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1096220641 wait complete. 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd7c87800 1 Processor -- start 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd7c87800 1 -- start start 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd7c87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f5d8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd7c87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558c2f5df4f0 con 0x558c2f5d8be0 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f5d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f5d8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38562/0 (socket says 172.21.15.173:38562) 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.047+0000 7f3dd5786640 1 -- 172.21.15.173:0/2327008201 learned_addr learned my addr 172.21.15.173:0/2327008201 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:57.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.048+0000 7f3dd5786640 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c2f5d6c10 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.048+0000 7f3dd5786640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f5d8520 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c010 tx=0x7f3dc8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.048+0000 7f3cc1e03640 1 -- 172.21.15.173:0/2327008201 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc8012070 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.048+0000 7f3cc1e03640 1 -- 172.21.15.173:0/2327008201 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc801a7a0 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.048+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c2f5d6ea0 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.048+0000 7f3cc1e03640 1 -- 172.21.15.173:0/2327008201 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc801aa80 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.048+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c2f5d73c0 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3cc1e03640 1 -- 172.21.15.173:0/2327008201 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3dc8015020 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3cc1e03640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cbc036900 0x7f3cbc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3cc1e03640 1 -- 172.21.15.173:0/2327008201 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3dc8020070 con 0x558c2f5d8be0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3dccf85640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cbc036900 0x7f3cbc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f5dc6f0 0x558c2f6da650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f6dabe0 con 0x558c2f5dc6f0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3dd5f87640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f5dc6f0 0x558c2f6da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.049+0000 7f3dccf85640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cbc036900 0x7f3cbc038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0054000 tx=0x7f3dc004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.050+0000 7f3dd5f87640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f5dc6f0 0x558c2f6da650 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.050+0000 7f3dd5f87640 1 -- 172.21.15.173:0/2327008201 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f5dc6f0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.050+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f6db510 con 0x558c2f5dc6f0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.050+0000 7f3dd5f87640 1 -- 172.21.15.173:0/2327008201 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f5dc6f0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.050+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f6dcf40 0x558c2f6df400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.050+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f6dfb90 con 0x558c2f6dcf40 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.050+0000 7f3dd5786640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f6dcf40 0x558c2f6df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.051+0000 7f3dd5786640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f6dcf40 0x558c2f6df400 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.051+0000 7f3dd5786640 1 -- 172.21.15.173:0/2327008201 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f6dcf40 2024-05-15T18:09:57.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.051+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f6dbd90 con 0x558c2f5dc6f0 2024-05-15T18:09:57.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.051+0000 7f3dd5f87640 1 -- 172.21.15.173:0/2327008201 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f5dc6f0 2024-05-15T18:09:57.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.051+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558c2f6e1090 0x558c2f6e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.051+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f6e3c60 con 0x558c2f6e1090 2024-05-15T18:09:57.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.051+0000 7f3dccf85640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558c2f6e1090 0x558c2f6e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.052+0000 7f3dccf85640 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558c2f6e1090 0x558c2f6e3500 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.052+0000 7f3dccf85640 1 -- 172.21.15.173:0/2327008201 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3dc005a040 con 0x558c2f6e1090 2024-05-15T18:09:57.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd7c87800 1 Processor -- start 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd7c87800 1 -- start start 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd7c87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6f2070 0x558c2f6f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd7c87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558c2f5d8a60 con 0x558c2f6f2070 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6f2070 0x558c2f6f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6f2070 0x558c2f6f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38572/0 (socket says 172.21.15.173:38572) 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd5786640 1 -- 172.21.15.173:0/858619314 learned_addr learned my addr 172.21.15.173:0/858619314 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd5786640 1 -- 172.21.15.173:0/858619314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c2f6f29d0 con 0x558c2f6f2070 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.053+0000 7f3dd5786640 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6f2070 0x558c2f6f2490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3dc804aa00 tx=0x7f3dc802caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.054+0000 7f3cbaffd640 1 -- 172.21.15.173:0/858619314 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc804c2f0 con 0x558c2f6f2070 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.054+0000 7f3cbaffd640 1 -- 172.21.15.173:0/858619314 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc80492f0 con 0x558c2f6f2070 2024-05-15T18:09:57.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.054+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c2f6f3440 con 0x558c2f6f2070 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.054+0000 7f3cbaffd640 1 -- 172.21.15.173:0/858619314 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc80495f0 con 0x558c2f6f2070 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.054+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c2f6f3940 con 0x558c2f6f2070 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.054+0000 7f3cbaffd640 1 -- 172.21.15.173:0/858619314 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3dc8044060 con 0x558c2f6f2070 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.054+0000 7f3cbaffd640 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cac0368d0 0x7f3cac038d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3cbaffd640 1 -- 172.21.15.173:0/858619314 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3dc8025200 con 0x558c2f6f2070 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dccf85640 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cac0368d0 0x7f3cac038d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd7c87800 1 Processor -- start 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd7c87800 1 -- start start 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dccf85640 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cac0368d0 0x7f3cac038d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x558c2f5d77e0 tx=0x7f3dc0005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd7c87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f6ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd7c87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558c2f4c9cf0 con 0x558c2f6ff190 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f6ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f6ff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38586/0 (socket says 172.21.15.173:38586) 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd5786640 1 -- 172.21.15.173:0/1379206530 learned_addr learned my addr 172.21.15.173:0/1379206530 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.055+0000 7f3dd5786640 1 -- 172.21.15.173:0/1379206530 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c2f6ffb80 con 0x558c2f6ff190 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd5786640 1 --2- 172.21.15.173:0/1379206530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f6ff5b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8025150 tx=0x7f3dc802e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d6e72bc06cc845 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1379206530 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc803d070 con 0x558c2f6ff190 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1379206530 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc8044e10 con 0x558c2f6ff190 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1379206530 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc80448f0 con 0x558c2f6ff190 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1379206530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 msgr2=0x558c2f6ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1379206530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f6ff5b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8025150 tx=0x7f3dc802e940 comp rx=0 tx=0).stop 2024-05-15T18:09:57.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1379206530 shutdown_connections 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1379206530 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f6ff5b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1379206530 >> 172.21.15.173:0/1379206530 conn(0x558c2f6fb4f0 msgr2=0x558c2f6f9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1379206530 shutdown_connections 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.056+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1379206530 wait complete. 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd7c87800 1 Processor -- start 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd7c87800 1 -- start start 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd7c87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f706430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd7c87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558c2f7000b0 con 0x558c2f6ff190 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f706430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd5786640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f706430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:38594/0 (socket says 172.21.15.173:38594) 2024-05-15T18:09:57.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 learned_addr learned my addr 172.21.15.173:0/1755386484 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c2f706970 con 0x558c2f6ff190 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.057+0000 7f3dd5786640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f706430 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8025190 tx=0x7f3dc8040f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.058+0000 7f3caaffd640 1 -- 172.21.15.173:0/1755386484 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc80249d0 con 0x558c2f6ff190 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.058+0000 7f3caaffd640 1 -- 172.21.15.173:0/1755386484 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc8067070 con 0x558c2f6ff190 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.058+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c2f706970 con 0x558c2f6ff190 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.058+0000 7f3caaffd640 1 -- 172.21.15.173:0/1755386484 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dc8030a80 con 0x558c2f6ff190 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.058+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c2f706970 con 0x558c2f6ff190 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3caaffd640 1 -- 172.21.15.173:0/1755386484 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3dc8030c20 con 0x558c2f6ff190 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3caaffd640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ca0036900 0x7f3ca0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3caaffd640 1 -- 172.21.15.173:0/1755386484 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3dc806dc10 con 0x558c2f6ff190 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3dccf85640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ca0036900 0x7f3ca0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f711bf0 0x558c2f7140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f714800 con 0x558c2f711bf0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.059+0000 7f3dccf85640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ca0036900 0x7f3ca0038dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x558c2f6e4060 tx=0x7f3dc004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd5f87640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f711bf0 0x558c2f7140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd5f87640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f711bf0 0x558c2f7140b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 20 realm 2024-05-15T18:09:57.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f714c10 con 0x558c2f711bf0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7154e0 con 0x558c2f711bf0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.060+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x558c2f711bf0 2024-05-15T18:09:57.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd7c87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f7165e0 0x558c2f7189d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f718fe0 con 0x558c2f7165e0 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd5786640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f7165e0 0x558c2f7189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd5786640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f7165e0 0x558c2f7189d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd7c87800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd7c87800 20 searching for the correct realm 2024-05-15T18:09:57.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.061+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71a8f0 con 0x558c2f7165e0 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dd5786640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3dc8062050 0x7f3dc802d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71a8f0 con 0x7f3dc8062050 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dccf85640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3dc8062050 0x7f3dc802d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dccf85640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3dc8062050 0x7f3dc802d860 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dccf85640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3dc0074040 0x7f3dc0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.062+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71a8f0 con 0x7f3dc0074040 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.063+0000 7f3dd5f87640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3dc0074040 0x7f3dc0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:09:57.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.063+0000 7f3dd5f87640 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3dc0074040 0x7f3dc0081410 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.063+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3dd000a4a0 con 0x7f3dc0074040 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.063+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x558c2f711bf0 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.063+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.063+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x558c2f711bf0 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x7f3dc0074040 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x7f3dc0074040 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x7f3dc0074040 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x7f3dc0074040 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x7f3dc8062050 2024-05-15T18:09:57.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.064+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x558c2f7165e0 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x558c2f711bf0 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x7f3dc0074040 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x7f3dc0074040 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x558c2f711bf0 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.065+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558c2f715880 con 0x7f3dc8062050 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.066+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.066+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f7165e0 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.066+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.066+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f7165e0 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.066+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.066+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc0074040 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x7f3dc0074040 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f7165e0 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f7165e0 2024-05-15T18:09:57.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f711bf0 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.067+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f711bf0 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3dd000a4a0 con 0x558c2f711bf0 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc0074040 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd0033040 con 0x7f3dc0074040 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f7165e0 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc8062050 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.068+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f711bf0 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.069+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.069+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc0074040 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.069+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.069+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f7165e0 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.069+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.069+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc0074040 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.069+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc8062050 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f7165e0 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc8062050 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x558c2f711bf0 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.070+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3dc008e060 con 0x7f3dc8062050 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:09:57.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7198a0 con 0x558c2f711bf0 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f719c90 con 0x558c2f711bf0 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:09:57.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f719c90 con 0x7f3dc0074040 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 zone default found 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 4 Realm: () 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 zonegroup default 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.071+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71ad70 con 0x7f3dc0074040 2024-05-15T18:09:57.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71c750 con 0x558c2f7165e0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71caf0 con 0x558c2f7165e0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 20 started sync module instance, tier type = 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:09:57.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.072+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71bbf0 con 0x7f3dc8062050 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.073+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.073+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94060579764032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71ce90 con 0x7f3dc8062050 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.073+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71d6e0 con 0x558c2f711bf0 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.074+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94060579764032] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.075+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.075+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94060579770928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71d650 con 0x558c2f711bf0 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.075+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71e5a0 con 0x558c2f7165e0 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.076+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94060579770928] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.076+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.076+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94060579774704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71e9c0 con 0x558c2f7165e0 2024-05-15T18:09:57.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.076+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71f3e0 con 0x7f3dc8062050 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.077+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.077+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94060579778256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71fcb0 con 0x7f3dc8062050 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.077+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f720790 con 0x558c2f711bf0 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.077+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94060579774704] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.078+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94060579778256] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.078+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.078+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94060579780608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f71dad0 con 0x558c2f711bf0 2024-05-15T18:09:57.075 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.078+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7211a0 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.080+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.080+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94060579785968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7215c0 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.080+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f721ff0 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.080+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94060579780608] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.081+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.081+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94060579789568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f721ff0 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.081+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7229f0 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.081+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94060579785968] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94060579789568] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94060579783328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f722500 con 0x7f3dc0074040 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 20 add_watcher() i=0 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 20 add_watcher() i=1 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 20 add_watcher() i=2 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 20 add_watcher() i=3 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 20 add_watcher() i=4 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 20 add_watcher() i=5 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.082+0000 7f3dd7c87800 20 add_watcher() i=6 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.083+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94060579783328] v31'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.083+0000 7f3dd7c87800 20 add_watcher() i=7 2024-05-15T18:09:57.095 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.083+0000 7f3dd7c87800 2 all 8 watchers are set, enabling cache 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.083+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7259e0 con 0x558c2f711bf0 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.083+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.083+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94060579792128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f722dd0 con 0x558c2f711bf0 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.084+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94060579792128] v31'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.084+0000 7f3c8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.084+0000 7f3dd7c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.084+0000 7f3dd7c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.084+0000 7f3dd7c87800 5 note: GC not initialized 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.085+0000 7f3c8a7e4640 20 reqs_thread_entry: start 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.085+0000 7f3dd7c87800 20 init_complete bucket index max shards: 11 2024-05-15T18:09:57.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.085+0000 7f3dd7c87800 20 Filter name: none 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.085+0000 7f3bfbfff640 20 reqs_thread_entry: start 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.085+0000 7f3dd7c87800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.085+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.085+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f758d60 con 0x7f3dc0074040 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.086+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.086+0000 7f3dd7c87800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.086+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.086+0000 7f3dd7c87800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.086+0000 7f3dd7c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.086+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f75ce40 con 0x7f3dc8062050 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v31'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-15T18:09:57.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dd7c87800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dd7c87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94060580026624 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f75d9b0 con 0x7f3dc0074040 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== watch-notify(notify (1) cookie 94060579785968 notify 133143986209 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f3dd001e040 con 0x7f3dc0074040 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(64 notify.5 [notify cookie 94060580026624 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3cb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986209 cookie 94060579785968 notifier 4727 bl.length()=382 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3cb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3cb8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c98003ea0 con 0x7f3dc0074040 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.087+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.088+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== watch-notify(notify_complete (2) cookie 94060580026624 notify 133143986209 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3dd0038440 con 0x7f3dc0074040 2024-05-15T18:09:57.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.088+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f75d8b0 con 0x558c2f711bf0 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.088+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.088+0000 7f3dd7c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 : miss 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.088+0000 7f3dd7c87800 20 rados->read ofs=0 len=0 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.088+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 8.1b 8:d90a6dd8:root::.bucket.meta.myfoo6%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f75b0b0 con 0x7f3dc8062050 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(67 .bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dd7c87800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 info.flags=0x17 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dd7c87800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 to cache LRU end 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dd7c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dd7c87800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dd7c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 2024-05-15T18:09:57.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.089+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 8.1b 8:d90a6dd8:root::.bucket.meta.myfoo6%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f764b10 con 0x7f3dc8062050 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(68 .bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v31'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 info.flags=0x17 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 to cache LRU end 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9, ofs0, ns] 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify cookie 94060580026160 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x558c2f7165e0 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== watch-notify(notify (1) cookie 94060579774704 notify 133143986189 ret 0) ==== 790+0+0 (crc 0 0 0) 0x558c2f6f3440 con 0x558c2f7165e0 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3cabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94060579774704 notifier 4727 bl.length()=748 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(69 notify.2 [notify cookie 94060580026160 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3cabfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 info.flags=0x17 2024-05-15T18:09:57.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3cabfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 to cache LRU end 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3cabfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3cabfff640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c08003530 con 0x558c2f7165e0 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(70 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== watch-notify(notify_complete (2) cookie 94060580026160 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c2f6f29d0 con 0x558c2f7165e0 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): orig_sources= new_sources= 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): potential sources added=[] removed=[] 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): orig_dests= new_dests= 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): potential dests added=[] removed=[] 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.090+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7632b0 con 0x558c2f711bf0 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.091+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(71 bud.buckets [call] v31'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.091+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7632b0 con 0x558c2f711bf0 2024-05-15T18:09:57.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.092+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(72 bud.buckets [call] v31'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.092+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7642c0 con 0x558c2f711bf0 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.093+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v31'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.093+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.093+0000 7f3dd7c87800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.093+0000 7f3dd7c87800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.093+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94060580026160 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7642c0 con 0x7f3dc8062050 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== watch-notify(notify (1) cookie 94060579778256 notify 133143986191 ret 0) ==== 358+0+0 (crc 0 0 0) 0x558c2f75a8f0 con 0x7f3dc8062050 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3cabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94060579778256 notifier 4727 bl.length()=316 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3cabfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3cabfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-15T18:09:57.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3cabfff640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c08003560 con 0x7f3dc8062050 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(74 notify.3 [notify cookie 94060580026160 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== watch-notify(notify_complete (2) cookie 94060580026160 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3dc0088040 con 0x7f3dc8062050 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3dd7c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 : hit (requested=0x17, cached=0x17) 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3dd7c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.094+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:76 8.1b 8:d90a6dd8:root::.bucket.meta.myfoo6%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763c90 con 0x7f3dc8062050 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(76 .bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v31'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 info.flags=0x17 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dd7c87800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 to cache LRU end 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dd7c87800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dd7c87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9, ofs0, ns] 2024-05-15T18:09:57.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94060580057776 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763be0 con 0x558c2f7165e0 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== watch-notify(notify (1) cookie 94060579774704 notify 133143986190 ret 0) ==== 790+0+0 (crc 0 0 0) 0x558c2f6f29d0 con 0x558c2f7165e0 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3cb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94060579774704 notifier 4727 bl.length()=748 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3cb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 info.flags=0x17 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3cb8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 to cache LRU end 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3cb8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c98003ea0 con 0x558c2f7165e0 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.095+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(77 notify.2 [notify cookie 94060580057776 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== watch-notify(notify_complete (2) cookie 94060580057776 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c2f5d73c0 con 0x558c2f7165e0 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): orig_sources= new_sources= 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): potential sources added=[] removed=[] 2024-05-15T18:09:57.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): orig_dests= new_dests= 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd7c87800 20 handle_bi_update(): bucket=:myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]): potential dests added=[] removed=[] 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:79 4.35 4:ada0a1ab:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x558c2f711bf0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(79 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 4.2f 4:f467f441:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x558c2f711bf0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(80 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.096+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:81 4.39 4:9ea4ba09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x558c2f7165e0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.097+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(81 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.097+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:82 4.2a 4:57844c0a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x558c2f711bf0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.097+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(82 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.097+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:83 4.26 4:64aba49a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x7f3dc0074040 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.097+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(83 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.097+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:84 4.1a 4:5a2489c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x7f3dc8062050 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.098+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(84 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.098+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 4.8 4:120f846c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x558c2f7165e0 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.098+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(85 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.098+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:86 4.1 4:82a269f1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x7f3dc8062050 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.098+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(86 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.098+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:87 4.27 4:e441ca94:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763760 con 0x558c2f711bf0 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.099+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(87 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3dd0031040 con 0x558c2f711bf0 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.099+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:88 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763c40 con 0x558c2f7165e0 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.099+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(88 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [call out=378b] v0'0 uv3 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.099+0000 7f3dd7c87800 10 cls_bucket_list_unordered: got thirteen 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.099+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:89 4.4 4:216436cc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763c40 con 0x7f3dc0074040 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(89 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3dd0031040 con 0x7f3dc0074040 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 get_obj_state: octx=0x7f3dd000aa90 obj=myfoo6:thirteen state=0x558c2f75b918 s->prefetch_data=0 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:90 3.6 3:61cf7946:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763c40 con 0x558c2f711bf0 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(90 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f3dd0052370 con 0x558c2f711bf0 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 10 manifest: total_size = 8 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.15360047182403921011 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.acl 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.content_type 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.etag 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.idtag 2024-05-15T18:09:57.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.manifest 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 get_obj_state: octx=0x7f3dd000aa90 obj=myfoo6:thirteen state=0x558c2f75b918 s->prefetch_data=0 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 : hit (requested=0x17, cached=0x17) 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.100+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f763330 con 0x558c2f7165e0 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.101+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.102+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:92 3.6 3:61cf7946:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7662a0 con 0x558c2f711bf0 2024-05-15T18:09:57.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.103+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(92 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v31'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x558c2f711bf0 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.103+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:93 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7662a0 con 0x558c2f7165e0 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:1 objects processed in :myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9]). Next marker thirteen 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.103+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f767f20 con 0x7f3dc8062050 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v31'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd7c87800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd7c87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94060580033872 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7662a0 con 0x7f3dc0074040 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(93 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3cabfff640 20 handle_completion(): completion ok for obj=thirteen 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== watch-notify(notify (1) cookie 94060579785968 notify 133143986210 ret 0) ==== 598+0+0 (crc 0 0 0) 0x558c2f764660 con 0x7f3dc0074040 2024-05-15T18:09:57.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3cb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986210 cookie 94060579785968 notifier 4727 bl.length()=556 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3cb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3cb8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(95 notify.5 [notify cookie 94060580033872 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c98003ea0 con 0x7f3dc0074040 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.104+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== watch-notify(notify_complete (2) cookie 94060580033872 notify 133143986210 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c2f761e20 con 0x7f3dc0074040 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.105+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f767f20 con 0x558c2f711bf0 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.105+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v31'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x558c2f711bf0 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.105+0000 7f3dd7c87800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.105+0000 7f3dd7c87800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-15T18:09:57.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.105+0000 7f3dd7c87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.105+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94060580033872 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f767f20 con 0x7f3dc0074040 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== watch-notify(notify (1) cookie 94060579785968 notify 133143986211 ret 0) ==== 219+0+0 (crc 0 0 0) 0x558c2f761e20 con 0x7f3dc0074040 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3cb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986211 cookie 94060579785968 notifier 4727 bl.length()=177 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3cb8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3cb8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(98 notify.5 [notify cookie 94060580033872 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c98003ea0 con 0x7f3dc0074040 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== watch-notify(notify_complete (2) cookie 94060580033872 notify 133143986211 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3dd0038440 con 0x7f3dc0074040 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3dd7c87800 10 removing user index: bar 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.106+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f767f20 con 0x7f3dc0074040 2024-05-15T18:09:57.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(100 bar [delete] v31'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3dd7c87800 10 removing default.rgw.meta+users.uid+bar from cache 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3dd7c87800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94060580033872 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558c2f767f20 con 0x7f3dc0074040 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== watch-notify(notify (1) cookie 94060579783328 notify 133143986212 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f3dd0038440 con 0x7f3dc0074040 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3cb8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986212 cookie 94060579783328 notifier 4727 bl.length()=152 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3cb8ff9640 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3c98003ea0 con 0x7f3dc0074040 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.107+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(101 notify.7 [notify cookie 94060580033872 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.108+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.108+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== watch-notify(notify_complete (2) cookie 94060580033872 notify 133143986212 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3dd0038a30 con 0x7f3dc0074040 2024-05-15T18:09:57.113 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-15T18:09:56.931160Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:09:56.931147Z","tags":[],"group_ids":[]} 2024-05-15T18:09:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.109+0000 7f3c8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:09:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.109+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94060579792128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f767f20 con 0x558c2f711bf0 2024-05-15T18:09:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.110+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94060579792128] v31'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x558c2f711bf0 2024-05-15T18:09:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.110+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94060579764032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f767f20 con 0x7f3dc8062050 2024-05-15T18:09:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.111+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94060579764032] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.111+0000 7f3dd7c87800 20 remove_watcher() i=0 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.111+0000 7f3dd7c87800 2 removed watcher, disabling cache 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.111+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94060579770928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7416c0 con 0x558c2f711bf0 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.112+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94060579770928] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x558c2f711bf0 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.112+0000 7f3dd7c87800 20 remove_watcher() i=1 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.112+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94060579774704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7416c0 con 0x558c2f7165e0 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.113+0000 7f3dd5786640 1 -- 172.21.15.173:0/1755386484 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94060579774704] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc802b070 con 0x558c2f7165e0 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.113+0000 7f3dd7c87800 20 remove_watcher() i=2 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.113+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94060579778256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7416c0 con 0x7f3dc8062050 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.114+0000 7f3dccf85640 1 -- 172.21.15.173:0/1755386484 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94060579778256] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dc007f070 con 0x7f3dc8062050 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.114+0000 7f3dd7c87800 20 remove_watcher() i=3 2024-05-15T18:09:57.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.114+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94060579780608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7416c0 con 0x558c2f711bf0 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.115+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94060579780608] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x558c2f711bf0 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.115+0000 7f3dd7c87800 20 remove_watcher() i=4 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.115+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94060579785968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7416c0 con 0x7f3dc0074040 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.116+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94060579785968] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.116+0000 7f3dd7c87800 20 remove_watcher() i=5 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.116+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94060579789568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7416c0 con 0x7f3dc0074040 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.117+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94060579789568] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.118+0000 7f3dd7c87800 20 remove_watcher() i=6 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.118+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94060579783328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558c2f7416c0 con 0x7f3dc0074040 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.118+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94060579783328] v31'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3dd0052370 con 0x7f3dc0074040 2024-05-15T18:09:57.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 20 remove_watcher() i=7 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3dc0074040 msgr2=0x7f3dc0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3dc0074040 0x7f3dc0081410 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f711bf0 msgr2=0x558c2f7140b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f711bf0 0x558c2f7140b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3dc8062050 msgr2=0x7f3dc802d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3dc8062050 0x7f3dc802d860 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f7165e0 msgr2=0x558c2f7189d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f7165e0 0x558c2f7189d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ca0036900 msgr2=0x7f3ca0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3ca0036900 0x7f3ca0038dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x558c2f6e4060 tx=0x7f3dc004f000 comp rx=0 tx=0).stop 2024-05-15T18:09:57.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 msgr2=0x558c2f706430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd5f87640 1 -- 172.21.15.173:0/1755386484 reap_dead start 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f706430 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8025190 tx=0x7f3dc8040f50 comp rx=0 tx=0).stop 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 shutdown_connections 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/1755386484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6ff190 0x558c2f706430 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 >> 172.21.15.173:0/1755386484 conn(0x558c2f6fb4f0 msgr2=0x558c2f6f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 shutdown_connections 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/1755386484 wait complete. 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cac0368d0 msgr2=0x7f3cac038d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cac0368d0 0x7f3cac038d90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x558c2f5d77e0 tx=0x7f3dc0005a00 comp rx=0 tx=0).stop 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6f2070 msgr2=0x558c2f6f2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6f2070 0x558c2f6f2490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3dc804aa00 tx=0x7f3dc802caa0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 shutdown_connections 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cac0368d0 0x7f3cac038d90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/858619314 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f6f2070 0x558c2f6f2490 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 >> 172.21.15.173:0/858619314 conn(0x558c2f6e6110 msgr2=0x558c2f6e6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 shutdown_connections 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.119+0000 7f3dd7c87800 1 -- 172.21.15.173:0/858619314 wait complete. 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558c2f6e1090 msgr2=0x558c2f6e3500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558c2f6e1090 0x558c2f6e3500 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f5dc6f0 msgr2=0x558c2f6da650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558c2f5dc6f0 0x558c2f6da650 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f6dcf40 msgr2=0x558c2f6df400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558c2f6dcf40 0x558c2f6df400 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cbc036900 msgr2=0x7f3cbc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3cbc036900 0x7f3cbc038dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0054000 tx=0x7f3dc004e000 comp rx=0 tx=0).stop 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 msgr2=0x558c2f5d8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 --2- 172.21.15.173:0/2327008201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c2f5d8be0 0x558c2f5d8520 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c010 tx=0x7f3dc8000ed0 comp rx=0 tx=0).stop 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd5f87640 1 -- 172.21.15.173:0/2327008201 reap_dead start 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 shutdown_connections 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 >> 172.21.15.173:0/2327008201 conn(0x558c2f5d25b0 msgr2=0x558c2f6c3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 shutdown_connections 2024-05-15T18:09:57.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:09:57.120+0000 7f3dd7c87800 1 -- 172.21.15.173:0/2327008201 wait complete. 2024-05-15T18:09:57.126 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-15T18:09:56.931160Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:09:56.931147Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:02.132 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:10:02.132 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-15T18:10:02.132 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-15T18:10:02.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-15T18:10:02.133 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-05-15T18:10:02.192 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:02.192 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.216+0000 7fd856f2f800 1 Processor -- start 2024-05-15T18:10:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.216+0000 7fd856f2f800 1 -- start start 2024-05-15T18:10:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.216+0000 7fd856f2f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5633386b9ba0 0x5633386bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.216+0000 7fd856f2f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633386bffe0 con 0x5633386bc4d0 2024-05-15T18:10:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.216+0000 7fd856f2f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56333854a050 con 0x5633386b9ba0 2024-05-15T18:10:02.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.217+0000 7fd852bae640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5633386b9ba0 0x5633386bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.217+0000 7fd8523ad640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5633386bc4d0 0x5633386be8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43520/0 (socket says 172.21.15.173:43520) 2024-05-15T18:10:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.217+0000 7fd8523ad640 1 -- 172.21.15.173:0/1568602002 learned_addr learned my addr 172.21.15.173:0/1568602002 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.217+0000 7fd852bae640 1 -- 172.21.15.173:0/1568602002 >> v1:172.21.15.3:6789/0 conn(0x5633386bc4d0 legacy=0x5633386be8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.217+0000 7fd852bae640 1 -- 172.21.15.173:0/1568602002 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633386c11c0 con 0x5633386b9ba0 2024-05-15T18:10:02.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.219+0000 7fd852bae640 1 --2- 172.21.15.173:0/1568602002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633386bbf90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd84400a470 tx=0x7fd84401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab77b6e1d349d18 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.219+0000 7fd851bac640 1 -- 172.21.15.173:0/1568602002 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844057070 con 0x5633386b9ba0 2024-05-15T18:10:02.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.219+0000 7fd851bac640 1 -- 172.21.15.173:0/1568602002 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd844052570 con 0x5633386b9ba0 2024-05-15T18:10:02.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.219+0000 7fd851bac640 1 -- 172.21.15.173:0/1568602002 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844052870 con 0x5633386b9ba0 2024-05-15T18:10:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.220+0000 7fd856f2f800 1 -- 172.21.15.173:0/1568602002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 msgr2=0x5633386bbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.220+0000 7fd856f2f800 1 --2- 172.21.15.173:0/1568602002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633386bbf90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd84400a470 tx=0x7fd84401ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.220+0000 7fd856f2f800 1 -- 172.21.15.173:0/1568602002 shutdown_connections 2024-05-15T18:10:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.220+0000 7fd856f2f800 1 --2- 172.21.15.173:0/1568602002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633386bbf90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.220+0000 7fd856f2f800 1 -- 172.21.15.173:0/1568602002 >> 172.21.15.173:0/1568602002 conn(0x5633386b35f0 msgr2=0x5633386b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.220+0000 7fd856f2f800 1 -- 172.21.15.173:0/1568602002 shutdown_connections 2024-05-15T18:10:02.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.220+0000 7fd856f2f800 1 -- 172.21.15.173:0/1568602002 wait complete. 2024-05-15T18:10:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.235+0000 7fd856f2f800 1 Processor -- start 2024-05-15T18:10:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.235+0000 7fd856f2f800 1 -- start start 2024-05-15T18:10:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.235+0000 7fd856f2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.236+0000 7fd856f2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5633386041f0 con 0x5633386b9ba0 2024-05-15T18:10:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.236+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.236+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387aa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37578/0 (socket says 172.21.15.173:37578) 2024-05-15T18:10:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.236+0000 7fd852bae640 1 -- 172.21.15.173:0/3973205939 learned_addr learned my addr 172.21.15.173:0/3973205939 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.236+0000 7fd852bae640 1 -- 172.21.15.173:0/3973205939 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633387aadc0 con 0x5633386b9ba0 2024-05-15T18:10:02.213 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.237+0000 7fd852bae640 1 --2- 172.21.15.173:0/3973205939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387aa7f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd844055040 tx=0x7fd84404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99b88619dc20bd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.237+0000 7fd740e09640 1 -- 172.21.15.173:0/3973205939 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844057040 con 0x5633386b9ba0 2024-05-15T18:10:02.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.237+0000 7fd740e09640 1 -- 172.21.15.173:0/3973205939 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd844052990 con 0x5633386b9ba0 2024-05-15T18:10:02.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.237+0000 7fd740e09640 1 -- 172.21.15.173:0/3973205939 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844052c70 con 0x5633386b9ba0 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 -- 172.21.15.173:0/3973205939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 msgr2=0x5633387aa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 --2- 172.21.15.173:0/3973205939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387aa7f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd844055040 tx=0x7fd84404c000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 -- 172.21.15.173:0/3973205939 shutdown_connections 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 --2- 172.21.15.173:0/3973205939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387aa7f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 -- 172.21.15.173:0/3973205939 >> 172.21.15.173:0/3973205939 conn(0x5633386b35f0 msgr2=0x5633387a6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 -- 172.21.15.173:0/3973205939 shutdown_connections 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 -- 172.21.15.173:0/3973205939 wait complete. 2024-05-15T18:10:02.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 Processor -- start 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 -- start start 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.238+0000 7fd856f2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5633386c0450 con 0x5633386b9ba0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37582/0 (socket says 172.21.15.173:37582) 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd852bae640 1 -- 172.21.15.173:0/2949903782 learned_addr learned my addr 172.21.15.173:0/2949903782 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd852bae640 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633387b2750 con 0x5633386b9ba0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd852bae640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387b2210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd84400a470 tx=0x7fd844003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd73f606640 1 -- 172.21.15.173:0/2949903782 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844073070 con 0x5633386b9ba0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd73f606640 1 -- 172.21.15.173:0/2949903782 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84405d780 con 0x5633386b9ba0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633387b29e0 con 0x5633386b9ba0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.239+0000 7fd73f606640 1 -- 172.21.15.173:0/2949903782 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844057070 con 0x5633386b9ba0 2024-05-15T18:10:02.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.240+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633387b5690 con 0x5633386b9ba0 2024-05-15T18:10:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.240+0000 7fd73f606640 1 -- 172.21.15.173:0/2949903782 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd844076070 con 0x5633386b9ba0 2024-05-15T18:10:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.240+0000 7fd73f606640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd738036900 0x7fd738038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd73f606640 1 -- 172.21.15.173:0/2949903782 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fd84408dff0 con 0x5633386b9ba0 2024-05-15T18:10:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd8523ad640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd738036900 0x7fd738038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633386bc4d0 0x5633387b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387b99d0 con 0x5633386bc4d0 2024-05-15T18:10:02.220 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd8533af640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633386bc4d0 0x5633387b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd8523ad640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd738036900 0x7fd738038dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd848000f60 tx=0x7fd8480012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd8533af640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633386bc4d0 0x5633387b9450 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.241+0000 7fd8533af640 1 -- 172.21.15.173:0/2949903782 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633386bc4d0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.242+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387b6a20 con 0x5633386bc4d0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.242+0000 7fd8533af640 1 -- 172.21.15.173:0/2949903782 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633386bc4d0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.242+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387bbd20 0x5633387be110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.242+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387be7e0 con 0x5633387bbd20 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.242+0000 7fd852bae640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387bbd20 0x5633387be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.242+0000 7fd852bae640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387bbd20 0x5633387be110 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.243+0000 7fd852bae640 1 -- 172.21.15.173:0/2949903782 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd844075030 con 0x5633387bbd20 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.243+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387bacd0 con 0x5633386bc4d0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.243+0000 7fd8533af640 1 -- 172.21.15.173:0/2949903782 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633386bc4d0 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.243+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5633387bfc20 0x5633387c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.243+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387c2870 con 0x5633387bfc20 2024-05-15T18:10:02.221 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.243+0000 7fd8523ad640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5633387bfc20 0x5633387c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.244+0000 7fd8523ad640 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5633387bfc20 0x5633387c20e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.244+0000 7fd8523ad640 1 -- 172.21.15.173:0/2949903782 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd848009050 con 0x5633387bfc20 2024-05-15T18:10:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.245+0000 7fd856f2f800 1 Processor -- start 2024-05-15T18:10:02.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.245+0000 7fd856f2f800 1 -- start start 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.245+0000 7fd856f2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633387d0d20 0x5633387d1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.245+0000 7fd856f2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5633385aacf0 con 0x5633387d0d20 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.245+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633387d0d20 0x5633387d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.245+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633387d0d20 0x5633387d1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37584/0 (socket says 172.21.15.173:37584) 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.245+0000 7fd852bae640 1 -- 172.21.15.173:0/2944729347 learned_addr learned my addr 172.21.15.173:0/2944729347 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.246+0000 7fd852bae640 1 -- 172.21.15.173:0/2944729347 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633387d1680 con 0x5633387d0d20 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.246+0000 7fd852bae640 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633387d0d20 0x5633387d1140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd84405b450 tx=0x7fd844066ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.246+0000 7fd73ce01640 1 -- 172.21.15.173:0/2944729347 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8440773b0 con 0x5633387d0d20 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.246+0000 7fd73ce01640 1 -- 172.21.15.173:0/2944729347 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84408a070 con 0x5633387d0d20 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.246+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633387d20f0 con 0x5633387d0d20 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.246+0000 7fd73ce01640 1 -- 172.21.15.173:0/2944729347 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844077680 con 0x5633387d0d20 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.246+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633387d25f0 con 0x5633387d0d20 2024-05-15T18:10:02.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.247+0000 7fd73ce01640 1 -- 172.21.15.173:0/2944729347 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd84408c7c0 con 0x5633387d0d20 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.247+0000 7fd73ce01640 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd72c036900 0x7fd72c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.247+0000 7fd73ce01640 1 -- 172.21.15.173:0/2944729347 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fd84409ab90 con 0x5633387d0d20 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.247+0000 7fd8523ad640 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd72c036900 0x7fd72c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.247+0000 7fd856f2f800 1 Processor -- start 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.247+0000 7fd856f2f800 1 -- start start 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.247+0000 7fd8523ad640 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd72c036900 0x7fd72c038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd84800bf50 tx=0x7fd84800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.248+0000 7fd856f2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633386b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.248+0000 7fd856f2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5633387ab080 con 0x5633386b9190 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.248+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633386b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.248+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633386b95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37598/0 (socket says 172.21.15.173:37598) 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.248+0000 7fd852bae640 1 -- 172.21.15.173:0/3614268605 learned_addr learned my addr 172.21.15.173:0/3614268605 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.248+0000 7fd852bae640 1 -- 172.21.15.173:0/3614268605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633386b7990 con 0x5633386b9190 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.248+0000 7fd852bae640 1 --2- 172.21.15.173:0/3614268605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633386b95b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd844073040 tx=0x7fd8440778e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323474e9dafe4070 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd7367fc640 1 -- 172.21.15.173:0/3614268605 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8440aa070 con 0x5633386b9190 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd7367fc640 1 -- 172.21.15.173:0/3614268605 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd844054e00 con 0x5633386b9190 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd7367fc640 1 -- 172.21.15.173:0/3614268605 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd84409f040 con 0x5633386b9190 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 -- 172.21.15.173:0/3614268605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 msgr2=0x5633386b95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 --2- 172.21.15.173:0/3614268605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633386b95b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd844073040 tx=0x7fd8440778e0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 -- 172.21.15.173:0/3614268605 shutdown_connections 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 --2- 172.21.15.173:0/3614268605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633386b95b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 -- 172.21.15.173:0/3614268605 >> 172.21.15.173:0/3614268605 conn(0x5633387da190 msgr2=0x5633387d81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 -- 172.21.15.173:0/3614268605 shutdown_connections 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 -- 172.21.15.173:0/3614268605 wait complete. 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.249+0000 7fd856f2f800 1 Processor -- start 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd856f2f800 1 -- start start 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd856f2f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633387e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd856f2f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5633386b7da0 con 0x5633386b9190 2024-05-15T18:10:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633387e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd852bae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633387e7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37604/0 (socket says 172.21.15.173:37604) 2024-05-15T18:10:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 learned_addr learned my addr 172.21.15.173:0/476771442 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633387e7940 con 0x5633386b9190 2024-05-15T18:10:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.250+0000 7fd852bae640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633387e7400 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd84405cfd0 tx=0x7fd84404bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.251+0000 7fd734ff9640 1 -- 172.21.15.173:0/476771442 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8440b5020 con 0x5633386b9190 2024-05-15T18:10:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.251+0000 7fd734ff9640 1 -- 172.21.15.173:0/476771442 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8440ab040 con 0x5633386b9190 2024-05-15T18:10:02.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.251+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633387e7940 con 0x5633386b9190 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.251+0000 7fd734ff9640 1 -- 172.21.15.173:0/476771442 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8440aa070 con 0x5633386b9190 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.251+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633387e7940 con 0x5633386b9190 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd734ff9640 1 -- 172.21.15.173:0/476771442 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd8440b8020 con 0x5633386b9190 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd734ff9640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd71c0368b0 0x7fd71c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd734ff9640 1 -- 172.21.15.173:0/476771442 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fd8440bbba0 con 0x5633386b9190 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd8523ad640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd71c0368b0 0x7fd71c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd8523ad640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd71c0368b0 0x7fd71c038d70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd848001b60 tx=0x7fd848010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633387f2b30 0x5633387f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.252+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387f5740 con 0x5633387f2b30 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd8533af640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633387f2b30 0x5633387f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd8533af640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633387f2b30 0x5633387f4ff0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 20 realm 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387f5b50 con 0x5633387f2b30 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.253+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387f6420 con 0x5633387f2b30 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd856f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387f7520 0x5633387f9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387f9ed0 con 0x5633387f7520 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd852bae640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387f7520 0x5633387f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.254+0000 7fd852bae640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387f7520 0x5633387f9910 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd856f2f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd856f2f800 20 searching for the correct realm 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387fb7e0 con 0x5633387f7520 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd852bae640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fd8440ba020 0x7fd84409a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387fb7e0 con 0x7fd8440ba020 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd8523ad640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fd8440ba020 0x7fd84409a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.255+0000 7fd8523ad640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fd8440ba020 0x7fd84409a530 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.256+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.256+0000 7fd8523ad640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd848037040 0x7fd848036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.256+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387fb7e0 con 0x7fd848037040 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.256+0000 7fd8533af640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd848037040 0x7fd848036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.257+0000 7fd8533af640 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd848037040 0x7fd848036410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.257+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd84c00a4a0 con 0x7fd848037040 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.257+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.257+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.257+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.257+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.257+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd848037040 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.258+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x7fd848037040 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.258+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd848037040 2024-05-15T18:10:02.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.258+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x7fd848037040 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.258+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd8440ba020 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd848037040 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x7fd848037040 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.259+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd8440ba020 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.260+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd848037040 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.261+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x7fd848037040 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.261+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.261+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.261+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.261+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.261+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.262+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.262+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.262+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd84c00a4a0 con 0x5633387f2b30 2024-05-15T18:10:02.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.262+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd848037040 2024-05-15T18:10:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.262+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c033040 con 0x7fd848037040 2024-05-15T18:10:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.262+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd8440ba020 2024-05-15T18:10:02.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd848037040 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.263+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.264+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.264+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd848037040 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.264+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.264+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd8440ba020 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.264+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.265+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f7520 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.265+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.265+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd8440ba020 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.265+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.265+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x5633387f2b30 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.265+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.265+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5633387f67c0 con 0x7fd8440ba020 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:02.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387fa790 con 0x5633387f2b30 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387fab80 con 0x5633387f2b30 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387fab80 con 0x7fd848037040 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.266+0000 7fd856f2f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 zone default found 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 4 Realm: () 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 zonegroup default 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387fa330 con 0x7fd848037040 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387fd640 con 0x5633387f7520 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633387fd9e0 con 0x5633387f7520 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 started sync module instance, tier type = 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.267+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fcae0 con 0x7fd8440ba020 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.268+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.269+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94777991220944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fc740 con 0x7fd8440ba020 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.269+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fe6e0 con 0x5633387f2b30 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.270+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94777991220944] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.270+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.270+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94777991225184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fe970 con 0x5633387f2b30 2024-05-15T18:10:02.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.270+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387ff490 con 0x5633387f7520 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.271+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94777991225184] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.271+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.271+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94777991229280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387ff880 con 0x5633387f7520 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.272+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633388002d0 con 0x7fd8440ba020 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.272+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.273+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94777991235264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338800f90 con 0x7fd8440ba020 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.273+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338801a00 con 0x5633387f2b30 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.273+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94777991229280] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.274+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94777991235264] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.274+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.274+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94777991236320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fe3c0 con 0x5633387f2b30 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.274+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633388022e0 con 0x7fd848037040 2024-05-15T18:10:02.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.275+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94777991236320] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.275+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.275+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94777991238864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338802250 con 0x7fd848037040 2024-05-15T18:10:02.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.275+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338802cf0 con 0x7fd848037040 2024-05-15T18:10:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.276+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.276+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94777991243840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338803110 con 0x7fd848037040 2024-05-15T18:10:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.276+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338803c10 con 0x7fd848037040 2024-05-15T18:10:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.276+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94777991238864] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.277+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94777991243840] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94777991247616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338802c60 con 0x7fd848037040 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 20 add_watcher() i=0 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 20 add_watcher() i=1 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 20 add_watcher() i=2 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 20 add_watcher() i=3 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 20 add_watcher() i=4 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 20 add_watcher() i=5 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.278+0000 7fd856f2f800 20 add_watcher() i=6 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.279+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94777991247616] v31'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.279+0000 7fd856f2f800 20 add_watcher() i=7 2024-05-15T18:10:02.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.279+0000 7fd856f2f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.279+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563338806d10 con 0x5633387f2b30 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.279+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.279+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94777991241120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338804190 con 0x5633387f2b30 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.280+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94777991241120] v31'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.280+0000 7fd7097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.280+0000 7fd856f2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.280+0000 7fd856f2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.280+0000 7fd856f2f800 5 note: GC not initialized 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd683fff640 20 reqs_thread_entry: start 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 20 Filter name: none 2024-05-15T18:10:02.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd681ffb640 20 reqs_thread_entry: start 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56333883a010 con 0x7fd848037040 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.281+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5633388387b0 con 0x7fd848037040 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.282+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.282+0000 7fd856f2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.282+0000 7fd856f2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.282+0000 7fd856f2f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.282+0000 7fd856f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.282+0000 7fd856f2f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.282+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633388390a0 con 0x7fd848037040 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v31'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd856f2f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd856f2f800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd856f2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94777991465968 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56333883d950 con 0x7fd848037040 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== watch-notify(notify (1) cookie 94777991238864 notify 133143986213 ret 0) ==== 598+0+0 (crc 0 0 0) 0x563338839440 con 0x7fd848037040 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd7367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986213 cookie 94777991238864 notifier 4734 bl.length()=556 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd7367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-15T18:10:02.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(65 notify.5 [notify cookie 94777991465968 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd7367fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.283+0000 7fd7367fc640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd718003ea0 con 0x7fd848037040 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.284+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.284+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== watch-notify(notify_complete (2) cookie 94777991465968 notify 133143986213 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5633388388b0 con 0x7fd848037040 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.284+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56333883b480 con 0x7fd848037040 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd856f2f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd856f2f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd856f2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94777991465888 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56333883d950 con 0x5633387f7520 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== watch-notify(notify (1) cookie 94777991229280 notify 133143986191 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5633387d20f0 con 0x5633387f7520 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd7367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94777991229280 notifier 4734 bl.length()=177 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd7367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-15T18:10:02.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd7367fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-15T18:10:02.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 notify.2 [notify cookie 94777991465888 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.285+0000 7fd7367fc640 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fd718003ea0 con 0x5633387f7520 2024-05-15T18:10:02.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.286+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.286+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== watch-notify(notify_complete (2) cookie 94777991465888 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5633387d1680 con 0x5633387f7520 2024-05-15T18:10:02.270 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-15T18:10:02.282595Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:02.282583Z","tags":[],"group_ids":[]} 2024-05-15T18:10:02.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.286+0000 7fd7097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.286+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94777991241120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387ef710 con 0x5633387f2b30 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.288+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94777991241120] v31'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.288+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94777991220944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338801da0 con 0x7fd8440ba020 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.288+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94777991220944] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.289+0000 7fd856f2f800 20 remove_watcher() i=0 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.289+0000 7fd856f2f800 2 removed watcher, disabling cache 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.289+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94777991225184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fced0 con 0x5633387f2b30 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.290+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94777991225184] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.290+0000 7fd856f2f800 20 remove_watcher() i=1 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.290+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94777991229280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fdf60 con 0x5633387f7520 2024-05-15T18:10:02.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.291+0000 7fd852bae640 1 -- 172.21.15.173:0/476771442 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94777991229280] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8440a2040 con 0x5633387f7520 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.291+0000 7fd856f2f800 20 remove_watcher() i=2 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.291+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94777991235264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fef60 con 0x7fd8440ba020 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.292+0000 7fd8523ad640 1 -- 172.21.15.173:0/476771442 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94777991235264] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd848009050 con 0x7fd8440ba020 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.292+0000 7fd856f2f800 20 remove_watcher() i=3 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.292+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94777991236320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fef60 con 0x5633387f2b30 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.293+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94777991236320] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x5633387f2b30 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.293+0000 7fd856f2f800 20 remove_watcher() i=4 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.293+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94777991238864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5633387fef60 con 0x7fd848037040 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.294+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94777991238864] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.294+0000 7fd856f2f800 20 remove_watcher() i=5 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.294+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94777991243840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338800b70 con 0x7fd848037040 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.296+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94777991243840] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.296+0000 7fd856f2f800 20 remove_watcher() i=6 2024-05-15T18:10:02.277 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.296+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94777991247616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563338800b70 con 0x7fd848037040 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94777991247616] v31'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c031040 con 0x7fd848037040 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 20 remove_watcher() i=7 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd848037040 msgr2=0x7fd848036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd848037040 0x7fd848036410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633387f2b30 msgr2=0x5633387f4ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633387f2b30 0x5633387f4ff0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fd8440ba020 msgr2=0x7fd84409a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fd8440ba020 0x7fd84409a530 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387f7520 msgr2=0x5633387f9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387f7520 0x5633387f9910 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd71c0368b0 msgr2=0x7fd71c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd71c0368b0 0x7fd71c038d70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd848001b60 tx=0x7fd848010000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 msgr2=0x5633387e7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd8533af640 1 -- 172.21.15.173:0/476771442 reap_dead start 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633387e7400 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd84405cfd0 tx=0x7fd84404bf20 comp rx=0 tx=0).stop 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 shutdown_connections 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 --2- 172.21.15.173:0/476771442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9190 0x5633387e7400 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 >> 172.21.15.173:0/476771442 conn(0x5633387da190 msgr2=0x5633387d77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 shutdown_connections 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/476771442 wait complete. 2024-05-15T18:10:02.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.297+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd72c036900 msgr2=0x7fd72c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd72c036900 0x7fd72c038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd84800bf50 tx=0x7fd84800f000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633387d0d20 msgr2=0x5633387d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633387d0d20 0x5633387d1140 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd84405b450 tx=0x7fd844066ac0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 shutdown_connections 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd72c036900 0x7fd72c038dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2944729347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633387d0d20 0x5633387d1140 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 >> 172.21.15.173:0/2944729347 conn(0x5633387c4dc0 msgr2=0x5633387c51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 shutdown_connections 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2944729347 wait complete. 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5633387bfc20 msgr2=0x5633387c20e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5633387bfc20 0x5633387c20e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633386bc4d0 msgr2=0x5633387b9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5633386bc4d0 0x5633387b9450 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387bbd20 msgr2=0x5633387be110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5633387bbd20 0x5633387be110 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd738036900 msgr2=0x7fd738038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd738036900 0x7fd738038dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd848000f60 tx=0x7fd8480012b0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 msgr2=0x5633387b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 --2- 172.21.15.173:0/2949903782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5633386b9ba0 0x5633387b2210 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd84400a470 tx=0x7fd844003020 comp rx=0 tx=0).stop 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd8533af640 1 -- 172.21.15.173:0/2949903782 reap_dead start 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 shutdown_connections 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 >> 172.21.15.173:0/2949903782 conn(0x5633386b35f0 msgr2=0x5633387a4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 shutdown_connections 2024-05-15T18:10:02.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.298+0000 7fd856f2f800 1 -- 172.21.15.173:0/2949903782 wait complete. 2024-05-15T18:10:02.283 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-15T18:10:02.282595Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:02.282583Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:02.297 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:10:02.302 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-05-15T18:10:02.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-15T18:10:02.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-15T18:10:02.303 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-05-15T18:10:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:02.350 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9ce87800 1 Processor -- start 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9ce87800 1 -- start start 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9ce87800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55931dda1540 0x55931ddaa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9ce87800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55931dd140a0 con 0x55931dd9fa00 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9ce87800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55931dc32050 con 0x55931dda1540 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9a185640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55931dda1540 0x55931ddaa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9a185640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55931dda1540 0x55931ddaa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37612/0 (socket says 172.21.15.173:37612) 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9a986640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55931dd9fa00 0x55931dd9fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43530/0 (socket says 172.21.15.173:43530) 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9a185640 1 -- 172.21.15.173:0/4060713323 learned_addr learned my addr 172.21.15.173:0/4060713323 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.352 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9a185640 1 -- 172.21.15.173:0/4060713323 >> v1:172.21.15.3:6789/0 conn(0x55931dd9fa00 legacy=0x55931dd9fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.375+0000 7f5c9a185640 1 -- 172.21.15.173:0/4060713323 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931ddab590 con 0x55931dda1540 2024-05-15T18:10:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.377+0000 7f5c9a185640 1 --2- 172.21.15.173:0/4060713323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dda1540 0x55931ddaa040 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000a520 tx=0x7f5c9001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf0f1851f43863 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.377+0000 7f5c99984640 1 -- 172.21.15.173:0/4060713323 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c90057070 con 0x55931dda1540 2024-05-15T18:10:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.377+0000 7f5c99984640 1 -- 172.21.15.173:0/4060713323 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c90052570 con 0x55931dda1540 2024-05-15T18:10:02.354 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.377+0000 7f5c99984640 1 -- 172.21.15.173:0/4060713323 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c90052870 con 0x55931dda1540 2024-05-15T18:10:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.378+0000 7f5c9ce87800 1 -- 172.21.15.173:0/4060713323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dda1540 msgr2=0x55931ddaa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.378+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/4060713323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dda1540 0x55931ddaa040 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000a520 tx=0x7f5c9001d010 comp rx=0 tx=0).stop 2024-05-15T18:10:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.378+0000 7f5c9ce87800 1 -- 172.21.15.173:0/4060713323 shutdown_connections 2024-05-15T18:10:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.378+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/4060713323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dda1540 0x55931ddaa040 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.378+0000 7f5c9ce87800 1 -- 172.21.15.173:0/4060713323 >> 172.21.15.173:0/4060713323 conn(0x55931dd9b5c0 msgr2=0x55931dd9d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.378+0000 7f5c9ce87800 1 -- 172.21.15.173:0/4060713323 shutdown_connections 2024-05-15T18:10:02.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.378+0000 7f5c9ce87800 1 -- 172.21.15.173:0/4060713323 wait complete. 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9ce87800 1 Processor -- start 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9ce87800 1 -- start start 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9ce87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de949b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9ce87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55931dcec1c0 con 0x55931dd9fa00 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37626/0 (socket says 172.21.15.173:37626) 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9a986640 1 -- 172.21.15.173:0/3650325275 learned_addr learned my addr 172.21.15.173:0/3650325275 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.392+0000 7f5c9a986640 1 -- 172.21.15.173:0/3650325275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931de94f80 con 0x55931dd9fa00 2024-05-15T18:10:02.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5c9a986640 1 --2- 172.21.15.173:0/3650325275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de949b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c001e10 tx=0x7f5c8c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0da8547b16183e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5b88e09640 1 -- 172.21.15.173:0/3650325275 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c00e5c0 con 0x55931dd9fa00 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5b88e09640 1 -- 172.21.15.173:0/3650325275 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8c006070 con 0x55931dd9fa00 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5b88e09640 1 -- 172.21.15.173:0/3650325275 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c00e930 con 0x55931dd9fa00 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3650325275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 msgr2=0x55931de949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3650325275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de949b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c001e10 tx=0x7f5c8c00b6c0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3650325275 shutdown_connections 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3650325275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de949b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.393+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3650325275 >> 172.21.15.173:0/3650325275 conn(0x55931dd9b5c0 msgr2=0x55931de902d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3650325275 shutdown_connections 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3650325275 wait complete. 2024-05-15T18:10:02.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9ce87800 1 Processor -- start 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9ce87800 1 -- start start 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9ce87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de9c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9ce87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55931ddaa850 con 0x55931dd9fa00 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de9c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de9c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37642/0 (socket says 172.21.15.173:37642) 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9a986640 1 -- 172.21.15.173:0/3195897389 learned_addr learned my addr 172.21.15.173:0/3195897389 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.394+0000 7f5c9a986640 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931de9ca60 con 0x55931dd9fa00 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.395+0000 7f5c9a986640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de9c520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00b700 tx=0x7f5c8c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.395+0000 7f5b87606640 1 -- 172.21.15.173:0/3195897389 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c00f8d0 con 0x55931dd9fa00 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.395+0000 7f5b87606640 1 -- 172.21.15.173:0/3195897389 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00fa70 con 0x55931dd9fa00 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.395+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55931de9ccf0 con 0x55931dd9fa00 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.395+0000 7f5b87606640 1 -- 172.21.15.173:0/3195897389 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c02c060 con 0x55931dd9fa00 2024-05-15T18:10:02.374 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.395+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55931de9f9a0 con 0x55931dd9fa00 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5b87606640 1 -- 172.21.15.173:0/3195897389 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5c8c017070 con 0x55931dd9fa00 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5b87606640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b80036900 0x7f5b80038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5b87606640 1 -- 172.21.15.173:0/3195897389 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5c8c015020 con 0x55931dd9fa00 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5c9a185640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b80036900 0x7f5b80038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dda1540 0x55931dea3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dea3ce0 con 0x55931dda1540 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5c9b187640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dda1540 0x55931dea3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5c9a185640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b80036900 0x7f5b80038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5c90054000 tx=0x7f5c9004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.396+0000 7f5c9b187640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dda1540 0x55931dea3760 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.398 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.397+0000 7f5c9b187640 1 -- 172.21.15.173:0/3195897389 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dda1540 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.397+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dea0d30 con 0x55931dda1540 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.397+0000 7f5c9b187640 1 -- 172.21.15.173:0/3195897389 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dda1540 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.397+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dea6030 0x55931dea8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.397+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dea8af0 con 0x55931dea6030 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.397+0000 7f5c9a986640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dea6030 0x55931dea8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.397+0000 7f5c9a986640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dea6030 0x55931dea8420 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.398+0000 7f5c9a986640 1 -- 172.21.15.173:0/3195897389 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5c8c02e070 con 0x55931dea6030 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.398+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dea4fe0 con 0x55931dda1540 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.398+0000 7f5c9b187640 1 -- 172.21.15.173:0/3195897389 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dda1540 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.398+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55931dea9f30 0x55931deac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.399 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.398+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931deacb80 con 0x55931dea9f30 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.398+0000 7f5c9a185640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55931dea9f30 0x55931deac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.399+0000 7f5c9a185640 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55931dea9f30 0x55931deac3f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.399+0000 7f5c9a185640 1 -- 172.21.15.173:0/3195897389 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5c9005a040 con 0x55931dea9f30 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9ce87800 1 Processor -- start 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9ce87800 1 -- start start 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9ce87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931debafe0 0x55931debb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9ce87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55931dc92cf0 con 0x55931debafe0 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931debafe0 0x55931debb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931debafe0 0x55931debb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37646/0 (socket says 172.21.15.173:37646) 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9a986640 1 -- 172.21.15.173:0/2781397536 learned_addr learned my addr 172.21.15.173:0/2781397536 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9a986640 1 -- 172.21.15.173:0/2781397536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931debb940 con 0x55931debafe0 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.400+0000 7f5c9a986640 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931debafe0 0x55931debb400 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c001640 tx=0x7f5c8c019f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.401+0000 7f5b84e01640 1 -- 172.21.15.173:0/2781397536 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c035070 con 0x55931debafe0 2024-05-15T18:10:02.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.401+0000 7f5b84e01640 1 -- 172.21.15.173:0/2781397536 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00b070 con 0x55931debafe0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.401+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55931debc3b0 con 0x55931debafe0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.401+0000 7f5b84e01640 1 -- 172.21.15.173:0/2781397536 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c01baf0 con 0x55931debafe0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.401+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55931debc8b0 con 0x55931debafe0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.401+0000 7f5b84e01640 1 -- 172.21.15.173:0/2781397536 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5c8c01bc90 con 0x55931debafe0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5b84e01640 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b74036970 0x7f5b74038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5b84e01640 1 -- 172.21.15.173:0/2781397536 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5c8c038020 con 0x55931debafe0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9a185640 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b74036970 0x7f5b74038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9ce87800 1 Processor -- start 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9a185640 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b74036970 0x7f5b74038e30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55931dea41b0 tx=0x7f5c90005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9ce87800 1 -- start start 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9ce87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931dec8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9ce87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55931de95300 con 0x55931dec8150 2024-05-15T18:10:02.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931dec8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931dec8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37654/0 (socket says 172.21.15.173:37654) 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.402+0000 7f5c9a986640 1 -- 172.21.15.173:0/2163958501 learned_addr learned my addr 172.21.15.173:0/2163958501 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.403+0000 7f5c9a986640 1 -- 172.21.15.173:0/2163958501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931dec8b40 con 0x55931dec8150 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.403+0000 7f5c9a986640 1 --2- 172.21.15.173:0/2163958501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931dec8570 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c032150 tx=0x7f5c8c023900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c655933e9f18e77f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.403+0000 7f5b7e7fc640 1 -- 172.21.15.173:0/2163958501 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c064070 con 0x55931dec8150 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.403+0000 7f5b7e7fc640 1 -- 172.21.15.173:0/2163958501 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8c04e070 con 0x55931dec8150 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.403+0000 7f5b7e7fc640 1 -- 172.21.15.173:0/2163958501 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c00a220 con 0x55931dec8150 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2163958501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 msgr2=0x55931dec8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2163958501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931dec8570 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c032150 tx=0x7f5c8c023900 comp rx=0 tx=0).stop 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2163958501 shutdown_connections 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2163958501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931dec8570 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2163958501 >> 172.21.15.173:0/2163958501 conn(0x55931dec44b0 msgr2=0x55931dec2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2163958501 shutdown_connections 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2163958501 wait complete. 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 Processor -- start 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 -- start start 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931decf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9ce87800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55931dec91f0 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931decf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9a986640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931decf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37658/0 (socket says 172.21.15.173:37658) 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.404+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 learned_addr learned my addr 172.21.15.173:0/2261574276 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.405+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931decfaa0 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.405+0000 7f5c9a986640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931decf560 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c062040 tx=0x7f5c8c01df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.405+0000 7f5b7cff9640 1 -- 172.21.15.173:0/2261574276 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c064040 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.405+0000 7f5b7cff9640 1 -- 172.21.15.173:0/2261574276 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8c06f020 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.405+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55931decfaa0 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.405+0000 7f5b7cff9640 1 -- 172.21.15.173:0/2261574276 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c8c00a5a0 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.405+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55931decfaa0 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.406+0000 7f5b7cff9640 1 -- 172.21.15.173:0/2261574276 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5c8c00a740 con 0x55931dec8150 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.406+0000 7f5b7cff9640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b64036900 0x7f5b64038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.406+0000 7f5b7cff9640 1 -- 172.21.15.173:0/2261574276 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5c8c070030 con 0x55931dec8150 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.406+0000 7f5c9a185640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b64036900 0x7f5b64038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9a185640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b64036900 0x7f5b64038dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c90052bb0 tx=0x7f5c9004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dedacd0 0x55931dedd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dedd8e0 con 0x55931dedacd0 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9b187640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dedacd0 0x55931dedd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9b187640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dedacd0 0x55931dedd190 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9ce87800 20 realm 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.407+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931deddcf0 con 0x55931dedacd0 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dede5c0 con 0x55931dedacd0 2024-05-15T18:10:02.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x55931dedacd0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dedf6c0 0x55931dee1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dee2070 con 0x55931dedf6c0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9a986640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dedf6c0 0x55931dee1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.408+0000 7f5c9a986640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dedf6c0 0x55931dee1ab0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5c8c067070 con 0x55931dedf6c0 2024-05-15T18:10:02.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9ce87800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9ce87800 20 searching for the correct realm 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dee39a0 con 0x55931dedf6c0 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c067070 con 0x55931dedf6c0 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9a986640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5c8c00f070 0x7f5c8c04b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dee39a0 con 0x7f5c8c00f070 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.409+0000 7f5c9a185640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5c8c00f070 0x7f5c8c04b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.410+0000 7f5c9a185640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5c8c00f070 0x7f5c8c04b820 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.410+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.410+0000 7f5c9a185640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5c90074040 0x7f5c90081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.410+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dee39a0 con 0x7f5c90074040 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.410+0000 7f5c9b187640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5c90074040 0x7f5c90081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.408 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.410+0000 7f5c9b187640 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5c90074040 0x7f5c90081410 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.411+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5c9400a4a0 con 0x7f5c90074040 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.411+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x55931dedacd0 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.411+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.411+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x55931dedacd0 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.411+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.411+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x7f5c90074040 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x7f5c90074040 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x7f5c90074040 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x7f5c90074040 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x7f5c8c00f070 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x55931dedf6c0 2024-05-15T18:10:02.409 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c067070 con 0x55931dedf6c0 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x55931dedacd0 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.412+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x7f5c90074040 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.413+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x7f5c90074040 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.413+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x55931dedacd0 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.413+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.413+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55931dede960 con 0x7f5c8c00f070 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.413+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedf6c0 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c067070 con 0x55931dedf6c0 2024-05-15T18:10:02.410 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedf6c0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c90074040 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x7f5c90074040 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedf6c0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.414+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.415+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedf6c0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.415+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.415+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedacd0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.415+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.415+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedacd0 2024-05-15T18:10:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.415+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5c9400a4a0 con 0x55931dedacd0 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.415+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c90074040 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c94033040 con 0x7f5c90074040 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedf6c0 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c8c00f070 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedacd0 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.416+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c90074040 2024-05-15T18:10:02.412 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedf6c0 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c90074040 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c8c00f070 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.417+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedf6c0 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c8c00f070 2024-05-15T18:10:02.413 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x55931dedacd0 2024-05-15T18:10:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5c9008e060 con 0x7f5c8c00f070 2024-05-15T18:10:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:02.414 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dee2930 con 0x55931dedacd0 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.418+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dee2d20 con 0x55931dedacd0 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dee2d20 con 0x7f5c90074040 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 zone default found 2024-05-15T18:10:02.416 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 4 Realm: () 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 zonegroup default 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dee31f0 con 0x7f5c90074040 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.417 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.419+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dee31f0 con 0x55931dedf6c0 2024-05-15T18:10:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931dee58f0 con 0x55931dedf6c0 2024-05-15T18:10:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9ce87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9ce87800 20 started sync module instance, tier type = 2024-05-15T18:10:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9ce87800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.420+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee4ca0 con 0x7f5c8c00f070 2024-05-15T18:10:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.421+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.421+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94090350710928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee4900 con 0x7f5c8c00f070 2024-05-15T18:10:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.421+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee6820 con 0x55931dedacd0 2024-05-15T18:10:02.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.422+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94090350710928] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.434 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-15T18:10:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.422+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.423+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94090350715760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee6c40 con 0x55931dedacd0 2024-05-15T18:10:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.423+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee7600 con 0x55931dedf6c0 2024-05-15T18:10:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.424+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94090350715760] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.424+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.424+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94090350716816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee6bb0 con 0x55931dedf6c0 2024-05-15T18:10:02.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.424+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee84c0 con 0x7f5c8c00f070 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.425+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.425+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94090350725216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee9130 con 0x7f5c8c00f070 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.425+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94090350716816] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.425+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee9b60 con 0x55931dedacd0 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.426+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94090350725216] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.426+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.426+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94090350726272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee9b20 con 0x55931dedacd0 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.426+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deea4e0 con 0x7f5c90074040 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.427+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.427+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94090350731312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deea450 con 0x7f5c90074040 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.427+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeb430 con 0x7f5c90074040 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.427+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94090350726272] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.428+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94090350731312] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.428+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.428+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94090350733520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee9670 con 0x7f5c90074040 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.428+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeb8a0 con 0x7f5c90074040 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94090350733520] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94090350736368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeb810 con 0x7f5c90074040 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 20 add_watcher() i=0 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 20 add_watcher() i=1 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 20 add_watcher() i=2 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 20 add_watcher() i=3 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 20 add_watcher() i=4 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 20 add_watcher() i=5 2024-05-15T18:10:02.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.430+0000 7f5c9ce87800 20 add_watcher() i=6 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.431+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94090350736368] v31'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.431+0000 7f5c9ce87800 20 add_watcher() i=7 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.431+0000 7f5c9ce87800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.431+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931deeed00 con 0x55931dedacd0 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.431+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.431+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94090350735136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deec1f0 con 0x55931dedacd0 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.432+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94090350735136] v31'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.432+0000 7f5b517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.432+0000 7f5c9ce87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.432+0000 7f5c9ce87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.432+0000 7f5c9ce87800 5 note: GC not initialized 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5acbfff640 20 reqs_thread_entry: start 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 20 Filter name: none 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5ac9ffb640 20 reqs_thread_entry: start 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-15T18:10:02.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55931df221f0 con 0x7f5c8c00f070 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.433+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931df26380 con 0x7f5c90074040 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.435+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v31'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.440 INFO:teuthology.orchestra.run.smithi173.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.436+0000 7f5b517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.436+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94090350735136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deee890 con 0x55931dedacd0 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.437+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94090350735136] v31'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.437+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94090350710928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeaf20 con 0x7f5c8c00f070 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.438+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94090350710928] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.438+0000 7f5c9ce87800 20 remove_watcher() i=0 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.438+0000 7f5c9ce87800 2 removed watcher, disabling cache 2024-05-15T18:10:02.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.438+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94090350715760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeaf20 con 0x55931dedacd0 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.439+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94090350715760] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.439+0000 7f5c9ce87800 20 remove_watcher() i=1 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.439+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94090350716816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee6370 con 0x55931dedf6c0 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.440+0000 7f5c9a986640 1 -- 172.21.15.173:0/2261574276 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94090350716816] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c8c08c040 con 0x55931dedf6c0 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.440+0000 7f5c9ce87800 20 remove_watcher() i=2 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.440+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94090350725216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeaf20 con 0x7f5c8c00f070 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.441+0000 7f5c9a185640 1 -- 172.21.15.173:0/2261574276 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94090350725216] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c9007f070 con 0x7f5c8c00f070 2024-05-15T18:10:02.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.441+0000 7f5c9ce87800 20 remove_watcher() i=3 2024-05-15T18:10:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.441+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94090350726272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931dee8860 con 0x55931dedacd0 2024-05-15T18:10:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.442+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94090350726272] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x55931dedacd0 2024-05-15T18:10:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.442+0000 7f5c9ce87800 20 remove_watcher() i=4 2024-05-15T18:10:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.442+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94090350731312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeaf20 con 0x7f5c90074040 2024-05-15T18:10:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.443+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94090350731312] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.443+0000 7f5c9ce87800 20 remove_watcher() i=5 2024-05-15T18:10:02.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.443+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94090350733520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deea030 con 0x7f5c90074040 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.444+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94090350733520] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.444+0000 7f5c9ce87800 20 remove_watcher() i=6 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.444+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94090350736368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55931deeaf20 con 0x7f5c90074040 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94090350736368] v31'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c94031040 con 0x7f5c90074040 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 20 remove_watcher() i=7 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5c90074040 msgr2=0x7f5c90081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5c90074040 0x7f5c90081410 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dedacd0 msgr2=0x55931dedd190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dedacd0 0x55931dedd190 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5c8c00f070 msgr2=0x7f5c8c04b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5c8c00f070 0x7f5c8c04b820 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dedf6c0 msgr2=0x55931dee1ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dedf6c0 0x55931dee1ab0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b64036900 msgr2=0x7f5b64038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b64036900 0x7f5b64038dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c90052bb0 tx=0x7f5c9004f000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 msgr2=0x55931decf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9b187640 1 -- 172.21.15.173:0/2261574276 reap_dead start 2024-05-15T18:10:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.445+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931decf560 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c062040 tx=0x7f5c8c01df30 comp rx=0 tx=0).stop 2024-05-15T18:10:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 shutdown_connections 2024-05-15T18:10:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2261574276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dec8150 0x55931decf560 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 >> 172.21.15.173:0/2261574276 conn(0x55931dec44b0 msgr2=0x55931dec1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 shutdown_connections 2024-05-15T18:10:02.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2261574276 wait complete. 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b74036970 msgr2=0x7f5b74038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b74036970 0x7f5b74038e30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55931dea41b0 tx=0x7f5c90005ac0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931debafe0 msgr2=0x55931debb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931debafe0 0x55931debb400 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c001640 tx=0x7f5c8c019f90 comp rx=0 tx=0).stop 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 shutdown_connections 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b74036970 0x7f5b74038e30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/2781397536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931debafe0 0x55931debb400 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 >> 172.21.15.173:0/2781397536 conn(0x55931deaf080 msgr2=0x55931deaf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 shutdown_connections 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/2781397536 wait complete. 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55931dea9f30 msgr2=0x55931deac3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55931dea9f30 0x55931deac3f0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dda1540 msgr2=0x55931dea3760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55931dda1540 0x55931dea3760 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dea6030 msgr2=0x55931dea8420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55931dea6030 0x55931dea8420 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.446+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b80036900 msgr2=0x7f5b80038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5b80036900 0x7f5b80038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5c90054000 tx=0x7f5c9004e000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 msgr2=0x55931de9c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9ce87800 1 --2- 172.21.15.173:0/3195897389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55931dd9fa00 0x55931de9c520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c00b700 tx=0x7f5c8c000bc0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9b187640 1 -- 172.21.15.173:0/3195897389 reap_dead start 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 shutdown_connections 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 >> 172.21.15.173:0/3195897389 conn(0x55931dd9b5c0 msgr2=0x55931de8ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 shutdown_connections 2024-05-15T18:10:02.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.447+0000 7f5c9ce87800 1 -- 172.21.15.173:0/3195897389 wait complete. 2024-05-15T18:10:02.454 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:10:02.454 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-15T18:10:02.458 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-15T18:10:02.458 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-05-15T18:10:02.458 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-15T18:10:02.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-15T18:10:02.459 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-05-15T18:10:02.503 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:02.504 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4477a2800 1 Processor -- start 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4477a2800 1 -- start start 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4477a2800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5598daaabbe0 0x5598daaadfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4477a2800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598daab2020 con 0x5598daaae510 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4477a2800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5598da93c050 con 0x5598daaabbe0 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4452a1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5598daaabbe0 0x5598daaadfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4452a1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5598daaabbe0 0x5598daaadfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37666/0 (socket says 172.21.15.173:37666) 2024-05-15T18:10:02.505 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc444aa0640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5598daaae510 0x5598daab0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43538/0 (socket says 172.21.15.173:43538) 2024-05-15T18:10:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.528+0000 7fc4452a1640 1 -- 172.21.15.173:0/3965286939 learned_addr learned my addr 172.21.15.173:0/3965286939 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.529+0000 7fc4452a1640 1 -- 172.21.15.173:0/3965286939 >> v1:172.21.15.3:6789/0 conn(0x5598daaae510 legacy=0x5598daab0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.506 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.529+0000 7fc4452a1640 1 -- 172.21.15.173:0/3965286939 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598daab3200 con 0x5598daaabbe0 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4452a1640 1 --2- 172.21.15.173:0/3965286939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaadfd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc43800a520 tx=0x7fc43801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915fefd21d76295d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc43ffff640 1 -- 172.21.15.173:0/3965286939 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438057070 con 0x5598daaabbe0 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc43ffff640 1 -- 172.21.15.173:0/3965286939 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438052570 con 0x5598daaabbe0 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc43ffff640 1 -- 172.21.15.173:0/3965286939 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc43804ae60 con 0x5598daaabbe0 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4477a2800 1 -- 172.21.15.173:0/3965286939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 msgr2=0x5598daaadfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4477a2800 1 --2- 172.21.15.173:0/3965286939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaadfd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc43800a520 tx=0x7fc43801d010 comp rx=0 tx=0).stop 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4477a2800 1 -- 172.21.15.173:0/3965286939 shutdown_connections 2024-05-15T18:10:02.508 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4477a2800 1 --2- 172.21.15.173:0/3965286939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaadfd0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4477a2800 1 -- 172.21.15.173:0/3965286939 >> 172.21.15.173:0/3965286939 conn(0x5598daaa55b0 msgr2=0x5598daaa79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4477a2800 1 -- 172.21.15.173:0/3965286939 shutdown_connections 2024-05-15T18:10:02.509 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.531+0000 7fc4477a2800 1 -- 172.21.15.173:0/3965286939 wait complete. 2024-05-15T18:10:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.545+0000 7fc4477a2800 1 Processor -- start 2024-05-15T18:10:02.553 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.545+0000 7fc4477a2800 1 -- start start 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.545+0000 7fc4477a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.545+0000 7fc4477a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5598da9f61c0 con 0x5598daaabbe0 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.545+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.545+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37676/0 (socket says 172.21.15.173:37676) 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.545+0000 7fc4452a1640 1 -- 172.21.15.173:0/2301218147 learned_addr learned my addr 172.21.15.173:0/2301218147 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.546+0000 7fc4452a1640 1 -- 172.21.15.173:0/2301218147 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598daaa9ae0 con 0x5598daaabbe0 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.546+0000 7fc4452a1640 1 --2- 172.21.15.173:0/2301218147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaab520 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc43801d050 tx=0x7fc43804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424a8d734ff006d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.546+0000 7fc333606640 1 -- 172.21.15.173:0/2301218147 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438057040 con 0x5598daaabbe0 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.546+0000 7fc333606640 1 -- 172.21.15.173:0/2301218147 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438052720 con 0x5598daaabbe0 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.546+0000 7fc333606640 1 -- 172.21.15.173:0/2301218147 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438052a40 con 0x5598daaabbe0 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 -- 172.21.15.173:0/2301218147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 msgr2=0x5598daaab520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2301218147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaab520 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc43801d050 tx=0x7fc43804c000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 -- 172.21.15.173:0/2301218147 shutdown_connections 2024-05-15T18:10:02.554 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2301218147 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daaab520 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 -- 172.21.15.173:0/2301218147 >> 172.21.15.173:0/2301218147 conn(0x5598daaa55b0 msgr2=0x5598dab97f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 -- 172.21.15.173:0/2301218147 shutdown_connections 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 -- 172.21.15.173:0/2301218147 wait complete. 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 Processor -- start 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 -- start start 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daba6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.547+0000 7fc4477a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5598daab2490 con 0x5598daaabbe0 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daba6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daba6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37686/0 (socket says 172.21.15.173:37686) 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc4452a1640 1 -- 172.21.15.173:0/2347916441 learned_addr learned my addr 172.21.15.173:0/2347916441 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc4452a1640 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598daba67c0 con 0x5598daaabbe0 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc4452a1640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daba6280 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc438005930 tx=0x7fc438003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.555 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc331e03640 1 -- 172.21.15.173:0/2347916441 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438073070 con 0x5598daaabbe0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc331e03640 1 -- 172.21.15.173:0/2347916441 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43805d570 con 0x5598daaabbe0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc331e03640 1 -- 172.21.15.173:0/2347916441 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438057070 con 0x5598daaabbe0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598daba6a50 con 0x5598daaabbe0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.548+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598daba9700 con 0x5598daaabbe0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.549+0000 7fc331e03640 1 -- 172.21.15.173:0/2347916441 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc438076070 con 0x5598daaabbe0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.549+0000 7fc331e03640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc32c036950 0x7fc32c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.549+0000 7fc331e03640 1 -- 172.21.15.173:0/2347916441 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc43808de00 con 0x5598daaabbe0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc444aa0640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc32c036950 0x7fc32c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598daaae510 0x5598dabad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabada40 con 0x5598daaae510 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc445aa2640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598daaae510 0x5598dabad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc444aa0640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc32c036950 0x7fc32c038e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc430000f60 tx=0x7fc430001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.556 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc445aa2640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598daaae510 0x5598dabad4c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc445aa2640 1 -- 172.21.15.173:0/2347916441 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598daaae510 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.550+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabaaa90 con 0x5598daaae510 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc445aa2640 1 -- 172.21.15.173:0/2347916441 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598daaae510 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabafd90 0x5598dabb2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabb2870 con 0x5598dabafd90 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4452a1640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabafd90 0x5598dabb2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4452a1640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabafd90 0x5598dabb2180 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4452a1640 1 -- 172.21.15.173:0/2347916441 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc438075030 con 0x5598dabafd90 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabaed40 con 0x5598daaae510 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc445aa2640 1 -- 172.21.15.173:0/2347916441 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598daaae510 2024-05-15T18:10:02.557 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5598dabb3d20 0x5598dabb6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.551+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabb68d0 con 0x5598dabb3d20 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.552+0000 7fc444aa0640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5598dabb3d20 0x5598dabb6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.552+0000 7fc444aa0640 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5598dabb3d20 0x5598dabb6170 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.552+0000 7fc444aa0640 1 -- 172.21.15.173:0/2347916441 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc43000f690 con 0x5598dabb3d20 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4477a2800 1 Processor -- start 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4477a2800 1 -- start start 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4477a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabc4d30 0x5598dabc5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4477a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5598da99ccf0 con 0x5598dabc4d30 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabc4d30 0x5598dabc5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabc4d30 0x5598dabc5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37694/0 (socket says 172.21.15.173:37694) 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4452a1640 1 -- 172.21.15.173:0/3483228699 learned_addr learned my addr 172.21.15.173:0/3483228699 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.553+0000 7fc4452a1640 1 -- 172.21.15.173:0/3483228699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598dabc5690 con 0x5598dabc4d30 2024-05-15T18:10:02.558 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.554+0000 7fc4452a1640 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabc4d30 0x5598dabc5150 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc43808c1f0 tx=0x7fc4380668b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.554+0000 7fc32affd640 1 -- 172.21.15.173:0/3483228699 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc43805da50 con 0x5598dabc4d30 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.554+0000 7fc32affd640 1 -- 172.21.15.173:0/3483228699 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43805dbf0 con 0x5598dabc4d30 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.554+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598dabc6100 con 0x5598dabc4d30 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.554+0000 7fc32affd640 1 -- 172.21.15.173:0/3483228699 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc43806f580 con 0x5598dabc4d30 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.554+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598dabc6600 con 0x5598dabc4d30 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc32affd640 1 -- 172.21.15.173:0/3483228699 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc43806f720 con 0x5598dabc4d30 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc32affd640 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc320036900 0x7fc320038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc32affd640 1 -- 172.21.15.173:0/3483228699 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc438089070 con 0x5598dabc4d30 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc444aa0640 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc320036900 0x7fc320038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc4477a2800 1 Processor -- start 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc4477a2800 1 -- start start 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc444aa0640 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc320036900 0x7fc320038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5598dabae340 tx=0x7fc43000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc4477a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.559 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc4477a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5598daaa9da0 con 0x5598dabd1f20 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.555+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37700/0 (socket says 172.21.15.173:37700) 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.556+0000 7fc4452a1640 1 -- 172.21.15.173:0/1961386898 learned_addr learned my addr 172.21.15.173:0/1961386898 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.556+0000 7fc4452a1640 1 -- 172.21.15.173:0/1961386898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598dabd2910 con 0x5598dabd1f20 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.556+0000 7fc4452a1640 1 --2- 172.21.15.173:0/1961386898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd2340 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc438079910 tx=0x7fc438079940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107aad7d0a3d6fb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.556+0000 7fc328ff9640 1 -- 172.21.15.173:0/1961386898 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438099070 con 0x5598dabd1f20 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.556+0000 7fc328ff9640 1 -- 172.21.15.173:0/1961386898 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43806fad0 con 0x5598dabd1f20 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.556+0000 7fc328ff9640 1 -- 172.21.15.173:0/1961386898 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc438002130 con 0x5598dabd1f20 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 -- 172.21.15.173:0/1961386898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 msgr2=0x5598dabd2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1961386898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd2340 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc438079910 tx=0x7fc438079940 comp rx=0 tx=0).stop 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 -- 172.21.15.173:0/1961386898 shutdown_connections 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1961386898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd2340 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 -- 172.21.15.173:0/1961386898 >> 172.21.15.173:0/1961386898 conn(0x5598dabce1f0 msgr2=0x5598dabcc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 -- 172.21.15.173:0/1961386898 shutdown_connections 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 -- 172.21.15.173:0/1961386898 wait complete. 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 Processor -- start 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 -- start start 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4477a2800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5598dabd2f70 con 0x5598dabd1f20 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4452a1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37708/0 (socket says 172.21.15.173:37708) 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.557+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 learned_addr learned my addr 172.21.15.173:0/1601144077 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.558+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598dabd9750 con 0x5598dabd1f20 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.558+0000 7fc4452a1640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd9210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc438079c00 tx=0x7fc438082f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.558+0000 7fc316ffd640 1 -- 172.21.15.173:0/1601144077 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc43806c740 con 0x5598dabd1f20 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.558+0000 7fc316ffd640 1 -- 172.21.15.173:0/1601144077 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43805b790 con 0x5598dabd1f20 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.558+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598dabd9750 con 0x5598dabd1f20 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.558+0000 7fc316ffd640 1 -- 172.21.15.173:0/1601144077 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc43805ba70 con 0x5598dabd1f20 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.558+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598dabd9750 con 0x5598dabd1f20 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.559+0000 7fc316ffd640 1 -- 172.21.15.173:0/1601144077 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc43805bc10 con 0x5598dabd1f20 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.559+0000 7fc316ffd640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc310036900 0x7fc310038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.559+0000 7fc316ffd640 1 -- 172.21.15.173:0/1601144077 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc438056170 con 0x5598dabd1f20 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.559+0000 7fc444aa0640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc310036900 0x7fc310038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598dabe4a30 0x5598dabe6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc444aa0640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc310036900 0x7fc310038dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5598dabb6cd0 tx=0x7fc430010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe7640 con 0x5598dabe4a30 2024-05-15T18:10:02.562 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc445aa2640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598dabe4a30 0x5598dabe6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc445aa2640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598dabe4a30 0x5598dabe6ef0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc4477a2800 20 realm 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.560+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe7a50 con 0x5598dabe4a30 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe8320 con 0x5598dabe4a30 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabe9420 0x5598dabeb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabebe20 con 0x5598dabe9420 2024-05-15T18:10:02.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4452a1640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabe9420 0x5598dabeb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.561+0000 7fc4452a1640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabe9420 0x5598dabeb810 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc4477a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc4477a2800 20 searching for the correct realm 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabed750 con 0x5598dabe9420 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc4452a1640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc438078060 0x7fc4380b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabed750 con 0x7fc438078060 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc444aa0640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc438078060 0x7fc4380b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.562+0000 7fc444aa0640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc438078060 0x7fc4380b3440 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.563+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.563+0000 7fc444aa0640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc43000f070 0x7fc43002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.563+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabed750 con 0x7fc43000f070 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.563+0000 7fc445aa2640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc43000f070 0x7fc43002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.564+0000 7fc445aa2640 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc43000f070 0x7fc43002e910 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.564+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc44000a4a0 con 0x7fc43000f070 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.564+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.564+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.564+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.564+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.564+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc43000f070 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x7fc43000f070 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc43000f070 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x7fc43000f070 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc438078060 2024-05-15T18:10:02.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.565+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc43000f070 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x7fc43000f070 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc438078060 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.566+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc43000f070 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x7fc43000f070 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.567+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc44000a4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc43000f070 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc440033040 con 0x7fc43000f070 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.569 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.568+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc438078060 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc43000f070 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.569+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc43000f070 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc438078060 2024-05-15T18:10:02.570 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe9420 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc438078060 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.570+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x5598dabe4a30 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5598dabe86c0 con 0x7fc438078060 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:02.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabec6e0 con 0x5598dabe4a30 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabecad0 con 0x5598dabe4a30 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.571+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabecad0 con 0x7fc43000f070 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 20 zone default found 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 4 Realm: () 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 20 zonegroup default 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabedbd0 con 0x7fc43000f070 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabef5b0 con 0x5598dabe9420 2024-05-15T18:10:02.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.572+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabef950 con 0x5598dabe9420 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4477a2800 20 started sync module instance, tier type = 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4477a2800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.573+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabeea50 con 0x7fc438078060 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.574+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.574+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114993333664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabefcf0 con 0x7fc438078060 2024-05-15T18:10:02.574 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.574+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf0540 con 0x5598dabe4a30 2024-05-15T18:10:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.575+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114993333664] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.575+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.575+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114993340560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf04b0 con 0x5598dabe4a30 2024-05-15T18:10:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.575+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf1400 con 0x5598dabe9420 2024-05-15T18:10:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.576+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.577+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114993344336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf1ca0 con 0x5598dabe9420 2024-05-15T18:10:02.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.577+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf2790 con 0x7fc438078060 2024-05-15T18:10:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.578+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.578+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114993351552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf3450 con 0x7fc438078060 2024-05-15T18:10:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.578+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf3ec0 con 0x5598dabe4a30 2024-05-15T18:10:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.578+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114993340560] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.578+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114993344336] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.579+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.579+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114993346544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf0930 con 0x5598dabe4a30 2024-05-15T18:10:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.579+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf48d0 con 0x7fc43000f070 2024-05-15T18:10:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.579+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114993351552] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.580+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.580+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114993352608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf48d0 con 0x7fc43000f070 2024-05-15T18:10:02.595 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.580+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf51a0 con 0x7fc43000f070 2024-05-15T18:10:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.581+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114993346544] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.581+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.581+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114993355152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf5380 con 0x7fc43000f070 2024-05-15T18:10:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.581+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf5bd0 con 0x7fc43000f070 2024-05-15T18:10:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.581+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114993352608] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114993355152] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.596 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114993358336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf5830 con 0x7fc43000f070 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 20 add_watcher() i=0 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 20 add_watcher() i=1 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 20 add_watcher() i=2 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 20 add_watcher() i=3 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 20 add_watcher() i=4 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 20 add_watcher() i=5 2024-05-15T18:10:02.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.582+0000 7fc4477a2800 20 add_watcher() i=6 2024-05-15T18:10:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.583+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114993358336] v31'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.583+0000 7fc4477a2800 20 add_watcher() i=7 2024-05-15T18:10:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.583+0000 7fc4477a2800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.583+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf89a0 con 0x5598dabe4a30 2024-05-15T18:10:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.583+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.583+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114993361792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf5c50 con 0x5598dabe4a30 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.584+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114993361792] v31'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.585+0000 7fc2fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.585+0000 7fc4477a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.585+0000 7fc4477a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.585+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabf8130 con 0x5598dabe4a30 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.586+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.586+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac01a60 con 0x7fc43000f070 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.587+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.587+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac01f10 con 0x5598dabe9420 2024-05-15T18:10:02.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.588+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.588+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac022b0 con 0x5598dabe4a30 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.589+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'222 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.589+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac02820 con 0x7fc438078060 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.590+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.590+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac03070 con 0x5598dabe9420 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.591+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.591+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac03070 con 0x5598dabe4a30 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.592+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.592+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac03100 con 0x7fc43000f070 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.593+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.593+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac03190 con 0x7fc438078060 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.595+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.595+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac03700 con 0x5598dabe9420 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.595+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.596+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac03bb0 con 0x7fc438078060 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.596+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.596+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc43000f070 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.598+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.598+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc438078060 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.599+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.599+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc43000f070 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.600+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.600+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe4a30 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.601+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'223 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.601+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.602+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.602+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc438078060 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.603+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.603+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.602 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.604+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.604+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe4a30 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.605+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.605+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe4a30 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.606+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'224 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.606+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.608+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.608+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc438078060 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.609+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.609+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.610+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.610+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.611+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.611+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.611+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.612+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.612+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.612+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc43000f070 2024-05-15T18:10:02.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.614+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.614+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.615+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.615+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc43000f070 2024-05-15T18:10:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.616+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.616+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x5598dabe9420 2024-05-15T18:10:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.617+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.617+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc43000f070 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.619+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.619+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac038a0 con 0x7fc438078060 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc2fafe5640 20 reqs_thread_entry: start 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc4477a2800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc4477a2800 20 Filter name: none 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc2f8fe1640 20 reqs_thread_entry: start 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc4477a2800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-15T18:10:02.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.620+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac2ea50 con 0x7fc438078060 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac31310 con 0x5598dabe4a30 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 : miss 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.621+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 8.1b 8:d90a6dd8:root::.bucket.meta.myfoo6%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac31040 con 0x7fc438078060 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(96 .bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv5 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 info.flags=0x17 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 to cache LRU end 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:97 4.35 4:ada0a1ab:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae540 con 0x5598dabe4a30 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(97 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:98 4.2f 4:f467f441:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae580 con 0x5598dabe4a30 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(98 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.622+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:99 4.39 4:9ea4ba09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae580 con 0x5598dabe9420 2024-05-15T18:10:02.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.623+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(99 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.623+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 4.2a 4:57844c0a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae580 con 0x5598dabe4a30 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.623+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(100 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.623+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 4.26 4:64aba49a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae5c0 con 0x7fc43000f070 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.623+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(101 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440031040 con 0x7fc43000f070 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.623+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:102 4.1a 4:5a2489c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae5c0 con 0x7fc438078060 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.624+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(102 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.624+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:103 4.8 4:120f846c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae5e0 con 0x5598dabe9420 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.624+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(103 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.624+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:104 4.1 4:82a269f1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae5e0 con 0x7fc438078060 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.624+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(104 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.624+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 4.27 4:e441ca94:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae5e0 con 0x5598dabe4a30 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(105 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440031040 con 0x5598dabe4a30 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:106 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae5e0 con 0x5598dabe9420 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(106 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [call out=289b] v0'0 uv5 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc4477a2800 10 cls_bucket_list_unordered: got thirteen 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:107 4.4 4:216436cc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacae5e0 con 0x7fc43000f070 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(107 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc440049060 con 0x7fc43000f070 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc4477a2800 20 get_obj_state: octx=0x7fc44000aad0 obj=myfoo6:thirteen state=0x5598dacac5a8 s->prefetch_data=0 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.625+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:108 3.6 3:61cf7946:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacad3d0 con 0x5598dabe4a30 2024-05-15T18:10:02.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.626+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(108 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fc440049060 con 0x5598dabe4a30 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.626+0000 7fc4477a2800 10 manifest: total_size = 8 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.626+0000 7fc4477a2800 20 get_obj_state: setting s->obj_tag to _ysbFihtiHkzC5wKVi7ZcNSQnGf4U-gV 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.626+0000 7fc4477a2800 20 get_obj_state: octx=0x7fc44000aad0 obj=myfoo6:thirteen state=0x5598dacac5a8 s->prefetch_data=0 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.626+0000 7fc4477a2800 20 prepare_atomic_modification: state is not atomic. state=0x5598dacac5a8 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.626+0000 7fc4477a2800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.626+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:109 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dacadc50 con 0x5598dabe9420 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.627+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(109 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [stat,call,call] v31'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.627+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:110 3.6 3:61cf7946:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dacadc50 con 0x5598dabe4a30 2024-05-15T18:10:02.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(110 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9_thirteen [call] v31'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fc440049060 con 0x5598dabe4a30 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:111 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac35740 con 0x5598dabe9420 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 20 list_objects_ordered: starting attempt 1 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:112 4.35 4:ada0a1ab:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac35740 con 0x5598dabe4a30 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:113 4.2f 4:f467f441:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3aa70 con 0x5598dabe4a30 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:114 4.39 4:9ea4ba09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3d3d0 con 0x5598dabe9420 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:115 4.2a 4:57844c0a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3fcc0 con 0x5598dabe4a30 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:116 4.26 4:64aba49a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac425b0 con 0x7fc43000f070 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:117 4.1a 4:5a2489c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac45210 con 0x7fc438078060 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:118 4.8 4:120f846c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3d410 con 0x5598dabe9420 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.628+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:119 4.1 4:82a269f1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac49d50 con 0x7fc438078060 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:120 4.27 4:e441ca94:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x5598dabe4a30 2024-05-15T18:10:02.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(119 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(118 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:121 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac46220 con 0x5598dabe9420 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(117 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc430037040 con 0x7fc438078060 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(116 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440049060 con 0x7fc43000f070 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(112 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440049060 con 0x5598dabe4a30 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:122 4.4 4:216436cc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac46220 con 0x7fc43000f070 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(113 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440049060 con 0x5598dabe4a30 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(114 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(115 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440049060 con 0x5598dabe4a30 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(120 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440049060 con 0x5598dabe4a30 2024-05-15T18:10:02.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.629+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(122 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc440049060 con 0x7fc43000f070 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(111 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [stat,call,call] v31'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc317fff640 20 handle_completion(): completion ok for obj=thirteen 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(121 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9])"; uploads.size()=0; is_truncated=0 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:123 4.35 4:ada0a1ab:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac46220 con 0x5598dabe4a30 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:124 4.2f 4:f467f441:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x5598dabe4a30 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:125 4.39 4:9ea4ba09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4b1d0 con 0x5598dabe9420 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:126 4.2a 4:57844c0a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3c350 con 0x5598dabe4a30 2024-05-15T18:10:02.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:127 4.26 4:64aba49a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3f8e0 con 0x7fc43000f070 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:128 4.1a 4:5a2489c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x7fc438078060 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:129 4.8 4:120f846c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac46220 con 0x5598dabe9420 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:130 4.1 4:82a269f1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4b1d0 con 0x7fc438078060 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:131 4.27 4:e441ca94:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3f8e0 con 0x5598dabe4a30 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(129 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== osd_op_reply(123 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:132 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3f8e0 con 0x5598dabe9420 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(124 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:133 4.4 4:216436cc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3c350 con 0x7fc43000f070 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(125 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(126 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.630+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(127 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.631+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== osd_op_reply(131 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.631+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(128 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.631+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(133 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.631+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(130 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.631+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(132 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.631+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x5598dabe4a30 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(134 bud.buckets [call] v31'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc4477a2800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x5598dabe4a30 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc4477a2800 20 rados_obj.operate() r=0 bl.length=166 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc4477a2800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc4477a2800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.632+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x5598dabe4a30 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v31'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc4477a2800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc4477a2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-15T18:10:02.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94114993719088 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac45be0 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== watch-notify(notify (1) cookie 94114993351552 notify 133143986193 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5598dac30560 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94114993351552 notifier 4748 bl.length()=150 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc328ff9640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc308003d60 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.633+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(137 notify.3 [notify cookie 94114993719088 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.634+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.634+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== watch-notify(notify_complete (2) cookie 94114993719088 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598dabf7b60 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.634+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:139 8.1b 8:d90a6dd8:root::.bucket.meta.myfoo6%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(139 .bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 [call,call,delete] v31'6 uv6 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 from cache 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9, ofs0, ns] 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94114993719088 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dacadb70 con 0x5598dabe9420 2024-05-15T18:10:02.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== watch-notify(notify (1) cookie 94114993344336 notify 133143986192 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5598dac03100 con 0x5598dabe9420 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc317fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94114993344336 notifier 4748 bl.length()=207 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc317fff640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc26c0032c0 con 0x5598dabe9420 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(140 notify.2 [notify cookie 94114993719088 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 40 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 41 ==== watch-notify(notify_complete (2) cookie 94114993719088 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598dabc5690 con 0x5598dabe9420 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:142 4.35 4:ada0a1ab:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x5598dabe4a30 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:143 4.2f 4:f467f441:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3c7a0 con 0x5598dabe4a30 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:144 4.39 4:9ea4ba09:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac2f4f0 con 0x5598dabe9420 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:145 4.2a 4:57844c0a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac2fe00 con 0x5598dabe4a30 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:146 4.26 4:64aba49a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x7fc43000f070 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:147 4.1a 4:5a2489c9:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac45530 con 0x7fc438078060 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.635+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:148 4.8 4:120f846c:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac45e00 con 0x5598dabe9420 2024-05-15T18:10:02.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.636+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:149 4.1 4:82a269f1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3c7a0 con 0x7fc438078060 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.636+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:150 4.27 4:e441ca94:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac2fe00 con 0x5598dabe4a30 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.636+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:151 4.19 4:9a332435:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac2f4f0 con 0x5598dabe9420 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.636+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:152 4.4 4:216436cc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac3c7a0 con 0x7fc43000f070 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.637+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== osd_op_reply(147 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.5 [delete] v31'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.637+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 45 ==== osd_op_reply(142 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.0 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.637+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 42 ==== osd_op_reply(151 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.9 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.637+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 43 ==== osd_op_reply(144 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.2 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.638+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(146 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.4 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.638+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(152 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.10 [delete] v31'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.638+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 46 ==== osd_op_reply(143 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.1 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.638+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== osd_op_reply(149 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.7 [delete] v31'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.638+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 47 ==== osd_op_reply(145 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.3 [delete] v31'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.638+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 44 ==== osd_op_reply(148 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.6 [delete] v31'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 48 ==== osd_op_reply(150 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9.8 [delete] v31'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4477a2800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 : miss 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4477a2800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:153 6.11 6:8d1ff17d:::pubsub..bucket.myfoo6%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c730 con 0x5598dabe9420 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 45 ==== osd_op_reply(153 pubsub..bucket.myfoo6/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4477a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4477a2800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 info.flags=0x0 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4477a2800 10 adding default.rgw.log++pubsub..bucket.myfoo6/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 to cache LRU end 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.640+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:154 6.11 6:8d1ff17d:::pubsub..bucket.myfoo6%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac45530 con 0x5598dabe9420 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.641+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 46 ==== osd_op_reply(154 pubsub..bucket.myfoo6/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.9 [delete] v31'29 uv23 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.641+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac2f4a0 con 0x5598dabe4a30 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.642+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 49 ==== osd_op_reply(155 bud.buckets [call] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.642+0000 7fc4477a2800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.642+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c6d0 con 0x5598dabe4a30 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.643+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 50 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v31'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.643+0000 7fc4477a2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.643+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94114993718992 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac30fb0 con 0x7fc43000f070 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.643+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== watch-notify(notify (1) cookie 94114993352608 notify 133143986215 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5598dac02d90 con 0x7fc43000f070 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.643+0000 7fc317fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986215 cookie 94114993352608 notifier 4748 bl.length()=170 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.643+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(157 notify.5 [notify cookie 94114993718992 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.643+0000 7fc317fff640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc26c0032c0 con 0x7fc43000f070 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.644+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.644+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== watch-notify(notify_complete (2) cookie 94114993718992 notify 133143986215 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598dabc6100 con 0x7fc43000f070 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.644+0000 7fc4477a2800 10 removing email index: 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.644+0000 7fc4477a2800 10 removing user buckets index 2024-05-15T18:10:02.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.644+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c6d0 con 0x5598dabe4a30 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.645+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 51 ==== osd_op_reply(159 bud.buckets [delete] v31'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.645+0000 7fc4477a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.645+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94114993718992 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac30fb0 con 0x7fc43000f070 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.645+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== watch-notify(notify (1) cookie 94114993355152 notify 133143986216 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5598dabc6100 con 0x7fc43000f070 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.645+0000 7fc328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986216 cookie 94114993355152 notifier 4748 bl.length()=160 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.645+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(160 notify.6 [notify cookie 94114993718992 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.645+0000 7fc328ff9640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc308003d60 con 0x7fc43000f070 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.646+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.646+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== watch-notify(notify_complete (2) cookie 94114993718992 notify 133143986216 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598dabf82c0 con 0x7fc43000f070 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.646+0000 7fc4477a2800 10 removing user index: bud 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.646+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dac4c6d0 con 0x7fc438078060 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(162 bud [call,call,delete] v31'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc4477a2800 10 removing default.rgw.meta+users.uid+bud from cache 2024-05-15T18:10:02.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc4477a2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94114993718992 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5598dac30fb0 con 0x7fc43000f070 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== watch-notify(notify (1) cookie 94114993352608 notify 133143986217 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5598dabf82c0 con 0x7fc43000f070 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986217 cookie 94114993352608 notifier 4748 bl.length()=152 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc328ff9640 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc308003d60 con 0x7fc43000f070 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(163 notify.5 [notify cookie 94114993718992 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.647+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.648+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== watch-notify(notify_complete (2) cookie 94114993718992 notify 133143986217 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598dabf80f0 con 0x7fc43000f070 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.648+0000 7fc2fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.648+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114993361792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x5598dabe4a30 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.649+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 52 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94114993361792] v31'225 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.649+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114993333664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x7fc438078060 2024-05-15T18:10:02.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.650+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 35 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94114993333664] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.650+0000 7fc4477a2800 20 remove_watcher() i=0 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.650+0000 7fc4477a2800 2 removed watcher, disabling cache 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.650+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114993340560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x5598dabe4a30 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.652+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 53 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94114993340560] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.652+0000 7fc4477a2800 20 remove_watcher() i=1 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.652+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114993344336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x5598dabe9420 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.653+0000 7fc4452a1640 1 -- 172.21.15.173:0/1601144077 <== osd.3 v2:172.21.15.173:6814/3793320597 47 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94114993344336] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc43809b070 con 0x5598dabe9420 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.653+0000 7fc4477a2800 20 remove_watcher() i=2 2024-05-15T18:10:02.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.653+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114993351552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x7fc438078060 2024-05-15T18:10:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.654+0000 7fc444aa0640 1 -- 172.21.15.173:0/1601144077 <== osd.2 v2:172.21.15.173:6808/3098545592 36 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94114993351552] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc430053040 con 0x7fc438078060 2024-05-15T18:10:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.654+0000 7fc4477a2800 20 remove_watcher() i=3 2024-05-15T18:10:02.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.654+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114993346544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x5598dabe4a30 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.655+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.1 v2:172.21.15.173:6800/3225970667 54 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94114993346544] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x5598dabe4a30 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.655+0000 7fc4477a2800 20 remove_watcher() i=4 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.655+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114993352608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x7fc43000f070 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.656+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94114993352608] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.656+0000 7fc4477a2800 20 remove_watcher() i=5 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.656+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114993355152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x7fc43000f070 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.657+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94114993355152] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.657+0000 7fc4477a2800 20 remove_watcher() i=6 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.657+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114993358336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5598dabfde00 con 0x7fc43000f070 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94114993358336] v31'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc440055040 con 0x7fc43000f070 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 20 remove_watcher() i=7 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc43000f070 msgr2=0x7fc43002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc43000f070 0x7fc43002e910 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598dabe4a30 msgr2=0x5598dabe6ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598dabe4a30 0x5598dabe6ef0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc438078060 msgr2=0x7fc4380b3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc438078060 0x7fc4380b3440 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabe9420 msgr2=0x5598dabeb810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.658+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabe9420 0x5598dabeb810 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc310036900 msgr2=0x7fc310038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc310036900 0x7fc310038dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5598dabb6cd0 tx=0x7fc430010000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 msgr2=0x5598dabd9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/1601144077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabd1f20 0x5598dabd9210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc438079c00 tx=0x7fc438082f90 comp rx=0 tx=0).stop 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 reap_dead start 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc445aa2640 1 -- 172.21.15.173:0/1601144077 reap_dead start 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 shutdown_connections 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 >> 172.21.15.173:0/1601144077 conn(0x5598dabce1f0 msgr2=0x5598dabcb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 shutdown_connections 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/1601144077 wait complete. 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc320036900 msgr2=0x7fc320038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc320036900 0x7fc320038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5598dabae340 tx=0x7fc43000f000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabc4d30 msgr2=0x5598dabc5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabc4d30 0x5598dabc5150 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc43808c1f0 tx=0x7fc4380668b0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 shutdown_connections 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc320036900 0x7fc320038dc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/3483228699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598dabc4d30 0x5598dabc5150 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 >> 172.21.15.173:0/3483228699 conn(0x5598dabb8dd0 msgr2=0x5598dabb91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 shutdown_connections 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/3483228699 wait complete. 2024-05-15T18:10:02.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5598dabb3d20 msgr2=0x5598dabb6170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5598dabb3d20 0x5598dabb6170 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598daaae510 msgr2=0x5598dabad4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5598daaae510 0x5598dabad4c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabafd90 msgr2=0x5598dabb2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.659+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5598dabafd90 0x5598dabb2180 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc32c036950 msgr2=0x7fc32c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc32c036950 0x7fc32c038e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc430000f60 tx=0x7fc430001370 comp rx=0 tx=0).stop 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 msgr2=0x5598daba6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 --2- 172.21.15.173:0/2347916441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598daaabbe0 0x5598daba6280 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc438005930 tx=0x7fc438003020 comp rx=0 tx=0).stop 2024-05-15T18:10:02.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc445aa2640 1 -- 172.21.15.173:0/2347916441 reap_dead start 2024-05-15T18:10:02.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 shutdown_connections 2024-05-15T18:10:02.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 >> 172.21.15.173:0/2347916441 conn(0x5598daaa55b0 msgr2=0x5598dab97b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 shutdown_connections 2024-05-15T18:10:02.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.660+0000 7fc4477a2800 1 -- 172.21.15.173:0/2347916441 wait complete. 2024-05-15T18:10:02.659 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-15T18:10:02.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-15T18:10:02.659 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-05-15T18:10:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:02.705 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d6021d800 1 Processor -- start 2024-05-15T18:10:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d6021d800 1 -- start start 2024-05-15T18:10:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d6021d800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557d255349f0 0x557d25534e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d6021d800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d254a9a70 con 0x557d25535350 2024-05-15T18:10:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d6021d800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x557d253c7050 con 0x557d255349f0 2024-05-15T18:10:02.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d5dd1c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557d255349f0 0x557d25534e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d5d51b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x557d25535350 0x557d25535800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:43550/0 (socket says 172.21.15.173:43550) 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d5dd1c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557d255349f0 0x557d25534e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37712/0 (socket says 172.21.15.173:37712) 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.728+0000 7f5d5d51b640 1 -- 172.21.15.173:0/638631169 learned_addr learned my addr 172.21.15.173:0/638631169 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.729+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/638631169 >> v1:172.21.15.3:6789/0 conn(0x557d25535350 legacy=0x557d25535800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.729+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/638631169 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d25535f10 con 0x557d255349f0 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/638631169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25534e10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5d58005fd0 tx=0x7f5d5801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62d707969b377ae server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d5cd1a640 1 -- 172.21.15.173:0/638631169 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d58052560 con 0x557d255349f0 2024-05-15T18:10:02.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d5cd1a640 1 -- 172.21.15.173:0/638631169 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d58052700 con 0x557d255349f0 2024-05-15T18:10:02.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d5cd1a640 1 -- 172.21.15.173:0/638631169 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d58052a60 con 0x557d255349f0 2024-05-15T18:10:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d6021d800 1 -- 172.21.15.173:0/638631169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 msgr2=0x557d25534e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d6021d800 1 --2- 172.21.15.173:0/638631169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25534e10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5d58005fd0 tx=0x7f5d5801ccc0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d6021d800 1 -- 172.21.15.173:0/638631169 shutdown_connections 2024-05-15T18:10:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d6021d800 1 --2- 172.21.15.173:0/638631169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25534e10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d6021d800 1 -- 172.21.15.173:0/638631169 >> 172.21.15.173:0/638631169 conn(0x557d255305b0 msgr2=0x557d255329d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d6021d800 1 -- 172.21.15.173:0/638631169 shutdown_connections 2024-05-15T18:10:02.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.731+0000 7f5d6021d800 1 -- 172.21.15.173:0/638631169 wait complete. 2024-05-15T18:10:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.745+0000 7f5d6021d800 1 Processor -- start 2024-05-15T18:10:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.745+0000 7f5d6021d800 1 -- start start 2024-05-15T18:10:02.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.745+0000 7f5d6021d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25629ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.745+0000 7f5d6021d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d254811c0 con 0x557d255349f0 2024-05-15T18:10:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25629ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25629ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37728/0 (socket says 172.21.15.173:37728) 2024-05-15T18:10:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/1800727380 learned_addr learned my addr 172.21.15.173:0/1800727380 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/1800727380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2562a080 con 0x557d255349f0 2024-05-15T18:10:02.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/1800727380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25629ab0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5d58007000 tx=0x7f5d5804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efa091b66f11c78 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5c4be07640 1 -- 172.21.15.173:0/1800727380 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d58052cd0 con 0x557d255349f0 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5c4be07640 1 -- 172.21.15.173:0/1800727380 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d580528b0 con 0x557d255349f0 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.746+0000 7f5c4be07640 1 -- 172.21.15.173:0/1800727380 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d5805c430 con 0x557d255349f0 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 -- 172.21.15.173:0/1800727380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 msgr2=0x557d25629ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 --2- 172.21.15.173:0/1800727380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25629ab0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5d58007000 tx=0x7f5d5804c000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 -- 172.21.15.173:0/1800727380 shutdown_connections 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 --2- 172.21.15.173:0/1800727380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d255349f0 0x557d25629ab0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 -- 172.21.15.173:0/1800727380 >> 172.21.15.173:0/1800727380 conn(0x557d255305b0 msgr2=0x557d256253d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 -- 172.21.15.173:0/1800727380 shutdown_connections 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 -- 172.21.15.173:0/1800727380 wait complete. 2024-05-15T18:10:02.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 Processor -- start 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 -- start start 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25535350 0x557d25631750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.747+0000 7f5d6021d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d25536440 con 0x557d25535350 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25535350 0x557d25631750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25535350 0x557d25631750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37744/0 (socket says 172.21.15.173:37744) 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3471806975 learned_addr learned my addr 172.21.15.173:0/3471806975 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d25631c90 con 0x557d25535350 2024-05-15T18:10:02.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25535350 0x557d25631750 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5d58000f80 tx=0x7f5d58003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5c4a604640 1 -- 172.21.15.173:0/3471806975 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d5805c430 con 0x557d25535350 2024-05-15T18:10:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5c4a604640 1 -- 172.21.15.173:0/3471806975 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5806f410 con 0x557d25535350 2024-05-15T18:10:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d25631f20 con 0x557d25535350 2024-05-15T18:10:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5c4a604640 1 -- 172.21.15.173:0/3471806975 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d5806f6f0 con 0x557d25535350 2024-05-15T18:10:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.748+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d25634bd0 con 0x557d25535350 2024-05-15T18:10:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.749+0000 7f5c4a604640 1 -- 172.21.15.173:0/3471806975 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d5806fb30 con 0x557d25535350 2024-05-15T18:10:02.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.749+0000 7f5c4a604640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c44036900 0x7f5c44038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.749+0000 7f5c4a604640 1 -- 172.21.15.173:0/3471806975 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5d5806c070 con 0x557d25535350 2024-05-15T18:10:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c44036900 0x7f5c44038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d25636980 0x557d25638d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25639340 con 0x557d25636980 2024-05-15T18:10:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d5e51d640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d25636980 0x557d25638d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c44036900 0x7f5c44038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d48000f60 tx=0x7f5d480012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d5e51d640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d25636980 0x557d25638d70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3471806975 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d25636980 2024-05-15T18:10:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.750+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25635f40 con 0x557d25636980 2024-05-15T18:10:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3471806975 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d500083e0 con 0x557d25636980 2024-05-15T18:10:02.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d2563b650 0x557d2563da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2563e130 con 0x557d2563b650 2024-05-15T18:10:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d2563b650 0x557d2563da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d2563b650 0x557d2563da40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3471806975 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d58064070 con 0x557d2563b650 2024-05-15T18:10:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d2563a600 con 0x557d25636980 2024-05-15T18:10:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.751+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3471806975 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d500083e0 con 0x557d25636980 2024-05-15T18:10:02.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.752+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d2563f590 0x557d25641a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.752+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25642190 con 0x557d2563f590 2024-05-15T18:10:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.752+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d2563f590 0x557d25641a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.752+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d2563f590 0x557d25641a00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3471806975 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d48009050 con 0x557d2563f590 2024-05-15T18:10:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d6021d800 1 Processor -- start 2024-05-15T18:10:02.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d6021d800 1 -- start start 2024-05-15T18:10:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d6021d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25650640 0x557d25650a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d6021d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d25427cf0 con 0x557d25650640 2024-05-15T18:10:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25650640 0x557d25650a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25650640 0x557d25650a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37750/0 (socket says 172.21.15.173:37750) 2024-05-15T18:10:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.753+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/1309447133 learned_addr learned my addr 172.21.15.173:0/1309447133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.754+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/1309447133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d25650fa0 con 0x557d25650640 2024-05-15T18:10:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.754+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25650640 0x557d25650a60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5d5806d4d0 tx=0x7f5d5805bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.754+0000 7f5c437fe640 1 -- 172.21.15.173:0/1309447133 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d5808ea70 con 0x557d25650640 2024-05-15T18:10:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.754+0000 7f5c437fe640 1 -- 172.21.15.173:0/1309447133 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5808ec10 con 0x557d25650640 2024-05-15T18:10:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.754+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d25651a10 con 0x557d25650640 2024-05-15T18:10:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.754+0000 7f5c437fe640 1 -- 172.21.15.173:0/1309447133 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d580663f0 con 0x557d25650640 2024-05-15T18:10:02.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.754+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d25651f10 con 0x557d25650640 2024-05-15T18:10:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.755+0000 7f5c437fe640 1 -- 172.21.15.173:0/1309447133 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d58066590 con 0x557d25650640 2024-05-15T18:10:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.755+0000 7f5c437fe640 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c38036950 0x7f5c38038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.755+0000 7f5c437fe640 1 -- 172.21.15.173:0/1309447133 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5d58084050 con 0x557d25650640 2024-05-15T18:10:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.755+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c38036950 0x7f5c38038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.755+0000 7f5d6021d800 1 Processor -- start 2024-05-15T18:10:02.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d6021d800 1 -- start start 2024-05-15T18:10:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c38036950 0x7f5c38038e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bf50 tx=0x7f5d4800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d6021d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d2565db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d6021d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d2562a3a0 con 0x557d2565d740 2024-05-15T18:10:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d2565db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d2565db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37756/0 (socket says 172.21.15.173:37756) 2024-05-15T18:10:02.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/106946652 learned_addr learned my addr 172.21.15.173:0/106946652 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/106946652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2565e130 con 0x557d2565d740 2024-05-15T18:10:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/106946652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d2565db60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5d5806f8f0 tx=0x7f5d58077d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bc83e869ff69dd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.756+0000 7f5c417fa640 1 -- 172.21.15.173:0/106946652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d580a7070 con 0x557d2565d740 2024-05-15T18:10:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5c417fa640 1 -- 172.21.15.173:0/106946652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d580873f0 con 0x557d2565d740 2024-05-15T18:10:02.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5c417fa640 1 -- 172.21.15.173:0/106946652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d5808e1c0 con 0x557d2565d740 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 -- 172.21.15.173:0/106946652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 msgr2=0x557d2565db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 --2- 172.21.15.173:0/106946652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d2565db60 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5d5806f8f0 tx=0x7f5d58077d10 comp rx=0 tx=0).stop 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 -- 172.21.15.173:0/106946652 shutdown_connections 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 --2- 172.21.15.173:0/106946652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d2565db60 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 -- 172.21.15.173:0/106946652 >> 172.21.15.173:0/106946652 conn(0x557d25659aa0 msgr2=0x557d25657b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 -- 172.21.15.173:0/106946652 shutdown_connections 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 -- 172.21.15.173:0/106946652 wait complete. 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 Processor -- start 2024-05-15T18:10:02.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 -- start start 2024-05-15T18:10:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.757+0000 7f5d6021d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d25664980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d6021d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557d2565e660 con 0x557d2565d740 2024-05-15T18:10:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d25664980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d5dd1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d25664980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:37766/0 (socket says 172.21.15.173:37766) 2024-05-15T18:10:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 learned_addr learned my addr 172.21.15.173:0/3621805847 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:02.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d25664ec0 con 0x557d2565d740 2024-05-15T18:10:02.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d25664980 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5d5807efd0 tx=0x7f5d580880d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5c2f7fe640 1 -- 172.21.15.173:0/3621805847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d580b1070 con 0x557d2565d740 2024-05-15T18:10:02.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5c2f7fe640 1 -- 172.21.15.173:0/3621805847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5804ce20 con 0x557d2565d740 2024-05-15T18:10:02.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d25664ec0 con 0x557d2565d740 2024-05-15T18:10:02.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5c2f7fe640 1 -- 172.21.15.173:0/3621805847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d580a7040 con 0x557d2565d740 2024-05-15T18:10:02.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.758+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d25664ec0 con 0x557d2565d740 2024-05-15T18:10:02.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.759+0000 7f5c2f7fe640 1 -- 172.21.15.173:0/3621805847 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d580b4070 con 0x557d2565d740 2024-05-15T18:10:02.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.759+0000 7f5c2f7fe640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c28036900 0x7f5c28038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.759+0000 7f5c2f7fe640 1 -- 172.21.15.173:0/3621805847 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5d5809f070 con 0x557d2565d740 2024-05-15T18:10:02.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.759+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c28036900 0x7f5c28038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.760+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c28036900 0x7f5c28038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d48001b60 tx=0x7f5d48010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.760+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.760+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d2566ff90 0x557d25672450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.760+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25672ba0 con 0x557d2566ff90 2024-05-15T18:10:02.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.760+0000 7f5d5e51d640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d2566ff90 0x557d25672450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.760+0000 7f5d5e51d640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d2566ff90 0x557d25672450 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 realm 2024-05-15T18:10:02.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25672fb0 con 0x557d2566ff90 2024-05-15T18:10:02.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:02.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d2566ff90 2024-05-15T18:10:02.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25673c20 con 0x557d2566ff90 2024-05-15T18:10:02.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d256745e0 0x557d256769d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25676fe0 con 0x557d256745e0 2024-05-15T18:10:02.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.761+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d256745e0 0x557d256769d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d256745e0 0x557d256769d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d6021d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:02.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d6021d800 20 searching for the correct realm 2024-05-15T18:10:02.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25678910 con 0x557d256745e0 2024-05-15T18:10:02.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d5dd1c640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5d580b6070 0x7f5d58087680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25678910 con 0x7f5d580b6070 2024-05-15T18:10:02.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.762+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5d580b6070 0x7f5d58087680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.763+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5d580b6070 0x7f5d58087680 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.763+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.763+0000 7f5d5d51b640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5d48037040 0x7f5d48036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:02.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.763+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25678910 con 0x7f5d48037040 2024-05-15T18:10:02.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.763+0000 7f5d5e51d640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5d48037040 0x7f5d48036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:02.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5d48037040 0x7f5d48036410 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:02.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d2566ff90 2024-05-15T18:10:02.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d2566ff90 2024-05-15T18:10:02.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x7f5d48037040 2024-05-15T18:10:02.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.764+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x7f5d48037040 2024-05-15T18:10:02.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x7f5d580b6070 2024-05-15T18:10:02.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d256745e0 2024-05-15T18:10:02.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d2566ff90 2024-05-15T18:10:02.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.765+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x7f5d48037040 2024-05-15T18:10:02.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d2566ff90 2024-05-15T18:10:02.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x7f5d580b6070 2024-05-15T18:10:02.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d256745e0 2024-05-15T18:10:02.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.766+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d256745e0 2024-05-15T18:10:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.767+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.767+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x7f5d48037040 2024-05-15T18:10:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.767+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.767+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d256745e0 2024-05-15T18:10:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d256745e0 2024-05-15T18:10:02.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d2566ff90 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d2566ff90 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.768+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x7f5d48037040 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d256745e0 2024-05-15T18:10:02.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x7f5d580b6070 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d2566ff90 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.769+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x7f5d48037040 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.770+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.770+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d256745e0 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.770+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.770+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x7f5d48037040 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.770+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.770+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x7f5d580b6070 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.770+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d256745e0 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x7f5d580b6070 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x557d2566ff90 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f5d50026040 con 0x7f5d580b6070 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.771+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d2566ff90 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x557d2566ff90 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25673880 con 0x7f5d48037040 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 zone default found 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 4 Realm: () 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:02.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 zonegroup default 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.772+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25677de0 con 0x7f5d48037040 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25677930 con 0x557d256745e0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25677d90 con 0x557d256745e0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 20 started sync module instance, tier type = 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:02.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.773+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d25679c10 con 0x7f5d580b6070 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.774+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.774+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93995986818912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567a560 con 0x7f5d580b6070 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.774+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567b020 con 0x557d2566ff90 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.775+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93995986818912] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.776+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.776+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93995986823920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567b410 con 0x557d2566ff90 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.776+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567be60 con 0x557d256745e0 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.777+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93995986823920] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.777+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.777+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93995986827600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567b410 con 0x557d256745e0 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.777+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567c910 con 0x7f5d580b6070 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.778+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.778+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93995986830368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567d1e0 con 0x7f5d580b6070 2024-05-15T18:10:02.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.778+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567dce0 con 0x557d2566ff90 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.778+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93995986827600] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.779+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93995986830368] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.779+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.779+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93995986832688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d25679fb0 con 0x557d2566ff90 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.779+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567e5c0 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.780+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93995986832688] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.780+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.780+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93995986835408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567e530 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.780+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567efd0 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.782+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93995986835408] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.782+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.782+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93995986838112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567efd0 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.782+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567f9d0 con 0x7f5d48037040 2024-05-15T18:10:02.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93995986838112] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93995986842848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567fbb0 con 0x7f5d48037040 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 20 add_watcher() i=0 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 20 add_watcher() i=1 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 20 add_watcher() i=2 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 20 add_watcher() i=3 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 20 add_watcher() i=4 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 20 add_watcher() i=5 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.783+0000 7f5d6021d800 20 add_watcher() i=6 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.784+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93995986842848] v31'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.784+0000 7f5d6021d800 20 add_watcher() i=7 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.784+0000 7f5d6021d800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.784+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25682f80 con 0x557d2566ff90 2024-05-15T18:10:02.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.784+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.784+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93995986844320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d25680370 con 0x557d2566ff90 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.785+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93995986844320] v31'226 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.785+0000 7f5c0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.785+0000 7f5d6021d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.785+0000 7f5d6021d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.786+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568b720 con 0x557d2566ff90 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.787+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.787+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568bdf0 con 0x7f5d48037040 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.788+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.788+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568c210 con 0x557d256745e0 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.789+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.789+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568c160 con 0x557d2566ff90 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.790+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'227 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.790+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568c7f0 con 0x7f5d580b6070 2024-05-15T18:10:02.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.791+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.791+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568d210 con 0x557d256745e0 2024-05-15T18:10:02.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.791+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.792+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568d210 con 0x557d2566ff90 2024-05-15T18:10:02.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.793+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.793+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568d210 con 0x7f5d48037040 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.794+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.794+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568d210 con 0x7f5d580b6070 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.795+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.795+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568d7a0 con 0x557d256745e0 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.796+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.796+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568d830 con 0x7f5d580b6070 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.797+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.797+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dce0 con 0x7f5d48037040 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.798+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.798+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dce0 con 0x7f5d580b6070 2024-05-15T18:10:02.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.799+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.799+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dce0 con 0x7f5d48037040 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.800+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.800+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dc50 con 0x557d2566ff90 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.801+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'228 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.801+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dc50 con 0x557d256745e0 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.802+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.802+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dce0 con 0x7f5d580b6070 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.803+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.803+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dd70 con 0x557d256745e0 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.804+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.804+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dd70 con 0x557d2566ff90 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.805+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.805+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dd70 con 0x557d2566ff90 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.806+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'229 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.806+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dd70 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.807+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.808+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568dd70 con 0x7f5d580b6070 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.808+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.808+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568de30 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.809+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.809+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568de30 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.810+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.810+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568de00 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.811+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.811+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568de30 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.812+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.812+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568de30 con 0x7f5d48037040 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.814+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.814+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568de00 con 0x557d256745e0 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.815+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.815+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568de00 con 0x7f5d48037040 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.816+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.816+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568e4f0 con 0x557d256745e0 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.818+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.818+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568cdb0 con 0x7f5d48037040 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.819+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.819+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2568cdb0 con 0x7f5d580b6070 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5c0e7fc640 20 reqs_thread_entry: start 2024-05-15T18:10:02.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5d6021d800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5d6021d800 20 Filter name: none 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5b7ffff640 20 reqs_thread_entry: start 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5d6021d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.820+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256b8ed0 con 0x7f5d48037040 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.821+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.821+0000 7f5d6021d800 20 rados_obj.operate() r=0 bl.length=380 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.821+0000 7f5d6021d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.821+0000 7f5d6021d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.821+0000 7f5d6021d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.821+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256bb7d0 con 0x7f5d48037040 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 : miss 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:96 8.f 8:f5aea8d2:root::.bucket.meta.myfoo7%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256bb530 con 0x557d256745e0 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 20 rados_obj.operate() r=0 bl.length=382 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 info.flags=0x17 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 to cache LRU end 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.822+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:97 4.23 4:c45b4c17:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a10 con 0x7f5d48037040 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.823+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(97 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.823+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:98 4.14 4:28503ffb:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a10 con 0x7f5d580b6070 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.823+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(98 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.823+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:99 4.20 4:065c1081:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a10 con 0x557d2566ff90 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.824+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(99 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.824+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 4.4 4:23033bfc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a90 con 0x7f5d48037040 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.824+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(100 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.824+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:101 4.2a 4:56cce651:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a90 con 0x557d2566ff90 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.824+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(101 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.824+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:102 4.3c 4:3e9d4a24:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a90 con 0x557d2566ff90 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(102 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5 [call out=378b] v0'0 uv4 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d6021d800 10 cls_bucket_list_unordered: got fourteen 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:103 4.1d 4:b8bb3fbe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a90 con 0x557d256745e0 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(103 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:104 4.1a 4:5bb7e231:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a90 con 0x7f5d580b6070 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(104 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:105 4.1 4:82bbd7e1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a90 con 0x7f5d580b6070 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.825+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(105 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:106 4.3c 4:3e44790a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a90 con 0x557d2566ff90 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(106 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:107 4.2b 4:d67f4e1e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d25738a10 con 0x557d2566ff90 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(107 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 20 get_obj_state: octx=0x7f5d50008ca0 obj=myfoo7:fourteen state=0x557d25736a98 s->prefetch_data=0 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:108 3.7 3:e150c714:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d257378c0 con 0x557d256745e0 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(108 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 10 manifest: total_size = 8 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10710700500069913333 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 20 get_obj_state: octx=0x7f5d50008ca0 obj=myfoo7:fourteen state=0x557d25736a98 s->prefetch_data=0 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 20 prepare_atomic_modification: state is not atomic. state=0x557d25736a98 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.826+0000 7f5d6021d800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.827+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:109 4.3c 4:3e9d4a24:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d25738180 con 0x557d2566ff90 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.828+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(109 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.828+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:110 3.7 3:e150c714:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d25738180 con 0x557d256745e0 2024-05-15T18:10:02.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.829+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(110 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10_fourteen [call] v31'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.829+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:111 4.3c 4:3e9d4a24:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256bfc30 con 0x557d2566ff90 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.829+0000 7f5d6021d800 20 list_objects_ordered: starting attempt 1 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.829+0000 7f5d6021d800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.829+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:112 4.23 4:c45b4c17:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256c2550 con 0x7f5d48037040 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:113 4.14 4:28503ffb:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256c4e50 con 0x7f5d580b6070 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:114 4.20 4:065c1081:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256c2550 con 0x557d2566ff90 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:115 4.4 4:23033bfc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256c9ed0 con 0x7f5d48037040 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:116 4.2a 4:56cce651:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256c2550 con 0x557d2566ff90 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:117 4.3c 4:3e9d4a24:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256cf130 con 0x557d2566ff90 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:118 4.1d 4:b8bb3fbe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d1bb0 con 0x557d256745e0 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:119 4.1a 4:5bb7e231:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d44c0 con 0x7f5d580b6070 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:120 4.1 4:82bbd7e1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d7060 con 0x7f5d580b6070 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:121 4.3c 4:3e44790a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d9ee0 con 0x557d2566ff90 2024-05-15T18:10:02.840 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:122 4.2b 4:d67f4e1e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccf0 con 0x557d2566ff90 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(112 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(113 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(115 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(114 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(116 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(118 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(119 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(120 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d48009050 con 0x7f5d580b6070 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.830+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(122 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.831+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(121 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.831+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(111 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5 [stat,call,call] v31'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.831+0000 7f5c40ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.831+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== osd_op_reply(117 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.841 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.831+0000 7f5d6021d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10])"; uploads.size()=0; is_truncated=0 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:123 4.23 4:c45b4c17:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccf0 con 0x7f5d48037040 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:124 4.14 4:28503ffb:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d6fe0 con 0x7f5d580b6070 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:125 4.20 4:065c1081:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256dc590 con 0x557d2566ff90 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:126 4.4 4:23033bfc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccf0 con 0x7f5d48037040 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:127 4.2a 4:56cce651:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256ca170 con 0x557d2566ff90 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:128 4.3c 4:3e9d4a24:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256dc590 con 0x557d2566ff90 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:129 4.1d 4:b8bb3fbe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d9f00 con 0x557d256745e0 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:130 4.1a 4:5bb7e231:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d6fe0 con 0x7f5d580b6070 2024-05-15T18:10:02.842 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:131 4.1 4:82bbd7e1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256ca170 con 0x7f5d580b6070 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:132 4.3c 4:3e44790a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccf0 con 0x557d2566ff90 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:133 4.2b 4:d67f4e1e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256bfa30 con 0x557d2566ff90 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(125 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(123 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(126 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(129 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(124 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(128 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(130 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== osd_op_reply(131 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== osd_op_reply(133 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(127 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.843 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(132 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.832+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256d6fe0 con 0x7f5d48037040 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(134 fud.buckets [call] v31'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d6021d800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d6fe0 con 0x7f5d580b6070 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv45 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d6021d800 20 rados_obj.operate() r=0 bl.length=168 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d6021d800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d6021d800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.834+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256d6fc0 con 0x7f5d580b6070 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(136 myfoo7 [call,call,delete] v31'46 uv46 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5d6021d800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-05-15T18:10:02.844 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5d6021d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93995987225840 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256d6fc0 con 0x7f5d580b6070 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== watch-notify(notify (1) cookie 93995986830368 notify 133143986194 ret 0) ==== 192+0+0 (crc 0 0 0) 0x557d2568b0e0 con 0x7f5d580b6070 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5c40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 93995986830368 notifier 4755 bl.length()=150 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5c40ff9640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5b880032c0 con 0x7f5d580b6070 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.835+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(137 notify.3 [notify cookie 93995987225840 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.836+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.836+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== watch-notify(notify_complete (2) cookie 93995987225840 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d2568d5b0 con 0x7f5d580b6070 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.836+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:139 8.f 8:f5aea8d2:root::.bucket.meta.myfoo7%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256bff50 con 0x557d256745e0 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 [call,call,delete] v31'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5d6021d800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 from cache 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5d6021d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10, ofs0, ns] 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 93995987225840 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256bff50 con 0x7f5d48037040 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== watch-notify(notify (1) cookie 93995986842848 notify 133143986218 ret 0) ==== 250+0+0 (crc 0 0 0) 0x557d2568de60 con 0x7f5d48037040 2024-05-15T18:10:02.845 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5c417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986218 cookie 93995986842848 notifier 4755 bl.length()=208 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5c417fa640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5c20003d60 con 0x7f5d48037040 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.837+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(140 notify.7 [notify cookie 93995987225840 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== watch-notify(notify_complete (2) cookie 93995987225840 notify 133143986218 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d25651a10 con 0x7f5d48037040 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:142 4.23 4:c45b4c17:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256bff50 con 0x7f5d48037040 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:143 4.14 4:28503ffb:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccf0 con 0x7f5d580b6070 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:144 4.20 4:065c1081:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256bff50 con 0x557d2566ff90 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:145 4.4 4:23033bfc:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256b9960 con 0x7f5d48037040 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:146 4.2a 4:56cce651:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256ba230 con 0x557d2566ff90 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:147 4.3c 4:3e9d4a24:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256bff50 con 0x557d2566ff90 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:148 4.1d 4:b8bb3fbe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256b9960 con 0x557d256745e0 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:149 4.1a 4:5bb7e231:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccf0 con 0x7f5d580b6070 2024-05-15T18:10:02.846 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:150 4.1 4:82bbd7e1:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256bff50 con 0x7f5d580b6070 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:151 4.3c 4:3e44790a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256cdc30 con 0x557d2566ff90 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.838+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:152 4.2b 4:d67f4e1e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccf0 con 0x557d2566ff90 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.839+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(142 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.0 [delete] v31'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.839+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(143 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.1 [delete] v31'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 35 ==== osd_op_reply(149 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.7 [delete] v31'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 36 ==== osd_op_reply(150 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.8 [delete] v31'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(145 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.3 [delete] v31'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(144 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.2 [delete] v31'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 45 ==== osd_op_reply(147 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.5 [delete] v31'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.849 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 46 ==== osd_op_reply(146 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.4 [delete] v31'11 uv11 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 47 ==== osd_op_reply(152 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.10 [delete] v31'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(148 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.6 [delete] v31'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 48 ==== osd_op_reply(151 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10.9 [delete] v31'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d6021d800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 : miss 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d6021d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:153 6.a 6:56a5913e:::pubsub..bucket.myfoo7%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccb0 con 0x7f5d580b6070 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 37 ==== osd_op_reply(153 pubsub..bucket.myfoo7/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d6021d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d6021d800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 info.flags=0x0 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.840+0000 7f5d6021d800 10 adding default.rgw.log++pubsub..bucket.myfoo7/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 to cache LRU end 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.841+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:154 6.a 6:56a5913e:::pubsub..bucket.myfoo7%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccb0 con 0x7f5d580b6070 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.842+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 38 ==== osd_op_reply(154 pubsub..bucket.myfoo7/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.10 [delete] v31'38 uv31 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.842+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccb0 con 0x7f5d48037040 2024-05-15T18:10:02.850 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.844+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(155 fud.buckets [call] v31'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.844+0000 7f5d6021d800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.844+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256dccb0 con 0x7f5d48037040 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.845+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v31'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.845+0000 7f5d6021d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.845+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 93995987599520 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256bb4a0 con 0x557d256745e0 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.845+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== watch-notify(notify (1) cookie 93995986827600 notify 133143986193 ret 0) ==== 212+0+0 (crc 0 0 0) 0x557d256baa50 con 0x557d256745e0 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.845+0000 7f5c40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 93995986827600 notifier 4755 bl.length()=170 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.845+0000 7f5c40ff9640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5b880032c0 con 0x557d256745e0 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.845+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(157 notify.2 [notify cookie 93995987599520 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.846+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.846+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== watch-notify(notify_complete (2) cookie 93995987599520 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d25650fa0 con 0x557d256745e0 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.846+0000 7f5d6021d800 10 removing email index: 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.846+0000 7f5d6021d800 10 removing user buckets index 2024-05-15T18:10:02.851 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.846+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256c9760 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.847+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(159 fud.buckets [delete] v31'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.847+0000 7f5d6021d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.847+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93995987599520 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256cec80 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.847+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== watch-notify(notify (1) cookie 93995986838112 notify 133143986219 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557d25651a10 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.847+0000 7f5c417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986219 cookie 93995986838112 notifier 4755 bl.length()=160 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.847+0000 7f5c417fa640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5c20003d60 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.847+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== osd_op_reply(160 notify.6 [notify cookie 93995987599520 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.848+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.848+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== watch-notify(notify_complete (2) cookie 93995987599520 notify 133143986219 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d2568b8b0 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.848+0000 7f5d6021d800 10 removing user index: fud 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.848+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d256cec80 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== osd_op_reply(162 fud [call,call,delete] v31'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d6021d800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-15T18:10:02.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d6021d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93995987168384 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d256bb4a0 con 0x7f5d48037040 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 47 ==== watch-notify(notify (1) cookie 93995986835408 notify 133143986220 ret 0) ==== 194+0+0 (crc 0 0 0) 0x557d2568b8b0 con 0x7f5d48037040 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5c40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986220 cookie 93995986835408 notifier 4755 bl.length()=152 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5c40ff9640 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5b880032c0 con 0x7f5d48037040 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 48 ==== osd_op_reply(163 notify.5 [notify cookie 93995987168384 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 49 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.849+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 50 ==== watch-notify(notify_complete (2) cookie 93995987168384 notify 133143986220 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d2568b6e0 con 0x7f5d48037040 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.850+0000 7f5c0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.850+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93995986844320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d25689380 con 0x557d2566ff90 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.851+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 49 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93995986844320] v31'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.851+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93995986818912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567faa0 con 0x7f5d580b6070 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.852+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 39 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93995986818912] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.852+0000 7f5d6021d800 20 remove_watcher() i=0 2024-05-15T18:10:02.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.852+0000 7f5d6021d800 2 removed watcher, disabling cache 2024-05-15T18:10:02.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.852+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93995986823920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567faa0 con 0x557d2566ff90 2024-05-15T18:10:02.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.854+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 50 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93995986823920] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.854+0000 7f5d6021d800 20 remove_watcher() i=1 2024-05-15T18:10:02.854 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.854+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93995986827600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567aaf0 con 0x557d256745e0 2024-05-15T18:10:02.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.855+0000 7f5d5dd1c640 1 -- 172.21.15.173:0/3621805847 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93995986827600] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d580bd070 con 0x557d256745e0 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.855+0000 7f5d6021d800 20 remove_watcher() i=2 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.855+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93995986830368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567faa0 con 0x7f5d580b6070 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.856+0000 7f5d5d51b640 1 -- 172.21.15.173:0/3621805847 <== osd.2 v2:172.21.15.173:6808/3098545592 40 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93995986830368] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d4804b040 con 0x7f5d580b6070 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.856+0000 7f5d6021d800 20 remove_watcher() i=3 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.856+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93995986832688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567b950 con 0x557d2566ff90 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.857+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.1 v2:172.21.15.173:6800/3225970667 51 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93995986832688] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x557d2566ff90 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.857+0000 7f5d6021d800 20 remove_watcher() i=4 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.857+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93995986835408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567aaf0 con 0x7f5d48037040 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.858+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 51 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93995986835408] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.858+0000 7f5d6021d800 20 remove_watcher() i=5 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.858+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93995986838112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567faa0 con 0x7f5d48037040 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.859+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 52 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93995986838112] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.859+0000 7f5d6021d800 20 remove_watcher() i=6 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.859+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93995986842848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d2567cd30 con 0x7f5d48037040 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 <== osd.0 v2:172.21.15.3:6800/774076599 53 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93995986842848] v31'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d500083e0 con 0x7f5d48037040 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 20 remove_watcher() i=7 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5d48037040 msgr2=0x7f5d48036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5d48037040 0x7f5d48036410 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d2566ff90 msgr2=0x557d25672450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d2566ff90 0x557d25672450 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5d580b6070 msgr2=0x7f5d58087680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5d580b6070 0x7f5d58087680 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d256745e0 msgr2=0x557d256769d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d256745e0 0x557d256769d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c28036900 msgr2=0x7f5c28038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c28036900 0x7f5c28038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5d48001b60 tx=0x7f5d48010000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3621805847 reap_dead start 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 msgr2=0x557d25664980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d25664980 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5d5807efd0 tx=0x7f5d580880d0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 shutdown_connections 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3621805847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d2565d740 0x557d25664980 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 >> 172.21.15.173:0/3621805847 conn(0x557d25659aa0 msgr2=0x557d25657100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 shutdown_connections 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.861+0000 7f5d6021d800 1 -- 172.21.15.173:0/3621805847 wait complete. 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c38036950 msgr2=0x7f5c38038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c38036950 0x7f5c38038e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bf50 tx=0x7f5d4800f000 comp rx=0 tx=0).stop 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25650640 msgr2=0x557d25650a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25650640 0x557d25650a60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5d5806d4d0 tx=0x7f5d5805bea0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 shutdown_connections 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c38036950 0x7f5c38038e10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/1309447133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25650640 0x557d25650a60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 >> 172.21.15.173:0/1309447133 conn(0x557d256446e0 msgr2=0x557d25644ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 shutdown_connections 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/1309447133 wait complete. 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d2563f590 msgr2=0x557d25641a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557d2563f590 0x557d25641a00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d25636980 msgr2=0x557d25638d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557d25636980 0x557d25638d70 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d2563b650 msgr2=0x557d2563da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557d2563b650 0x557d2563da40 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c44036900 msgr2=0x7f5c44038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5c44036900 0x7f5c44038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5d48000f60 tx=0x7f5d480012b0 comp rx=0 tx=0).stop 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25535350 msgr2=0x557d25631750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 --2- 172.21.15.173:0/3471806975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557d25535350 0x557d25631750 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5d58000f80 tx=0x7f5d58003330 comp rx=0 tx=0).stop 2024-05-15T18:10:02.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d5e51d640 1 -- 172.21.15.173:0/3471806975 reap_dead start 2024-05-15T18:10:02.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 shutdown_connections 2024-05-15T18:10:02.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 >> 172.21.15.173:0/3471806975 conn(0x557d255305b0 msgr2=0x557d25623bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:02.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 shutdown_connections 2024-05-15T18:10:02.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:02.862+0000 7f5d6021d800 1 -- 172.21.15.173:0/3471806975 wait complete. 2024-05-15T18:10:42.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-05-15T18:10:42.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-05-15T18:10:42.866 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-05-15T18:10:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:42.919 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.943+0000 7fc68932d800 1 Processor -- start 2024-05-15T18:10:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.943+0000 7fc68932d800 1 -- start start 2024-05-15T18:10:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc68932d800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d9ca377b60 0x55d9ca379f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc68932d800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9ca37dfa0 con 0x55d9ca37a490 2024-05-15T18:10:42.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc68932d800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55d9ca208050 con 0x55d9ca377b60 2024-05-15T18:10:42.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc684f7f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d9ca377b60 0x55d9ca379f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc68477e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55d9ca37a490 0x55d9ca37c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38560/0 (socket says 172.21.15.173:38560) 2024-05-15T18:10:42.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc68477e640 1 -- 172.21.15.173:0/3667854469 learned_addr learned my addr 172.21.15.173:0/3667854469 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:42.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc684f7f640 1 -- 172.21.15.173:0/3667854469 >> v1:172.21.15.3:6789/0 conn(0x55d9ca37a490 legacy=0x55d9ca37c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:42.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.944+0000 7fc684f7f640 1 -- 172.21.15.173:0/3667854469 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca37f180 con 0x55d9ca377b60 2024-05-15T18:10:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3667854469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca379f50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc674005fd0 tx=0x7fc67401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46226cbde3c6130 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc683f7d640 1 -- 172.21.15.173:0/3667854469 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc674052560 con 0x55d9ca377b60 2024-05-15T18:10:42.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc683f7d640 1 -- 172.21.15.173:0/3667854469 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc674052700 con 0x55d9ca377b60 2024-05-15T18:10:42.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc683f7d640 1 -- 172.21.15.173:0/3667854469 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc674052a60 con 0x55d9ca377b60 2024-05-15T18:10:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc68932d800 1 -- 172.21.15.173:0/3667854469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 msgr2=0x55d9ca379f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc68932d800 1 --2- 172.21.15.173:0/3667854469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca379f50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc674005fd0 tx=0x7fc67401ccc0 comp rx=0 tx=0).stop 2024-05-15T18:10:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc68932d800 1 -- 172.21.15.173:0/3667854469 shutdown_connections 2024-05-15T18:10:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc68932d800 1 --2- 172.21.15.173:0/3667854469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca379f50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc68932d800 1 -- 172.21.15.173:0/3667854469 >> 172.21.15.173:0/3667854469 conn(0x55d9ca3715b0 msgr2=0x55d9ca3739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc68932d800 1 -- 172.21.15.173:0/3667854469 shutdown_connections 2024-05-15T18:10:42.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.947+0000 7fc68932d800 1 -- 172.21.15.173:0/3667854469 wait complete. 2024-05-15T18:10:42.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.963+0000 7fc68932d800 1 Processor -- start 2024-05-15T18:10:42.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.963+0000 7fc68932d800 1 -- start start 2024-05-15T18:10:42.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.963+0000 7fc68932d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca3774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.963+0000 7fc68932d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca2c21d0 con 0x55d9ca377b60 2024-05-15T18:10:42.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca3774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca3774a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50002/0 (socket says 172.21.15.173:50002) 2024-05-15T18:10:42.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc684f7f640 1 -- 172.21.15.173:0/3176466942 learned_addr learned my addr 172.21.15.173:0/3176466942 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:42.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc684f7f640 1 -- 172.21.15.173:0/3176466942 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca375a60 con 0x55d9ca377b60 2024-05-15T18:10:42.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3176466942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca3774a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc674007000 tx=0x7fc67404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521a93e5d55ecd4d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc572e0d640 1 -- 172.21.15.173:0/3176466942 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6740529e0 con 0x55d9ca377b60 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc572e0d640 1 -- 172.21.15.173:0/3176466942 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc674052b80 con 0x55d9ca377b60 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.964+0000 7fc572e0d640 1 -- 172.21.15.173:0/3176466942 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67405c430 con 0x55d9ca377b60 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.965+0000 7fc68932d800 1 -- 172.21.15.173:0/3176466942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 msgr2=0x55d9ca3774a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.965+0000 7fc68932d800 1 --2- 172.21.15.173:0/3176466942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca3774a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc674007000 tx=0x7fc67404c000 comp rx=0 tx=0).stop 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.965+0000 7fc68932d800 1 -- 172.21.15.173:0/3176466942 shutdown_connections 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.965+0000 7fc68932d800 1 --2- 172.21.15.173:0/3176466942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca3774a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.965+0000 7fc68932d800 1 -- 172.21.15.173:0/3176466942 >> 172.21.15.173:0/3176466942 conn(0x55d9ca3715b0 msgr2=0x55d9ca463fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.965+0000 7fc68932d800 1 -- 172.21.15.173:0/3176466942 shutdown_connections 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.965+0000 7fc68932d800 1 -- 172.21.15.173:0/3176466942 wait complete. 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc68932d800 1 Processor -- start 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc68932d800 1 -- start start 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc68932d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca4723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc68932d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca37e410 con 0x55d9ca377b60 2024-05-15T18:10:42.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca4723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca4723a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50016/0 (socket says 172.21.15.173:50016) 2024-05-15T18:10:42.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc684f7f640 1 -- 172.21.15.173:0/3068566437 learned_addr learned my addr 172.21.15.173:0/3068566437 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:42.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.966+0000 7fc684f7f640 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca4728e0 con 0x55d9ca377b60 2024-05-15T18:10:42.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.967+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca4723a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc6740526d0 tx=0x7fc674003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.967+0000 7fc57160a640 1 -- 172.21.15.173:0/3068566437 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc674075070 con 0x55d9ca377b60 2024-05-15T18:10:42.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.967+0000 7fc57160a640 1 -- 172.21.15.173:0/3068566437 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc674070410 con 0x55d9ca377b60 2024-05-15T18:10:42.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.967+0000 7fc57160a640 1 -- 172.21.15.173:0/3068566437 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6740529e0 con 0x55d9ca377b60 2024-05-15T18:10:42.947 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.967+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9ca472b70 con 0x55d9ca377b60 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.967+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ca475820 con 0x55d9ca377b60 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.968+0000 7fc57160a640 1 -- 172.21.15.173:0/3068566437 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc674078070 con 0x55d9ca377b60 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.968+0000 7fc57160a640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc56c036950 0x7fc56c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.968+0000 7fc57160a640 1 -- 172.21.15.173:0/3068566437 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc67406d070 con 0x55d9ca377b60 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.968+0000 7fc68477e640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc56c036950 0x7fc56c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.968+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca37a490 0x55d9ca4795e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.968+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca479bb0 con 0x55d9ca37a490 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.968+0000 7fc685780640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca37a490 0x55d9ca4795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.969+0000 7fc68477e640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc56c036950 0x7fc56c038e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc678000f60 tx=0x7fc6780012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.969+0000 7fc685780640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca37a490 0x55d9ca4795e0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.969+0000 7fc685780640 1 -- 172.21.15.173:0/3068566437 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca37a490 2024-05-15T18:10:42.948 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.969+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca476b90 con 0x55d9ca37a490 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.969+0000 7fc685780640 1 -- 172.21.15.173:0/3068566437 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca37a490 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.969+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca47bf10 0x55d9ca47e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.969+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca47e9f0 con 0x55d9ca47bf10 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.970+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca47bf10 0x55d9ca47e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.970+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca47bf10 0x55d9ca47e300 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.970+0000 7fc684f7f640 1 -- 172.21.15.173:0/3068566437 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc674077030 con 0x55d9ca47bf10 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.970+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca47aec0 con 0x55d9ca37a490 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.970+0000 7fc685780640 1 -- 172.21.15.173:0/3068566437 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca37a490 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.970+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d9ca47fe50 0x55d9ca4822c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.970+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca482a20 con 0x55d9ca47fe50 2024-05-15T18:10:42.949 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.971+0000 7fc68477e640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d9ca47fe50 0x55d9ca4822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.971+0000 7fc68477e640 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d9ca47fe50 0x55d9ca4822c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc68477e640 1 -- 172.21.15.173:0/3068566437 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc678009050 con 0x55d9ca47fe50 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc68932d800 1 Processor -- start 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc68932d800 1 -- start start 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc68932d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca490e80 0x55d9ca4912a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc68932d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca268cf0 con 0x55d9ca490e80 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca490e80 0x55d9ca4912a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca490e80 0x55d9ca4912a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50018/0 (socket says 172.21.15.173:50018) 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.972+0000 7fc684f7f640 1 -- 172.21.15.173:0/2232167872 learned_addr learned my addr 172.21.15.173:0/2232167872 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.973+0000 7fc684f7f640 1 -- 172.21.15.173:0/2232167872 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca4917e0 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.973+0000 7fc684f7f640 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca490e80 0x55d9ca4912a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc67406ffd0 tx=0x7fc674078d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.973+0000 7fc56a7fc640 1 -- 172.21.15.173:0/2232167872 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc674066840 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.973+0000 7fc56a7fc640 1 -- 172.21.15.173:0/2232167872 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67408ea90 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.973+0000 7fc56a7fc640 1 -- 172.21.15.173:0/2232167872 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67408ed90 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.973+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9ca492250 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.973+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ca492750 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.974+0000 7fc56a7fc640 1 -- 172.21.15.173:0/2232167872 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc674070900 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.974+0000 7fc56a7fc640 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc55c036970 0x7fc55c038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.974+0000 7fc56a7fc640 1 -- 172.21.15.173:0/2232167872 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc674097b90 con 0x55d9ca490e80 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.974+0000 7fc68477e640 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc55c036970 0x7fc55c038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc68932d800 1 Processor -- start 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc68932d800 1 -- start start 2024-05-15T18:10:42.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc68477e640 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc55c036970 0x7fc55c038e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc67800bf50 tx=0x7fc67800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc68932d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca49e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc68932d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca375d80 con 0x55d9ca49e030 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca49e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca49e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50022/0 (socket says 172.21.15.173:50022) 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.975+0000 7fc684f7f640 1 -- 172.21.15.173:0/1250543631 learned_addr learned my addr 172.21.15.173:0/1250543631 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc684f7f640 1 -- 172.21.15.173:0/1250543631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca49ea20 con 0x55d9ca49e030 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc684f7f640 1 --2- 172.21.15.173:0/1250543631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca49e450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc67406fa50 tx=0x7fc67408e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6b68c6ebab7696 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc55bfff640 1 -- 172.21.15.173:0/1250543631 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67405b810 con 0x55d9ca49e030 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc55bfff640 1 -- 172.21.15.173:0/1250543631 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc674090110 con 0x55d9ca49e030 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc55bfff640 1 -- 172.21.15.173:0/1250543631 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67405b9b0 con 0x55d9ca49e030 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc68932d800 1 -- 172.21.15.173:0/1250543631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 msgr2=0x55d9ca49e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc68932d800 1 --2- 172.21.15.173:0/1250543631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca49e450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc67406fa50 tx=0x7fc67408e170 comp rx=0 tx=0).stop 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc68932d800 1 -- 172.21.15.173:0/1250543631 shutdown_connections 2024-05-15T18:10:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc68932d800 1 --2- 172.21.15.173:0/1250543631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca49e450 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc68932d800 1 -- 172.21.15.173:0/1250543631 >> 172.21.15.173:0/1250543631 conn(0x55d9ca49a390 msgr2=0x55d9ca4983f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc68932d800 1 -- 172.21.15.173:0/1250543631 shutdown_connections 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.976+0000 7fc68932d800 1 -- 172.21.15.173:0/1250543631 wait complete. 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.977+0000 7fc68932d800 1 Processor -- start 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.977+0000 7fc68932d800 1 -- start start 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.977+0000 7fc68932d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca4a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.977+0000 7fc68932d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9ca49f0d0 con 0x55d9ca49e030 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.977+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca4a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.977+0000 7fc684f7f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca4a5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50036/0 (socket says 172.21.15.173:50036) 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.977+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 learned_addr learned my addr 172.21.15.173:0/3622954842 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.978+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9ca4a5990 con 0x55d9ca49e030 2024-05-15T18:10:42.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.978+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca4a5450 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc67404c040 tx=0x7fc674050f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.978+0000 7fc55a7fc640 1 -- 172.21.15.173:0/3622954842 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6740bb070 con 0x55d9ca49e030 2024-05-15T18:10:42.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.978+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9ca4a5990 con 0x55d9ca49e030 2024-05-15T18:10:42.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.978+0000 7fc55a7fc640 1 -- 172.21.15.173:0/3622954842 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc67407a870 con 0x55d9ca49e030 2024-05-15T18:10:42.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.978+0000 7fc55a7fc640 1 -- 172.21.15.173:0/3622954842 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc67407ab50 con 0x55d9ca49e030 2024-05-15T18:10:42.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.978+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9ca4a5990 con 0x55d9ca49e030 2024-05-15T18:10:42.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.979+0000 7fc55a7fc640 1 -- 172.21.15.173:0/3622954842 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc6740be070 con 0x55d9ca49e030 2024-05-15T18:10:42.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.979+0000 7fc55a7fc640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc550036900 0x7fc550038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.979+0000 7fc55a7fc640 1 -- 172.21.15.173:0/3622954842 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fc6740a7070 con 0x55d9ca49e030 2024-05-15T18:10:42.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.979+0000 7fc68477e640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc550036900 0x7fc550038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68477e640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc550036900 0x7fc550038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc678001b60 tx=0x7fc678010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca4b0a70 0x55d9ca4b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b3680 con 0x55d9ca4b0a70 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc685780640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca4b0a70 0x55d9ca4b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc685780640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca4b0a70 0x55d9ca4b2f30 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68932d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68932d800 20 realm 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.980+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b3a90 con 0x55d9ca4b0a70 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:42.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b0a70 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4700 con 0x55d9ca4b0a70 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca4b50c0 0x55d9ca4b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b7ac0 con 0x55d9ca4b50c0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.981+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca4b50c0 0x55d9ca4b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca4b50c0 0x55d9ca4b74b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.975 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc68932d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc68932d800 20 searching for the correct realm 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b93f0 con 0x55d9ca4b50c0 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc684f7f640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc6740c0060 0x7fc6740a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b93f0 con 0x7fc6740c0060 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.982+0000 7fc68477e640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc6740c0060 0x7fc6740a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.983+0000 7fc68477e640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc6740c0060 0x7fc6740a08a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.983+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.983+0000 7fc68477e640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc678037040 0x7fc678036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.983+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b93f0 con 0x7fc678037040 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.983+0000 7fc685780640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc678037040 0x7fc678036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.984+0000 7fc685780640 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc678037040 0x7fc678036410 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.984+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.984+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b0a70 2024-05-15T18:10:42.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.984+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.984+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b0a70 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.985+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.985+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x7fc678037040 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.985+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.985+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x7fc678037040 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.985+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.985+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x7fc6740c0060 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b50c0 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b0a70 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x7fc678037040 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.986+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b0a70 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x7fc6740c0060 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.987+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x7fc678037040 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b0a70 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.988+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b0a70 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.989+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.989+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x7fc678037040 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.989+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.989+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b50c0 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.989+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.989+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x7fc6740c0060 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.990+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.990+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b0a70 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.990+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.990+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x7fc678037040 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.990+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.990+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b50c0 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.991+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.991+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x7fc678037040 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.991+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.991+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x7fc6740c0060 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.991+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.991+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b50c0 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x7fc6740c0060 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x55d9ca4b0a70 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fc67c026040 con 0x7fc6740c0060 2024-05-15T18:10:42.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.992+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b0a70 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x55d9ca4b0a70 2024-05-15T18:10:42.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b4360 con 0x7fc678037040 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 zone default found 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 4 Realm: () 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 zonegroup default 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.993+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b88c0 con 0x7fc678037040 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b8410 con 0x55d9ca4b50c0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4b8870 con 0x55d9ca4b50c0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 20 started sync module instance, tier type = 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.994+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4ba6f0 con 0x7fc6740c0060 2024-05-15T18:10:42.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.995+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.995+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393890218560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bb0c0 con 0x7fc6740c0060 2024-05-15T18:10:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.995+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bbb90 con 0x55d9ca4b0a70 2024-05-15T18:10:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.996+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94393890218560] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.997+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.997+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393890223744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bbfb0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.997+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bca00 con 0x55d9ca4b50c0 2024-05-15T18:10:42.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.998+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.998+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393890227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bd2a0 con 0x55d9ca4b50c0 2024-05-15T18:10:42.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.998+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bdda0 con 0x7fc6740c0060 2024-05-15T18:10:42.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.998+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94393890223744] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.999+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.999+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393890220816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4be640 con 0x7fc6740c0060 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:42.999+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bf000 con 0x55d9ca4b0a70 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.000+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94393890227440] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.001+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94393890220816] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.001+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.001+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393890229744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bf000 con 0x55d9ca4b0a70 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.001+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bf8a0 con 0x7fc678037040 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.002+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.002+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393890238944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bfcd0 con 0x7fc678037040 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.002+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4c07e0 con 0x7fc678037040 2024-05-15T18:10:42.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.002+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94393890229744] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.003+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94393890238944] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.003+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.003+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393890243216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bf6c0 con 0x7fc678037040 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.003+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4c0dc0 con 0x7fc678037040 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94393890243216] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393890237264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4c0dc0 con 0x7fc678037040 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 20 add_watcher() i=0 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 20 add_watcher() i=1 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 20 add_watcher() i=2 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 20 add_watcher() i=3 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 20 add_watcher() i=4 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 20 add_watcher() i=5 2024-05-15T18:10:42.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.004+0000 7fc68932d800 20 add_watcher() i=6 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.006+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94393890237264] v31'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.006+0000 7fc68932d800 20 add_watcher() i=7 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.006+0000 7fc68932d800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.006+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4c4140 con 0x55d9ca4b0a70 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.006+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.006+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393890257696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4c0f30 con 0x55d9ca4b0a70 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.007+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94393890257696] v31'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.007+0000 7fc53b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.007+0000 7fc68932d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.007+0000 7fc68932d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.007+0000 7fc68932d800 5 note: GC not initialized 2024-05-15T18:10:42.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.008+0000 7fc53a7e4640 20 reqs_thread_entry: start 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.008+0000 7fc68932d800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.008+0000 7fc68932d800 20 Filter name: none 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.008+0000 7fc5337fe640 20 reqs_thread_entry: start 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.008+0000 7fc68932d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.008+0000 7fc68932d800 20 rados->read ofs=0 len=0 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.008+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4f7560 con 0x55d9ca4b0a70 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.009+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.009+0000 7fc68932d800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.009+0000 7fc68932d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.009+0000 7fc68932d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.009+0000 7fc68932d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:42.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.009+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4f7040 con 0x7fc678037040 2024-05-15T18:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.010+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 usage.10 [call] v31'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.010+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4f7040 con 0x7fc678037040 2024-05-15T18:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.012+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 usage.10 [call] v31'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.012+0000 7fc53b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:42.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.012+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393890257696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4f7040 con 0x55d9ca4b0a70 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.014+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94393890257696] v31'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.014+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393890218560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4f7040 con 0x7fc6740c0060 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.015+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94393890218560] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.015+0000 7fc68932d800 20 remove_watcher() i=0 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.015+0000 7fc68932d800 2 removed watcher, disabling cache 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.015+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393890223744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4ba240 con 0x55d9ca4b0a70 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.016+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94393890223744] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.016+0000 7fc68932d800 20 remove_watcher() i=1 2024-05-15T18:10:42.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.016+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393890227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bb680 con 0x55d9ca4b50c0 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.017+0000 7fc684f7f640 1 -- 172.21.15.173:0/3622954842 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94393890227440] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6740bd030 con 0x55d9ca4b50c0 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.017+0000 7fc68932d800 20 remove_watcher() i=2 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.017+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393890220816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bb680 con 0x7fc6740c0060 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.018+0000 7fc68477e640 1 -- 172.21.15.173:0/3622954842 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94393890220816] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc678009050 con 0x7fc6740c0060 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.018+0000 7fc68932d800 20 remove_watcher() i=3 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.018+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393890229744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bb680 con 0x55d9ca4b0a70 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.020+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94393890229744] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x55d9ca4b0a70 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.020+0000 7fc68932d800 20 remove_watcher() i=4 2024-05-15T18:10:42.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.020+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393890238944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bb680 con 0x7fc678037040 2024-05-15T18:10:42.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.021+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94393890238944] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.021+0000 7fc68932d800 20 remove_watcher() i=5 2024-05-15T18:10:42.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.021+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393890243216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4bf1e0 con 0x7fc678037040 2024-05-15T18:10:42.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.022+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94393890243216] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:42.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.022+0000 7fc68932d800 20 remove_watcher() i=6 2024-05-15T18:10:42.998 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.022+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393890237264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d9ca4c0290 con 0x7fc678037040 2024-05-15T18:10:43.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94393890237264] v31'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc67c0083e0 con 0x7fc678037040 2024-05-15T18:10:43.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 20 remove_watcher() i=7 2024-05-15T18:10:43.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc678037040 msgr2=0x7fc678036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fc678037040 0x7fc678036410 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca4b0a70 msgr2=0x55d9ca4b2f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca4b0a70 0x55d9ca4b2f30 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc6740c0060 msgr2=0x7fc6740a08a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fc6740c0060 0x7fc6740a08a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca4b50c0 msgr2=0x55d9ca4b74b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca4b50c0 0x55d9ca4b74b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc550036900 msgr2=0x7fc550038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc550036900 0x7fc550038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc678001b60 tx=0x7fc678010000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc685780640 1 -- 172.21.15.173:0/3622954842 reap_dead start 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 msgr2=0x55d9ca4a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.023+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca4a5450 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc67404c040 tx=0x7fc674050f60 comp rx=0 tx=0).stop 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 shutdown_connections 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/3622954842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca49e030 0x55d9ca4a5450 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 >> 172.21.15.173:0/3622954842 conn(0x55d9ca49a390 msgr2=0x55d9ca4979f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 shutdown_connections 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/3622954842 wait complete. 2024-05-15T18:10:43.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc55c036970 msgr2=0x7fc55c038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc55c036970 0x7fc55c038e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc67800bf50 tx=0x7fc67800f000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca490e80 msgr2=0x55d9ca4912a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca490e80 0x55d9ca4912a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc67406ffd0 tx=0x7fc674078d40 comp rx=0 tx=0).stop 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 shutdown_connections 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc55c036970 0x7fc55c038e30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/2232167872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca490e80 0x55d9ca4912a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 >> 172.21.15.173:0/2232167872 conn(0x55d9ca484f20 msgr2=0x55d9ca485320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 shutdown_connections 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/2232167872 wait complete. 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d9ca47fe50 msgr2=0x55d9ca4822c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55d9ca47fe50 0x55d9ca4822c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca37a490 msgr2=0x55d9ca4795e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9ca37a490 0x55d9ca4795e0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca47bf10 msgr2=0x55d9ca47e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.024+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9ca47bf10 0x55d9ca47e300 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc56c036950 msgr2=0x7fc56c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc56c036950 0x7fc56c038e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc678000f60 tx=0x7fc6780012b0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 msgr2=0x55d9ca4723a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 --2- 172.21.15.173:0/3068566437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9ca377b60 0x55d9ca4723a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc6740526d0 tx=0x7fc674003330 comp rx=0 tx=0).stop 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc685780640 1 -- 172.21.15.173:0/3068566437 reap_dead start 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 shutdown_connections 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 >> 172.21.15.173:0/3068566437 conn(0x55d9ca3715b0 msgr2=0x55d9ca3762e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 shutdown_connections 2024-05-15T18:10:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.025+0000 7fc68932d800 1 -- 172.21.15.173:0/3068566437 wait complete. 2024-05-15T18:10:43.010 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-15T18:10:43.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-15T18:10:43.010 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-15T18:10:43.054 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.054 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f330ab25800 1 Processor -- start 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f330ab25800 1 -- start start 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f330ab25800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x556faaff29e0 0x556faaff2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f330ab25800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556faaf67a60 con 0x556faaff3340 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f330ab25800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x556faae85050 con 0x556faaff29e0 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f33068b7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x556faaff29e0 0x556faaff2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f32fe0b6640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x556faaff3340 0x556faaff37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38564/0 (socket says 172.21.15.173:38564) 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.079+0000 7f32fe0b6640 1 -- 172.21.15.173:0/635034873 learned_addr learned my addr 172.21.15.173:0/635034873 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:43.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.080+0000 7f33068b7640 1 -- 172.21.15.173:0/635034873 >> v1:172.21.15.3:6789/0 conn(0x556faaff3340 legacy=0x556faaff37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.080+0000 7f33068b7640 1 -- 172.21.15.173:0/635034873 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556faaff3f00 con 0x556faaff29e0 2024-05-15T18:10:43.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.081+0000 7f33068b7640 1 --2- 172.21.15.173:0/635034873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556faaff2e00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f32f800a470 tx=0x7f32f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6df4b129ff8f39e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f33060b6640 1 -- 172.21.15.173:0/635034873 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8057070 con 0x556faaff29e0 2024-05-15T18:10:43.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f33060b6640 1 -- 172.21.15.173:0/635034873 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f8052570 con 0x556faaff29e0 2024-05-15T18:10:43.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f33060b6640 1 -- 172.21.15.173:0/635034873 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8052870 con 0x556faaff29e0 2024-05-15T18:10:43.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f330ab25800 1 -- 172.21.15.173:0/635034873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 msgr2=0x556faaff2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f330ab25800 1 --2- 172.21.15.173:0/635034873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556faaff2e00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f32f800a470 tx=0x7f32f801ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:43.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f330ab25800 1 -- 172.21.15.173:0/635034873 shutdown_connections 2024-05-15T18:10:43.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f330ab25800 1 --2- 172.21.15.173:0/635034873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556faaff2e00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f330ab25800 1 -- 172.21.15.173:0/635034873 >> 172.21.15.173:0/635034873 conn(0x556faafee5a0 msgr2=0x556faaff09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f330ab25800 1 -- 172.21.15.173:0/635034873 shutdown_connections 2024-05-15T18:10:43.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.082+0000 7f330ab25800 1 -- 172.21.15.173:0/635034873 wait complete. 2024-05-15T18:10:43.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.096+0000 7f330ab25800 1 Processor -- start 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.096+0000 7f330ab25800 1 -- start start 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.096+0000 7f330ab25800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.096+0000 7f330ab25800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556faaf3f1d0 con 0x556faaff29e0 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.096+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.096+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0e7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50052/0 (socket says 172.21.15.173:50052) 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.096+0000 7f33068b7640 1 -- 172.21.15.173:0/134521998 learned_addr learned my addr 172.21.15.173:0/134521998 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.097+0000 7f33068b7640 1 -- 172.21.15.173:0/134521998 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fab0e8070 con 0x556faaff29e0 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.097+0000 7f33068b7640 1 --2- 172.21.15.173:0/134521998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0e7aa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f32f801ced0 tx=0x7f32f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1760b03d3c55071 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.097+0000 7f31f4e09640 1 -- 172.21.15.173:0/134521998 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8057040 con 0x556faaff29e0 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.097+0000 7f31f4e09640 1 -- 172.21.15.173:0/134521998 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f80529a0 con 0x556faaff29e0 2024-05-15T18:10:43.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.097+0000 7f31f4e09640 1 -- 172.21.15.173:0/134521998 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8052cc0 con 0x556faaff29e0 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 -- 172.21.15.173:0/134521998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 msgr2=0x556fab0e7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 --2- 172.21.15.173:0/134521998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0e7aa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f32f801ced0 tx=0x7f32f804c000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 -- 172.21.15.173:0/134521998 shutdown_connections 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 --2- 172.21.15.173:0/134521998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0e7aa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 -- 172.21.15.173:0/134521998 >> 172.21.15.173:0/134521998 conn(0x556faafee5a0 msgr2=0x556fab0e33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 -- 172.21.15.173:0/134521998 shutdown_connections 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 -- 172.21.15.173:0/134521998 wait complete. 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 Processor -- start 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 -- start start 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f330ab25800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556faaff4430 con 0x556faaff29e0 2024-05-15T18:10:43.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0ef520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50058/0 (socket says 172.21.15.173:50058) 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.098+0000 7f33068b7640 1 -- 172.21.15.173:0/4000940296 learned_addr learned my addr 172.21.15.173:0/4000940296 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.099+0000 7f33068b7640 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fab0efa60 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.099+0000 7f33068b7640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0ef520 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.099+0000 7f31f3606640 1 -- 172.21.15.173:0/4000940296 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8073070 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.099+0000 7f31f3606640 1 -- 172.21.15.173:0/4000940296 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f805d780 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.099+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fab0efcf0 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.099+0000 7f31f3606640 1 -- 172.21.15.173:0/4000940296 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8057070 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.099+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fab0f29a0 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.100+0000 7f31f3606640 1 -- 172.21.15.173:0/4000940296 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f32f8076070 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.100+0000 7f31f3606640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31ec036900 0x7f31ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.100+0000 7f31f3606640 1 -- 172.21.15.173:0/4000940296 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f32f808dea0 con 0x556faaff29e0 2024-05-15T18:10:43.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.100+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31ec036900 0x7f31ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.100+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556faaff3340 0x556fab0f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.100+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab0f6d40 con 0x556faaff3340 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.100+0000 7f33070b8640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556faaff3340 0x556fab0f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31ec036900 0x7f31ec038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32f0000f60 tx=0x7f32f00012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f33070b8640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556faaff3340 0x556fab0f6760 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f33070b8640 1 -- 172.21.15.173:0/4000940296 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556faaff3340 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab0f3d30 con 0x556faaff3340 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f33070b8640 1 -- 172.21.15.173:0/4000940296 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f330000a4a0 con 0x556faaff3340 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab0f9090 0x556fab0fb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab0fbb20 con 0x556fab0f9090 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.101+0000 7f33068b7640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab0f9090 0x556fab0fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.102+0000 7f33068b7640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab0f9090 0x556fab0fb480 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.081 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.102+0000 7f33068b7640 1 -- 172.21.15.173:0/4000940296 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32f8075030 con 0x556fab0f9090 2024-05-15T18:10:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.102+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab0f8040 con 0x556faaff3340 2024-05-15T18:10:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.102+0000 7f33070b8640 1 -- 172.21.15.173:0/4000940296 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f330000a4a0 con 0x556faaff3340 2024-05-15T18:10:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.102+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556fab0fcfd0 0x556fab0ff420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.102+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab0ffb80 con 0x556fab0fcfd0 2024-05-15T18:10:43.082 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.102+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556fab0fcfd0 0x556fab0ff420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.103+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556fab0fcfd0 0x556fab0ff420 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.103+0000 7f32fe0b6640 1 -- 172.21.15.173:0/4000940296 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32f0009050 con 0x556fab0fcfd0 2024-05-15T18:10:43.096 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f330ab25800 1 Processor -- start 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f330ab25800 1 -- start start 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f330ab25800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab10dfe0 0x556fab10e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f330ab25800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556faaee5cf0 con 0x556fab10dfe0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab10dfe0 0x556fab10e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab10dfe0 0x556fab10e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50068/0 (socket says 172.21.15.173:50068) 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f33068b7640 1 -- 172.21.15.173:0/2427758336 learned_addr learned my addr 172.21.15.173:0/2427758336 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.104+0000 7f33068b7640 1 -- 172.21.15.173:0/2427758336 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fab10e940 con 0x556fab10dfe0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.105+0000 7f33068b7640 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab10dfe0 0x556fab10e400 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f32f808c3c0 tx=0x7f32f805cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.105+0000 7f31f0e01640 1 -- 172.21.15.173:0/2427758336 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f80774e0 con 0x556fab10dfe0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.105+0000 7f31f0e01640 1 -- 172.21.15.173:0/2427758336 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f8089070 con 0x556fab10dfe0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.105+0000 7f31f0e01640 1 -- 172.21.15.173:0/2427758336 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f80777b0 con 0x556fab10dfe0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.105+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fab10f3b0 con 0x556fab10dfe0 2024-05-15T18:10:43.097 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.105+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fab10f8b0 con 0x556fab10dfe0 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.106+0000 7f31f0e01640 1 -- 172.21.15.173:0/2427758336 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f32f8076360 con 0x556fab10dfe0 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.106+0000 7f31f0e01640 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31e0036950 0x7f31e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.106+0000 7f31f0e01640 1 -- 172.21.15.173:0/2427758336 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f32f8093bc0 con 0x556fab10dfe0 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.106+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31e0036950 0x7f31e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.106+0000 7f330ab25800 1 Processor -- start 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.106+0000 7f330ab25800 1 -- start start 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.106+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31e0036950 0x7f31e0038e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f32f000bf50 tx=0x7f32f000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f330ab25800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab11b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f330ab25800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556fab0e8330 con 0x556fab11b100 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab11b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab11b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50074/0 (socket says 172.21.15.173:50074) 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f33068b7640 1 -- 172.21.15.173:0/2900988211 learned_addr learned my addr 172.21.15.173:0/2900988211 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f33068b7640 1 -- 172.21.15.173:0/2900988211 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fab11baf0 con 0x556fab11b100 2024-05-15T18:10:43.098 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f33068b7640 1 --2- 172.21.15.173:0/2900988211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab11b520 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f32f8066a30 tx=0x7f32f806edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ec3b47389f114f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f31ea7fc640 1 -- 172.21.15.173:0/2900988211 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8085d20 con 0x556fab11b100 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f31ea7fc640 1 -- 172.21.15.173:0/2900988211 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f805b570 con 0x556fab11b100 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.107+0000 7f31ea7fc640 1 -- 172.21.15.173:0/2900988211 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f8076650 con 0x556fab11b100 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 -- 172.21.15.173:0/2900988211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 msgr2=0x556fab11b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 --2- 172.21.15.173:0/2900988211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab11b520 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f32f8066a30 tx=0x7f32f806edf0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 -- 172.21.15.173:0/2900988211 shutdown_connections 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 --2- 172.21.15.173:0/2900988211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab11b520 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 -- 172.21.15.173:0/2900988211 >> 172.21.15.173:0/2900988211 conn(0x556fab117460 msgr2=0x556fab1154c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 -- 172.21.15.173:0/2900988211 shutdown_connections 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 -- 172.21.15.173:0/2900988211 wait complete. 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 Processor -- start 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 -- start start 2024-05-15T18:10:43.099 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab1224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.108+0000 7f330ab25800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556fab11c1a0 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab1224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f33068b7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab1224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50082/0 (socket says 172.21.15.173:50082) 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 learned_addr learned my addr 172.21.15.173:0/3365989029 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fab122a10 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f33068b7640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab1224d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f32f8095f80 tx=0x7f32f8095f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f31e8ff9640 1 -- 172.21.15.173:0/3365989029 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f80b4020 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f31e8ff9640 1 -- 172.21.15.173:0/3365989029 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f8076650 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556fab122a10 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f31e8ff9640 1 -- 172.21.15.173:0/3365989029 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f806ca10 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.109+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fab122a10 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.110+0000 7f31e8ff9640 1 -- 172.21.15.173:0/3365989029 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f32f80b7020 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.110+0000 7f31e8ff9640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31d0036900 0x7f31d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.110+0000 7f31e8ff9640 1 -- 172.21.15.173:0/3365989029 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f32f80ab050 con 0x556fab11b100 2024-05-15T18:10:43.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.110+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31d0036900 0x7f31d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.110+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556fab12dc30 0x556fab1300f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab130840 con 0x556fab12dc30 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f33070b8640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556fab12dc30 0x556fab1300f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31d0036900 0x7f31d0038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001b60 tx=0x7f32f0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f33070b8640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556fab12dc30 0x556fab1300f0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 20 realm 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab130c50 con 0x556fab12dc30 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.101 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.111+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab131520 con 0x556fab12dc30 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab1323b0 0x556fab1347a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab134f00 con 0x556fab1323b0 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f33068b7640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab1323b0 0x556fab1347a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.102 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f33068b7640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab1323b0 0x556fab1347a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 20 searching for the correct realm 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.112+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1368e0 con 0x556fab1323b0 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.113+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.113+0000 7f33068b7640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f32f80b9020 0x7f32f8093050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.113+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1368e0 con 0x7f32f80b9020 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.113+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f32f80b9020 0x7f32f8093050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.113+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f32f80b9020 0x7f32f8093050 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.113+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f0009050 con 0x7f32f80b9020 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.114+0000 7f32fe0b6640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f32f0038040 0x7f32f001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.114+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1368e0 con 0x7f32f0038040 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.114+0000 7f33070b8640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f32f0038040 0x7f32f001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.114+0000 7f33070b8640 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f32f0038040 0x7f32f001bab0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f0038040 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.115+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f0038040 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f80b9020 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f0009050 con 0x7f32f80b9020 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.116+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f0038040 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f80b9020 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32f0009050 con 0x7f32f80b9020 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.117+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.118+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.118+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f0038040 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.118+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.118+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.118+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.118+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f0038040 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.119+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.120+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f80b9020 2024-05-15T18:10:43.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.120+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f0009050 con 0x7f32f80b9020 2024-05-15T18:10:43.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.120+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.120+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.120+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f0038040 2024-05-15T18:10:43.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.120+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.120+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f0038040 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f80b9020 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f0009050 con 0x7f32f80b9020 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab1323b0 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.121+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f80b9020 2024-05-15T18:10:43.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x556fab12dc30 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556fab1318c0 con 0x7f32f80b9020 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab1358b0 con 0x556fab12dc30 2024-05-15T18:10:43.118 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab135ca0 con 0x556fab12dc30 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.122+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab135ca0 con 0x7f32f0038040 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 zone default found 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 4 Realm: () 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:43.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 zonegroup default 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab1360c0 con 0x7f32f0038040 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab1364e0 con 0x556fab1323b0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.123+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.124+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab138790 con 0x556fab1323b0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.124+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.124+0000 7f330ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.124+0000 7f330ab25800 20 started sync module instance, tier type = 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.124+0000 7f330ab25800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.124+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab137c30 con 0x7f32f80b9020 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.125+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.125+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93938099912784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab137890 con 0x7f32f80b9020 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.125+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab139690 con 0x556fab12dc30 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.126+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93938099912784] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.126+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.126+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93938099915648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab139a80 con 0x556fab12dc30 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.126+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13a440 con 0x556fab1323b0 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.127+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93938099915648] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.128+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.128+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93938099920784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13a7e0 con 0x556fab1323b0 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.128+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13b220 con 0x7f32f80b9020 2024-05-15T18:10:43.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.129+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.129+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93938099924208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13bac0 con 0x7f32f80b9020 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.129+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13c5a0 con 0x556fab12dc30 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.129+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93938099920784] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.130+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93938099924208] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.130+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.130+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93938099926544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13c0b0 con 0x556fab12dc30 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.130+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13cfe0 con 0x7f32f0038040 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.131+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93938099926544] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.131+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.131+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93938099917216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13cfe0 con 0x7f32f0038040 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.131+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13d890 con 0x7f32f0038040 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.132+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93938099917216] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.132+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.132+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93938099931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13da70 con 0x7f32f0038040 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.132+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13e2c0 con 0x7f32f0038040 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.133+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93938099931952] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.133+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93938099935856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13e340 con 0x7f32f0038040 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=0 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=1 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=2 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=3 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=4 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=5 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=6 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93938099935856] v31'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 20 add_watcher() i=7 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.134+0000 7f330ab25800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.135+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab1415d0 con 0x556fab12dc30 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.135+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.135+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93938099937280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13e8d0 con 0x556fab12dc30 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.136+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93938099937280] v31'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.136+0000 7f31bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.136+0000 7f330ab25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.136+0000 7f330ab25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.136+0000 7f330ab25800 5 note: GC not initialized 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.136+0000 7f3137fff640 20 reqs_thread_entry: start 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f330ab25800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f330ab25800 20 Filter name: none 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f3135ffb640 20 reqs_thread_entry: start 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f330ab25800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab1746d0 con 0x556fab12dc30 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f330ab25800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.137+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556fab175ac0 con 0x7f32f0038040 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.138+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.138+0000 7f31bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.138+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93938099937280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab140750 con 0x556fab12dc30 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.139+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93938099937280] v31'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.139+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93938099912784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab13e000 con 0x7f32f80b9020 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.140+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93938099912784] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.140+0000 7f330ab25800 20 remove_watcher() i=0 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.140+0000 7f330ab25800 2 removed watcher, disabling cache 2024-05-15T18:10:43.125 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.140+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93938099915648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab138050 con 0x556fab12dc30 2024-05-15T18:10:43.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.142+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93938099915648] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.142+0000 7f330ab25800 20 remove_watcher() i=1 2024-05-15T18:10:43.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.142+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93938099920784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab138050 con 0x556fab1323b0 2024-05-15T18:10:43.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.143+0000 7f33068b7640 1 -- 172.21.15.173:0/3365989029 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93938099920784] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f8099070 con 0x556fab1323b0 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.143+0000 7f330ab25800 20 remove_watcher() i=2 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.143+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93938099924208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab139f90 con 0x7f32f80b9020 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.144+0000 7f32fe0b6640 1 -- 172.21.15.173:0/3365989029 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93938099924208] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32f0045040 con 0x7f32f80b9020 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.144+0000 7f330ab25800 20 remove_watcher() i=3 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.144+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93938099926544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab138050 con 0x556fab12dc30 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.145+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93938099926544] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x556fab12dc30 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.145+0000 7f330ab25800 20 remove_watcher() i=4 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.145+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93938099917216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab139f90 con 0x7f32f0038040 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.146+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93938099917216] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.146+0000 7f330ab25800 20 remove_watcher() i=5 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.146+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93938099931952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab138050 con 0x7f32f0038040 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.148+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93938099931952] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.148+0000 7f330ab25800 20 remove_watcher() i=6 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.148+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93938099935856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556fab139f90 con 0x7f32f0038040 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93938099935856] v31'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f330000a4a0 con 0x7f32f0038040 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 20 remove_watcher() i=7 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f32f0038040 msgr2=0x7f32f001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f32f0038040 0x7f32f001bab0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556fab12dc30 msgr2=0x556fab1300f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556fab12dc30 0x556fab1300f0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f32f80b9020 msgr2=0x7f32f8093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f32f80b9020 0x7f32f8093050 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab1323b0 msgr2=0x556fab1347a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab1323b0 0x556fab1347a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31d0036900 msgr2=0x7f31d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31d0036900 0x7f31d0038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001b60 tx=0x7f32f0010000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 msgr2=0x556fab1224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f33070b8640 1 -- 172.21.15.173:0/3365989029 reap_dead start 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab1224d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f32f8095f80 tx=0x7f32f8095f10 comp rx=0 tx=0).stop 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 shutdown_connections 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 --2- 172.21.15.173:0/3365989029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab11b100 0x556fab1224d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 >> 172.21.15.173:0/3365989029 conn(0x556fab117460 msgr2=0x556fab114ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 shutdown_connections 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.149+0000 7f330ab25800 1 -- 172.21.15.173:0/3365989029 wait complete. 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31e0036950 msgr2=0x7f31e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31e0036950 0x7f31e0038e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f32f000bf50 tx=0x7f32f000f000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab10dfe0 msgr2=0x556fab10e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab10dfe0 0x556fab10e400 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f32f808c3c0 tx=0x7f32f805cf90 comp rx=0 tx=0).stop 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 shutdown_connections 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31e0036950 0x7f31e0038e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/2427758336 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556fab10dfe0 0x556fab10e400 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 >> 172.21.15.173:0/2427758336 conn(0x556fab102080 msgr2=0x556fab102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 shutdown_connections 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/2427758336 wait complete. 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556fab0fcfd0 msgr2=0x556fab0ff420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556fab0fcfd0 0x556fab0ff420 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556faaff3340 msgr2=0x556fab0f6760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556faaff3340 0x556fab0f6760 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab0f9090 msgr2=0x556fab0fb480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556fab0f9090 0x556fab0fb480 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31ec036900 msgr2=0x7f31ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f31ec036900 0x7f31ec038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32f0000f60 tx=0x7f32f00012b0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 msgr2=0x556fab0ef520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 --2- 172.21.15.173:0/4000940296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556faaff29e0 0x556fab0ef520 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c00 tx=0x7f32f8003020 comp rx=0 tx=0).stop 2024-05-15T18:10:43.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f33070b8640 1 -- 172.21.15.173:0/4000940296 reap_dead start 2024-05-15T18:10:43.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 shutdown_connections 2024-05-15T18:10:43.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 >> 172.21.15.173:0/4000940296 conn(0x556faafee5a0 msgr2=0x556fab0e1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 shutdown_connections 2024-05-15T18:10:43.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.150+0000 7f330ab25800 1 -- 172.21.15.173:0/4000940296 wait complete. 2024-05-15T18:10:43.136 INFO:teuthology.orchestra.run.smithi173.stdout:{"entries":[],"summary":[]} 2024-05-15T18:10:43.136 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-15T18:10:43.136 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-15T18:10:43.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-15T18:10:43.136 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-05-15T18:10:43.182 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.183 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb80ee11800 1 Processor -- start 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb80ee11800 1 -- start start 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb80ee11800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5594f0825590 0x5594f0827980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb80ee11800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594f0827f50 con 0x5594f0821150 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb80ee11800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5594f06b2050 con 0x5594f0825590 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb80a4fd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5594f0821150 0x5594f0821570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38574/0 (socket says 172.21.15.173:38574) 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb80a4fd640 1 -- 172.21.15.173:0/2163130101 learned_addr learned my addr 172.21.15.173:0/2163130101 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.207+0000 7fb809cfc640 1 --2- 172.21.15.173:0/2163130101 >> v2:172.21.15.3:3300/0 conn(0x5594f0825590 0x5594f0827980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.208+0000 7fb8094fb640 1 -- 172.21.15.173:0/2163130101 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122308498 0 0) 0x5594f0827f50 con 0x5594f0821150 2024-05-15T18:10:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.208+0000 7fb8094fb640 1 -- 172.21.15.173:0/2163130101 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f4001e10 con 0x5594f0821150 2024-05-15T18:10:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.208+0000 7fb809cfc640 1 -- 172.21.15.173:0/2163130101 >> v1:172.21.15.3:6789/0 conn(0x5594f0821150 legacy=0x5594f0821570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.208+0000 7fb809cfc640 1 -- 172.21.15.173:0/2163130101 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f0829180 con 0x5594f0825590 2024-05-15T18:10:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb809cfc640 1 --2- 172.21.15.173:0/2163130101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0825590 0x5594f0827980 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb80000a470 tx=0x7fb80001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0f811b7f8fc84e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb8094fb640 1 -- 172.21.15.173:0/2163130101 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb800057070 con 0x5594f0825590 2024-05-15T18:10:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb8094fb640 1 -- 172.21.15.173:0/2163130101 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb800052570 con 0x5594f0825590 2024-05-15T18:10:43.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb8094fb640 1 -- 172.21.15.173:0/2163130101 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb800052870 con 0x5594f0825590 2024-05-15T18:10:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb80ee11800 1 -- 172.21.15.173:0/2163130101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0825590 msgr2=0x5594f0827980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb80ee11800 1 --2- 172.21.15.173:0/2163130101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0825590 0x5594f0827980 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb80000a470 tx=0x7fb80001cdb0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb80ee11800 1 -- 172.21.15.173:0/2163130101 shutdown_connections 2024-05-15T18:10:43.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb80ee11800 1 --2- 172.21.15.173:0/2163130101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0825590 0x5594f0827980 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb80ee11800 1 -- 172.21.15.173:0/2163130101 >> 172.21.15.173:0/2163130101 conn(0x5594f081c790 msgr2=0x5594f081ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb80ee11800 1 -- 172.21.15.173:0/2163130101 shutdown_connections 2024-05-15T18:10:43.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.210+0000 7fb80ee11800 1 -- 172.21.15.173:0/2163130101 wait complete. 2024-05-15T18:10:43.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.224+0000 7fb80ee11800 1 Processor -- start 2024-05-15T18:10:43.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.224+0000 7fb80ee11800 1 -- start start 2024-05-15T18:10:43.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.224+0000 7fb80ee11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f0912480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.201 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.224+0000 7fb80ee11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5594f076c1c0 con 0x5594f0821150 2024-05-15T18:10:43.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.225+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f0912480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.225+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f0912480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50096/0 (socket says 172.21.15.173:50096) 2024-05-15T18:10:43.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.225+0000 7fb80a4fd640 1 -- 172.21.15.173:0/820870985 learned_addr learned my addr 172.21.15.173:0/820870985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.202 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.225+0000 7fb80a4fd640 1 -- 172.21.15.173:0/820870985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f0912a50 con 0x5594f0821150 2024-05-15T18:10:43.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.226+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/820870985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f0912480 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001e30 tx=0x7fb7fc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d54615f286f030 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.226+0000 7fb6f8608640 1 -- 172.21.15.173:0/820870985 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc012020 con 0x5594f0821150 2024-05-15T18:10:43.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.226+0000 7fb6f8608640 1 -- 172.21.15.173:0/820870985 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00e5a0 con 0x5594f0821150 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.226+0000 7fb6f8608640 1 -- 172.21.15.173:0/820870985 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc00e8e0 con 0x5594f0821150 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.226+0000 7fb80ee11800 1 -- 172.21.15.173:0/820870985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 msgr2=0x5594f0912480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.226+0000 7fb80ee11800 1 --2- 172.21.15.173:0/820870985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f0912480 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001e30 tx=0x7fb7fc00b780 comp rx=0 tx=0).stop 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 -- 172.21.15.173:0/820870985 shutdown_connections 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 --2- 172.21.15.173:0/820870985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f0912480 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 -- 172.21.15.173:0/820870985 >> 172.21.15.173:0/820870985 conn(0x5594f081c790 msgr2=0x5594f090dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 -- 172.21.15.173:0/820870985 shutdown_connections 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 -- 172.21.15.173:0/820870985 wait complete. 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 Processor -- start 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 -- start start 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f091a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80ee11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5594f0828420 con 0x5594f0821150 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f091a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f091a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50104/0 (socket says 172.21.15.173:50104) 2024-05-15T18:10:43.205 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.227+0000 7fb80a4fd640 1 -- 172.21.15.173:0/3203003814 learned_addr learned my addr 172.21.15.173:0/3203003814 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.228+0000 7fb80a4fd640 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f091a540 con 0x5594f0821150 2024-05-15T18:10:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.228+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f091a000 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001e30 tx=0x7fb7fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.228+0000 7fb6f6e05640 1 -- 172.21.15.173:0/3203003814 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc012030 con 0x5594f0821150 2024-05-15T18:10:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.228+0000 7fb6f6e05640 1 -- 172.21.15.173:0/3203003814 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc01a7a0 con 0x5594f0821150 2024-05-15T18:10:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.228+0000 7fb6f6e05640 1 -- 172.21.15.173:0/3203003814 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc01aaa0 con 0x5594f0821150 2024-05-15T18:10:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.228+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594f091a7d0 con 0x5594f0821150 2024-05-15T18:10:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.228+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f091d480 con 0x5594f0821150 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb6f6e05640 1 -- 172.21.15.173:0/3203003814 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb7fc015020 con 0x5594f0821150 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb6f6e05640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6f0036950 0x7fb6f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb6f6e05640 1 -- 172.21.15.173:0/3203003814 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb7fc020030 con 0x5594f0821150 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb809cfc640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6f0036950 0x7fb6f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0825590 0x5594f0921240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0921780 con 0x5594f0825590 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb80acfe640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0825590 0x5594f0921240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.229+0000 7fb809cfc640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6f0036950 0x7fb6f0038e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb800054000 tx=0x7fb80004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.230+0000 7fb80acfe640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0825590 0x5594f0921240 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.230+0000 7fb80acfe640 1 -- 172.21.15.173:0/3203003814 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0825590 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.230+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f091e7e0 con 0x5594f0825590 2024-05-15T18:10:43.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.230+0000 7fb80acfe640 1 -- 172.21.15.173:0/3203003814 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0825590 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.230+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f0923a70 0x5594f0925e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.230+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0926550 con 0x5594f0923a70 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.230+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f0923a70 0x5594f0925e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.231+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f0923a70 0x5594f0925e60 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.231+0000 7fb80a4fd640 1 -- 172.21.15.173:0/3203003814 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7fc018970 con 0x5594f0923a70 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.231+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0922a50 con 0x5594f0825590 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.231+0000 7fb80acfe640 1 -- 172.21.15.173:0/3203003814 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0825590 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.231+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5594f09279b0 0x5594f0929e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.231+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f092a580 con 0x5594f09279b0 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.232+0000 7fb809cfc640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5594f09279b0 0x5594f0929e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.232+0000 7fb809cfc640 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5594f09279b0 0x5594f0929e20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb809cfc640 1 -- 172.21.15.173:0/3203003814 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb80005a040 con 0x5594f09279b0 2024-05-15T18:10:43.211 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb80ee11800 1 Processor -- start 2024-05-15T18:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb80ee11800 1 -- start start 2024-05-15T18:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb80ee11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0938960 0x5594f0938d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb80ee11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5594f0712cf0 con 0x5594f0938960 2024-05-15T18:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0938960 0x5594f0938d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0938960 0x5594f0938d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50110/0 (socket says 172.21.15.173:50110) 2024-05-15T18:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.233+0000 7fb80a4fd640 1 -- 172.21.15.173:0/2820369858 learned_addr learned my addr 172.21.15.173:0/2820369858 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.212 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.234+0000 7fb80a4fd640 1 -- 172.21.15.173:0/2820369858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f09392c0 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.234+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0938960 0x5594f0938d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc018c80 tx=0x7fb7fc044de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.234+0000 7fb6effff640 1 -- 172.21.15.173:0/2820369858 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc03c070 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.234+0000 7fb6effff640 1 -- 172.21.15.173:0/2820369858 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc0442b0 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.234+0000 7fb6effff640 1 -- 172.21.15.173:0/2820369858 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc044590 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.234+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594f0939d30 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.234+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f0939d30 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.235+0000 7fb6effff640 1 -- 172.21.15.173:0/2820369858 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb7fc04c8d0 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.235+0000 7fb6effff640 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6e4036970 0x7fb6e4038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.235+0000 7fb6effff640 1 -- 172.21.15.173:0/2820369858 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb7fc051940 con 0x5594f0938960 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.235+0000 7fb809cfc640 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6e4036970 0x7fb6e4038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.222 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.235+0000 7fb80ee11800 1 Processor -- start 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.235+0000 7fb80ee11800 1 -- start start 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.235+0000 7fb809cfc640 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6e4036970 0x7fb6e4038e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5594f091e700 tx=0x7fb800005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb80ee11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f0945d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb80ee11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5594f0912dd0 con 0x5594f0945970 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f0945d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f0945d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50112/0 (socket says 172.21.15.173:50112) 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb80a4fd640 1 -- 172.21.15.173:0/1566843108 learned_addr learned my addr 172.21.15.173:0/1566843108 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb80a4fd640 1 -- 172.21.15.173:0/1566843108 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f0946360 con 0x5594f0945970 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/1566843108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f0945d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc016d70 tx=0x7fb7fc04cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96641e7eb48e3385 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb6edffb640 1 -- 172.21.15.173:0/1566843108 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc05e020 con 0x5594f0945970 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb6edffb640 1 -- 172.21.15.173:0/1566843108 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc037840 con 0x5594f0945970 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.236+0000 7fb6edffb640 1 -- 172.21.15.173:0/1566843108 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc037a50 con 0x5594f0945970 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 -- 172.21.15.173:0/1566843108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 msgr2=0x5594f0945d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 --2- 172.21.15.173:0/1566843108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f0945d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc016d70 tx=0x7fb7fc04cf90 comp rx=0 tx=0).stop 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 -- 172.21.15.173:0/1566843108 shutdown_connections 2024-05-15T18:10:43.223 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 --2- 172.21.15.173:0/1566843108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f0945d90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 -- 172.21.15.173:0/1566843108 >> 172.21.15.173:0/1566843108 conn(0x5594f0941bf0 msgr2=0x5594f093fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 -- 172.21.15.173:0/1566843108 shutdown_connections 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 -- 172.21.15.173:0/1566843108 wait complete. 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 Processor -- start 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 -- start start 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f094cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.237+0000 7fb80ee11800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5594f09469d0 con 0x5594f0945970 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f094cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb80a4fd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f094cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50118/0 (socket says 172.21.15.173:50118) 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 learned_addr learned my addr 172.21.15.173:0/4162245506 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594f094d290 con 0x5594f0945970 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f094cd50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc01ad00 tx=0x7fb7fc058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb6dbfff640 1 -- 172.21.15.173:0/4162245506 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc072070 con 0x5594f0945970 2024-05-15T18:10:43.224 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb6dbfff640 1 -- 172.21.15.173:0/4162245506 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc037c60 con 0x5594f0945970 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594f094d290 con 0x5594f0945970 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb6dbfff640 1 -- 172.21.15.173:0/4162245506 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7fc0163b0 con 0x5594f0945970 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.238+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594f094d290 con 0x5594f0945970 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.239+0000 7fb6dbfff640 1 -- 172.21.15.173:0/4162245506 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb7fc075070 con 0x5594f0945970 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.239+0000 7fb6dbfff640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6d4036900 0x7fb6d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.239+0000 7fb6dbfff640 1 -- 172.21.15.173:0/4162245506 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb7fc06a050 con 0x5594f0945970 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.239+0000 7fb809cfc640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6d4036900 0x7fb6d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.240+0000 7fb809cfc640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6d4036900 0x7fb6d4038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb80001cdf0 tx=0x7fb80004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.240+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.240+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0958460 0x5594f095a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.240+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f095b070 con 0x5594f0958460 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.240+0000 7fb80acfe640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0958460 0x5594f095a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.225 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.240+0000 7fb80acfe640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0958460 0x5594f095a920 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 realm 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f095b480 con 0x5594f0958460 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f095bd50 con 0x5594f0958460 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.226 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x5594f0958460 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f095ce50 0x5594f095f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f095f850 con 0x5594f095ce50 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.241+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f095ce50 0x5594f095f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f095ce50 0x5594f095f240 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80ee11800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80ee11800 20 searching for the correct realm 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f0961180 con 0x5594f095ce50 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.227 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80a4fd640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb7fc077060 0x7fb7fc0511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f0961180 con 0x7fb7fc077060 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.242+0000 7fb809cfc640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb7fc077060 0x7fb7fc0511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.243+0000 7fb809cfc640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb7fc077060 0x7fb7fc0511f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.243+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.243+0000 7fb809cfc640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb800074040 0x7fb800081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.243+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f0961180 con 0x7fb800074040 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.243+0000 7fb80acfe640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb800074040 0x7fb800081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.244+0000 7fb80acfe640 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb800074040 0x7fb800081410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.244+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb80400a4a0 con 0x7fb800074040 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.244+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x5594f0958460 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.244+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.244+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x5594f0958460 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.244+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.244+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x7fb800074040 2024-05-15T18:10:43.228 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x7fb800074040 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x7fb800074040 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x7fb800074040 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x7fb7fc077060 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x5594f095ce50 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.245+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x5594f0958460 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x7fb800074040 2024-05-15T18:10:43.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x7fb800074040 2024-05-15T18:10:43.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x5594f0958460 2024-05-15T18:10:43.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5594f095c0f0 con 0x7fb7fc077060 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.246+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.247+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.247+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.247+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.247+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb800074040 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.247+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x7fb800074040 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.247+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f0958460 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.239 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f0958460 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb80400a4a0 con 0x5594f0958460 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb800074040 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.248+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb804033040 con 0x7fb800074040 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.249+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f095ce50 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.249+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.249+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb7fc077060 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.249+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.249+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f0958460 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.249+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.249+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb800074040 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f095ce50 2024-05-15T18:10:43.240 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb800074040 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb7fc077060 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.250+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f095ce50 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb7fc077060 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x5594f0958460 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fb80008e060 con 0x7fb7fc077060 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:43.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0960110 con 0x5594f0958460 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.251+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0960500 con 0x5594f0958460 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0960500 con 0x7fb800074040 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.242 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 20 zone default found 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 4 Realm: () 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 20 zonegroup default 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0961600 con 0x7fb800074040 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.252+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.243 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0962fe0 con 0x5594f095ce50 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963380 con 0x5594f095ce50 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 20 started sync module instance, tier type = 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.253+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0962480 con 0x7fb7fc077060 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.254+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.254+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94098179891152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963720 con 0x7fb7fc077060 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.254+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963f70 con 0x5594f0958460 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.255+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94098179891152] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.255+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.244 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.255+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94098179898048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963ee0 con 0x5594f0958460 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.255+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0964e30 con 0x5594f095ce50 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.257+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94098179898048] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.257+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.257+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94098179901824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09651d0 con 0x5594f095ce50 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.257+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0965c20 con 0x7fb7fc077060 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.258+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.258+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098179907600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09668e0 con 0x7fb7fc077060 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.258+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94098179901824] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.258+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09643a0 con 0x5594f0958460 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.259+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94098179907600] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.259+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.259+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94098179908656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09672a0 con 0x5594f0958460 2024-05-15T18:10:43.245 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.259+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0967c60 con 0x7fb800074040 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.260+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94098179908656] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.260+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.260+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098179914128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09672a0 con 0x7fb800074040 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.260+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0968670 con 0x7fb800074040 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.261+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.261+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94098179916224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0968a90 con 0x7fb800074040 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.262+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0969550 con 0x7fb800074040 2024-05-15T18:10:43.246 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.262+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94098179914128] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94098179916224] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94098179920000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09685e0 con 0x7fb800074040 2024-05-15T18:10:43.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 20 add_watcher() i=0 2024-05-15T18:10:43.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 20 add_watcher() i=1 2024-05-15T18:10:43.249 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 20 add_watcher() i=2 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 20 add_watcher() i=3 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 20 add_watcher() i=4 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 20 add_watcher() i=5 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.263+0000 7fb80ee11800 20 add_watcher() i=6 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.264+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94098179920000] v31'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.264+0000 7fb80ee11800 20 add_watcher() i=7 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.264+0000 7fb80ee11800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.264+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09685e0 con 0x5594f0958460 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.264+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.264+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94098179911152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09685e0 con 0x5594f0958460 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.265+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94098179911152] v31'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.265+0000 7fb6c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:43.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.265+0000 7fb80ee11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.265+0000 7fb80ee11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.265+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0974ec0 con 0x5594f0958460 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.266+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.266+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0975590 con 0x7fb800074040 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.267+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.267+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09759b0 con 0x5594f095ce50 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.268+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.268+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0975d50 con 0x5594f0958460 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.269+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'236 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.269+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0976320 con 0x7fb7fc077060 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.270+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.270+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0976890 con 0x5594f095ce50 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.271+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.271+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0976920 con 0x5594f0958460 2024-05-15T18:10:43.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.273+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.273+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09769b0 con 0x7fb800074040 2024-05-15T18:10:43.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.274+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.274+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0976a40 con 0x7fb7fc077060 2024-05-15T18:10:43.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.275+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.275+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0976fb0 con 0x5594f095ce50 2024-05-15T18:10:43.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.276+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.276+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0976fb0 con 0x7fb7fc077060 2024-05-15T18:10:43.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.277+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.277+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x7fb800074040 2024-05-15T18:10:43.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.278+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.278+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x7fb7fc077060 2024-05-15T18:10:43.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.279+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.279+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09774f0 con 0x7fb800074040 2024-05-15T18:10:43.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.280+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.280+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09774f0 con 0x5594f0958460 2024-05-15T18:10:43.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.281+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'237 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.281+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09774f0 con 0x5594f095ce50 2024-05-15T18:10:43.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.282+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.282+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09774f0 con 0x7fb7fc077060 2024-05-15T18:10:43.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.283+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.283+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09774f0 con 0x5594f095ce50 2024-05-15T18:10:43.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.284+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.284+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09774f0 con 0x5594f0958460 2024-05-15T18:10:43.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.286+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.286+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f0958460 2024-05-15T18:10:43.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.287+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'238 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.287+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f095ce50 2024-05-15T18:10:43.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.288+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.288+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x7fb7fc077060 2024-05-15T18:10:43.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.289+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.289+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f095ce50 2024-05-15T18:10:43.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.290+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.266 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.290+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f095ce50 2024-05-15T18:10:43.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.290+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.290+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f095ce50 2024-05-15T18:10:43.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.291+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.291+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f095ce50 2024-05-15T18:10:43.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.292+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.292+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x7fb800074040 2024-05-15T18:10:43.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.294+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.294+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f095ce50 2024-05-15T18:10:43.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.295+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.295+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x7fb800074040 2024-05-15T18:10:43.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.296+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.296+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x5594f095ce50 2024-05-15T18:10:43.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.297+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.297+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x7fb800074040 2024-05-15T18:10:43.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.299+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.299+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0977460 con 0x7fb7fc077060 2024-05-15T18:10:43.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb63b7fe640 20 reqs_thread_entry: start 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb80ee11800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb80ee11800 20 Filter name: none 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb6397fa640 20 reqs_thread_entry: start 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb80ee11800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.300+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09a23a0 con 0x5594f0958460 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 20 rados_obj.operate() r=0 bl.length=391 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09a4820 con 0x7fb7fc077060 2024-05-15T18:10:43.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv44 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 : miss 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.301+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:96 8.9 8:91789500:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09a4760 con 0x7fb7fc077060 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(96 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv40 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 20 rados_obj.operate() r=0 bl.length=379 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 info.flags=0x17 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 to cache LRU end 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:97 4.23 4:c6a69b05:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21ed0 con 0x7fb800074040 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(97 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.281 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 4.10 4:0bde8499:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21ed0 con 0x5594f095ce50 2024-05-15T18:10:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(98 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.302+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:99 4.17 4:e9e1f396:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21ed0 con 0x7fb800074040 2024-05-15T18:10:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.303+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(99 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.303+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 4.2a 4:569c5bdd:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21ed0 con 0x5594f0958460 2024-05-15T18:10:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.303+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(100 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.303+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:101 4.2d 4:b63da703:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21900 con 0x7fb800074040 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.304+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(101 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.304+0000 7fb80ee11800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.304+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:102 4.c 4:33ddf95a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21940 con 0x5594f0958460 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.304+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(102 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804031040 con 0x5594f0958460 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.304+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:103 4.15 4:a8282a50:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21940 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.304+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(103 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.304+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:104 4.8 4:13db69fe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21940 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.305+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(104 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.305+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:105 4.1d 4:bb4e082e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21940 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.305+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(105 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.305+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:106 4.15 4:a97e2d95:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a218a0 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.305+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(106 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc074030 con 0x5594f095ce50 2024-05-15T18:10:43.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.305+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:107 4.18 4:1a9bdf81:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a218a0 con 0x7fb7fc077060 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(107 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 20 get_obj_state: octx=0x7fb800079040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5594f0a1ff58 s->prefetch_data=0 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:108 3.36 3:6e577752:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a20930 con 0x7fb7fc077060 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(108 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 10 manifest: total_size = 6 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 20 get_obj_state: setting s->obj_tag to 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.13870965525588993334 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 20 get_obj_state: octx=0x7fb800079040 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5594f0a1ff58 s->prefetch_data=0 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 20 prepare_atomic_modification: state is not atomic. state=0x5594f0a1ff58 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 20 bucket index object: :.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.306+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:109 4.2d 4:b63da703:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21310 con 0x7fb800074040 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.307+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(109 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb804031040 con 0x7fb800074040 2024-05-15T18:10:43.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.307+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:110 3.36 3:6e577752:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0a21310 con 0x7fb7fc077060 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(110 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7_15f6f8dc036519d7fe15b39338f6e5db [call] v31'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:111 4.2d 4:b63da703:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09a93a0 con 0x7fb800074040 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 20 list_objects_ordered: starting attempt 1 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:112 4.23 4:c6a69b05:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09aacf0 con 0x7fb800074040 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:113 4.10 4:0bde8499:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09ad5a0 con 0x5594f095ce50 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:114 4.17 4:e9e1f396:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09aff00 con 0x7fb800074040 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:115 4.2a 4:569c5bdd:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09aacf0 con 0x5594f0958460 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:116 4.2d 4:b63da703:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09b4fe0 con 0x7fb800074040 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:117 4.c 4:33ddf95a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09b7be0 con 0x5594f0958460 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:118 4.15 4:a8282a50:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09ba4d0 con 0x5594f095ce50 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:119 4.8 4:13db69fe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09aacf0 con 0x5594f095ce50 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:120 4.1d 4:bb4e082e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09bf5a0 con 0x5594f095ce50 2024-05-15T18:10:43.293 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:121 4.15 4:a97e2d95:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c2130 con 0x5594f095ce50 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.308+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:122 4.18 4:1a9bdf81:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4f60 con 0x7fb7fc077060 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(112 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(114 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(115 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(117 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(113 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc095040 con 0x5594f095ce50 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(118 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc095040 con 0x5594f095ce50 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(122 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(119 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc095040 con 0x5594f095ce50 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(120 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc095040 con 0x5594f095ce50 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.309+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(121 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc095040 con 0x5594f095ce50 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(111 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.294 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb6edffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(116 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7])"; uploads.size()=0; is_truncated=0 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:123 4.23 4:c6a69b05:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09ba530 con 0x7fb800074040 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:124 4.10 4:0bde8499:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4f60 con 0x5594f095ce50 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:125 4.17 4:e9e1f396:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c20b0 con 0x7fb800074040 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:126 4.2a 4:569c5bdd:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09bfa70 con 0x5594f0958460 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:127 4.2d 4:b63da703:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09ba530 con 0x7fb800074040 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:128 4.c 4:33ddf95a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c20b0 con 0x5594f0958460 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:129 4.15 4:a8282a50:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4f60 con 0x5594f095ce50 2024-05-15T18:10:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:130 4.8 4:13db69fe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09bfa70 con 0x5594f095ce50 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:131 4.1d 4:bb4e082e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09a8ef0 con 0x5594f095ce50 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:132 4.15 4:a97e2d95:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09b43d0 con 0x5594f095ce50 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:133 4.18 4:1a9bdf81:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09bc940 con 0x7fb7fc077060 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(123 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(125 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.310+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(128 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(124 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(126 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== osd_op_reply(129 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(130 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(133 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 40 ==== osd_op_reply(131 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 41 ==== osd_op_reply(132 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(127 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.311+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09ba490 con 0x7fb7fc077060 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(134 foo.buckets [call] v31'47 uv47 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb80ee11800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09ba490 con 0x7fb7fc077060 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv41 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb80ee11800 20 rados_obj.operate() r=0 bl.length=165 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb80ee11800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb80ee11800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.312+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09ba490 con 0x7fb7fc077060 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.313+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(136 myfoo [call,call,delete] v31'48 uv48 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.313+0000 7fb80ee11800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-15T18:10:43.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.313+0000 7fb80ee11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.313+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94098180252816 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb800074040 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.314+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== watch-notify(notify (1) cookie 94098179916224 notify 133143986221 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5594f0976320 con 0x7fb800074040 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.314+0000 7fb6ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986221 cookie 94098179916224 notifier 4776 bl.length()=149 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.314+0000 7fb6ed7fa640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb640003320 con 0x7fb800074040 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.314+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== osd_op_reply(137 notify.6 [notify cookie 94098180252816 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.314+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.314+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== watch-notify(notify_complete (2) cookie 94098180252816 notify 133143986221 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594f09392c0 con 0x7fb800074040 2024-05-15T18:10:43.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.314+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:139 8.9 8:91789500:root::.bucket.meta.myfoo%3a74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb7fc077060 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.315+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(139 .bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 [call,call,delete] v31'49 uv49 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.315+0000 7fb80ee11800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 from cache 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.315+0000 7fb80ee11800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7, ofs0, ns] 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.315+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94098180161584 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb800074040 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== watch-notify(notify (1) cookie 94098179920000 notify 133143986222 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5594f09392c0 con 0x7fb800074040 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb6edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986222 cookie 94098179920000 notifier 4776 bl.length()=206 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(140 notify.7 [notify cookie 94098180161584 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb6edffb640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb6d0003d60 con 0x7fb800074040 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== watch-notify(notify_complete (2) cookie 94098180161584 notify 133143986222 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594f0975050 con 0x7fb800074040 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:142 4.23 4:c6a69b05:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb800074040 2024-05-15T18:10:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:143 4.10 4:0bde8499:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09b47f0 con 0x5594f095ce50 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:144 4.17 4:e9e1f396:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09b4c10 con 0x7fb800074040 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:145 4.2a 4:569c5bdd:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09a37c0 con 0x5594f0958460 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:146 4.2d 4:b63da703:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb800074040 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:147 4.c 4:33ddf95a:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4080 con 0x5594f0958460 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:148 4.15 4:a8282a50:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09b4c10 con 0x5594f095ce50 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:149 4.8 4:13db69fe:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09b47f0 con 0x5594f095ce50 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:150 4.1d 4:bb4e082e:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x5594f095ce50 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:151 4.15 4:a97e2d95:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09a37c0 con 0x5594f095ce50 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.316+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:152 4.18 4:1a9bdf81:::.dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4080 con 0x7fb7fc077060 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.317+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== osd_op_reply(152 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.10 [delete] v31'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 42 ==== osd_op_reply(148 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.6 [delete] v31'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== osd_op_reply(146 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.4 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.306 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(144 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.2 [delete] v31'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 43 ==== osd_op_reply(143 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.1 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(147 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.5 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(145 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.3 [delete] v31'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== osd_op_reply(142 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.0 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.318+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 44 ==== osd_op_reply(149 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.7 [delete] v31'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.319+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 45 ==== osd_op_reply(150 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.8 [delete] v31'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 46 ==== osd_op_reply(151 .dir.74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7.9 [delete] v31'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80ee11800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 : miss 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80ee11800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:153 6.6 6:663f6acf:::pubsub..bucket.myfoo%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x5594f095ce50 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80ee11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.307 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80ee11800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 info.flags=0x0 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80ee11800 10 adding default.rgw.log++pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 to cache LRU end 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.320+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:154 6.6 6:663f6acf:::pubsub..bucket.myfoo%2f74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x5594f095ce50 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.322+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 48 ==== osd_op_reply(154 pubsub..bucket.myfoo/74ac2443-e34d-4255-b728-cefe496e7fb2.4224.7 [delete] v31'14 uv13 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.322+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb7fc077060 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.323+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(155 foo.buckets [call] v31'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.323+0000 7fb80ee11800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.323+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb800074040 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v31'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb80ee11800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94098180161328 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb7fc077060 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== watch-notify(notify (1) cookie 94098179907600 notify 133143986195 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5594f09a2110 con 0x7fb7fc077060 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb6edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94098179907600 notifier 4776 bl.length()=170 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb6edffb640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb6d0003d60 con 0x7fb7fc077060 2024-05-15T18:10:43.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== osd_op_reply(157 notify.3 [notify cookie 94098180161328 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 35 ==== watch-notify(notify_complete (2) cookie 94098180161328 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594f0976de0 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb80ee11800 10 removing email index: foo@foo.com 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.324+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x5594f0958460 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.325+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(159 foo@foo.com [delete] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.325+0000 7fb80ee11800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.325+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94098180161328 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 36 ==== watch-notify(notify (1) cookie 94098179907600 notify 133143986196 ret 0) ==== 204+0+0 (crc 0 0 0) 0x5594f0976de0 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb6ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 94098179907600 notifier 4776 bl.length()=162 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb6ed7fa640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb640003320 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 37 ==== osd_op_reply(160 notify.3 [notify cookie 94098180161328 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 38 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 39 ==== watch-notify(notify_complete (2) cookie 94098180161328 notify 133143986196 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594f0975590 con 0x7fb7fc077060 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb80ee11800 10 removing user buckets index 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.326+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb7fc077060 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.327+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 40 ==== osd_op_reply(162 foo.buckets [delete] v31'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.327+0000 7fb80ee11800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.327+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94098180161328 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x7fb800074040 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 47 ==== watch-notify(notify (1) cookie 94098179914128 notify 133143986223 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5594f0975050 con 0x7fb800074040 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb6edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986223 cookie 94098179914128 notifier 4776 bl.length()=160 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 48 ==== osd_op_reply(163 notify.5 [notify cookie 94098180161328 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb6edffb640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb6d0003d60 con 0x7fb800074040 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 49 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 50 ==== watch-notify(notify_complete (2) cookie 94098180161328 notify 133143986223 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594f0974e80 con 0x7fb800074040 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb80ee11800 10 removing user index: foo 2024-05-15T18:10:43.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.328+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x5594f0958460 2024-05-15T18:10:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(165 foo [call,call,delete] v31'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb80ee11800 10 removing default.rgw.meta+users.uid+foo from cache 2024-05-15T18:10:43.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb80ee11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94098180161328 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5594f09c4800 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== watch-notify(notify (1) cookie 94098179908656 notify 133143986194 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5594f0974e80 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb6ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94098179908656 notifier 4776 bl.length()=152 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(166 notify.4 [notify cookie 94098180161328 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.329+0000 7fb6ed7fa640 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb6400032c0 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.330+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.330+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== watch-notify(notify_complete (2) cookie 94098180161328 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5594f0975260 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.330+0000 7fb6c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.331+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94098179911152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0972a60 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.332+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94098179911152] v31'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.332+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94098179891152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0966df0 con 0x7fb7fc077060 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.333+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 41 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94098179891152] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.333+0000 7fb80ee11800 20 remove_watcher() i=0 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.333+0000 7fb80ee11800 2 removed watcher, disabling cache 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.333+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94098179898048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0961fd0 con 0x5594f0958460 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.334+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94098179898048] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.334+0000 7fb80ee11800 20 remove_watcher() i=1 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.334+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94098179901824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963ac0 con 0x5594f095ce50 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.335+0000 7fb80a4fd640 1 -- 172.21.15.173:0/4162245506 <== osd.3 v2:172.21.15.173:6814/3793320597 49 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94098179901824] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7fc09e040 con 0x5594f095ce50 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.335+0000 7fb80ee11800 20 remove_watcher() i=2 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.335+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94098179907600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963ac0 con 0x7fb7fc077060 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.336+0000 7fb809cfc640 1 -- 172.21.15.173:0/4162245506 <== osd.2 v2:172.21.15.173:6808/3098545592 42 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94098179907600] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb80007f070 con 0x7fb7fc077060 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.336+0000 7fb80ee11800 20 remove_watcher() i=3 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.336+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94098179908656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0966010 con 0x5594f0958460 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.337+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94098179908656] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x5594f0958460 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.337+0000 7fb80ee11800 20 remove_watcher() i=4 2024-05-15T18:10:43.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.337+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94098179914128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963ac0 con 0x7fb800074040 2024-05-15T18:10:43.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.338+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 51 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94098179914128] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.338+0000 7fb80ee11800 20 remove_watcher() i=5 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.338+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94098179916224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0967990 con 0x7fb800074040 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.339+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 52 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94098179916224] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.339+0000 7fb80ee11800 20 remove_watcher() i=6 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.339+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94098179920000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5594f0963ac0 con 0x7fb800074040 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 <== osd.0 v2:172.21.15.3:6800/774076599 53 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94098179920000] v31'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb804049060 con 0x7fb800074040 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 20 remove_watcher() i=7 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb800074040 msgr2=0x7fb800081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb800074040 0x7fb800081410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0958460 msgr2=0x5594f095a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0958460 0x5594f095a920 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb7fc077060 msgr2=0x7fb7fc0511f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb7fc077060 0x7fb7fc0511f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f095ce50 msgr2=0x5594f095f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f095ce50 0x5594f095f240 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6d4036900 msgr2=0x7fb6d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.340+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6d4036900 0x7fb6d4038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb80001cdf0 tx=0x7fb80004f000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 msgr2=0x5594f094cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/4162245506 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0945970 0x5594f094cd50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc01ad00 tx=0x7fb7fc058000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 reap_dead start 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80acfe640 1 -- 172.21.15.173:0/4162245506 reap_dead start 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 shutdown_connections 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 >> 172.21.15.173:0/4162245506 conn(0x5594f0941bf0 msgr2=0x5594f093f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 shutdown_connections 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/4162245506 wait complete. 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6e4036970 msgr2=0x7fb6e4038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6e4036970 0x7fb6e4038e30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5594f091e700 tx=0x7fb800005a00 comp rx=0 tx=0).stop 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0938960 msgr2=0x5594f0938d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0938960 0x5594f0938d80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc018c80 tx=0x7fb7fc044de0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 shutdown_connections 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6e4036970 0x7fb6e4038e30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/2820369858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0938960 0x5594f0938d80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 >> 172.21.15.173:0/2820369858 conn(0x5594f092ca00 msgr2=0x5594f092ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 shutdown_connections 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/2820369858 wait complete. 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5594f09279b0 msgr2=0x5594f0929e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5594f09279b0 0x5594f0929e20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0825590 msgr2=0x5594f0921240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5594f0825590 0x5594f0921240 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f0923a70 msgr2=0x5594f0925e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5594f0923a70 0x5594f0925e60 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6f0036950 msgr2=0x7fb6f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb6f0036950 0x7fb6f0038e10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb800054000 tx=0x7fb80004e000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 msgr2=0x5594f091a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80ee11800 1 --2- 172.21.15.173:0/3203003814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5594f0821150 0x5594f091a000 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001e30 tx=0x7fb7fc000ed0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.341+0000 7fb80acfe640 1 -- 172.21.15.173:0/3203003814 reap_dead start 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.342+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 shutdown_connections 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.342+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 >> 172.21.15.173:0/3203003814 conn(0x5594f081c790 msgr2=0x5594f090c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.342+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 shutdown_connections 2024-05-15T18:10:43.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.342+0000 7fb80ee11800 1 -- 172.21.15.173:0/3203003814 wait complete. 2024-05-15T18:10:43.327 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-15T18:10:43.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-15T18:10:43.327 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-15T18:10:43.371 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.371 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.395+0000 7f7330c3f800 1 Processor -- start 2024-05-15T18:10:43.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.395+0000 7f7330c3f800 1 -- start start 2024-05-15T18:10:43.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7330c3f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5584ee792540 0x5584ee79b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7330c3f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5584ee705900 con 0x5584ee790a00 2024-05-15T18:10:43.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7330c3f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5584ee623050 con 0x5584ee792540 2024-05-15T18:10:43.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7325f3d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5584ee792540 0x5584ee79b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.372 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7325f3d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5584ee792540 0x5584ee79b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50122/0 (socket says 172.21.15.173:50122) 2024-05-15T18:10:43.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f732e73e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5584ee790a00 0x5584ee790e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38578/0 (socket says 172.21.15.173:38578) 2024-05-15T18:10:43.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7325f3d640 1 -- 172.21.15.173:0/3489831365 learned_addr learned my addr 172.21.15.173:0/3489831365 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7325f3d640 1 -- 172.21.15.173:0/3489831365 >> v1:172.21.15.3:6789/0 conn(0x5584ee790a00 legacy=0x5584ee790e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.373 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.396+0000 7f7325f3d640 1 -- 172.21.15.173:0/3489831365 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ee705ad0 con 0x5584ee792540 2024-05-15T18:10:43.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.398+0000 7f7325f3d640 1 --2- 172.21.15.173:0/3489831365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee792540 0x5584ee79b040 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f731800a520 tx=0x7f731801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6a135bea930fef server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.398+0000 7f732df3d640 1 -- 172.21.15.173:0/3489831365 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7318057070 con 0x5584ee792540 2024-05-15T18:10:43.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.398+0000 7f732df3d640 1 -- 172.21.15.173:0/3489831365 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7318052570 con 0x5584ee792540 2024-05-15T18:10:43.375 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.398+0000 7f732df3d640 1 -- 172.21.15.173:0/3489831365 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731804ae60 con 0x5584ee792540 2024-05-15T18:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.399+0000 7f7330c3f800 1 -- 172.21.15.173:0/3489831365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee792540 msgr2=0x5584ee79b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.399+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3489831365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee792540 0x5584ee79b040 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f731800a520 tx=0x7f731801d010 comp rx=0 tx=0).stop 2024-05-15T18:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.399+0000 7f7330c3f800 1 -- 172.21.15.173:0/3489831365 shutdown_connections 2024-05-15T18:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.399+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3489831365 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee792540 0x5584ee79b040 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.399+0000 7f7330c3f800 1 -- 172.21.15.173:0/3489831365 >> 172.21.15.173:0/3489831365 conn(0x5584ee78c5a0 msgr2=0x5584ee78e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.399+0000 7f7330c3f800 1 -- 172.21.15.173:0/3489831365 shutdown_connections 2024-05-15T18:10:43.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.399+0000 7f7330c3f800 1 -- 172.21.15.173:0/3489831365 wait complete. 2024-05-15T18:10:43.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.412+0000 7f7330c3f800 1 Processor -- start 2024-05-15T18:10:43.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.413+0000 7f7330c3f800 1 -- start start 2024-05-15T18:10:43.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.413+0000 7f7330c3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee8858e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.413+0000 7f7330c3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5584ee6dd1d0 con 0x5584ee790a00 2024-05-15T18:10:43.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.413+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee8858e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.413+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee8858e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50128/0 (socket says 172.21.15.173:50128) 2024-05-15T18:10:43.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.413+0000 7f732e73e640 1 -- 172.21.15.173:0/3485532974 learned_addr learned my addr 172.21.15.173:0/3485532974 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.413+0000 7f732e73e640 1 -- 172.21.15.173:0/3485532974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ee885eb0 con 0x5584ee790a00 2024-05-15T18:10:43.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f732e73e640 1 --2- 172.21.15.173:0/3485532974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee8858e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7320001e90 tx=0x7f732000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fa412b01b3a1c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f721c608640 1 -- 172.21.15.173:0/3485532974 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f732000e5c0 con 0x5584ee790a00 2024-05-15T18:10:43.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f721c608640 1 -- 172.21.15.173:0/3485532974 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7320006070 con 0x5584ee790a00 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f721c608640 1 -- 172.21.15.173:0/3485532974 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f732000e890 con 0x5584ee790a00 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f7330c3f800 1 -- 172.21.15.173:0/3485532974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 msgr2=0x5584ee8858e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3485532974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee8858e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7320001e90 tx=0x7f732000b6c0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f7330c3f800 1 -- 172.21.15.173:0/3485532974 shutdown_connections 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3485532974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee8858e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f7330c3f800 1 -- 172.21.15.173:0/3485532974 >> 172.21.15.173:0/3485532974 conn(0x5584ee78c5a0 msgr2=0x5584ee881200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f7330c3f800 1 -- 172.21.15.173:0/3485532974 shutdown_connections 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.414+0000 7f7330c3f800 1 -- 172.21.15.173:0/3485532974 wait complete. 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f7330c3f800 1 Processor -- start 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f7330c3f800 1 -- start start 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f7330c3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee88d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f7330c3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5584ee79b850 con 0x5584ee790a00 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee88d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.393 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee88d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50142/0 (socket says 172.21.15.173:50142) 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f732e73e640 1 -- 172.21.15.173:0/3904685959 learned_addr learned my addr 172.21.15.173:0/3904685959 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.415+0000 7f732e73e640 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ee88d9c0 con 0x5584ee790a00 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.416+0000 7f732e73e640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee88d480 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7320001ed0 tx=0x7f7320000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.416+0000 7f721ae05640 1 -- 172.21.15.173:0/3904685959 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f732001a880 con 0x5584ee790a00 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.416+0000 7f721ae05640 1 -- 172.21.15.173:0/3904685959 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732001aa20 con 0x5584ee790a00 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.416+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584ee88dc50 con 0x5584ee790a00 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.416+0000 7f721ae05640 1 -- 172.21.15.173:0/3904685959 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f732001ad40 con 0x5584ee790a00 2024-05-15T18:10:43.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.416+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ee890900 con 0x5584ee790a00 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f721ae05640 1 -- 172.21.15.173:0/3904685959 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7320017070 con 0x5584ee790a00 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f721ae05640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7214036900 0x7f7214038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f721ae05640 1 -- 172.21.15.173:0/3904685959 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f7320015020 con 0x5584ee790a00 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f7325f3d640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7214036900 0x7f7214038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee792540 0x5584ee8946c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee894c90 con 0x5584ee792540 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f732ef3f640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee792540 0x5584ee8946c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f7325f3d640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7214036900 0x7f7214038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7318054000 tx=0x7f731804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.417+0000 7f732ef3f640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee792540 0x5584ee8946c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.418+0000 7f732ef3f640 1 -- 172.21.15.173:0/3904685959 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee792540 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.418+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee891c90 con 0x5584ee792540 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.418+0000 7f732ef3f640 1 -- 172.21.15.173:0/3904685959 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee792540 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.418+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee896fa0 0x5584ee899390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.418+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee899a30 con 0x5584ee896fa0 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.418+0000 7f732e73e640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee896fa0 0x5584ee899390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.418+0000 7f732e73e640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee896fa0 0x5584ee899390 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.419+0000 7f732e73e640 1 -- 172.21.15.173:0/3904685959 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f732002e070 con 0x5584ee896fa0 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.419+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee895f50 con 0x5584ee792540 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.419+0000 7f732ef3f640 1 -- 172.21.15.173:0/3904685959 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee792540 2024-05-15T18:10:43.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.419+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5584ee89aee0 0x5584ee89d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.419+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee89da90 con 0x5584ee89aee0 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.419+0000 7f7325f3d640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5584ee89aee0 0x5584ee89d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.419+0000 7f7325f3d640 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5584ee89aee0 0x5584ee89d330 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.420+0000 7f7325f3d640 1 -- 172.21.15.173:0/3904685959 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f731805a040 con 0x5584ee89aee0 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.420+0000 7f7330c3f800 1 Processor -- start 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.420+0000 7f7330c3f800 1 -- start start 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.420+0000 7f7330c3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8abef0 0x5584ee8ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.420+0000 7f7330c3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5584ee683cf0 con 0x5584ee8abef0 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.420+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8abef0 0x5584ee8ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8abef0 0x5584ee8ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50152/0 (socket says 172.21.15.173:50152) 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f732e73e640 1 -- 172.21.15.173:0/3896052570 learned_addr learned my addr 172.21.15.173:0/3896052570 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f732e73e640 1 -- 172.21.15.173:0/3896052570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ee8ac850 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f732e73e640 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8abef0 0x5584ee8ac310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f73200178f0 tx=0x7f7320017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f7213fff640 1 -- 172.21.15.173:0/3896052570 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7320017e60 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f7213fff640 1 -- 172.21.15.173:0/3896052570 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73200408e0 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f7213fff640 1 -- 172.21.15.173:0/3896052570 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7320040bc0 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584ee8ad2c0 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.421+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ee8ad7c0 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.422+0000 7f7213fff640 1 -- 172.21.15.173:0/3896052570 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7320044a60 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.422+0000 7f7213fff640 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7208036900 0x7f7208038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.422+0000 7f7213fff640 1 -- 172.21.15.173:0/3896052570 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f732003dbf0 con 0x5584ee8abef0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.422+0000 7f7325f3d640 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7208036900 0x7f7208038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.422+0000 7f7330c3f800 1 Processor -- start 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f7330c3f800 1 -- start start 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f7325f3d640 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7208036900 0x7f7208038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5584ee891bb0 tx=0x7f7318005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f7330c3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f7330c3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5584ee886230 con 0x5584ee8b9070 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8b9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50166/0 (socket says 172.21.15.173:50166) 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f732e73e640 1 -- 172.21.15.173:0/3870004732 learned_addr learned my addr 172.21.15.173:0/3870004732 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f732e73e640 1 -- 172.21.15.173:0/3870004732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ee8b9a60 con 0x5584ee8b9070 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f732e73e640 1 --2- 172.21.15.173:0/3870004732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8b9490 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7320040d90 tx=0x7f7320040e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118ce9352e11dbf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f7211ffb640 1 -- 172.21.15.173:0/3870004732 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7320058030 con 0x5584ee8b9070 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f7211ffb640 1 -- 172.21.15.173:0/3870004732 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7320026930 con 0x5584ee8b9070 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.423+0000 7f7211ffb640 1 -- 172.21.15.173:0/3870004732 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7320041dd0 con 0x5584ee8b9070 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 -- 172.21.15.173:0/3870004732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 msgr2=0x5584ee8b9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3870004732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8b9490 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7320040d90 tx=0x7f7320040e80 comp rx=0 tx=0).stop 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 -- 172.21.15.173:0/3870004732 shutdown_connections 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3870004732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8b9490 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 -- 172.21.15.173:0/3870004732 >> 172.21.15.173:0/3870004732 conn(0x5584ee8b5390 msgr2=0x5584ee8b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 -- 172.21.15.173:0/3870004732 shutdown_connections 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 -- 172.21.15.173:0/3870004732 wait complete. 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 Processor -- start 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 -- start start 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.424+0000 7f7330c3f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5584ee8ba180 con 0x5584ee8b9070 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f732e73e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50178/0 (socket says 172.21.15.173:50178) 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 learned_addr learned my addr 172.21.15.173:0/182715184 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ee8c0a30 con 0x5584ee8b9070 2024-05-15T18:10:43.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f732e73e640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8c04f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f732003dfd0 tx=0x7f73200055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f71fffff640 1 -- 172.21.15.173:0/182715184 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7320044d50 con 0x5584ee8b9070 2024-05-15T18:10:43.421 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f71fffff640 1 -- 172.21.15.173:0/182715184 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7320044ef0 con 0x5584ee8b9070 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584ee8c0a30 con 0x5584ee8b9070 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f71fffff640 1 -- 172.21.15.173:0/182715184 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f732000f5f0 con 0x5584ee8b9070 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.425+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ee8c0a30 con 0x5584ee8b9070 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.426+0000 7f71fffff640 1 -- 172.21.15.173:0/182715184 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f732006b070 con 0x5584ee8b9070 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.426+0000 7f71fffff640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f71f8036900 0x7f71f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.426+0000 7f71fffff640 1 -- 172.21.15.173:0/182715184 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f732005c050 con 0x5584ee8b9070 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.426+0000 7f7325f3d640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f71f8036900 0x7f71f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.426+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.426+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee8cbb50 0x5584ee8ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8ce760 con 0x5584ee8cbb50 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f732ef3f640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee8cbb50 0x5584ee8ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7325f3d640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f71f8036900 0x7f71f8038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7318052fd0 tx=0x7f731804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f732ef3f640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee8cbb50 0x5584ee8ce010 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 20 realm 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8ceb70 con 0x5584ee8cbb50 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.427+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf440 con 0x5584ee8cbb50 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.423 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x5584ee8cbb50 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f7330c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee8d02d0 0x5584ee8d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d2e20 con 0x5584ee8d02d0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f732e73e640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee8d02d0 0x5584ee8d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.428+0000 7f732e73e640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee8d02d0 0x5584ee8d26c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f7330c3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f7330c3f800 20 searching for the correct realm 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d4800 con 0x5584ee8d02d0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.424 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f732e73e640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f732000f070 0x7f7320027430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d4800 con 0x7f732000f070 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f7325f3d640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f732000f070 0x7f7320027430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.429+0000 7f7325f3d640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f732000f070 0x7f7320027430 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.430+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.430+0000 7f7325f3d640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7318074040 0x7f7318081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.430+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d4800 con 0x7f7318074040 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.430+0000 7f732ef3f640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7318074040 0x7f7318081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.430+0000 7f732ef3f640 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7318074040 0x7f7318081410 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x5584ee8cbb50 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x5584ee8cbb50 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.425 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x7f7318074040 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.431+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x7f7318074040 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x7f732000f070 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x5584ee8d02d0 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x5584ee8cbb50 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.432+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x7f7318074040 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x5584ee8cbb50 2024-05-15T18:10:43.426 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8cf7e0 con 0x7f732000f070 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8d02d0 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.433+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8d02d0 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f7318074040 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8d02d0 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8d02d0 2024-05-15T18:10:43.427 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.434+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8cbb50 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8cbb50 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f7318074040 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8d02d0 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.435+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f732000f070 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8cbb50 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f7318074040 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.428 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8d02d0 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.436+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f7318074040 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f732000f070 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8d02d0 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f732000f070 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.437+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x5584ee8cbb50 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f731808e060 con 0x7f732000f070 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:43.429 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d37d0 con 0x5584ee8cbb50 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d3bc0 con 0x5584ee8cbb50 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:43.430 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.438+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d3bc0 con 0x7f7318074040 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 zone default found 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 4 Realm: () 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 zonegroup default 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d3fe0 con 0x7f7318074040 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d4400 con 0x5584ee8d02d0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.439+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d66b0 con 0x5584ee8d02d0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.440+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.440+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.440+0000 7f7330c3f800 20 started sync module instance, tier type = 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.440+0000 7f7330c3f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.440+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d5b50 con 0x7f732000f070 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.441+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.441+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94029426286448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d57b0 con 0x7f732000f070 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.441+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d7520 con 0x5584ee8cbb50 2024-05-15T18:10:43.432 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.442+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94029426286448] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.442+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.442+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94029426290800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d7940 con 0x5584ee8cbb50 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.442+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d8300 con 0x5584ee8d02d0 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.443+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94029426290800] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.444+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.444+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94029426291856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d78b0 con 0x5584ee8d02d0 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.444+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d9170 con 0x7f732000f070 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.445+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94029426291856] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.445+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.445+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94029426298048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d9560 con 0x7f732000f070 2024-05-15T18:10:43.433 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.445+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8d9f60 con 0x5584ee8cbb50 2024-05-15T18:10:43.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.446+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94029426298048] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.442 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.446+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.446+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94029426296480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8da350 con 0x5584ee8cbb50 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.446+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8dadf0 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.447+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.447+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94029426305216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8dadb0 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.447+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8dbd50 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.447+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94029426296480] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.448+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94029426305216] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.449+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.449+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94029426309216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8db000 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.449+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8dc200 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94029426309216] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94029426301552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8dc200 con 0x7f7318074040 2024-05-15T18:10:43.443 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 20 add_watcher() i=0 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 20 add_watcher() i=1 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 20 add_watcher() i=2 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 20 add_watcher() i=3 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 20 add_watcher() i=4 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 20 add_watcher() i=5 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.450+0000 7f7330c3f800 20 add_watcher() i=6 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.451+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94029426301552] v31'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.451+0000 7f7330c3f800 20 add_watcher() i=7 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.451+0000 7f7330c3f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.451+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8df560 con 0x5584ee8cbb50 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.451+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.451+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94029426310848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee8dc790 con 0x5584ee8cbb50 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.452+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94029426310848] v31'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.452+0000 7f71e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.452+0000 7f7330c3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.452+0000 7f7330c3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.452+0000 7f7330c3f800 5 note: GC not initialized 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f715f7fe640 20 reqs_thread_entry: start 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f7330c3f800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f7330c3f800 20 Filter name: none 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f715d7fa640 20 reqs_thread_entry: start 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f7330c3f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125f0 con 0x5584ee8cbb50 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.453+0000 7f7330c3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:could not fetch user info: no user info saved 2024-05-15T18:10:43.445 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.454+0000 7f71e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.454+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94029426310848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x5584ee8cbb50 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.455+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94029426310848] v31'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.455+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94029426286448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x7f732000f070 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.456+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94029426286448] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.456+0000 7f7330c3f800 20 remove_watcher() i=0 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.456+0000 7f7330c3f800 2 removed watcher, disabling cache 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.456+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94029426290800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x5584ee8cbb50 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.457+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94029426290800] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.457+0000 7f7330c3f800 20 remove_watcher() i=1 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.457+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94029426291856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x5584ee8d02d0 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.458+0000 7f732e73e640 1 -- 172.21.15.173:0/182715184 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94029426291856] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7320074020 con 0x5584ee8d02d0 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.458+0000 7f7330c3f800 20 remove_watcher() i=2 2024-05-15T18:10:43.446 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.458+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94029426298048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x7f732000f070 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.459+0000 7f7325f3d640 1 -- 172.21.15.173:0/182715184 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94029426298048] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731807f070 con 0x7f732000f070 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.459+0000 7f7330c3f800 20 remove_watcher() i=3 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.459+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94029426296480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x5584ee8cbb50 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.460+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94029426296480] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x5584ee8cbb50 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.460+0000 7f7330c3f800 20 remove_watcher() i=4 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.460+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94029426305216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x7f7318074040 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.461+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94029426305216] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.461+0000 7f7330c3f800 20 remove_watcher() i=5 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.461+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94029426309216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x7f7318074040 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.462+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94029426309216] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.462+0000 7f7330c3f800 20 remove_watcher() i=6 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.462+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94029426301552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584ee9125b0 con 0x7f7318074040 2024-05-15T18:10:43.447 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94029426301552] v31'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f732800a4a0 con 0x7f7318074040 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 20 remove_watcher() i=7 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7318074040 msgr2=0x7f7318081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f7318074040 0x7f7318081410 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee8cbb50 msgr2=0x5584ee8ce010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee8cbb50 0x5584ee8ce010 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f732000f070 msgr2=0x7f7320027430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f732000f070 0x7f7320027430 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee8d02d0 msgr2=0x5584ee8d26c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee8d02d0 0x5584ee8d26c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f71f8036900 msgr2=0x7f71f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f71f8036900 0x7f71f8038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7318052fd0 tx=0x7f731804f000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 msgr2=0x5584ee8c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8c04f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f732003dfd0 tx=0x7f73200055c0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.463+0000 7f732ef3f640 1 -- 172.21.15.173:0/182715184 reap_dead start 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 shutdown_connections 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/182715184 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8b9070 0x5584ee8c04f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 >> 172.21.15.173:0/182715184 conn(0x5584ee8b5390 msgr2=0x5584ee8b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 shutdown_connections 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/182715184 wait complete. 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7208036900 msgr2=0x7f7208038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7208036900 0x7f7208038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5584ee891bb0 tx=0x7f7318005ac0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8abef0 msgr2=0x5584ee8ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8abef0 0x5584ee8ac310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f73200178f0 tx=0x7f7320017d30 comp rx=0 tx=0).stop 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 shutdown_connections 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7208036900 0x7f7208038dc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3896052570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee8abef0 0x5584ee8ac310 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 >> 172.21.15.173:0/3896052570 conn(0x5584ee89ff90 msgr2=0x5584ee8a0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 shutdown_connections 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3896052570 wait complete. 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5584ee89aee0 msgr2=0x5584ee89d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5584ee89aee0 0x5584ee89d330 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee792540 msgr2=0x5584ee8946c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5584ee792540 0x5584ee8946c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee896fa0 msgr2=0x5584ee899390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5584ee896fa0 0x5584ee899390 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7214036900 msgr2=0x7f7214038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7214036900 0x7f7214038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7318054000 tx=0x7f731804e000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 msgr2=0x5584ee88d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.450 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f7330c3f800 1 --2- 172.21.15.173:0/3904685959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5584ee790a00 0x5584ee88d480 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7320001ed0 tx=0x7f7320000ed0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.464+0000 7f732ef3f640 1 -- 172.21.15.173:0/3904685959 reap_dead start 2024-05-15T18:10:43.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.465+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 shutdown_connections 2024-05-15T18:10:43.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.465+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 >> 172.21.15.173:0/3904685959 conn(0x5584ee78c5a0 msgr2=0x5584ee87fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.465+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 shutdown_connections 2024-05-15T18:10:43.451 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.465+0000 7f7330c3f800 1 -- 172.21.15.173:0/3904685959 wait complete. 2024-05-15T18:10:43.451 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-15T18:10:43.452 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-05-15T18:10:43.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-05-15T18:10:43.452 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-05-15T18:10:43.495 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.496 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.520+0000 7fca6572d800 1 Processor -- start 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.520+0000 7fca6572d800 1 -- start start 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.520+0000 7fca6572d800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d9e35b4c10 0x55d9e35b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.520+0000 7fca6572d800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9e35bb050 con 0x55d9e35b7540 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.520+0000 7fca6572d800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55d9e3445050 con 0x55d9e35b4c10 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.521+0000 7fca6137f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d9e35b4c10 0x55d9e35b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.521+0000 7fca6137f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55d9e35b4c10 0x55d9e35b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50194/0 (socket says 172.21.15.173:50194) 2024-05-15T18:10:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.521+0000 7fca60b7e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55d9e35b7540 0x55d9e35b9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38580/0 (socket says 172.21.15.173:38580) 2024-05-15T18:10:43.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.521+0000 7fca6137f640 1 -- 172.21.15.173:0/595582271 learned_addr learned my addr 172.21.15.173:0/595582271 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.521+0000 7fca6137f640 1 -- 172.21.15.173:0/595582271 >> v1:172.21.15.3:6789/0 conn(0x55d9e35b7540 legacy=0x55d9e35b9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.521+0000 7fca6137f640 1 -- 172.21.15.173:0/595582271 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e35bc230 con 0x55d9e35b4c10 2024-05-15T18:10:43.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6137f640 1 --2- 172.21.15.173:0/595582271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b7000 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a520 tx=0x7fca5401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afb50d467048571 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca53fff640 1 -- 172.21.15.173:0/595582271 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54057070 con 0x55d9e35b4c10 2024-05-15T18:10:43.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca53fff640 1 -- 172.21.15.173:0/595582271 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca54052570 con 0x55d9e35b4c10 2024-05-15T18:10:43.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca53fff640 1 -- 172.21.15.173:0/595582271 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5404ae60 con 0x55d9e35b4c10 2024-05-15T18:10:43.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6572d800 1 -- 172.21.15.173:0/595582271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 msgr2=0x55d9e35b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6572d800 1 --2- 172.21.15.173:0/595582271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b7000 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fca5400a520 tx=0x7fca5401d010 comp rx=0 tx=0).stop 2024-05-15T18:10:43.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6572d800 1 -- 172.21.15.173:0/595582271 shutdown_connections 2024-05-15T18:10:43.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6572d800 1 --2- 172.21.15.173:0/595582271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b7000 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6572d800 1 -- 172.21.15.173:0/595582271 >> 172.21.15.173:0/595582271 conn(0x55d9e35ae660 msgr2=0x55d9e35b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6572d800 1 -- 172.21.15.173:0/595582271 shutdown_connections 2024-05-15T18:10:43.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.523+0000 7fca6572d800 1 -- 172.21.15.173:0/595582271 wait complete. 2024-05-15T18:10:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.537+0000 7fca6572d800 1 Processor -- start 2024-05-15T18:10:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.537+0000 7fca6572d800 1 -- start start 2024-05-15T18:10:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.538+0000 7fca6572d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.538+0000 7fca6572d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9e34ff1d0 con 0x55d9e35b4c10 2024-05-15T18:10:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.538+0000 7fca6137f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.538+0000 7fca6137f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50210/0 (socket says 172.21.15.173:50210) 2024-05-15T18:10:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.538+0000 7fca6137f640 1 -- 172.21.15.173:0/3660863573 learned_addr learned my addr 172.21.15.173:0/3660863573 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.538+0000 7fca6137f640 1 -- 172.21.15.173:0/3660863573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e35b2b10 con 0x55d9e35b4c10 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.538+0000 7fca6137f640 1 --2- 172.21.15.173:0/3660863573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b4550 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fca54055040 tx=0x7fca5404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659ffa56bd5a50fd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fc94f606640 1 -- 172.21.15.173:0/3660863573 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54057040 con 0x55d9e35b4c10 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fc94f606640 1 -- 172.21.15.173:0/3660863573 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca54052720 con 0x55d9e35b4c10 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fc94f606640 1 -- 172.21.15.173:0/3660863573 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54052a20 con 0x55d9e35b4c10 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fca6572d800 1 -- 172.21.15.173:0/3660863573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 msgr2=0x55d9e35b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fca6572d800 1 --2- 172.21.15.173:0/3660863573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b4550 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fca54055040 tx=0x7fca5404c000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fca6572d800 1 -- 172.21.15.173:0/3660863573 shutdown_connections 2024-05-15T18:10:43.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fca6572d800 1 --2- 172.21.15.173:0/3660863573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e35b4550 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fca6572d800 1 -- 172.21.15.173:0/3660863573 >> 172.21.15.173:0/3660863573 conn(0x55d9e35ae660 msgr2=0x55d9e36a1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fca6572d800 1 -- 172.21.15.173:0/3660863573 shutdown_connections 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.539+0000 7fca6572d800 1 -- 172.21.15.173:0/3660863573 wait complete. 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6572d800 1 Processor -- start 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6572d800 1 -- start start 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6572d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e36af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6572d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9e35bb4c0 con 0x55d9e35b4c10 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6137f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e36af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6137f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e36af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50224/0 (socket says 172.21.15.173:50224) 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6137f640 1 -- 172.21.15.173:0/1216129138 learned_addr learned my addr 172.21.15.173:0/1216129138 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.540+0000 7fca6137f640 1 -- 172.21.15.173:0/1216129138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e36af9d0 con 0x55d9e35b4c10 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fca6137f640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e36af490 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fca54052540 tx=0x7fca54003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fc94de03640 1 -- 172.21.15.173:0/1216129138 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54073070 con 0x55d9e35b4c10 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fc94de03640 1 -- 172.21.15.173:0/1216129138 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5405d440 con 0x55d9e35b4c10 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9e36afc60 con 0x55d9e35b4c10 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fc94de03640 1 -- 172.21.15.173:0/1216129138 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca54057070 con 0x55d9e35b4c10 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e36b2910 con 0x55d9e35b4c10 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fca6572d800 1 Processor -- start 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.541+0000 7fca6572d800 1 -- start start 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca6572d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36bd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca6572d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9e34a5cf0 con 0x55d9e36bcd40 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fc94de03640 1 -- 172.21.15.173:0/1216129138 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca54076070 con 0x55d9e35b4c10 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca61b80640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca61b80640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50234/0 (socket says 172.21.15.173:50234) 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca61b80640 1 -- 172.21.15.173:0/700914694 learned_addr learned my addr 172.21.15.173:0/700914694 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fc94de03640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc948036900 0x7fc948038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fc94de03640 1 -- 172.21.15.173:0/1216129138 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fca5408db90 con 0x55d9e35b4c10 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca6137f640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc948036900 0x7fc948038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca61b80640 1 -- 172.21.15.173:0/700914694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e36bd6a0 con 0x55d9e36bcd40 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca61b80640 1 --2- 172.21.15.173:0/700914694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36bd160 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00a430 tx=0x7fca5c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4def716610019f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fca6137f640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc948036900 0x7fc948038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca54066f70 tx=0x7fca5405d820 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fc9477fe640 1 -- 172.21.15.173:0/700914694 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c015070 con 0x55d9e36bcd40 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fc9477fe640 1 -- 172.21.15.173:0/700914694 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c001670 con 0x55d9e36bcd40 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.542+0000 7fc9477fe640 1 -- 172.21.15.173:0/700914694 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c001990 con 0x55d9e36bcd40 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 -- 172.21.15.173:0/700914694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 msgr2=0x55d9e36bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 --2- 172.21.15.173:0/700914694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36bd160 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00a430 tx=0x7fca5c00a8f0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 -- 172.21.15.173:0/700914694 shutdown_connections 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 --2- 172.21.15.173:0/700914694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36bd160 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 -- 172.21.15.173:0/700914694 >> 172.21.15.173:0/700914694 conn(0x55d9e35b7540 msgr2=0x55d9e36b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 -- 172.21.15.173:0/700914694 shutdown_connections 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 -- 172.21.15.173:0/700914694 wait complete. 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 Processor -- start 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 -- start start 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.543+0000 7fca6572d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9e36be030 con 0x55d9e36bcd40 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fca61b80640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fca61b80640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50236/0 (socket says 172.21.15.173:50236) 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fca61b80640 1 -- 172.21.15.173:0/1460057981 learned_addr learned my addr 172.21.15.173:0/1460057981 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fca61b80640 1 -- 172.21.15.173:0/1460057981 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e36c4790 con 0x55d9e36bcd40 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fca61b80640 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36c4250 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00a930 tx=0x7fca5c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fc945ffb640 1 -- 172.21.15.173:0/1460057981 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c020020 con 0x55d9e36bcd40 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fc945ffb640 1 -- 172.21.15.173:0/1460057981 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c0108b0 con 0x55d9e36bcd40 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9e36c4a20 con 0x55d9e36bcd40 2024-05-15T18:10:43.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fc945ffb640 1 -- 172.21.15.173:0/1460057981 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c015040 con 0x55d9e36bcd40 2024-05-15T18:10:43.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.544+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e36c76d0 con 0x55d9e36bcd40 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.545+0000 7fc945ffb640 1 -- 172.21.15.173:0/1460057981 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca5c023020 con 0x55d9e36bcd40 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.545+0000 7fc945ffb640 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc938036900 0x7fc938038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.545+0000 7fc945ffb640 1 -- 172.21.15.173:0/1460057981 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fca5c04bef0 con 0x55d9e36bcd40 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.545+0000 7fca60b7e640 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc938036900 0x7fc938038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6572d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6572d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca60b7e640 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc938036900 0x7fc938038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca58000f60 tx=0x7fca580012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6572d800 1 Processor -- start 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6572d800 1 -- start start 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6572d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36de960 0x55d9e36ded80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6572d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d9e35b2dd0 con 0x55d9e36de960 2024-05-15T18:10:43.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6137f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36de960 0x55d9e36ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6137f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36de960 0x55d9e36ded80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50244/0 (socket says 172.21.15.173:50244) 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.546+0000 7fca6137f640 1 -- 172.21.15.173:0/2004514896 learned_addr learned my addr 172.21.15.173:0/2004514896 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.547+0000 7fca6137f640 1 -- 172.21.15.173:0/2004514896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e36df2c0 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.547+0000 7fca6137f640 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36de960 0x55d9e36ded80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fca54006b30 tx=0x7fca5405dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.547+0000 7fc9267e4640 1 -- 172.21.15.173:0/2004514896 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5408de60 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.547+0000 7fc9267e4640 1 -- 172.21.15.173:0/2004514896 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca54091070 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.547+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9e36dfd30 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.547+0000 7fc9267e4640 1 -- 172.21.15.173:0/2004514896 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5405c880 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.547+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e36e0230 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.548+0000 7fc9267e4640 1 -- 172.21.15.173:0/2004514896 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca5405ca20 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.548+0000 7fc9267e4640 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc898036900 0x7fc898038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.548+0000 7fc9267e4640 1 -- 172.21.15.173:0/2004514896 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fca54002000 con 0x55d9e36de960 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.548+0000 7fca60b7e640 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc898036900 0x7fc898038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.548+0000 7fc91ffff640 20 reqs_thread_entry: start 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.548+0000 7fca60b7e640 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc898036900 0x7fc898038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca58001ed0 tx=0x7fca5800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9e36ec360 0x55d9e36ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9e36eeec0 con 0x55d9e36ec360 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca61b80640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9e36ec360 0x55d9e36ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca61b80640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9e36ec360 0x55d9e36ee7f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca61b80640 1 -- 172.21.15.173:0/1216129138 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca5c00e070 con 0x55d9e36ec360 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9e36f0c90 0x55d9e36f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:2 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d9e36f3780 con 0x55d9e36f0c90 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.549+0000 7fca6137f640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9e36f0c90 0x55d9e36f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.550+0000 7fca6137f640 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9e36f0c90 0x55d9e36f3080 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.550+0000 7fca6137f640 1 -- 172.21.15.173:0/1216129138 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(2 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca54084070 con 0x55d9e36f0c90 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc938036900 msgr2=0x7fc938038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc938036900 0x7fc938038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca58000f60 tx=0x7fca580012f0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 msgr2=0x55d9e36c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36c4250 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00a930 tx=0x7fca5c003370 comp rx=0 tx=0).stop 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 shutdown_connections 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc938036900 0x7fc938038dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/1460057981 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36bcd40 0x55d9e36c4250 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 >> 172.21.15.173:0/1460057981 conn(0x55d9e35b7540 msgr2=0x55d9e36b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 shutdown_connections 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1460057981 wait complete. 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc898036900 msgr2=0x7fc898038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc898036900 0x7fc898038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca58001ed0 tx=0x7fca5800f000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36de960 msgr2=0x55d9e36ded80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36de960 0x55d9e36ded80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fca54006b30 tx=0x7fca5405dd20 comp rx=0 tx=0).stop 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 shutdown_connections 2024-05-15T18:10:43.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc898036900 0x7fc898038dc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/2004514896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e36de960 0x55d9e36ded80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 >> 172.21.15.173:0/2004514896 conn(0x55d9e36d33f0 msgr2=0x55d9e36d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 shutdown_connections 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/2004514896 wait complete. 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9e36ec360 msgr2=0x55d9e36ee7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9e36ec360 0x55d9e36ee7f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9e36f0c90 msgr2=0x55d9e36f3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9e36f0c90 0x55d9e36f3080 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc948036900 msgr2=0x7fc948038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.551+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc948036900 0x7fc948038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca54066f70 tx=0x7fca5405d820 comp rx=0 tx=0).stop 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 msgr2=0x55d9e36af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e36af490 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fca54052540 tx=0x7fca54003020 comp rx=0 tx=0).stop 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 shutdown_connections 2024-05-15T18:10:43.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55d9e36ec360 0x55d9e36ee7f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55d9e36f0c90 0x55d9e36f3080 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fc948036900 0x7fc948038dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 --2- 172.21.15.173:0/1216129138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d9e35b4c10 0x55d9e36af490 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 >> 172.21.15.173:0/1216129138 conn(0x55d9e35ae660 msgr2=0x55d9e35b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 shutdown_connections 2024-05-15T18:10:43.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.552+0000 7fca6572d800 1 -- 172.21.15.173:0/1216129138 wait complete. 2024-05-15T18:10:43.538 INFO:teuthology.orchestra.run.smithi173.stdout:{"id":"74ac2443-e34d-4255-b728-cefe496e7fb2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-15T18:10:43.538 DEBUG:tasks.util.rgw: json result: {'id': '74ac2443-e34d-4255-b728-cefe496e7fb2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-15T18:10:43.539 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-05-15T18:10:43.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-05-15T18:10:43.539 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-05-15T18:10:43.622 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.622 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd75a51f800 1 Processor -- start 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd75a51f800 1 -- start start 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd75a51f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558948118a10 0x558948118e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd75a51f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55894808da10 con 0x558948119370 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd75a51f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x558947fab050 con 0x558948118a10 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd7561ca640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558948118a10 0x558948118e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd7561ca640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558948118a10 0x558948118e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50256/0 (socket says 172.21.15.173:50256) 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd74ffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x558948119370 0x558948119820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38592/0 (socket says 172.21.15.173:38592) 2024-05-15T18:10:43.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.647+0000 7fd7561ca640 1 -- 172.21.15.173:0/1144926475 learned_addr learned my addr 172.21.15.173:0/1144926475 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.648+0000 7fd7561ca640 1 -- 172.21.15.173:0/1144926475 >> v1:172.21.15.3:6789/0 conn(0x558948119370 legacy=0x558948119820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.648+0000 7fd7561ca640 1 -- 172.21.15.173:0/1144926475 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558948119f30 con 0x558948118a10 2024-05-15T18:10:43.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.648+0000 7fd7559c9640 1 -- 172.21.15.173:0/1144926475 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105059093 0 0) 0x55894808da10 con 0x558948119370 2024-05-15T18:10:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd7561ca640 1 --2- 172.21.15.173:0/1144926475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x558948118e30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd74800a520 tx=0x7fd74801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f910ac3f8712357 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd7559c9640 1 -- 172.21.15.173:0/1144926475 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd748057070 con 0x558948118a10 2024-05-15T18:10:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd7559c9640 1 -- 172.21.15.173:0/1144926475 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd748052570 con 0x558948118a10 2024-05-15T18:10:43.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd7559c9640 1 -- 172.21.15.173:0/1144926475 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74804ae60 con 0x558948118a10 2024-05-15T18:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd75a51f800 1 -- 172.21.15.173:0/1144926475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 msgr2=0x558948118e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1144926475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x558948118e30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd74800a520 tx=0x7fd74801d010 comp rx=0 tx=0).stop 2024-05-15T18:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd75a51f800 1 -- 172.21.15.173:0/1144926475 shutdown_connections 2024-05-15T18:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1144926475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x558948118e30 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd75a51f800 1 -- 172.21.15.173:0/1144926475 >> 172.21.15.173:0/1144926475 conn(0x558948114590 msgr2=0x5589481169b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd75a51f800 1 -- 172.21.15.173:0/1144926475 shutdown_connections 2024-05-15T18:10:43.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.650+0000 7fd75a51f800 1 -- 172.21.15.173:0/1144926475 wait complete. 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.663+0000 7fd75a51f800 1 Processor -- start 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.663+0000 7fd75a51f800 1 -- start start 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.663+0000 7fd75a51f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x55894820d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.663+0000 7fd75a51f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5589480651c0 con 0x558948118a10 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd7561ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x55894820d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd7561ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x55894820d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50266/0 (socket says 172.21.15.173:50266) 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd7561ca640 1 -- 172.21.15.173:0/3742551610 learned_addr learned my addr 172.21.15.173:0/3742551610 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd7561ca640 1 -- 172.21.15.173:0/3742551610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894820df20 con 0x558948118a10 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd7561ca640 1 --2- 172.21.15.173:0/3742551610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x55894820d950 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd748055040 tx=0x7fd74804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9227e802ae0ea7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd644608640 1 -- 172.21.15.173:0/3742551610 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd748062070 con 0x558948118a10 2024-05-15T18:10:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd644608640 1 -- 172.21.15.173:0/3742551610 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd748052720 con 0x558948118a10 2024-05-15T18:10:43.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.664+0000 7fd644608640 1 -- 172.21.15.173:0/3742551610 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd748057040 con 0x558948118a10 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 -- 172.21.15.173:0/3742551610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 msgr2=0x55894820d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3742551610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x55894820d950 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd748055040 tx=0x7fd74804c000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 -- 172.21.15.173:0/3742551610 shutdown_connections 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3742551610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948118a10 0x55894820d950 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 -- 172.21.15.173:0/3742551610 >> 172.21.15.173:0/3742551610 conn(0x558948114590 msgr2=0x558948209270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 -- 172.21.15.173:0/3742551610 shutdown_connections 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 -- 172.21.15.173:0/3742551610 wait complete. 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.665+0000 7fd75a51f800 1 Processor -- start 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd75a51f800 1 -- start start 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd75a51f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948119370 0x5589482154d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd75a51f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55894811a460 con 0x558948119370 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd7561ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948119370 0x5589482154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd7561ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948119370 0x5589482154d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50276/0 (socket says 172.21.15.173:50276) 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 learned_addr learned my addr 172.21.15.173:0/1146465155 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558948215a10 con 0x558948119370 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.666+0000 7fd7561ca640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948119370 0x5589482154d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd748005400 tx=0x7fd748002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd642e05640 1 -- 172.21.15.173:0/1146465155 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd748057070 con 0x558948119370 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558948215ca0 con 0x558948119370 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd642e05640 1 -- 172.21.15.173:0/1146465155 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd748067450 con 0x558948119370 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558948218950 con 0x558948119370 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd642e05640 1 -- 172.21.15.173:0/1146465155 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd748062040 con 0x558948119370 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd75a51f800 1 Processor -- start 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd75a51f800 1 -- start start 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd75a51f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x558948223960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.667+0000 7fd75a51f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55894800bcf0 con 0x558948223540 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd7569cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x558948223960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd7569cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x558948223960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50292/0 (socket says 172.21.15.173:50292) 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd7569cb640 1 -- 172.21.15.173:0/3768464872 learned_addr learned my addr 172.21.15.173:0/3768464872 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd642e05640 1 -- 172.21.15.173:0/1146465155 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd748067730 con 0x558948119370 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd642e05640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd63c036900 0x7fd63c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd7569cb640 1 -- 172.21.15.173:0/3768464872 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558948223f30 con 0x558948223540 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd642e05640 1 -- 172.21.15.173:0/1146465155 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fd74808df00 con 0x558948119370 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd7561ca640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd63c036900 0x7fd63c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd7569cb640 1 --2- 172.21.15.173:0/3768464872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x558948223960 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd75000a430 tx=0x7fd75000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c158ddea5d68b1c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd640e01640 1 -- 172.21.15.173:0/3768464872 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750015070 con 0x558948223540 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd640e01640 1 -- 172.21.15.173:0/3768464872 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd750001670 con 0x558948223540 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.668+0000 7fd640e01640 1 -- 172.21.15.173:0/3768464872 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750001990 con 0x558948223540 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 -- 172.21.15.173:0/3768464872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 msgr2=0x558948223960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd7561ca640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd63c036900 0x7fd63c038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd748052fd0 tx=0x7fd7480058f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3768464872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x558948223960 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd75000a430 tx=0x7fd75000a8f0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 -- 172.21.15.173:0/3768464872 shutdown_connections 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3768464872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x558948223960 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 -- 172.21.15.173:0/3768464872 >> 172.21.15.173:0/3768464872 conn(0x55894821f850 msgr2=0x55894821d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 -- 172.21.15.173:0/3768464872 shutdown_connections 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 -- 172.21.15.173:0/3768464872 wait complete. 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 Processor -- start 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 -- start start 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x55894822a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd75a51f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558948224460 con 0x558948223540 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd7569cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x55894822a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd7569cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x55894822a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50298/0 (socket says 172.21.15.173:50298) 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.669+0000 7fd7569cb640 1 -- 172.21.15.173:0/975268568 learned_addr learned my addr 172.21.15.173:0/975268568 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.670+0000 7fd7569cb640 1 -- 172.21.15.173:0/975268568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894822ac30 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.670+0000 7fd7569cb640 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x55894822a6f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd75000a930 tx=0x7fd750003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.670+0000 7fd63affd640 1 -- 172.21.15.173:0/975268568 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750020020 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.670+0000 7fd63affd640 1 -- 172.21.15.173:0/975268568 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7500108b0 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.670+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55894822aec0 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.670+0000 7fd63affd640 1 -- 172.21.15.173:0/975268568 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd750015040 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.670+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894822db70 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.671+0000 7fd63affd640 1 -- 172.21.15.173:0/975268568 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd750023020 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.671+0000 7fd63affd640 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd630036950 0x7fd630038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.671+0000 7fd63affd640 1 -- 172.21.15.173:0/975268568 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fd75004be70 con 0x558948223540 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.671+0000 7fd74ffff640 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd630036950 0x7fd630038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.671+0000 7fd75a51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.671+0000 7fd75a51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd75a51f800 1 Processor -- start 2024-05-15T18:10:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd74ffff640 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd630036950 0x7fd630038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd740000c00 tx=0x7fd740001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd75a51f800 1 -- start start 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd75a51f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948244d30 0x558948245150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd75a51f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55894820e1e0 con 0x558948244d30 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd7561ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948244d30 0x558948245150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd7561ca640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948244d30 0x558948245150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50306/0 (socket says 172.21.15.173:50306) 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd7561ca640 1 -- 172.21.15.173:0/3854139061 learned_addr learned my addr 172.21.15.173:0/3854139061 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.672+0000 7fd7561ca640 1 -- 172.21.15.173:0/3854139061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558948245690 con 0x558948244d30 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.673+0000 7fd7561ca640 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948244d30 0x558948245150 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd748044990 tx=0x7fd74808c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.673+0000 7fd61b7e6640 1 -- 172.21.15.173:0/3854139061 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74805d440 con 0x558948244d30 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.673+0000 7fd61b7e6640 1 -- 172.21.15.173:0/3854139061 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74805c3e0 con 0x558948244d30 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.673+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558948246100 con 0x558948244d30 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.673+0000 7fd61b7e6640 1 -- 172.21.15.173:0/3854139061 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74805d5e0 con 0x558948244d30 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.673+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558948246600 con 0x558948244d30 2024-05-15T18:10:43.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd61b7e6640 1 -- 172.21.15.173:0/3854139061 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd74805c760 con 0x558948244d30 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd61b7e6640 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd58c0368b0 0x7fd58c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd61b7e6640 1 -- 172.21.15.173:0/3854139061 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fd748080040 con 0x558948244d30 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd74ffff640 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd58c0368b0 0x7fd58c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd6197e2640 20 reqs_thread_entry: start 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd74ffff640 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd58c0368b0 0x7fd58c038d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd740000f60 tx=0x7fd740006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558948252780 0x558948254bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558948255250 con 0x558948252780 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.674+0000 7fd7569cb640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558948252780 0x558948254bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd7569cb640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558948252780 0x558948254bd0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558948255b30 con 0x558948252780 2024-05-15T18:10:43.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558948257440 0x558948259890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55894825a020 con 0x558948257440 2024-05-15T18:10:43.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd7561ca640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558948257440 0x558948259890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.675+0000 7fd7561ca640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558948257440 0x558948259890 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.676+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.676+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558948267160 con 0x558948252780 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.676+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:NOTICE: set zone's realm_id= 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.676+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(5 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd7561ca640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x558948118a10 0x7fd7480769b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948118a10 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd74ffff640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x558948118a10 0x7fd7480769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd74ffff640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x558948118a10 0x7fd7480769b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd74001e040 con 0x558948118a10 2024-05-15T18:10:43.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd74ffff640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd74001ec10 0x7fd74001c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.677+0000 7fd7569cb640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd74001ec10 0x7fd74001c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.678+0000 7fd7569cb640 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd74001ec10 0x7fd74001c970 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.678+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.678+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.678+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.678+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948118a10 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd74001e040 con 0x558948118a10 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.679+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948118a10 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(17 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd74002b040 con 0x558948118a10 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.680+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.681+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=74b] v22'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(25 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.673 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.682+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.683+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(26 [pgnls start_epoch 31 out=107b] v29'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.683+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948118a10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.683+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd74002b040 con 0x558948118a10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.683+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.683+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.683+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.683+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.684+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.684+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.684+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x7fd74001ec10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.684+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd750010d70 con 0x7fd74001ec10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.684+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948118a10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.684+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd74002b040 con 0x558948118a10 2024-05-15T18:10:43.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.684+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948257440 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948118a10 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd74002b040 con 0x558948118a10 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948252780 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(35 [pgnls start_epoch 31 out=115b] v22'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55894825e520 con 0x558948118a10 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd74ffff640 1 -- 172.21.15.173:0/1146465155 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(36 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd74002b040 con 0x558948118a10 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.685+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558948260fd0 con 0x558948252780 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.686+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.686+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:38 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558948265030 con 0x558948257440 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.686+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(38 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.686+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:39 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558948256750 con 0x558948257440 2024-05-15T18:10:43.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.687+0000 7fd7561ca640 1 -- 172.21.15.173:0/1146465155 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(39 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [create,call,writefull 0~1155] v31'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fd748064070 con 0x558948257440 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.687+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5589482639b0 con 0x558948252780 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.689+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v31'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.689+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558948261450 con 0x558948252780 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.689+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v31'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fd750010d70 con 0x558948252780 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd630036950 msgr2=0x7fd630038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd630036950 0x7fd630038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd740000c00 tx=0x7fd740001330 comp rx=0 tx=0).stop 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 msgr2=0x55894822a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x55894822a6f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd75000a930 tx=0x7fd750003370 comp rx=0 tx=0).stop 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 shutdown_connections 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd630036950 0x7fd630038e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 --2- 172.21.15.173:0/975268568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948223540 0x55894822a6f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 >> 172.21.15.173:0/975268568 conn(0x55894821f850 msgr2=0x55894821ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 shutdown_connections 2024-05-15T18:10:43.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.690+0000 7fd75a51f800 1 -- 172.21.15.173:0/975268568 wait complete. 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd58c0368b0 msgr2=0x7fd58c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd58c0368b0 0x7fd58c038d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd740000f60 tx=0x7fd740006000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948244d30 msgr2=0x558948245150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948244d30 0x558948245150 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd748044990 tx=0x7fd74808c340 comp rx=0 tx=0).stop 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 shutdown_connections 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd58c0368b0 0x7fd58c038d70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/3854139061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948244d30 0x558948245150 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 >> 172.21.15.173:0/3854139061 conn(0x558948239800 msgr2=0x55894823a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 shutdown_connections 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/3854139061 wait complete. 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd74001ec10 msgr2=0x7fd74001c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fd74001ec10 0x7fd74001c970 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558948252780 msgr2=0x558948254bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.677 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558948252780 0x558948254bd0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x558948118a10 msgr2=0x7fd7480769b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x558948118a10 0x7fd7480769b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558948257440 msgr2=0x558948259890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558948257440 0x558948259890 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd63c036900 msgr2=0x7fd63c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fd63c036900 0x7fd63c038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd748052fd0 tx=0x7fd7480058f0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948119370 msgr2=0x5589482154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd7569cb640 1 -- 172.21.15.173:0/1146465155 reap_dead start 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948119370 0x5589482154d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd748005400 tx=0x7fd748002fb0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 shutdown_connections 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 --2- 172.21.15.173:0/1146465155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558948119370 0x5589482154d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 >> 172.21.15.173:0/1146465155 conn(0x558948114590 msgr2=0x558948207a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 shutdown_connections 2024-05-15T18:10:43.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.691+0000 7fd75a51f800 1 -- 172.21.15.173:0/1146465155 wait complete. 2024-05-15T18:10:43.680 INFO:teuthology.orchestra.run.smithi173.stdout:{"id":"74ac2443-e34d-4255-b728-cefe496e7fb2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-15T18:10:43.680 DEBUG:tasks.util.rgw: json result: {'id': '74ac2443-e34d-4255-b728-cefe496e7fb2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-15T18:10:43.680 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-05-15T18:10:43.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-05-15T18:10:43.680 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-05-15T18:10:43.762 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.762 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.786+0000 7fbc47719800 1 Processor -- start 2024-05-15T18:10:43.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.786+0000 7fbc47719800 1 -- start start 2024-05-15T18:10:43.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.786+0000 7fbc47719800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559e858b4510 0x559e858bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.786+0000 7fbc47719800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e85827910 con 0x559e858b29d0 2024-05-15T18:10:43.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.786+0000 7fbc47719800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x559e85745050 con 0x559e858b4510 2024-05-15T18:10:43.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.787+0000 7fbc3ca17640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559e858b4510 0x559e858bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.787+0000 7fbc45218640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x559e858b29d0 0x559e858b2df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38600/0 (socket says 172.21.15.173:38600) 2024-05-15T18:10:43.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.787+0000 7fbc3ca17640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x559e858b4510 0x559e858bd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50320/0 (socket says 172.21.15.173:50320) 2024-05-15T18:10:43.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.787+0000 7fbc45218640 1 -- 172.21.15.173:0/2985098100 learned_addr learned my addr 172.21.15.173:0/2985098100 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:43.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.787+0000 7fbc3ca17640 1 -- 172.21.15.173:0/2985098100 >> v1:172.21.15.3:6789/0 conn(0x559e858b29d0 legacy=0x559e858b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.787+0000 7fbc3ca17640 1 -- 172.21.15.173:0/2985098100 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e858be560 con 0x559e858b4510 2024-05-15T18:10:43.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.789+0000 7fbc3ca17640 1 --2- 172.21.15.173:0/2985098100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b4510 0x559e858bd010 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000a470 tx=0x7fbc3001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a3d5728396a6fd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.789+0000 7fbc44a17640 1 -- 172.21.15.173:0/2985098100 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30057070 con 0x559e858b4510 2024-05-15T18:10:43.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.789+0000 7fbc44a17640 1 -- 172.21.15.173:0/2985098100 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3004adc0 con 0x559e858b4510 2024-05-15T18:10:43.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.789+0000 7fbc44a17640 1 -- 172.21.15.173:0/2985098100 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc30052590 con 0x559e858b4510 2024-05-15T18:10:43.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.789+0000 7fbc47719800 1 -- 172.21.15.173:0/2985098100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b4510 msgr2=0x559e858bd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.789+0000 7fbc47719800 1 --2- 172.21.15.173:0/2985098100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b4510 0x559e858bd010 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000a470 tx=0x7fbc3001ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:43.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.789+0000 7fbc47719800 1 -- 172.21.15.173:0/2985098100 shutdown_connections 2024-05-15T18:10:43.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.790+0000 7fbc47719800 1 --2- 172.21.15.173:0/2985098100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b4510 0x559e858bd010 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.790+0000 7fbc47719800 1 -- 172.21.15.173:0/2985098100 >> 172.21.15.173:0/2985098100 conn(0x559e858ae590 msgr2=0x559e858b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.790+0000 7fbc47719800 1 -- 172.21.15.173:0/2985098100 shutdown_connections 2024-05-15T18:10:43.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.790+0000 7fbc47719800 1 -- 172.21.15.173:0/2985098100 wait complete. 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.803+0000 7fbc47719800 1 Processor -- start 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.803+0000 7fbc47719800 1 -- start start 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.803+0000 7fbc47719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859a79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.803+0000 7fbc47719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559e857ff1c0 con 0x559e858b29d0 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbc45218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859a79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbc45218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859a79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50330/0 (socket says 172.21.15.173:50330) 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbc45218640 1 -- 172.21.15.173:0/789126267 learned_addr learned my addr 172.21.15.173:0/789126267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbc45218640 1 -- 172.21.15.173:0/789126267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e859a7fb0 con 0x559e858b29d0 2024-05-15T18:10:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbc45218640 1 --2- 172.21.15.173:0/789126267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859a79e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbc38001de0 tx=0x7fbc3800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4f6d8080023b89 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbb33606640 1 -- 172.21.15.173:0/789126267 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38012020 con 0x559e858b29d0 2024-05-15T18:10:43.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbb33606640 1 -- 172.21.15.173:0/789126267 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3800e5a0 con 0x559e858b29d0 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.804+0000 7fbb33606640 1 -- 172.21.15.173:0/789126267 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3800e8c0 con 0x559e858b29d0 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 -- 172.21.15.173:0/789126267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 msgr2=0x559e859a79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 --2- 172.21.15.173:0/789126267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859a79e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fbc38001de0 tx=0x7fbc3800b6c0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 -- 172.21.15.173:0/789126267 shutdown_connections 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 --2- 172.21.15.173:0/789126267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859a79e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 -- 172.21.15.173:0/789126267 >> 172.21.15.173:0/789126267 conn(0x559e858ae590 msgr2=0x559e859a3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 -- 172.21.15.173:0/789126267 shutdown_connections 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 -- 172.21.15.173:0/789126267 wait complete. 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 Processor -- start 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 -- start start 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.805+0000 7fbc47719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559e858bd820 con 0x559e858b29d0 2024-05-15T18:10:43.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbc45218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbc45218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50342/0 (socket says 172.21.15.173:50342) 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbc45218640 1 -- 172.21.15.173:0/3068004495 learned_addr learned my addr 172.21.15.173:0/3068004495 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbc45218640 1 -- 172.21.15.173:0/3068004495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e859afa90 con 0x559e858b29d0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbc45218640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859af550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c010 tx=0x7fbc38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbb31e03640 1 -- 172.21.15.173:0/3068004495 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38012070 con 0x559e858b29d0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbb31e03640 1 -- 172.21.15.173:0/3068004495 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3801a7a0 con 0x559e858b29d0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e859afd20 con 0x559e858b29d0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbb31e03640 1 -- 172.21.15.173:0/3068004495 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3801aa80 con 0x559e858b29d0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.806+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e859b29d0 con 0x559e858b29d0 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbc47719800 1 Processor -- start 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbc47719800 1 -- start start 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbc47719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbc47719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559e857a5cf0 con 0x559e859bce00 2024-05-15T18:10:43.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbb31e03640 1 -- 172.21.15.173:0/3068004495 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbc38015020 con 0x559e858b29d0 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbc45a19640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbc45a19640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859bd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50346/0 (socket says 172.21.15.173:50346) 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbc45a19640 1 -- 172.21.15.173:0/776982560 learned_addr learned my addr 172.21.15.173:0/776982560 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbb31e03640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb2c036900 0x7fbb2c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.807+0000 7fbb31e03640 1 -- 172.21.15.173:0/3068004495 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fbc38020070 con 0x559e858b29d0 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc45218640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb2c036900 0x7fbb2c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc45a19640 1 -- 172.21.15.173:0/776982560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e859bd760 con 0x559e859bce00 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc45a19640 1 --2- 172.21.15.173:0/776982560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859bd220 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a430 tx=0x7fbc4000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6087f4317976dfd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc45218640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb2c036900 0x7fbb2c038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc380015f0 tx=0x7fbc38001520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbb2b7fe640 1 -- 172.21.15.173:0/776982560 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40015070 con 0x559e859bce00 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbb2b7fe640 1 -- 172.21.15.173:0/776982560 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40001670 con 0x559e859bce00 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbb2b7fe640 1 -- 172.21.15.173:0/776982560 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40001990 con 0x559e859bce00 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc47719800 1 -- 172.21.15.173:0/776982560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 msgr2=0x559e859bd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc47719800 1 --2- 172.21.15.173:0/776982560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859bd220 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a430 tx=0x7fbc4000a8f0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc47719800 1 -- 172.21.15.173:0/776982560 shutdown_connections 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc47719800 1 --2- 172.21.15.173:0/776982560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859bd220 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc47719800 1 -- 172.21.15.173:0/776982560 >> 172.21.15.173:0/776982560 conn(0x559e858b4510 msgr2=0x559e859b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc47719800 1 -- 172.21.15.173:0/776982560 shutdown_connections 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.808+0000 7fbc47719800 1 -- 172.21.15.173:0/776982560 wait complete. 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc47719800 1 Processor -- start 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc47719800 1 -- start start 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc47719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc47719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559e859be0f0 con 0x559e859bce00 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc45a19640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc45a19640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50360/0 (socket says 172.21.15.173:50360) 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc45a19640 1 -- 172.21.15.173:0/226185567 learned_addr learned my addr 172.21.15.173:0/226185567 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.809+0000 7fbc45a19640 1 -- 172.21.15.173:0/226185567 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e859c4830 con 0x559e859bce00 2024-05-15T18:10:43.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.810+0000 7fbc45a19640 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859c42f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a930 tx=0x7fbc40003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.810+0000 7fbb29ffb640 1 -- 172.21.15.173:0/226185567 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40020020 con 0x559e859bce00 2024-05-15T18:10:43.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.810+0000 7fbb29ffb640 1 -- 172.21.15.173:0/226185567 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc400108b0 con 0x559e859bce00 2024-05-15T18:10:43.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.810+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e859c4ac0 con 0x559e859bce00 2024-05-15T18:10:43.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.810+0000 7fbb29ffb640 1 -- 172.21.15.173:0/226185567 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc40015040 con 0x559e859bce00 2024-05-15T18:10:43.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.810+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e859c7770 con 0x559e859bce00 2024-05-15T18:10:43.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.810+0000 7fbb29ffb640 1 -- 172.21.15.173:0/226185567 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbc40023020 con 0x559e859bce00 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbb29ffb640 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb1c036950 0x7fbb1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbb29ffb640 1 -- 172.21.15.173:0/226185567 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fbc4004bf40 con 0x559e859bce00 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbc3ca17640 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb1c036950 0x7fbb1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbc47719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbc47719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbc3ca17640 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb1c036950 0x7fbb1c038e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbc30054000 tx=0x7fbc3004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbc47719800 1 Processor -- start 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.811+0000 7fbc47719800 1 -- start start 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc47719800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859dea00 0x559e859dee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc47719800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559e859a8330 con 0x559e859dea00 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc45218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859dea00 0x559e859dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc45218640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859dea00 0x559e859dee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50370/0 (socket says 172.21.15.173:50370) 2024-05-15T18:10:43.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc45218640 1 -- 172.21.15.173:0/3067580279 learned_addr learned my addr 172.21.15.173:0/3067580279 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc45218640 1 -- 172.21.15.173:0/3067580279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e859df360 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc45218640 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859dea00 0x559e859dee20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbc3804aa00 tx=0x7fbc3804c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbb09fe3640 1 -- 172.21.15.173:0/3067580279 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc38016920 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbb09fe3640 1 -- 172.21.15.173:0/3067580279 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc38016ac0 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.812+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e859dfdd0 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.813+0000 7fbb09fe3640 1 -- 172.21.15.173:0/3067580279 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc3800d950 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.813+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e859e02d0 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.813+0000 7fbb09fe3640 1 -- 172.21.15.173:0/3067580279 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbc3800daf0 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.813+0000 7fbb09fe3640 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba88036900 0x7fba88038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.813+0000 7fbb09fe3640 1 -- 172.21.15.173:0/3067580279 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fbc38035070 con 0x559e859dea00 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.813+0000 7fbc3ca17640 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba88036900 0x7fba88038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fba837fe640 20 reqs_thread_entry: start 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559e859ec400 0x559e859ee870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fbc3ca17640 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba88036900 0x7fba88038dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc3001ced0 tx=0x7fbc30005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e859eeef0 con 0x559e859ec400 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fbc45a19640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559e859ec400 0x559e859ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fbc45a19640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559e859ec400 0x559e859ee870 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fbc45a19640 1 -- 172.21.15.173:0/3068004495 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc40010d70 con 0x559e859ec400 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.814+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e859ef820 con 0x559e859ec400 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.815+0000 7fbc45a19640 1 -- 172.21.15.173:0/3068004495 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc40010d70 con 0x559e859ec400 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.815+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559e859f1130 0x559e859f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.815+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559e859f3d10 con 0x559e859f1130 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.815+0000 7fbc45218640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559e859f1130 0x559e859f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.815+0000 7fbc45218640 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559e859f1130 0x559e859f3580 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc45218640 1 -- 172.21.15.173:0/3068004495 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fbc38043020 con 0x559e859f1130 2024-05-15T18:10:43.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb1c036950 msgr2=0x7fbb1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb1c036950 0x7fbb1c038e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbc30054000 tx=0x7fbc3004e000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 msgr2=0x559e859c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859c42f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a930 tx=0x7fbc40003370 comp rx=0 tx=0).stop 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 shutdown_connections 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb1c036950 0x7fbb1c038e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 --2- 172.21.15.173:0/226185567 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859bce00 0x559e859c42f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 >> 172.21.15.173:0/226185567 conn(0x559e858b4510 msgr2=0x559e859b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 shutdown_connections 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.816+0000 7fbc47719800 1 -- 172.21.15.173:0/226185567 wait complete. 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba88036900 msgr2=0x7fba88038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba88036900 0x7fba88038dc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbc3001ced0 tx=0x7fbc30005a00 comp rx=0 tx=0).stop 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859dea00 msgr2=0x559e859dee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859dea00 0x559e859dee20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbc3804aa00 tx=0x7fbc3804c420 comp rx=0 tx=0).stop 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 shutdown_connections 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fba88036900 0x7fba88038dc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3067580279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e859dea00 0x559e859dee20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 >> 172.21.15.173:0/3067580279 conn(0x559e859d34b0 msgr2=0x559e859d3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 shutdown_connections 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3067580279 wait complete. 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559e859ec400 msgr2=0x559e859ee870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559e859ec400 0x559e859ee870 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559e859f1130 msgr2=0x559e859f3580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559e859f1130 0x559e859f3580 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb2c036900 msgr2=0x7fbb2c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb2c036900 0x7fbb2c038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc380015f0 tx=0x7fbc38001520 comp rx=0 tx=0).stop 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 msgr2=0x559e859af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859af550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800c010 tx=0x7fbc38000ed0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 shutdown_connections 2024-05-15T18:10:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x559e859ec400 0x559e859ee870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x559e859f1130 0x559e859f3580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fbb2c036900 0x7fbb2c038dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 --2- 172.21.15.173:0/3068004495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559e858b29d0 0x559e859af550 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 >> 172.21.15.173:0/3068004495 conn(0x559e858ae590 msgr2=0x559e859a1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 shutdown_connections 2024-05-15T18:10:43.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.817+0000 7fbc47719800 1 -- 172.21.15.173:0/3068004495 wait complete. 2024-05-15T18:10:43.803 INFO:teuthology.orchestra.run.smithi173.stdout:{"id":"74ac2443-e34d-4255-b728-cefe496e7fb2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-15T18:10:43.803 DEBUG:tasks.util.rgw: json result: {'id': '74ac2443-e34d-4255-b728-cefe496e7fb2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-15T18:10:43.803 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-15T18:10:43.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-15T18:10:43.804 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-15T18:10:43.889 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.889 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e3140f800 1 Processor -- start 2024-05-15T18:10:43.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e3140f800 1 -- start start 2024-05-15T18:10:43.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e3140f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5558b3727c80 0x5558b372a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e3140f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558b372e0c0 con 0x5558b372a5b0 2024-05-15T18:10:43.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e3140f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5558b35b8050 con 0x5558b3727c80 2024-05-15T18:10:43.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e2cb6a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5558b3727c80 0x5558b372a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e2cb6a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5558b3727c80 0x5558b372a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50384/0 (socket says 172.21.15.173:50384) 2024-05-15T18:10:43.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/73499447 learned_addr learned my addr 172.21.15.173:0/73499447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.914+0000 7f8e2c369640 1 --1- 172.21.15.173:0/73499447 >> v1:172.21.15.3:6789/0 conn(0x5558b372a5b0 0x5558b372c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38604/0 (socket says 172.21.15.173:38604) 2024-05-15T18:10:43.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.915+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/73499447 >> v1:172.21.15.3:6789/0 conn(0x5558b372a5b0 legacy=0x5558b372c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.915+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/73499447 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b372f2a0 con 0x5558b3727c80 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/73499447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b372a070 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005fd0 tx=0x7f8e2401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f70af40e056655 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e2bb68640 1 -- 172.21.15.173:0/73499447 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24052540 con 0x5558b3727c80 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e2bb68640 1 -- 172.21.15.173:0/73499447 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e2404e070 con 0x5558b3727c80 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e2bb68640 1 -- 172.21.15.173:0/73499447 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24052890 con 0x5558b3727c80 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e3140f800 1 -- 172.21.15.173:0/73499447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 msgr2=0x5558b372a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e3140f800 1 --2- 172.21.15.173:0/73499447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b372a070 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005fd0 tx=0x7f8e2401cd80 comp rx=0 tx=0).stop 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e3140f800 1 -- 172.21.15.173:0/73499447 shutdown_connections 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e3140f800 1 --2- 172.21.15.173:0/73499447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b372a070 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e3140f800 1 -- 172.21.15.173:0/73499447 >> 172.21.15.173:0/73499447 conn(0x5558b3721610 msgr2=0x5558b3723a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e3140f800 1 -- 172.21.15.173:0/73499447 shutdown_connections 2024-05-15T18:10:43.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.917+0000 7f8e3140f800 1 -- 172.21.15.173:0/73499447 wait complete. 2024-05-15T18:10:43.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.931+0000 7f8e3140f800 1 Processor -- start 2024-05-15T18:10:43.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.931+0000 7f8e3140f800 1 -- start start 2024-05-15T18:10:43.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.931+0000 7f8e3140f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b37275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.931+0000 7f8e3140f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5558b36721f0 con 0x5558b3727c80 2024-05-15T18:10:43.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.931+0000 7f8e2cb6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b37275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.931+0000 7f8e2cb6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b37275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50394/0 (socket says 172.21.15.173:50394) 2024-05-15T18:10:43.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.931+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/3909238711 learned_addr learned my addr 172.21.15.173:0/3909238711 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.932+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/3909238711 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b3725b80 con 0x5558b3727c80 2024-05-15T18:10:43.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.932+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/3909238711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b37275c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401ba70 tx=0x7f8e2404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d24beca9a43225b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.932+0000 7f8d1ae0d640 1 -- 172.21.15.173:0/3909238711 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24052820 con 0x5558b3727c80 2024-05-15T18:10:43.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.932+0000 7f8d1ae0d640 1 -- 172.21.15.173:0/3909238711 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e24062070 con 0x5558b3727c80 2024-05-15T18:10:43.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.932+0000 7f8d1ae0d640 1 -- 172.21.15.173:0/3909238711 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24052b10 con 0x5558b3727c80 2024-05-15T18:10:43.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 -- 172.21.15.173:0/3909238711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 msgr2=0x5558b37275c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 --2- 172.21.15.173:0/3909238711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b37275c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8e2401ba70 tx=0x7f8e2404c000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 -- 172.21.15.173:0/3909238711 shutdown_connections 2024-05-15T18:10:43.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 --2- 172.21.15.173:0/3909238711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b37275c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 -- 172.21.15.173:0/3909238711 >> 172.21.15.173:0/3909238711 conn(0x5558b3721610 msgr2=0x5558b3814040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 -- 172.21.15.173:0/3909238711 shutdown_connections 2024-05-15T18:10:43.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 -- 172.21.15.173:0/3909238711 wait complete. 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 Processor -- start 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 -- start start 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b38223d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e3140f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5558b372e530 con 0x5558b3727c80 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e2cb6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b38223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e2cb6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b38223d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50402/0 (socket says 172.21.15.173:50402) 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.933+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/1444754479 learned_addr learned my addr 172.21.15.173:0/1444754479 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.934+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/1444754479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b3822910 con 0x5558b3727c80 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.934+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b38223d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400a190 tx=0x7f8e24003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.934+0000 7f8d1960a640 1 -- 172.21.15.173:0/1444754479 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24071570 con 0x5558b3727c80 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.934+0000 7f8d1960a640 1 -- 172.21.15.173:0/1444754479 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e24058040 con 0x5558b3727c80 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.934+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558b3822ba0 con 0x5558b3727c80 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.934+0000 7f8d1960a640 1 -- 172.21.15.173:0/1444754479 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24071880 con 0x5558b3727c80 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.934+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558b3825850 con 0x5558b3727c80 2024-05-15T18:10:43.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e3140f800 1 Processor -- start 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e3140f800 1 -- start start 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e3140f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38300f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e3140f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5558b3618cf0 con 0x5558b382fcd0 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8d1960a640 1 -- 172.21.15.173:0/1444754479 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e24050070 con 0x5558b3727c80 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e2d36b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38300f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e2d36b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38300f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50410/0 (socket says 172.21.15.173:50410) 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e2d36b640 1 -- 172.21.15.173:0/3907315921 learned_addr learned my addr 172.21.15.173:0/3907315921 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8d1960a640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d14036900 0x7f8d14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8d1960a640 1 -- 172.21.15.173:0/1444754479 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8e2408e4f0 con 0x5558b3727c80 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d14036900 0x7f8d14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.935+0000 7f8e2d36b640 1 -- 172.21.15.173:0/3907315921 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b3830630 con 0x5558b382fcd0 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e2d36b640 1 --2- 172.21.15.173:0/3907315921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38300f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00a400 tx=0x7f8e1c00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1242a481619c34b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d14036900 0x7f8d14038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8e2407afd0 tx=0x7f8e2407af00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8d12ffd640 1 -- 172.21.15.173:0/3907315921 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c0087e0 con 0x5558b382fcd0 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8d12ffd640 1 -- 172.21.15.173:0/3907315921 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0089a0 con 0x5558b382fcd0 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8d12ffd640 1 -- 172.21.15.173:0/3907315921 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c008d00 con 0x5558b382fcd0 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e3140f800 1 -- 172.21.15.173:0/3907315921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 msgr2=0x5558b38300f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e3140f800 1 --2- 172.21.15.173:0/3907315921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38300f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00a400 tx=0x7f8e1c00a8c0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e3140f800 1 -- 172.21.15.173:0/3907315921 shutdown_connections 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e3140f800 1 --2- 172.21.15.173:0/3907315921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38300f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e3140f800 1 -- 172.21.15.173:0/3907315921 >> 172.21.15.173:0/3907315921 conn(0x5558b372a5b0 msgr2=0x5558b382c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e3140f800 1 -- 172.21.15.173:0/3907315921 shutdown_connections 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.936+0000 7f8e3140f800 1 -- 172.21.15.173:0/3907315921 wait complete. 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.937+0000 7f8e3140f800 1 Processor -- start 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.937+0000 7f8e3140f800 1 -- start start 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.937+0000 7f8e3140f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.937+0000 7f8e3140f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5558b3830fc0 con 0x5558b382fcd0 2024-05-15T18:10:43.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.937+0000 7f8e2d36b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.937+0000 7f8e2d36b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38371c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50424/0 (socket says 172.21.15.173:50424) 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.937+0000 7f8e2d36b640 1 -- 172.21.15.173:0/152274133 learned_addr learned my addr 172.21.15.173:0/152274133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.938+0000 7f8e2d36b640 1 -- 172.21.15.173:0/152274133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b3837700 con 0x5558b382fcd0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.938+0000 7f8e2d36b640 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38371c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5558b3830a80 tx=0x7f8e1c002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.938+0000 7f8d117fa640 1 -- 172.21.15.173:0/152274133 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c022020 con 0x5558b382fcd0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.938+0000 7f8d117fa640 1 -- 172.21.15.173:0/152274133 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c019040 con 0x5558b382fcd0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.938+0000 7f8d117fa640 1 -- 172.21.15.173:0/152274133 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1c013950 con 0x5558b382fcd0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.938+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558b3837990 con 0x5558b382fcd0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.938+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558b383a640 con 0x5558b382fcd0 2024-05-15T18:10:43.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.939+0000 7f8d117fa640 1 -- 172.21.15.173:0/152274133 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e1c025020 con 0x5558b382fcd0 2024-05-15T18:10:43.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.939+0000 7f8d117fa640 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d04036950 0x7f8d04038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.939+0000 7f8d117fa640 1 -- 172.21.15.173:0/152274133 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8e1c04c1a0 con 0x5558b382fcd0 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.939+0000 7f8e2c369640 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d04036950 0x7f8d04038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e3140f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e3140f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e2c369640 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d04036950 0x7f8d04038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000f60 tx=0x7f8e140012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e3140f800 1 Processor -- start 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e3140f800 1 -- start start 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e3140f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b38518c0 0x5558b3851ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e3140f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5558b3725e40 con 0x5558b38518c0 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e2cb6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b38518c0 0x5558b3851ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e2cb6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b38518c0 0x5558b3851ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50426/0 (socket says 172.21.15.173:50426) 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.940+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/2666678940 learned_addr learned my addr 172.21.15.173:0/2666678940 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.941+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/2666678940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558b3852220 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.941+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b38518c0 0x5558b3851ce0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8e2406e000 tx=0x7f8e24070bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.941+0000 7f8cf1fe3640 1 -- 172.21.15.173:0/2666678940 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24067950 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.941+0000 7f8cf1fe3640 1 -- 172.21.15.173:0/2666678940 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e24066400 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.941+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558b3852c90 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.941+0000 7f8cf1fe3640 1 -- 172.21.15.173:0/2666678940 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e24067770 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.941+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558b3853190 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8cf1fe3640 1 -- 172.21.15.173:0/2666678940 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8e24065380 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8cf1fe3640 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8c64036900 0x7f8c64038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8cf1fe3640 1 -- 172.21.15.173:0/2666678940 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f8e24082070 con 0x5558b38518c0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8e2c369640 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8c64036900 0x7f8c64038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8ceb7fe640 20 reqs_thread_entry: start 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8e2c369640 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8c64036900 0x7f8c64038dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8e14001ed0 tx=0x7f8e1400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5558b385f2c0 0x5558b3861780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558b3861e50 con 0x5558b385f2c0 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.942+0000 7f8e2d36b640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5558b385f2c0 0x5558b3861780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.943+0000 7f8e2d36b640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5558b385f2c0 0x5558b3861780 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.943+0000 7f8e2d36b640 1 -- 172.21.15.173:0/1444754479 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8e1c049130 con 0x5558b385f2c0 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.943+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5558b3863c20 0x5558b3866010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.943+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:2 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5558b3866710 con 0x5558b3863c20 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.943+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5558b3863c20 0x5558b3866010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.943+0000 7f8e2cb6a640 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5558b3863c20 0x5558b3866010 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.944+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/1444754479 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(2 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f8e24077020 con 0x5558b3863c20 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.944+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5558b38632f0 con 0x5558b3863c20 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.945+0000 7f8e2cb6a640 1 -- 172.21.15.173:0/1444754479 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [stat,call,call,writefull 0~993] v31'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f8e24077020 con 0x5558b3863c20 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d04036950 msgr2=0x7f8d04038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d04036950 0x7f8d04038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8e14000f60 tx=0x7f8e140012f0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 msgr2=0x5558b38371c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38371c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x5558b3830a80 tx=0x7f8e1c002ff0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 shutdown_connections 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d04036950 0x7f8d04038e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/152274133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b382fcd0 0x5558b38371c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 >> 172.21.15.173:0/152274133 conn(0x5558b372a5b0 msgr2=0x5558b3829db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 shutdown_connections 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/152274133 wait complete. 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8c64036900 msgr2=0x7f8c64038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8c64036900 0x7f8c64038dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8e14001ed0 tx=0x7f8e1400f000 comp rx=0 tx=0).stop 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b38518c0 msgr2=0x5558b3851ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b38518c0 0x5558b3851ce0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8e2406e000 tx=0x7f8e24070bc0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 shutdown_connections 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8c64036900 0x7f8c64038dc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 --2- 172.21.15.173:0/2666678940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b38518c0 0x5558b3851ce0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.946+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 >> 172.21.15.173:0/2666678940 conn(0x5558b3846350 msgr2=0x5558b3846d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 shutdown_connections 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/2666678940 wait complete. 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5558b385f2c0 msgr2=0x5558b3861780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5558b385f2c0 0x5558b3861780 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5558b3863c20 msgr2=0x5558b3866010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5558b3863c20 0x5558b3866010 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d14036900 msgr2=0x7f8d14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d14036900 0x7f8d14038dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8e2407afd0 tx=0x7f8e2407af00 comp rx=0 tx=0).stop 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 msgr2=0x5558b38223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b38223d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400a190 tx=0x7f8e24003330 comp rx=0 tx=0).stop 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 shutdown_connections 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5558b385f2c0 0x5558b3861780 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5558b3863c20 0x5558b3866010 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8d14036900 0x7f8d14038dc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 --2- 172.21.15.173:0/1444754479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5558b3727c80 0x5558b38223d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 >> 172.21.15.173:0/1444754479 conn(0x5558b3721610 msgr2=0x5558b37263a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 shutdown_connections 2024-05-15T18:10:43.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.947+0000 7f8e3140f800 1 -- 172.21.15.173:0/1444754479 wait complete. 2024-05-15T18:10:43.932 INFO:teuthology.orchestra.run.smithi173.stdout:{"id":"74ac2443-e34d-4255-b728-cefe496e7fb2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-15T18:10:43.932 DEBUG:tasks.util.rgw: json result: {'id': '74ac2443-e34d-4255-b728-cefe496e7fb2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-15T18:10:43.933 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-05-15T18:10:43.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-05-15T18:10:43.933 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-05-15T18:10:43.975 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:43.975 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:43.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.999+0000 7f4d0ce98800 1 Processor -- start 2024-05-15T18:10:43.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.999+0000 7f4d0ce98800 1 -- start start 2024-05-15T18:10:43.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.999+0000 7f4d0ce98800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560152430130 0x560152430550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.999+0000 7f4d0ce98800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560152430bd0 con 0x560152431340 2024-05-15T18:10:43.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:43.999+0000 7f4d0ce98800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5601522c1050 con 0x560152430130 2024-05-15T18:10:43.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.000+0000 7f4d0a99e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560152430130 0x560152430550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.000+0000 7f4d0a99e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x560152430130 0x560152430550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50428/0 (socket says 172.21.15.173:50428) 2024-05-15T18:10:43.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.000+0000 7f4d0219d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x560152431340 0x5601524317c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38612/0 (socket says 172.21.15.173:38612) 2024-05-15T18:10:43.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.000+0000 7f4d0a99e640 1 -- 172.21.15.173:0/4174414159 learned_addr learned my addr 172.21.15.173:0/4174414159 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.000+0000 7f4d0a99e640 1 -- 172.21.15.173:0/4174414159 >> v1:172.21.15.3:6789/0 conn(0x560152431340 legacy=0x5601524317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.000+0000 7f4d0a99e640 1 -- 172.21.15.173:0/4174414159 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560152431f00 con 0x560152430130 2024-05-15T18:10:43.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.002+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/4174414159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x560152430550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a520 tx=0x7f4cfc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e4f947e7c0a57f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:43.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.002+0000 7f4d0a19d640 1 -- 172.21.15.173:0/4174414159 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc057070 con 0x560152430130 2024-05-15T18:10:43.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.002+0000 7f4d0a19d640 1 -- 172.21.15.173:0/4174414159 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc052570 con 0x560152430130 2024-05-15T18:10:43.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.002+0000 7f4d0a19d640 1 -- 172.21.15.173:0/4174414159 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc052870 con 0x560152430130 2024-05-15T18:10:43.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.003+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4174414159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 msgr2=0x560152430550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:43.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.003+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/4174414159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x560152430550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a520 tx=0x7f4cfc01d010 comp rx=0 tx=0).stop 2024-05-15T18:10:43.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.003+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4174414159 shutdown_connections 2024-05-15T18:10:43.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.003+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/4174414159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x560152430550 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:43.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.003+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4174414159 >> 172.21.15.173:0/4174414159 conn(0x56015242b770 msgr2=0x56015242db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:43.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.003+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4174414159 shutdown_connections 2024-05-15T18:10:43.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.003+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4174414159 wait complete. 2024-05-15T18:10:43.993 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0ce98800 1 Processor -- start 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0ce98800 1 -- start start 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0ce98800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525217c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0ce98800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56015237b1c0 con 0x560152430130 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0a99e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0a99e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525217c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50440/0 (socket says 172.21.15.173:50440) 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0a99e640 1 -- 172.21.15.173:0/1505728673 learned_addr learned my addr 172.21.15.173:0/1505728673 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.017+0000 7f4d0a99e640 1 -- 172.21.15.173:0/1505728673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560152521d90 con 0x560152430130 2024-05-15T18:10:43.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/1505728673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525217c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc055040 tx=0x7f4cfc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578e1b3d8705b8af server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4bf8e09640 1 -- 172.21.15.173:0/1505728673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc057040 con 0x560152430130 2024-05-15T18:10:44.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4bf8e09640 1 -- 172.21.15.173:0/1505728673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc052850 con 0x560152430130 2024-05-15T18:10:44.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4bf8e09640 1 -- 172.21.15.173:0/1505728673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc052b50 con 0x560152430130 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4d0ce98800 1 -- 172.21.15.173:0/1505728673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 msgr2=0x5601525217c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/1505728673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525217c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc055040 tx=0x7f4cfc04c000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4d0ce98800 1 -- 172.21.15.173:0/1505728673 shutdown_connections 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/1505728673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525217c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.018+0000 7f4d0ce98800 1 -- 172.21.15.173:0/1505728673 >> 172.21.15.173:0/1505728673 conn(0x56015242b770 msgr2=0x56015251d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0ce98800 1 -- 172.21.15.173:0/1505728673 shutdown_connections 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0ce98800 1 -- 172.21.15.173:0/1505728673 wait complete. 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0ce98800 1 Processor -- start 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0ce98800 1 -- start start 2024-05-15T18:10:44.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0ce98800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525291f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0ce98800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560152439810 con 0x560152430130 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0a99e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525291f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0a99e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525291f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50442/0 (socket says 172.21.15.173:50442) 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.019+0000 7f4d0a99e640 1 -- 172.21.15.173:0/3412897383 learned_addr learned my addr 172.21.15.173:0/3412897383 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.020+0000 7f4d0a99e640 1 -- 172.21.15.173:0/3412897383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560152529730 con 0x560152430130 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.020+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525291f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a520 tx=0x7f4cfc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.020+0000 7f4bf7606640 1 -- 172.21.15.173:0/3412897383 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc073070 con 0x560152430130 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.020+0000 7f4bf7606640 1 -- 172.21.15.173:0/3412897383 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc05d650 con 0x560152430130 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.020+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601525299c0 con 0x560152430130 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.020+0000 7f4bf7606640 1 -- 172.21.15.173:0/3412897383 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc057070 con 0x560152430130 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.020+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015252c670 con 0x560152430130 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0ce98800 1 Processor -- start 2024-05-15T18:10:44.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0ce98800 1 -- start start 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0ce98800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x560152536ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0ce98800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560152321cf0 con 0x560152536aa0 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4bf7606640 1 -- 172.21.15.173:0/3412897383 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4cfc076070 con 0x560152430130 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4bf7606640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4bf0036900 0x7f4bf0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0b19f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x560152536ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0b19f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x560152536ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50450/0 (socket says 172.21.15.173:50450) 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4bf7606640 1 -- 172.21.15.173:0/3412897383 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f4cfc08deb0 con 0x560152430130 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0b19f640 1 -- 172.21.15.173:0/4120860452 learned_addr learned my addr 172.21.15.173:0/4120860452 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4bf0036900 0x7f4bf0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.021+0000 7f4d0b19f640 1 -- 172.21.15.173:0/4120860452 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560152537400 con 0x560152536aa0 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4bf0036900 0x7f4bf0038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc08c450 tx=0x7f4cfc052f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0b19f640 1 --2- 172.21.15.173:0/4120860452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x560152536ec0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400a430 tx=0x7f4d0400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434c2d8cef555bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4bf5602640 1 -- 172.21.15.173:0/4120860452 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d04015070 con 0x560152536aa0 2024-05-15T18:10:44.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4bf5602640 1 -- 172.21.15.173:0/4120860452 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d04001670 con 0x560152536aa0 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4bf5602640 1 -- 172.21.15.173:0/4120860452 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d04001990 con 0x560152536aa0 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4120860452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 msgr2=0x560152536ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/4120860452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x560152536ec0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400a430 tx=0x7f4d0400a8f0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4120860452 shutdown_connections 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/4120860452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x560152536ec0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4120860452 >> 172.21.15.173:0/4120860452 conn(0x560152431340 msgr2=0x560152533540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4120860452 shutdown_connections 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.022+0000 7f4d0ce98800 1 -- 172.21.15.173:0/4120860452 wait complete. 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0ce98800 1 Processor -- start 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0ce98800 1 -- start start 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0ce98800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x5601523a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0ce98800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560152537d90 con 0x560152536aa0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0b19f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x5601523a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0b19f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x5601523a57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50464/0 (socket says 172.21.15.173:50464) 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0b19f640 1 -- 172.21.15.173:0/997603010 learned_addr learned my addr 172.21.15.173:0/997603010 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.023+0000 7f4d0b19f640 1 -- 172.21.15.173:0/997603010 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601523a3ed0 con 0x560152536aa0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.024+0000 7f4d0b19f640 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x5601523a57e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4d04013040 tx=0x7f4d04003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.024+0000 7f4bef7fe640 1 -- 172.21.15.173:0/997603010 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d04020020 con 0x560152536aa0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.024+0000 7f4bef7fe640 1 -- 172.21.15.173:0/997603010 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d040108e0 con 0x560152536aa0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.024+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601523a4160 con 0x560152536aa0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.024+0000 7f4bef7fe640 1 -- 172.21.15.173:0/997603010 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d04015040 con 0x560152536aa0 2024-05-15T18:10:44.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.024+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601523a4600 con 0x560152536aa0 2024-05-15T18:10:44.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4bef7fe640 1 -- 172.21.15.173:0/997603010 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4d04023020 con 0x560152536aa0 2024-05-15T18:10:44.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4bef7fe640 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4be4036950 0x7f4be4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4bef7fe640 1 -- 172.21.15.173:0/997603010 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f4d0404bf40 con 0x560152536aa0 2024-05-15T18:10:44.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4d0219d640 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4be4036950 0x7f4be4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4d0ce98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:44.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4d0ce98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:44.011 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4d0219d640 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4be4036950 0x7f4be4038e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4000f60 tx=0x7f4cf40012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.025+0000 7f4d0ce98800 1 Processor -- start 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0ce98800 1 -- start start 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0ce98800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56015255a840 0x56015255ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0ce98800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560152522050 con 0x56015255a840 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0a99e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56015255a840 0x56015255ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0a99e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56015255a840 0x56015255ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50466/0 (socket says 172.21.15.173:50466) 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0a99e640 1 -- 172.21.15.173:0/81990138 learned_addr learned my addr 172.21.15.173:0/81990138 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0a99e640 1 -- 172.21.15.173:0/81990138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015255b1a0 con 0x56015255a840 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.026+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56015255a840 0x56015255ac60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc08c3c0 tx=0x7f4cfc066b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.027+0000 7f4bcf7e6640 1 -- 172.21.15.173:0/81990138 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc097070 con 0x56015255a840 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.027+0000 7f4bcf7e6640 1 -- 172.21.15.173:0/81990138 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc08a040 con 0x56015255a840 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.027+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56015255bc10 con 0x56015255a840 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.027+0000 7f4bcf7e6640 1 -- 172.21.15.173:0/81990138 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cfc089050 con 0x56015255a840 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.027+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015255c110 con 0x56015255a840 2024-05-15T18:10:44.012 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.027+0000 7f4bcf7e6640 1 -- 172.21.15.173:0/81990138 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4cfc09a070 con 0x56015255a840 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4bcf7e6640 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4b4c0368b0 0x7f4b4c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4bcf7e6640 1 -- 172.21.15.173:0/81990138 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f4cfc09dc00 con 0x56015255a840 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4d0219d640 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4b4c0368b0 0x7f4b4c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4bcd7e2640 20 reqs_thread_entry: start 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4d0219d640 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4b4c0368b0 0x7f4b4c038d70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001ed0 tx=0x7f4cf400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560152568300 0x56015256a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56015256ad80 con 0x560152568300 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4d0b19f640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560152568300 0x56015256a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.028+0000 7f4d0b19f640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560152568300 0x56015256a6f0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.029+0000 7f4d0b19f640 1 -- 172.21.15.173:0/3412897383 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d0400e070 con 0x560152568300 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.029+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56015256b2e0 con 0x560152568300 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.029+0000 7f4d0b19f640 1 -- 172.21.15.173:0/3412897383 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d0400e070 con 0x560152568300 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.029+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56015256cf00 0x56015256f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.029+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:3 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56015256fb20 con 0x56015256cf00 2024-05-15T18:10:44.013 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.029+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56015256cf00 0x56015256f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.029+0000 7f4d0a99e640 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56015256cf00 0x56015256f390 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.030+0000 7f4d0a99e640 1 -- 172.21.15.173:0/3412897383 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(3 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4cfc099030 con 0x56015256cf00 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4be4036950 msgr2=0x7f4be4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4be4036950 0x7f4be4038e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4000f60 tx=0x7f4cf40012f0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 msgr2=0x5601523a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x5601523a57e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4d04013040 tx=0x7f4d04003370 comp rx=0 tx=0).stop 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 shutdown_connections 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4be4036950 0x7f4be4038e10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/997603010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152536aa0 0x5601523a57e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 >> 172.21.15.173:0/997603010 conn(0x560152431340 msgr2=0x560152530b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 shutdown_connections 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/997603010 wait complete. 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4b4c0368b0 msgr2=0x7f4b4c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.014 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4b4c0368b0 0x7f4b4c038d70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001ed0 tx=0x7f4cf400f000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56015255a840 msgr2=0x56015255ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56015255a840 0x56015255ac60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc08c3c0 tx=0x7f4cfc066b40 comp rx=0 tx=0).stop 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 shutdown_connections 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4b4c0368b0 0x7f4b4c038d70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/81990138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56015255a840 0x56015255ac60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 >> 172.21.15.173:0/81990138 conn(0x56015254f2d0 msgr2=0x56015254fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 shutdown_connections 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/81990138 wait complete. 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56015256cf00 msgr2=0x56015256f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56015256cf00 0x56015256f390 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560152568300 msgr2=0x56015256a6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560152568300 0x56015256a6f0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4bf0036900 msgr2=0x7f4bf0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.015 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4bf0036900 0x7f4bf0038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc08c450 tx=0x7f4cfc052f90 comp rx=0 tx=0).stop 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 msgr2=0x5601525291f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525291f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00a520 tx=0x7f4cfc003020 comp rx=0 tx=0).stop 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 shutdown_connections 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x56015256cf00 0x56015256f390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x560152568300 0x56015256a6f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4bf0036900 0x7f4bf0038dc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.031+0000 7f4d0ce98800 1 --2- 172.21.15.173:0/3412897383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560152430130 0x5601525291f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.032+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 >> 172.21.15.173:0/3412897383 conn(0x56015242b770 msgr2=0x56015251b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.032+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 shutdown_connections 2024-05-15T18:10:44.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.032+0000 7f4d0ce98800 1 -- 172.21.15.173:0/3412897383 wait complete. 2024-05-15T18:10:44.017 INFO:teuthology.orchestra.run.smithi173.stdout:{"id":"0a7d7418-39f7-493f-89f0-016c6637672d","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"74ac2443-e34d-4255-b728-cefe496e7fb2","zones":[{"id":"74ac2443-e34d-4255-b728-cefe496e7fb2","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-15T18:10:44.017 DEBUG:tasks.util.rgw: json result: {'id': '0a7d7418-39f7-493f-89f0-016c6637672d', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '74ac2443-e34d-4255-b728-cefe496e7fb2', 'zones': [{'id': '74ac2443-e34d-4255-b728-cefe496e7fb2', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-15T18:10:44.020 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-05-15T18:10:44.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-15T18:10:44.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-15T18:10:44.039 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-05-15T18:10:44.111 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:44.111 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:44.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.135+0000 7f04e8929800 1 Processor -- start 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.135+0000 7f04e8929800 1 -- start start 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e8929800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561149872b00 0x561149874ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e8929800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561149878f40 con 0x561149875430 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e8929800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x561149703050 con 0x561149872b00 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e46be640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561149872b00 0x561149874ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04dbebd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x561149875430 0x561149877820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38628/0 (socket says 172.21.15.173:38628) 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e46be640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561149872b00 0x561149874ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50472/0 (socket says 172.21.15.173:50472) 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04dbebd640 1 -- 172.21.15.173:0/1370255128 learned_addr learned my addr 172.21.15.173:0/1370255128 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e46be640 1 -- 172.21.15.173:0/1370255128 >> v1:172.21.15.3:6789/0 conn(0x561149875430 legacy=0x561149877820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e3ebd640 1 -- 172.21.15.173:0/1370255128 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911478396 0 0) 0x561149878f40 con 0x561149875430 2024-05-15T18:10:44.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.136+0000 7f04e46be640 1 -- 172.21.15.173:0/1370255128 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114987a120 con 0x561149872b00 2024-05-15T18:10:44.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.138+0000 7f04e46be640 1 --2- 172.21.15.173:0/1370255128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149874ef0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f04d400a470 tx=0x7f04d401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13daf0d44686b0f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.138+0000 7f04e3ebd640 1 -- 172.21.15.173:0/1370255128 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4057070 con 0x561149872b00 2024-05-15T18:10:44.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.138+0000 7f04e3ebd640 1 -- 172.21.15.173:0/1370255128 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d4052570 con 0x561149872b00 2024-05-15T18:10:44.115 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.138+0000 7f04e3ebd640 1 -- 172.21.15.173:0/1370255128 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4052870 con 0x561149872b00 2024-05-15T18:10:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.139+0000 7f04e8929800 1 -- 172.21.15.173:0/1370255128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 msgr2=0x561149874ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.139+0000 7f04e8929800 1 --2- 172.21.15.173:0/1370255128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149874ef0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f04d400a470 tx=0x7f04d401ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.139+0000 7f04e8929800 1 -- 172.21.15.173:0/1370255128 shutdown_connections 2024-05-15T18:10:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.139+0000 7f04e8929800 1 --2- 172.21.15.173:0/1370255128 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149874ef0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.139+0000 7f04e8929800 1 -- 172.21.15.173:0/1370255128 >> 172.21.15.173:0/1370255128 conn(0x56114986c550 msgr2=0x56114986e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.139+0000 7f04e8929800 1 -- 172.21.15.173:0/1370255128 shutdown_connections 2024-05-15T18:10:44.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.139+0000 7f04e8929800 1 -- 172.21.15.173:0/1370255128 wait complete. 2024-05-15T18:10:44.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.152+0000 7f04e8929800 1 Processor -- start 2024-05-15T18:10:44.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.152+0000 7f04e8929800 1 -- start start 2024-05-15T18:10:44.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.152+0000 7f04e8929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149963570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.152+0000 7f04e8929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5611497bd170 con 0x561149872b00 2024-05-15T18:10:44.129 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149963570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149963570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50478/0 (socket says 172.21.15.173:50478) 2024-05-15T18:10:44.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f04e46be640 1 -- 172.21.15.173:0/3794058047 learned_addr learned my addr 172.21.15.173:0/3794058047 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f04e46be640 1 -- 172.21.15.173:0/3794058047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561149963b40 con 0x561149872b00 2024-05-15T18:10:44.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f04e46be640 1 --2- 172.21.15.173:0/3794058047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149963570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f04d4055040 tx=0x7f04d404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69787d46a4f0fe4f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f03d260c640 1 -- 172.21.15.173:0/3794058047 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4062070 con 0x561149872b00 2024-05-15T18:10:44.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f03d260c640 1 -- 172.21.15.173:0/3794058047 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d40528d0 con 0x561149872b00 2024-05-15T18:10:44.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.153+0000 7f03d260c640 1 -- 172.21.15.173:0/3794058047 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4057040 con 0x561149872b00 2024-05-15T18:10:44.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 -- 172.21.15.173:0/3794058047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 msgr2=0x561149963570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 --2- 172.21.15.173:0/3794058047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149963570 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f04d4055040 tx=0x7f04d404c000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 -- 172.21.15.173:0/3794058047 shutdown_connections 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 --2- 172.21.15.173:0/3794058047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x561149963570 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 -- 172.21.15.173:0/3794058047 >> 172.21.15.173:0/3794058047 conn(0x56114986c550 msgr2=0x56114995ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 -- 172.21.15.173:0/3794058047 shutdown_connections 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 -- 172.21.15.173:0/3794058047 wait complete. 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.154+0000 7f04e8929800 1 Processor -- start 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e8929800 1 -- start start 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e8929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x56114996aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e8929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561149879410 con 0x561149872b00 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x56114996aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x56114996aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50484/0 (socket says 172.21.15.173:50484) 2024-05-15T18:10:44.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e46be640 1 -- 172.21.15.173:0/3690311018 learned_addr learned my addr 172.21.15.173:0/3690311018 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e46be640 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114996b530 con 0x561149872b00 2024-05-15T18:10:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.155+0000 7f04e46be640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x56114996aff0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f04d4055040 tx=0x7f04d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.156+0000 7f03d0e09640 1 -- 172.21.15.173:0/3690311018 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4057050 con 0x561149872b00 2024-05-15T18:10:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.156+0000 7f03d0e09640 1 -- 172.21.15.173:0/3690311018 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d4067790 con 0x561149872b00 2024-05-15T18:10:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.156+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56114996b7c0 con 0x561149872b00 2024-05-15T18:10:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.156+0000 7f03d0e09640 1 -- 172.21.15.173:0/3690311018 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4062040 con 0x561149872b00 2024-05-15T18:10:44.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.156+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56114996e470 con 0x561149872b00 2024-05-15T18:10:44.137 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f03d0e09640 1 -- 172.21.15.173:0/3690311018 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04d4067a70 con 0x561149872b00 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f03d0e09640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03cc036900 0x7f03cc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f03d0e09640 1 -- 172.21.15.173:0/3690311018 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f04d408e490 con 0x561149872b00 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f04dbebd640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03cc036900 0x7f03cc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561149875430 0x561149972230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561149972770 con 0x561149875430 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f04e4ebf640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561149875430 0x561149972230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f04dbebd640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03cc036900 0x7f03cc038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f04cc000c00 tx=0x7f04cc0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.157+0000 7f04e4ebf640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561149875430 0x561149972230 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.158+0000 7f04e4ebf640 1 -- 172.21.15.173:0/3690311018 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x561149875430 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.158+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56114996f7c0 con 0x561149875430 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.158+0000 7f04e4ebf640 1 -- 172.21.15.173:0/3690311018 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04dc00a4a0 con 0x561149875430 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.158+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561149974a40 0x561149976e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.158+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561149977500 con 0x561149974a40 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.158+0000 7f04e46be640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561149974a40 0x561149976e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.158+0000 7f04e46be640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561149974a40 0x561149976e30 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.159+0000 7f04e46be640 1 -- 172.21.15.173:0/3690311018 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f04d4064070 con 0x561149974a40 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.159+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499739f0 con 0x561149875430 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.159+0000 7f04e4ebf640 1 -- 172.21.15.173:0/3690311018 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04dc00a4a0 con 0x561149875430 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.159+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5611499789b0 0x56114997ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.159+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56114997b560 con 0x5611499789b0 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.159+0000 7f04dbebd640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5611499789b0 0x56114997ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.160+0000 7f04dbebd640 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5611499789b0 0x56114997ae00 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.160+0000 7f04dbebd640 1 -- 172.21.15.173:0/3690311018 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04cc00f670 con 0x5611499789b0 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e8929800 1 Processor -- start 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e8929800 1 -- start start 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e8929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5611499899c0 0x561149989de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e8929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561149763cf0 con 0x5611499899c0 2024-05-15T18:10:44.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5611499899c0 0x561149989de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5611499899c0 0x561149989de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50498/0 (socket says 172.21.15.173:50498) 2024-05-15T18:10:44.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e46be640 1 -- 172.21.15.173:0/3101208030 learned_addr learned my addr 172.21.15.173:0/3101208030 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e46be640 1 -- 172.21.15.173:0/3101208030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114998a320 con 0x5611499899c0 2024-05-15T18:10:44.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.161+0000 7f04e46be640 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5611499899c0 0x561149989de0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f04d4007000 tx=0x7f04d408e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.162+0000 7f03c9ffb640 1 -- 172.21.15.173:0/3101208030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d408b390 con 0x5611499899c0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.162+0000 7f03c9ffb640 1 -- 172.21.15.173:0/3101208030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d408b530 con 0x5611499899c0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.162+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56114998ad90 con 0x5611499899c0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.162+0000 7f03c9ffb640 1 -- 172.21.15.173:0/3101208030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4007f20 con 0x5611499899c0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.162+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56114998b290 con 0x5611499899c0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.162+0000 7f03c9ffb640 1 -- 172.21.15.173:0/3101208030 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04d4084040 con 0x5611499899c0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f03c9ffb640 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03bc036950 0x7f03bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f03c9ffb640 1 -- 172.21.15.173:0/3101208030 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f04d4087070 con 0x5611499899c0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04dbebd640 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03bc036950 0x7f03bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04e8929800 1 Processor -- start 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04e8929800 1 -- start start 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04dbebd640 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03bc036950 0x7f03bc038e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561149972ff0 tx=0x7f04cc006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04e8929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x561149996f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04e8929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561149963e00 con 0x561149996b50 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x561149996f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x561149996f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50502/0 (socket says 172.21.15.173:50502) 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.163+0000 7f04e46be640 1 -- 172.21.15.173:0/838196641 learned_addr learned my addr 172.21.15.173:0/838196641 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.164+0000 7f04e46be640 1 -- 172.21.15.173:0/838196641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561149997540 con 0x561149996b50 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.164+0000 7f04e46be640 1 --2- 172.21.15.173:0/838196641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x561149996f70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f04d4066fd0 tx=0x7f04d40080c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8334438dad6bec server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.164+0000 7f03c37fe640 1 -- 172.21.15.173:0/838196641 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d40a6070 con 0x561149996b50 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.164+0000 7f03c37fe640 1 -- 172.21.15.173:0/838196641 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d4086c60 con 0x561149996b50 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.164+0000 7f03c37fe640 1 -- 172.21.15.173:0/838196641 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d4065370 con 0x561149996b50 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.164+0000 7f04e8929800 1 -- 172.21.15.173:0/838196641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 msgr2=0x561149996f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.164+0000 7f04e8929800 1 --2- 172.21.15.173:0/838196641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x561149996f70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f04d4066fd0 tx=0x7f04d40080c0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 -- 172.21.15.173:0/838196641 shutdown_connections 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 --2- 172.21.15.173:0/838196641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x561149996f70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 -- 172.21.15.173:0/838196641 >> 172.21.15.173:0/838196641 conn(0x561149992e60 msgr2=0x561149990ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 -- 172.21.15.173:0/838196641 shutdown_connections 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 -- 172.21.15.173:0/838196641 wait complete. 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 Processor -- start 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 -- start start 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x56114999df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e8929800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561149997bd0 con 0x561149996b50 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x56114999df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e46be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x56114999df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50508/0 (socket says 172.21.15.173:50508) 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 learned_addr learned my addr 172.21.15.173:0/1018742531 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.165+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114999e440 con 0x561149996b50 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.166+0000 7f04e46be640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x56114999df00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f04d40869c0 tx=0x7f04d4082e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.166+0000 7f03c1ffb640 1 -- 172.21.15.173:0/1018742531 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d40b1020 con 0x561149996b50 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.166+0000 7f03c1ffb640 1 -- 172.21.15.173:0/1018742531 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d40a7040 con 0x561149996b50 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.166+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56114999e440 con 0x561149996b50 2024-05-15T18:10:44.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.166+0000 7f03c1ffb640 1 -- 172.21.15.173:0/1018742531 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04d40a6070 con 0x561149996b50 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.166+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56114999e440 con 0x561149996b50 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.167+0000 7f03c1ffb640 1 -- 172.21.15.173:0/1018742531 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04d40b4020 con 0x561149996b50 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.167+0000 7f03c1ffb640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03b4036900 0x7f03b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.167+0000 7f03c1ffb640 1 -- 172.21.15.173:0/1018742531 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f04d40b11c0 con 0x561149996b50 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.167+0000 7f04dbebd640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03b4036900 0x7f03b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.167+0000 7f04dbebd640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03b4036900 0x7f03b4038dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00ffd0 tx=0x7f04cc023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.167+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5611499a9640 0x5611499abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499ac250 con 0x5611499a9640 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e4ebf640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5611499a9640 0x5611499abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e4ebf640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5611499a9640 0x5611499abb00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 20 realm 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499ac660 con 0x5611499a9640 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.168+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499acf30 con 0x5611499a9640 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e8929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5611499ae030 0x5611499b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499b0a30 con 0x5611499ae030 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e46be640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5611499ae030 0x5611499b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.169+0000 7f04e46be640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5611499ae030 0x5611499b0420 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04e8929800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04e8929800 20 searching for the correct realm 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499b2360 con 0x5611499ae030 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04e46be640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f04d40b6020 0x7f04d40ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499b2360 con 0x7f04d40b6020 2024-05-15T18:10:44.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04dbebd640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f04d40b6020 0x7f04d40ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.170+0000 7f04dbebd640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f04d40b6020 0x7f04d40ad8e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.171+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.171+0000 7f04dbebd640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f04cc02e910 0x7f04cc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.171+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499b2360 con 0x7f04cc02e910 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.171+0000 7f04e4ebf640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f04cc02e910 0x7f04cc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.171+0000 7f04e4ebf640 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f04cc02e910 0x7f04cc03a3c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.171+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.171+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04cc02e910 2024-05-15T18:10:44.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04cc02e910 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.172+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04d40b6020 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.173+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.173+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.173+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.173+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.173+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.173+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04cc02e910 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04d40b6020 2024-05-15T18:10:44.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.174+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04cc02e910 2024-05-15T18:10:44.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.175+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.175+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.175+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.175+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.175+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.175+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04cc02e910 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.176+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04d40b6020 2024-05-15T18:10:44.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04cc02e910 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.177+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04cc02e910 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04d40b6020 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499ae030 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04d40b6020 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.178+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x5611499a9640 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5611499ad2d0 con 0x7f04d40b6020 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:44.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499b12f0 con 0x5611499a9640 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499b16e0 con 0x5611499a9640 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.179+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499b16e0 con 0x7f04cc02e910 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 zone default found 2024-05-15T18:10:44.176 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 4 Realm: () 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 zonegroup default 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499b27e0 con 0x7f04cc02e910 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499b41c0 con 0x5611499ae030 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.180+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499b4560 con 0x5611499ae030 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.181+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.181+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.181+0000 7f04e8929800 20 started sync module instance, tier type = 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.181+0000 7f04e8929800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.181+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b3660 con 0x7f04d40b6020 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.182+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.182+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94632249340336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b4900 con 0x7f04d40b6020 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.182+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b51d0 con 0x5611499a9640 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.183+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94632249340336] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.183+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.183+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94632249347232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b55f0 con 0x5611499a9640 2024-05-15T18:10:44.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.183+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b6030 con 0x5611499ae030 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.184+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.184+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94632249350912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b68d0 con 0x5611499ae030 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.184+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b73b0 con 0x7f04d40b6020 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.185+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94632249347232] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.185+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94632249350912] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.185+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.186+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94632249342592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b77d0 con 0x7f04d40b6020 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.186+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b8060 con 0x5611499a9640 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.187+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94632249342592] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.187+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.187+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94632249355968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b8450 con 0x5611499a9640 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.187+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b8ec0 con 0x7f04cc02e910 2024-05-15T18:10:44.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.188+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94632249355968] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.188+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.188+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94632249362832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b8e80 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.188+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b98d0 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.189+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94632249362832] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.189+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.189+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94632249359216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b98d0 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.189+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499ba290 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94632249359216] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94632249365536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499ba470 con 0x7f04cc02e910 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 20 add_watcher() i=0 2024-05-15T18:10:44.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 20 add_watcher() i=1 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 20 add_watcher() i=2 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 20 add_watcher() i=3 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 20 add_watcher() i=4 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 20 add_watcher() i=5 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.190+0000 7f04e8929800 20 add_watcher() i=6 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.191+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94632249365536] v31'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.191+0000 7f04e8929800 20 add_watcher() i=7 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.191+0000 7f04e8929800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.191+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499bd620 con 0x5611499a9640 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.192+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.192+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94632249380784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499ba3c0 con 0x5611499a9640 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94632249380784] v31'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f039a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 5 note: GC not initialized 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f03997e2640 20 reqs_thread_entry: start 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 20 Filter name: none 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f030affd640 20 reqs_thread_entry: start 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.193+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499f0ca0 con 0x7f04cc02e910 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499ef440 con 0x5611499a9640 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.194+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499efd10 con 0x7f04cc02e910 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.195+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v31'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.195+0000 7f04e8929800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.195+0000 7f04e8929800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.195+0000 7f04e8929800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.195+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94632249587808 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499f45e0 con 0x5611499a9640 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== watch-notify(notify (1) cookie 94632249355968 notify 133143986195 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5611499f00b0 con 0x5611499a9640 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify cookie 94632249587808 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f03c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94632249355968 notifier 4825 bl.length()=649 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f03c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f03c37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f03c37fe640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f03a8003ea0 con 0x5611499a9640 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== watch-notify(notify_complete (2) cookie 94632249587808 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611499f06f0 con 0x5611499a9640 2024-05-15T18:10:44.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.196+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499f20f0 con 0x5611499a9640 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.197+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v31'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.197+0000 7f04e8929800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.197+0000 7f04e8929800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.197+0000 7f04e8929800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.197+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94632249587680 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5611499f45c0 con 0x5611499ae030 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== watch-notify(notify (1) cookie 94632249350912 notify 133143986194 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56114998ad90 con 0x5611499ae030 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f03c37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94632249350912 notifier 4825 bl.length()=177 2024-05-15T18:10:44.186 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f03c37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-15T18:10:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f03c37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-15T18:10:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f03c37fe640 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f03a8003ea0 con 0x5611499ae030 2024-05-15T18:10:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(68 notify.2 [notify cookie 94632249587680 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== watch-notify(notify_complete (2) cookie 94632249587680 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56114998a320 con 0x5611499ae030 2024-05-15T18:10:44.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.198+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.187 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:44.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.199+0000 7f039a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.199+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94632249380784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499a6740 con 0x5611499a9640 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.200+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94632249380784] v31'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.200+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94632249340336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499bcfb0 con 0x7f04d40b6020 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.201+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94632249340336] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.201+0000 7f04e8929800 20 remove_watcher() i=0 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.201+0000 7f04e8929800 2 removed watcher, disabling cache 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.201+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94632249347232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b31b0 con 0x5611499a9640 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.202+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94632249347232] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.202+0000 7f04e8929800 20 remove_watcher() i=1 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.202+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94632249350912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b31b0 con 0x5611499ae030 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.203+0000 7f04e46be640 1 -- 172.21.15.173:0/1018742531 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94632249350912] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d4094020 con 0x5611499ae030 2024-05-15T18:10:44.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.203+0000 7f04e8929800 20 remove_watcher() i=2 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.203+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94632249342592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b31b0 con 0x7f04d40b6020 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.204+0000 7f04dbebd640 1 -- 172.21.15.173:0/1018742531 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94632249342592] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc037040 con 0x7f04d40b6020 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.204+0000 7f04e8929800 20 remove_watcher() i=3 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.204+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94632249355968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b31b0 con 0x5611499a9640 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.205+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94632249355968] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x5611499a9640 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.205+0000 7f04e8929800 20 remove_watcher() i=4 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.205+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94632249362832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b31b0 con 0x7f04cc02e910 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.206+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94632249362832] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.206+0000 7f04e8929800 20 remove_watcher() i=5 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.206+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94632249359216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b8990 con 0x7f04cc02e910 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.207+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94632249359216] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.207+0000 7f04e8929800 20 remove_watcher() i=6 2024-05-15T18:10:44.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.207+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94632249365536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5611499b31b0 con 0x7f04cc02e910 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.208+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94632249365536] v31'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04dc00a4a0 con 0x7f04cc02e910 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.208+0000 7f04e8929800 20 remove_watcher() i=7 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f04cc02e910 msgr2=0x7f04cc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f04cc02e910 0x7f04cc03a3c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5611499a9640 msgr2=0x5611499abb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5611499a9640 0x5611499abb00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f04d40b6020 msgr2=0x7f04d40ad8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f04d40b6020 0x7f04d40ad8e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5611499ae030 msgr2=0x5611499b0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5611499ae030 0x5611499b0420 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03b4036900 msgr2=0x7f03b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03b4036900 0x7f03b4038dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00ffd0 tx=0x7f04cc023040 comp rx=0 tx=0).stop 2024-05-15T18:10:44.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 msgr2=0x56114999df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/1018742531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149996b50 0x56114999df00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f04d40869c0 tx=0x7f04d4082e90 comp rx=0 tx=0).stop 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 reap_dead start 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e4ebf640 1 -- 172.21.15.173:0/1018742531 reap_dead start 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 shutdown_connections 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 >> 172.21.15.173:0/1018742531 conn(0x561149992e60 msgr2=0x5611499904c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 shutdown_connections 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/1018742531 wait complete. 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03bc036950 msgr2=0x7f03bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03bc036950 0x7f03bc038e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561149972ff0 tx=0x7f04cc006000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5611499899c0 msgr2=0x561149989de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5611499899c0 0x561149989de0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f04d4007000 tx=0x7f04d408e3a0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 shutdown_connections 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03bc036950 0x7f03bc038e10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 --2- 172.21.15.173:0/3101208030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5611499899c0 0x561149989de0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 >> 172.21.15.173:0/3101208030 conn(0x56114997da60 msgr2=0x56114997de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 shutdown_connections 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.209+0000 7f04e8929800 1 -- 172.21.15.173:0/3101208030 wait complete. 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5611499789b0 msgr2=0x56114997ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5611499789b0 0x56114997ae00 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561149875430 msgr2=0x561149972230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561149875430 0x561149972230 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561149974a40 msgr2=0x561149976e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561149974a40 0x561149976e30 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03cc036900 msgr2=0x7f03cc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f03cc036900 0x7f03cc038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f04cc000c00 tx=0x7f04cc0013b0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 msgr2=0x56114996aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 --2- 172.21.15.173:0/3690311018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561149872b00 0x56114996aff0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f04d4055040 tx=0x7f04d4002fb0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e4ebf640 1 -- 172.21.15.173:0/3690311018 reap_dead start 2024-05-15T18:10:44.197 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 shutdown_connections 2024-05-15T18:10:44.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 >> 172.21.15.173:0/3690311018 conn(0x56114986c550 msgr2=0x56114995d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 shutdown_connections 2024-05-15T18:10:44.198 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.210+0000 7f04e8929800 1 -- 172.21.15.173:0/3690311018 wait complete. 2024-05-15T18:10:44.199 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.199 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.199 ERROR:root:0 2024-05-15T18:10:44.200 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:44.206 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000ed8921f8d60a02c3-006644faa4-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:10:44.206 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-05-15T18:10:44.216 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:44.217 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-05-15T18:10:44.228 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-05-15T18:10:44.228 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-05-15T18:10:44.243 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-15T18:10:44.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-15T18:10:44.251 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-05-15T18:10:44.252 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:44.255 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:44.255 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-05-15T18:10:44.259 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:44.260 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:44.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:44.260 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-05-15T18:10:44.308 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:44.308 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:44.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43af63f800 1 Processor -- start 2024-05-15T18:10:44.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43af63f800 1 -- start start 2024-05-15T18:10:44.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43af63f800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558a26ee76f0 0x558a26ee9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43af63f800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a26eea020 con 0x558a26ee3be0 2024-05-15T18:10:44.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43af63f800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x558a26d74050 con 0x558a26ee76f0 2024-05-15T18:10:44.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43ac93d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558a26ee76f0 0x558a26ee9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43ad13e640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x558a26ee3be0 0x558a26ee5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38638/0 (socket says 172.21.15.173:38638) 2024-05-15T18:10:44.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.333+0000 7f43ad13e640 1 -- 172.21.15.173:0/1093955275 learned_addr learned my addr 172.21.15.173:0/1093955275 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:44.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.334+0000 7f43ac93d640 1 -- 172.21.15.173:0/1093955275 >> v1:172.21.15.3:6789/0 conn(0x558a26ee3be0 legacy=0x558a26ee5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.334+0000 7f43a7fff640 1 -- 172.21.15.173:0/1093955275 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617876236 0 0) 0x558a26eea020 con 0x558a26ee3be0 2024-05-15T18:10:44.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.334+0000 7f43ac93d640 1 -- 172.21.15.173:0/1093955275 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a26eeb200 con 0x558a26ee76f0 2024-05-15T18:10:44.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43ac93d640 1 --2- 172.21.15.173:0/1093955275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee76f0 0x558a26ee9ae0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f439800a470 tx=0x7f439801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8e60bbbcabad7b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43a7fff640 1 -- 172.21.15.173:0/1093955275 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4398057070 con 0x558a26ee76f0 2024-05-15T18:10:44.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43a7fff640 1 -- 172.21.15.173:0/1093955275 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4398052570 con 0x558a26ee76f0 2024-05-15T18:10:44.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43a7fff640 1 -- 172.21.15.173:0/1093955275 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4398052870 con 0x558a26ee76f0 2024-05-15T18:10:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43af63f800 1 -- 172.21.15.173:0/1093955275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee76f0 msgr2=0x558a26ee9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43af63f800 1 --2- 172.21.15.173:0/1093955275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee76f0 0x558a26ee9ae0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f439800a470 tx=0x7f439801ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43af63f800 1 -- 172.21.15.173:0/1093955275 shutdown_connections 2024-05-15T18:10:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43af63f800 1 --2- 172.21.15.173:0/1093955275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee76f0 0x558a26ee9ae0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43af63f800 1 -- 172.21.15.173:0/1093955275 >> 172.21.15.173:0/1093955275 conn(0x558a26edd570 msgr2=0x558a26edf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43af63f800 1 -- 172.21.15.173:0/1093955275 shutdown_connections 2024-05-15T18:10:44.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.336+0000 7f43af63f800 1 -- 172.21.15.173:0/1093955275 wait complete. 2024-05-15T18:10:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.350+0000 7f43af63f800 1 Processor -- start 2024-05-15T18:10:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.350+0000 7f43af63f800 1 -- start start 2024-05-15T18:10:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.350+0000 7f43af63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26ee3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.350+0000 7f43af63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558a26e2e1c0 con 0x558a26ee3be0 2024-05-15T18:10:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26ee3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26ee3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50528/0 (socket says 172.21.15.173:50528) 2024-05-15T18:10:44.327 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f43ad13e640 1 -- 172.21.15.173:0/2537150218 learned_addr learned my addr 172.21.15.173:0/2537150218 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f43ad13e640 1 -- 172.21.15.173:0/2537150218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a26ee1ae0 con 0x558a26ee3be0 2024-05-15T18:10:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f43ad13e640 1 --2- 172.21.15.173:0/2537150218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26ee3520 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b210 tx=0x7f43a000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb0aa08e8141fa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f429b606640 1 -- 172.21.15.173:0/2537150218 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a0008070 con 0x558a26ee3be0 2024-05-15T18:10:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f429b606640 1 -- 172.21.15.173:0/2537150218 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a000d500 con 0x558a26ee3be0 2024-05-15T18:10:44.330 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.351+0000 7f429b606640 1 -- 172.21.15.173:0/2537150218 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a000d840 con 0x558a26ee3be0 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.352+0000 7f43af63f800 1 -- 172.21.15.173:0/2537150218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 msgr2=0x558a26ee3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.352+0000 7f43af63f800 1 --2- 172.21.15.173:0/2537150218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26ee3520 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b210 tx=0x7f43a000b6d0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.352+0000 7f43af63f800 1 -- 172.21.15.173:0/2537150218 shutdown_connections 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.352+0000 7f43af63f800 1 --2- 172.21.15.173:0/2537150218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26ee3520 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.352+0000 7f43af63f800 1 -- 172.21.15.173:0/2537150218 >> 172.21.15.173:0/2537150218 conn(0x558a26edd570 msgr2=0x558a26fcfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.352+0000 7f43af63f800 1 -- 172.21.15.173:0/2537150218 shutdown_connections 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.352+0000 7f43af63f800 1 -- 172.21.15.173:0/2537150218 wait complete. 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43af63f800 1 Processor -- start 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43af63f800 1 -- start start 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43af63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26fde290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43af63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558a26eea4f0 con 0x558a26ee3be0 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26fde290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26fde290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50532/0 (socket says 172.21.15.173:50532) 2024-05-15T18:10:44.331 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43ad13e640 1 -- 172.21.15.173:0/2900422082 learned_addr learned my addr 172.21.15.173:0/2900422082 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43ad13e640 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a26fde7d0 con 0x558a26ee3be0 2024-05-15T18:10:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.353+0000 7f43ad13e640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26fde290 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b210 tx=0x7f43a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.354+0000 7f4299e03640 1 -- 172.21.15.173:0/2900422082 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a000f950 con 0x558a26ee3be0 2024-05-15T18:10:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.354+0000 7f4299e03640 1 -- 172.21.15.173:0/2900422082 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a000faf0 con 0x558a26ee3be0 2024-05-15T18:10:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.354+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a26fdea60 con 0x558a26ee3be0 2024-05-15T18:10:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.354+0000 7f4299e03640 1 -- 172.21.15.173:0/2900422082 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a000fdd0 con 0x558a26ee3be0 2024-05-15T18:10:44.332 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.354+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a26fe1710 con 0x558a26ee3be0 2024-05-15T18:10:44.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f4299e03640 1 -- 172.21.15.173:0/2900422082 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43a0017040 con 0x558a26ee3be0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f4299e03640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42940368b0 0x7f4294038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f4299e03640 1 -- 172.21.15.173:0/2900422082 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f43a0015020 con 0x558a26ee3be0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f43ac93d640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42940368b0 0x7f4294038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a26ee76f0 0x558a26fe54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a26fe5a50 con 0x558a26ee76f0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f43ad93f640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a26ee76f0 0x558a26fe54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f43ac93d640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42940368b0 0x7f4294038d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4398054000 tx=0x7f439804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.355+0000 7f43ad93f640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a26ee76f0 0x558a26fe54d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.356+0000 7f43ad93f640 1 -- 172.21.15.173:0/2900422082 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a26ee76f0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.356+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a26fe2aa0 con 0x558a26ee76f0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.356+0000 7f43ad93f640 1 -- 172.21.15.173:0/2900422082 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a26ee76f0 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.356+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a26fe7d80 0x558a26fea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.356+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a26fea860 con 0x558a26fe7d80 2024-05-15T18:10:44.338 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.356+0000 7f43ad13e640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a26fe7d80 0x558a26fea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.356+0000 7f43ad13e640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a26fe7d80 0x558a26fea170 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.357+0000 7f43ad13e640 1 -- 172.21.15.173:0/2900422082 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43a002d070 con 0x558a26fe7d80 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.357+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a26fe6d30 con 0x558a26ee76f0 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.357+0000 7f43ad93f640 1 -- 172.21.15.173:0/2900422082 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a26ee76f0 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.357+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558a26febd10 0x558a26fee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.357+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a26fee8c0 con 0x558a26febd10 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.357+0000 7f43ac93d640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558a26febd10 0x558a26fee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.358+0000 7f43ac93d640 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558a26febd10 0x558a26fee160 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.358+0000 7f43ac93d640 1 -- 172.21.15.173:0/2900422082 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f439805a040 con 0x558a26febd10 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.358+0000 7f43af63f800 1 Processor -- start 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.358+0000 7f43af63f800 1 -- start start 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.358+0000 7f43af63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ffcd20 0x558a26ffd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.358+0000 7f43af63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558a26dd4cf0 con 0x558a26ffcd20 2024-05-15T18:10:44.339 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ffcd20 0x558a26ffd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ffcd20 0x558a26ffd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50544/0 (socket says 172.21.15.173:50544) 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f43ad13e640 1 -- 172.21.15.173:0/558320931 learned_addr learned my addr 172.21.15.173:0/558320931 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f43ad13e640 1 -- 172.21.15.173:0/558320931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a26ffd680 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f43ad13e640 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ffcd20 0x558a26ffd140 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b710 tx=0x7f43a000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f4292ffd640 1 -- 172.21.15.173:0/558320931 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a001a8f0 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f4292ffd640 1 -- 172.21.15.173:0/558320931 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a0019940 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f4292ffd640 1 -- 172.21.15.173:0/558320931 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a0044c20 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a26ffe0f0 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.359+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a26ffe5f0 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.360+0000 7f4292ffd640 1 -- 172.21.15.173:0/558320931 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43a0044dc0 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.360+0000 7f4292ffd640 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4288036900 0x7f4288038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.360+0000 7f4292ffd640 1 -- 172.21.15.173:0/558320931 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f43a003bbd0 con 0x558a26ffcd20 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.360+0000 7f43ac93d640 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4288036900 0x7f4288038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.340 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.360+0000 7f43af63f800 1 Processor -- start 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.360+0000 7f43af63f800 1 -- start start 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43ac93d640 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4288036900 0x7f4288038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x558a26fe6330 tx=0x7f4398005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43af63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a2700a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43af63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558a26ee1e60 con 0x558a2700a010 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a2700a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a2700a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50552/0 (socket says 172.21.15.173:50552) 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43ad13e640 1 -- 172.21.15.173:0/1384756248 learned_addr learned my addr 172.21.15.173:0/1384756248 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43ad13e640 1 -- 172.21.15.173:0/1384756248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a2700aa00 con 0x558a2700a010 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f43ad13e640 1 --2- 172.21.15.173:0/1384756248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a2700a430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f43a0041fd0 tx=0x7f43a00268b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6634ece8a0b3b77 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f4290ff9640 1 -- 172.21.15.173:0/1384756248 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a003f050 con 0x558a2700a010 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f4290ff9640 1 -- 172.21.15.173:0/1384756248 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a003f1f0 con 0x558a2700a010 2024-05-15T18:10:44.341 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.361+0000 7f4290ff9640 1 -- 172.21.15.173:0/1384756248 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a0018850 con 0x558a2700a010 2024-05-15T18:10:44.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 -- 172.21.15.173:0/1384756248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 msgr2=0x558a2700a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 --2- 172.21.15.173:0/1384756248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a2700a430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f43a0041fd0 tx=0x7f43a00268b0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 -- 172.21.15.173:0/1384756248 shutdown_connections 2024-05-15T18:10:44.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 --2- 172.21.15.173:0/1384756248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a2700a430 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 -- 172.21.15.173:0/1384756248 >> 172.21.15.173:0/1384756248 conn(0x558a270062e0 msgr2=0x558a27004340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 -- 172.21.15.173:0/1384756248 shutdown_connections 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 -- 172.21.15.173:0/1384756248 wait complete. 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 Processor -- start 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 -- start start 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a27011140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.362+0000 7f43af63f800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558a2700af50 con 0x558a2700a010 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a27011140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f43ad13e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a27011140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50564/0 (socket says 172.21.15.173:50564) 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 learned_addr learned my addr 172.21.15.173:0/758385631 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a27011680 con 0x558a2700a010 2024-05-15T18:10:44.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f43ad13e640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a27011140 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f43a004a2e0 tx=0x7f43a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f427effd640 1 -- 172.21.15.173:0/758385631 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a003f050 con 0x558a2700a010 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f427effd640 1 -- 172.21.15.173:0/758385631 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a0068070 con 0x558a2700a010 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f427effd640 1 -- 172.21.15.173:0/758385631 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43a0030450 con 0x558a2700a010 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a27011680 con 0x558a2700a010 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.363+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a27011680 con 0x558a2700a010 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.364+0000 7f427effd640 1 -- 172.21.15.173:0/758385631 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43a00306b0 con 0x558a2700a010 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.364+0000 7f427effd640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42780368b0 0x7f4278038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.365+0000 7f427effd640 1 -- 172.21.15.173:0/758385631 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f43a006ec10 con 0x558a2700a010 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.365+0000 7f43ac93d640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42780368b0 0x7f4278038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.365+0000 7f43ac93d640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42780368b0 0x7f4278038d70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f439801ced0 tx=0x7f439804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.365+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.365+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a2701c790 0x558a2701ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.365+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a2701f3a0 con 0x558a2701c790 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.365+0000 7f43ad93f640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a2701c790 0x558a2701ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43ad93f640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a2701c790 0x558a2701ec50 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 realm 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a2701f7b0 con 0x558a2701c790 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27020080 con 0x558a2701c790 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a27021180 0x558a27023570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.366+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27023b80 con 0x558a27021180 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.367+0000 7f43ad13e640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a27021180 0x558a27023570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.367+0000 7f43ad13e640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a27021180 0x558a27023570 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.367+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.367+0000 7f43af63f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.367+0000 7f43af63f800 20 searching for the correct realm 2024-05-15T18:10:44.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.367+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a270254b0 con 0x558a27021180 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.367+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ad13e640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f43a0026c20 0x7f43a0017330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a270254b0 con 0x7f43a0026c20 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ac93d640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f43a0026c20 0x7f43a0017330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ac93d640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f43a0026c20 0x7f43a0017330 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ac93d640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4398083040 0x7f4398075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a270254b0 con 0x7f4398083040 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.368+0000 7f43ad93f640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4398083040 0x7f4398075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.369+0000 7f43ad93f640 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4398083040 0x7f4398075430 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.369+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f43a800a4a0 con 0x7f4398083040 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.369+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.369+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.369+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f4398083040 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x7f4398083040 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f4398083040 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x7f4398083040 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f43a0026c20 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.370+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f4398083040 2024-05-15T18:10:44.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x7f4398083040 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.371+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f43a0026c20 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f4398083040 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x7f4398083040 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.372+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.365 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f43a800a4a0 con 0x558a2701c790 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.373+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f4398083040 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a8033040 con 0x7f4398083040 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f43a0026c20 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.374+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f4398083040 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f4398083040 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f43a0026c20 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.375+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a27021180 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f43a0026c20 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x558a2701c790 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.367 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558a27020420 con 0x7f43a0026c20 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.376+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27024440 con 0x558a2701c790 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27024830 con 0x558a2701c790 2024-05-15T18:10:44.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27024830 con 0x7f4398083040 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 zone default found 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 4 Realm: () 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:44.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 zonegroup default 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27025930 con 0x7f4398083040 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.377+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27027310 con 0x558a27021180 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43af63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a270276b0 con 0x558a27021180 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43af63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.370 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43af63f800 20 started sync module instance, tier type = 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43af63f800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.378+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a270267b0 con 0x7f43a0026c20 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.379+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.379+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94051848315648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27027a50 con 0x7f43a0026c20 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.379+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a270282a0 con 0x558a2701c790 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.380+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94051848315648] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.380+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.380+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94051848322544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27028210 con 0x558a2701c790 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.380+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27029160 con 0x558a27021180 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.381+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94051848322544] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.382+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.382+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94051848326320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27029550 con 0x558a27021180 2024-05-15T18:10:44.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.382+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27029f90 con 0x7f43a0026c20 2024-05-15T18:10:44.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.383+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94051848326320] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.376 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.383+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.383+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94051848329824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702a380 con 0x7f43a0026c20 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.383+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702ada0 con 0x558a2701c790 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.384+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94051848329824] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.384+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.384+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94051848333456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702b1c0 con 0x558a2701c790 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.384+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702bbe0 con 0x7f4398083040 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.385+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.385+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94051848337104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702bba0 con 0x7f4398083040 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.385+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702cb20 con 0x7f4398083040 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.385+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94051848333456] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.386+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94051848337104] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.386+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.386+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94051848341072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702bfd0 con 0x7f4398083040 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.386+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702cfd0 con 0x7f4398083040 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94051848341072] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94051848342304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702d3f0 con 0x7f4398083040 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 20 add_watcher() i=0 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 20 add_watcher() i=1 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 20 add_watcher() i=2 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 20 add_watcher() i=3 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 20 add_watcher() i=4 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 20 add_watcher() i=5 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.387+0000 7f43af63f800 20 add_watcher() i=6 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.388+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94051848342304] v31'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.388+0000 7f43af63f800 20 add_watcher() i=7 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.388+0000 7f43af63f800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.388+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a2702d3f0 con 0x558a2701c790 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.388+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.389+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94051848343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702d390 con 0x558a2701c790 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.389+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94051848343360] v31'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f42637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 5 note: GC not initialized 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f42627e4640 20 reqs_thread_entry: start 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 20 Filter name: none 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f41d3fff640 20 reqs_thread_entry: start 2024-05-15T18:10:44.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.390+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a270638d0 con 0x7f4398083040 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.391+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.391+0000 7f43af63f800 20 rados_obj.operate() r=0 bl.length=473 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.391+0000 7f43af63f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.391+0000 7f43af63f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.391+0000 7f43af63f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.391+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27069f20 con 0x7f4398083040 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.392+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.392+0000 7f43af63f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.392+0000 7f43af63f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.392+0000 7f43af63f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.392+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94051848591760 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558a27065730 con 0x558a2701c790 2024-05-15T18:10:44.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 94051848333456 notify 133143986197 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f43a801e040 con 0x558a2701c790 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f4290ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 94051848333456 notifier 4832 bl.length()=636 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f4290ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f4290ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 94051848591760 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f4290ff9640 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4270003ea0 con 0x558a2701c790 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.393+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 94051848591760 notify 133143986197 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f43a8018d90 con 0x558a2701c790 2024-05-15T18:10:44.381 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.394+0000 7f42637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.394+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94051848343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a270624a0 con 0x558a2701c790 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.395+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94051848343360] v31'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.395+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94051848315648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702cf40 con 0x7f43a0026c20 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.396+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94051848315648] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.396+0000 7f43af63f800 20 remove_watcher() i=0 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.396+0000 7f43af63f800 2 removed watcher, disabling cache 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.396+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94051848322544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27026300 con 0x558a2701c790 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.397+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94051848322544] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.397+0000 7f43af63f800 20 remove_watcher() i=1 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.397+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94051848326320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27026300 con 0x558a27021180 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.398+0000 7f43ad13e640 1 -- 172.21.15.173:0/758385631 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94051848326320] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a002d070 con 0x558a27021180 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.398+0000 7f43af63f800 20 remove_watcher() i=2 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.398+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94051848329824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27026300 con 0x7f43a0026c20 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.399+0000 7f43ac93d640 1 -- 172.21.15.173:0/758385631 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94051848329824] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4398070030 con 0x7f43a0026c20 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.399+0000 7f43af63f800 20 remove_watcher() i=3 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.399+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94051848333456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27029a60 con 0x558a2701c790 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.400+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94051848333456] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x558a2701c790 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.400+0000 7f43af63f800 20 remove_watcher() i=4 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.400+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94051848337104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a27026300 con 0x7f4398083040 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.401+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94051848337104] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.401+0000 7f43af63f800 20 remove_watcher() i=5 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.401+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94051848341072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702a890 con 0x7f4398083040 2024-05-15T18:10:44.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.402+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94051848341072] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.402+0000 7f43af63f800 20 remove_watcher() i=6 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.402+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94051848342304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558a2702b6d0 con 0x7f4398083040 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94051848342304] v31'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43a8031040 con 0x7f4398083040 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 20 remove_watcher() i=7 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4398083040 msgr2=0x7f4398075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f4398083040 0x7f4398075430 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a2701c790 msgr2=0x558a2701ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a2701c790 0x558a2701ec50 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f43a0026c20 msgr2=0x7f43a0017330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f43a0026c20 0x7f43a0017330 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a27021180 msgr2=0x558a27023570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.403+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a27021180 0x558a27023570 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42780368b0 msgr2=0x7f4278038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42780368b0 0x7f4278038d70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f439801ced0 tx=0x7f439804f000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 msgr2=0x558a27011140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/758385631 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a2700a010 0x558a27011140 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f43a004a2e0 tx=0x7f43a0016000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 reap_dead start 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43ad93f640 1 -- 172.21.15.173:0/758385631 reap_dead start 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 shutdown_connections 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 >> 172.21.15.173:0/758385631 conn(0x558a270062e0 msgr2=0x558a27003940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 shutdown_connections 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/758385631 wait complete. 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4288036900 msgr2=0x7f4288038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4288036900 0x7f4288038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x558a26fe6330 tx=0x7f4398005a00 comp rx=0 tx=0).stop 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ffcd20 msgr2=0x558a26ffd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ffcd20 0x558a26ffd140 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b710 tx=0x7f43a000ed50 comp rx=0 tx=0).stop 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 shutdown_connections 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f4288036900 0x7f4288038dc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/558320931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ffcd20 0x558a26ffd140 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 >> 172.21.15.173:0/558320931 conn(0x558a26ff0dc0 msgr2=0x558a26ff11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 shutdown_connections 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/558320931 wait complete. 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558a26febd10 msgr2=0x558a26fee160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558a26febd10 0x558a26fee160 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a26ee76f0 msgr2=0x558a26fe54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558a26ee76f0 0x558a26fe54d0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a26fe7d80 msgr2=0x558a26fea170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.404+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558a26fe7d80 0x558a26fea170 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42940368b0 msgr2=0x7f4294038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f42940368b0 0x7f4294038d70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4398054000 tx=0x7f439804e000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 msgr2=0x558a26fde290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 --2- 172.21.15.173:0/2900422082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558a26ee3be0 0x558a26fde290 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f43a000b210 tx=0x7f43a0000ed0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43ad93f640 1 -- 172.21.15.173:0/2900422082 reap_dead start 2024-05-15T18:10:44.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 shutdown_connections 2024-05-15T18:10:44.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 >> 172.21.15.173:0/2900422082 conn(0x558a26edd570 msgr2=0x558a26ee23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 shutdown_connections 2024-05-15T18:10:44.392 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.405+0000 7f43af63f800 1 -- 172.21.15.173:0/2900422082 wait complete. 2024-05-15T18:10:44.393 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.393 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.393 ERROR:root:0 2024-05-15T18:10:44.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-15T18:10:44.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-15T18:10:44.394 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-05-15T18:10:44.447 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:44.447 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:44.448 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07b4133800 1 Processor -- start 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07b4133800 1 -- start start 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07b4133800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5606e67ccb70 0x5606e67cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07b4133800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606e67d2fb0 con 0x5606e67cf4a0 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07b4133800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5606e665d050 con 0x5606e67ccb70 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07afdd8640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5606e67ccb70 0x5606e67cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07af5d7640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5606e67cf4a0 0x5606e67d1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38652/0 (socket says 172.21.15.173:38652) 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.472+0000 7f07af5d7640 1 -- 172.21.15.173:0/2454138634 learned_addr learned my addr 172.21.15.173:0/2454138634 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.473+0000 7f07afdd8640 1 -- 172.21.15.173:0/2454138634 >> v1:172.21.15.3:6789/0 conn(0x5606e67cf4a0 legacy=0x5606e67d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.473+0000 7f07afdd8640 1 -- 172.21.15.173:0/2454138634 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e67d4190 con 0x5606e67ccb70 2024-05-15T18:10:44.449 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.473+0000 7f07aedd6640 1 -- 172.21.15.173:0/2454138634 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164697670 0 0) 0x5606e67d2fb0 con 0x5606e67cf4a0 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.474+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2454138634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cef60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f07a000a470 tx=0x7f07a001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be50466a173faab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07aedd6640 1 -- 172.21.15.173:0/2454138634 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0057070 con 0x5606e67ccb70 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07aedd6640 1 -- 172.21.15.173:0/2454138634 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a0052570 con 0x5606e67ccb70 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07aedd6640 1 -- 172.21.15.173:0/2454138634 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0052870 con 0x5606e67ccb70 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07b4133800 1 -- 172.21.15.173:0/2454138634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 msgr2=0x5606e67cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07b4133800 1 --2- 172.21.15.173:0/2454138634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cef60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f07a000a470 tx=0x7f07a001ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07b4133800 1 -- 172.21.15.173:0/2454138634 shutdown_connections 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07b4133800 1 --2- 172.21.15.173:0/2454138634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cef60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07b4133800 1 -- 172.21.15.173:0/2454138634 >> 172.21.15.173:0/2454138634 conn(0x5606e67c6540 msgr2=0x5606e67c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07b4133800 1 -- 172.21.15.173:0/2454138634 shutdown_connections 2024-05-15T18:10:44.452 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.475+0000 7f07b4133800 1 -- 172.21.15.173:0/2454138634 wait complete. 2024-05-15T18:10:44.465 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07b4133800 1 Processor -- start 2024-05-15T18:10:44.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07b4133800 1 -- start start 2024-05-15T18:10:44.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07b4133800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07b4133800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5606e6717170 con 0x5606e67ccb70 2024-05-15T18:10:44.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50576/0 (socket says 172.21.15.173:50576) 2024-05-15T18:10:44.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07afdd8640 1 -- 172.21.15.173:0/2007859185 learned_addr learned my addr 172.21.15.173:0/2007859185 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.489+0000 7f07afdd8640 1 -- 172.21.15.173:0/2007859185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e67caa70 con 0x5606e67ccb70 2024-05-15T18:10:44.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.490+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2007859185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cc4b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f07a0055040 tx=0x7f07a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872abdeaf18c7d1f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.490+0000 7f069de0b640 1 -- 172.21.15.173:0/2007859185 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0057040 con 0x5606e67ccb70 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.490+0000 7f069de0b640 1 -- 172.21.15.173:0/2007859185 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a0052990 con 0x5606e67ccb70 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.490+0000 7f069de0b640 1 -- 172.21.15.173:0/2007859185 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0052c70 con 0x5606e67ccb70 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 -- 172.21.15.173:0/2007859185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 msgr2=0x5606e67cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 --2- 172.21.15.173:0/2007859185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cc4b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f07a0055040 tx=0x7f07a004c000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 -- 172.21.15.173:0/2007859185 shutdown_connections 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 --2- 172.21.15.173:0/2007859185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e67cc4b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 -- 172.21.15.173:0/2007859185 >> 172.21.15.173:0/2007859185 conn(0x5606e67c6540 msgr2=0x5606e68b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 -- 172.21.15.173:0/2007859185 shutdown_connections 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 -- 172.21.15.173:0/2007859185 wait complete. 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 Processor -- start 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 -- start start 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e68c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07b4133800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5606e67d3480 con 0x5606e67ccb70 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e68c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e68c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50582/0 (socket says 172.21.15.173:50582) 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.491+0000 7f07afdd8640 1 -- 172.21.15.173:0/2442474591 learned_addr learned my addr 172.21.15.173:0/2442474591 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.492+0000 7f07afdd8640 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e68c7680 con 0x5606e67ccb70 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.492+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e68c7140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f07a000a470 tx=0x7f07a0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.492+0000 7f0697fff640 1 -- 172.21.15.173:0/2442474591 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0073070 con 0x5606e67ccb70 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.492+0000 7f0697fff640 1 -- 172.21.15.173:0/2442474591 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a005d650 con 0x5606e67ccb70 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.492+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606e68c7910 con 0x5606e67ccb70 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.492+0000 7f0697fff640 1 -- 172.21.15.173:0/2442474591 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0057070 con 0x5606e67ccb70 2024-05-15T18:10:44.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.492+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606e68ca5c0 con 0x5606e67ccb70 2024-05-15T18:10:44.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.493+0000 7f0697fff640 1 -- 172.21.15.173:0/2442474591 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f07a0076070 con 0x5606e67ccb70 2024-05-15T18:10:44.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.493+0000 7f0697fff640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0698036950 0x7f0698038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.493+0000 7f0697fff640 1 -- 172.21.15.173:0/2442474591 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f07a008de60 con 0x5606e67ccb70 2024-05-15T18:10:44.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.493+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0698036950 0x7f0698038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.493+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e67cf4a0 0x5606e68ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.493+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e68ce910 con 0x5606e67cf4a0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.493+0000 7f07b05d9640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e67cf4a0 0x5606e68ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0698036950 0x7f0698038e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07a4000c00 tx=0x7f07a40013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07b05d9640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e67cf4a0 0x5606e68ce380 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07b05d9640 1 -- 172.21.15.173:0/2442474591 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e67cf4a0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e68cb930 con 0x5606e67cf4a0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07b05d9640 1 -- 172.21.15.173:0/2442474591 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e67cf4a0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e68d0c70 0x5606e68d3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e68d3750 con 0x5606e68d0c70 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.494+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e68d0c70 0x5606e68d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.495+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e68d0c70 0x5606e68d3060 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.495+0000 7f07afdd8640 1 -- 172.21.15.173:0/2442474591 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f07a0075030 con 0x5606e68d0c70 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.495+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e68cfc20 con 0x5606e67cf4a0 2024-05-15T18:10:44.475 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.495+0000 7f07b05d9640 1 -- 172.21.15.173:0/2442474591 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e67cf4a0 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.495+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5606e68d4c00 0x5606e68d7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.495+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e68d77b0 con 0x5606e68d4c00 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.496+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5606e68d4c00 0x5606e68d7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.496+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5606e68d4c00 0x5606e68d7050 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.496+0000 7f07af5d7640 1 -- 172.21.15.173:0/2442474591 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f07a400f670 con 0x5606e68d4c00 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07b4133800 1 Processor -- start 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07b4133800 1 -- start start 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07b4133800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68e5c10 0x5606e68e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07b4133800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5606e66bdcf0 con 0x5606e68e5c10 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68e5c10 0x5606e68e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68e5c10 0x5606e68e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50596/0 (socket says 172.21.15.173:50596) 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07afdd8640 1 -- 172.21.15.173:0/1615133353 learned_addr learned my addr 172.21.15.173:0/1615133353 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07afdd8640 1 -- 172.21.15.173:0/1615133353 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e68e6570 con 0x5606e68e5c10 2024-05-15T18:10:44.476 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f07afdd8640 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68e5c10 0x5606e68e6030 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006e60 tx=0x7f07a005cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.497+0000 7f06957fa640 1 -- 172.21.15.173:0/1615133353 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0076de0 con 0x5606e68e5c10 2024-05-15T18:10:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.498+0000 7f06957fa640 1 -- 172.21.15.173:0/1615133353 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a0089070 con 0x5606e68e5c10 2024-05-15T18:10:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.498+0000 7f06957fa640 1 -- 172.21.15.173:0/1615133353 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a005db80 con 0x5606e68e5c10 2024-05-15T18:10:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.498+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606e68e6fe0 con 0x5606e68e5c10 2024-05-15T18:10:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.498+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606e68e74e0 con 0x5606e68e5c10 2024-05-15T18:10:44.477 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.498+0000 7f06957fa640 1 -- 172.21.15.173:0/1615133353 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f07a0079990 con 0x5606e68e5c10 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.498+0000 7f06957fa640 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0688036900 0x7f0688038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.498+0000 7f06957fa640 1 -- 172.21.15.173:0/1615133353 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f07a0094ba0 con 0x5606e68e5c10 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07af5d7640 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0688036900 0x7f0688038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07b4133800 1 Processor -- start 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07b4133800 1 -- start start 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07af5d7640 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0688036900 0x7f0688038dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5606e68cf220 tx=0x7f07a4006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07b4133800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68f3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07b4133800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5606e67cad30 con 0x5606e68f2d50 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.490 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50598/0 (socket says 172.21.15.173:50598) 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07afdd8640 1 -- 172.21.15.173:0/3776650965 learned_addr learned my addr 172.21.15.173:0/3776650965 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.499+0000 7f07afdd8640 1 -- 172.21.15.173:0/3776650965 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e68f3740 con 0x5606e68f2d50 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07afdd8640 1 --2- 172.21.15.173:0/3776650965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68f3170 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f07a0095000 tx=0x7f07a005dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8380fe3a05637d33 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f068effd640 1 -- 172.21.15.173:0/3776650965 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0079db0 con 0x5606e68f2d50 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f068effd640 1 -- 172.21.15.173:0/3776650965 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a0002000 con 0x5606e68f2d50 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f068effd640 1 -- 172.21.15.173:0/3776650965 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a006fbf0 con 0x5606e68f2d50 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07b4133800 1 -- 172.21.15.173:0/3776650965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 msgr2=0x5606e68f3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07b4133800 1 --2- 172.21.15.173:0/3776650965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68f3170 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f07a0095000 tx=0x7f07a005dde0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07b4133800 1 -- 172.21.15.173:0/3776650965 shutdown_connections 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07b4133800 1 --2- 172.21.15.173:0/3776650965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68f3170 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07b4133800 1 -- 172.21.15.173:0/3776650965 >> 172.21.15.173:0/3776650965 conn(0x5606e68ef060 msgr2=0x5606e68ed0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07b4133800 1 -- 172.21.15.173:0/3776650965 shutdown_connections 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.500+0000 7f07b4133800 1 -- 172.21.15.173:0/3776650965 wait complete. 2024-05-15T18:10:44.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07b4133800 1 Processor -- start 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07b4133800 1 -- start start 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07b4133800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07b4133800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5606e68f3dd0 con 0x5606e68f2d50 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07afdd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68fa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50612/0 (socket says 172.21.15.173:50612) 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 learned_addr learned my addr 172.21.15.173:0/2013847676 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.501+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606e68fa670 con 0x5606e68f2d50 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.502+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68fa130 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006cf0 tx=0x7f07a005fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.502+0000 7f068d7fa640 1 -- 172.21.15.173:0/2013847676 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a00b5020 con 0x5606e68f2d50 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.502+0000 7f068d7fa640 1 -- 172.21.15.173:0/2013847676 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a00789d0 con 0x5606e68f2d50 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.502+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606e68fa670 con 0x5606e68f2d50 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.502+0000 7f068d7fa640 1 -- 172.21.15.173:0/2013847676 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a0078cf0 con 0x5606e68f2d50 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.502+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606e68fab10 con 0x5606e68f2d50 2024-05-15T18:10:44.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.502+0000 7f068d7fa640 1 -- 172.21.15.173:0/2013847676 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f07a00b8020 con 0x5606e68f2d50 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f068d7fa640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0678036950 0x7f0678038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f068d7fa640 1 -- 172.21.15.173:0/2013847676 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f07a00ac050 con 0x5606e68f2d50 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0678036950 0x7f0678038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0678036950 0x7f0678038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5606e68d7bb0 tx=0x7f07a4023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e6905880 0x5606e6907d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e6908490 con 0x5606e6905880 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.503+0000 7f07b05d9640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e6905880 0x5606e6907d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b05d9640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e6905880 0x5606e6907d40 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 20 realm 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e69088a0 con 0x5606e6905880 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909170 con 0x5606e6905880 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.504+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b4133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e690a270 0x5606e690c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e690cc70 con 0x5606e690a270 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e690a270 0x5606e690c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e690a270 0x5606e690c660 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b4133800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b4133800 20 searching for the correct realm 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.505+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e690e5a0 con 0x5606e690a270 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07afdd8640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07a00ba020 0x7f07a00026b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e690e5a0 con 0x7f07a00ba020 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07a00ba020 0x7f07a00026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07a00ba020 0x7f07a00026b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07af5d7640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07a403a3c0 0x7f07a403a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.506+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e690e5a0 con 0x7f07a403a3c0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.507+0000 7f07b05d9640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07a403a3c0 0x7f07a403a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.507+0000 7f07b05d9640 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07a403a3c0 0x7f07a403a7e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.507+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07a800a4a0 con 0x7f07a403a3c0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.507+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.507+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.507+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a403a3c0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x7f07a403a3c0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a403a3c0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x7f07a403a3c0 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a00ba020 2024-05-15T18:10:44.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.508+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a403a3c0 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x7f07a403a3c0 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.509+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a00ba020 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.497 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a403a3c0 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x7f07a403a3c0 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.510+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07a800a4a0 con 0x5606e6905880 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a403a3c0 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.511+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a8033040 con 0x7f07a403a3c0 2024-05-15T18:10:44.498 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.512+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.512+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.512+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a00ba020 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.512+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.512+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.512+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.512+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a403a3c0 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a403a3c0 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a00ba020 2024-05-15T18:10:44.499 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.513+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e690a270 2024-05-15T18:10:44.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a00ba020 2024-05-15T18:10:44.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.500 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x5606e6905880 2024-05-15T18:10:44.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5606e6909510 con 0x7f07a00ba020 2024-05-15T18:10:44.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e690d530 con 0x5606e6905880 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.514+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e690d920 con 0x5606e6905880 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e690d920 con 0x7f07a403a3c0 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 zone default found 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 4 Realm: () 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 zonegroup default 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e690ea20 con 0x7f07a403a3c0 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.515+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e6910400 con 0x5606e690a270 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e69107a0 con 0x5606e690a270 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 20 started sync module instance, tier type = 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.516+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e690f8a0 con 0x7f07a00ba020 2024-05-15T18:10:44.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.517+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.517+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94587638051824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6910b40 con 0x7f07a00ba020 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.517+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e69113d0 con 0x5606e6905880 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.518+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94587638051824] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.519+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.519+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94587638058720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e69117c0 con 0x5606e6905880 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.519+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6912220 con 0x5606e690a270 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.520+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94587638058720] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.520+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.520+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94587638062288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6912610 con 0x5606e690a270 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.520+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6913070 con 0x7f07a00ba020 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.521+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94587638062288] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.521+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.521+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94587638054032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6913910 con 0x7f07a00ba020 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.521+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e69142d0 con 0x5606e6905880 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.522+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.522+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94587638071296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6914ad0 con 0x5606e6905880 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.522+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e69155d0 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.522+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94587638054032] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.523+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94587638071296] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.524+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.524+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94587638075584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6915590 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.524+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6915ea0 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.525+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94587638075584] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.525+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.525+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94587638068320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6915590 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.525+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6916470 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94587638068320] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94587638077856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6916470 con 0x7f07a403a3c0 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 20 add_watcher() i=0 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 20 add_watcher() i=1 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 20 add_watcher() i=2 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 20 add_watcher() i=3 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 20 add_watcher() i=4 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 20 add_watcher() i=5 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.526+0000 7f07b4133800 20 add_watcher() i=6 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.527+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94587638077856] v31'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.527+0000 7f07b4133800 20 add_watcher() i=7 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.527+0000 7f07b4133800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.527+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e6919890 con 0x5606e6905880 2024-05-15T18:10:44.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.527+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.527+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94587638079888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6916d40 con 0x5606e6905880 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.528+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94587638079888] v31'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f0665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 5 note: GC not initialized 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f0664fe1640 20 reqs_thread_entry: start 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 20 Filter name: none 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f05de7fc640 20 reqs_thread_entry: start 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.529+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e694cd90 con 0x7f07a403a3c0 2024-05-15T18:10:44.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e694b530 con 0x5606e690a270 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-15T18:10:44.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.530+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e694bdd0 con 0x7f07a403a3c0 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.531+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v31'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.531+0000 7f07b4133800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.531+0000 7f07b4133800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.531+0000 7f07b4133800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.531+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94587638298912 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e69506d0 con 0x7f07a00ba020 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== watch-notify(notify (1) cookie 94587638051824 notify 133143986199 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f07a4018040 con 0x7f07a00ba020 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f068effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94587638051824 notifier 4839 bl.length()=533 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f068effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(65 notify.0 [notify cookie 94587638298912 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f068effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f068effd640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0674003ea0 con 0x7f07a00ba020 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== watch-notify(notify_complete (2) cookie 94587638298912 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f07a401fd10 con 0x7f07a00ba020 2024-05-15T18:10:44.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.532+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e694e200 con 0x5606e690a270 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v31'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f07b4133800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f07b4133800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f07b4133800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94587638298912 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606e694e200 con 0x5606e6905880 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 94587638058720 notify 133143986198 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5606e694c170 con 0x5606e6905880 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f068effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986198 cookie 94587638058720 notifier 4839 bl.length()=176 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f068effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f068effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(68 notify.1 [notify cookie 94587638298912 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.533+0000 7f068effd640 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0674003ea0 con 0x5606e6905880 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.534+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== watch-notify(notify_complete (2) cookie 94587638298912 notify 133143986198 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5606e694b6c0 con 0x5606e6905880 2024-05-15T18:10:44.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.534+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.521 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-05-15T18:10:44.530872Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.530859Z","tags":[],"group_ids":[]} 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.534+0000 7f0665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.534+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94587638079888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6919420 con 0x5606e6905880 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.535+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94587638079888] v31'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.535+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94587638051824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6916160 con 0x7f07a00ba020 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.536+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94587638051824] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.536+0000 7f07b4133800 20 remove_watcher() i=0 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.536+0000 7f07b4133800 2 removed watcher, disabling cache 2024-05-15T18:10:44.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.536+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94587638058720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e690f3f0 con 0x5606e6905880 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.538+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94587638058720] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.538+0000 7f07b4133800 20 remove_watcher() i=1 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.538+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94587638062288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e690f3f0 con 0x5606e690a270 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.539+0000 7f07afdd8640 1 -- 172.21.15.173:0/2013847676 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94587638062288] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a009a070 con 0x5606e690a270 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.539+0000 7f07b4133800 20 remove_watcher() i=2 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.539+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94587638054032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6911cd0 con 0x7f07a00ba020 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.540+0000 7f07af5d7640 1 -- 172.21.15.173:0/2013847676 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94587638054032] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a4037040 con 0x7f07a00ba020 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.540+0000 7f07b4133800 20 remove_watcher() i=3 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.540+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94587638071296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e690f3f0 con 0x5606e6905880 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.541+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94587638071296] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x5606e6905880 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.541+0000 7f07b4133800 20 remove_watcher() i=4 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.541+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94587638075584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6911cd0 con 0x7f07a403a3c0 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.542+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94587638075584] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.542+0000 7f07b4133800 20 remove_watcher() i=5 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.542+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94587638068320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e690f3f0 con 0x7f07a403a3c0 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.543+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94587638068320] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.543+0000 7f07b4133800 20 remove_watcher() i=6 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.543+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94587638077856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5606e6911cd0 con 0x7f07a403a3c0 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94587638077856] v31'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07a8031040 con 0x7f07a403a3c0 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 20 remove_watcher() i=7 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07a403a3c0 msgr2=0x7f07a403a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f07a403a3c0 0x7f07a403a7e0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e6905880 msgr2=0x5606e6907d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e6905880 0x5606e6907d40 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07a00ba020 msgr2=0x7f07a00026b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f07a00ba020 0x7f07a00026b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e690a270 msgr2=0x5606e690c660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e690a270 0x5606e690c660 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0678036950 msgr2=0x7f0678038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0678036950 0x7f0678038e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5606e68d7bb0 tx=0x7f07a4023040 comp rx=0 tx=0).stop 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 msgr2=0x5606e68fa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b05d9640 1 -- 172.21.15.173:0/2013847676 reap_dead start 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68fa130 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006cf0 tx=0x7f07a005fea0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 shutdown_connections 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 --2- 172.21.15.173:0/2013847676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68f2d50 0x5606e68fa130 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 >> 172.21.15.173:0/2013847676 conn(0x5606e68ef060 msgr2=0x5606e68ec6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 shutdown_connections 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.544+0000 7f07b4133800 1 -- 172.21.15.173:0/2013847676 wait complete. 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0688036900 msgr2=0x7f0688038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0688036900 0x7f0688038dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5606e68cf220 tx=0x7f07a4006000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68e5c10 msgr2=0x5606e68e6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68e5c10 0x5606e68e6030 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006e60 tx=0x7f07a005cd50 comp rx=0 tx=0).stop 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 shutdown_connections 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0688036900 0x7f0688038dc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/1615133353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e68e5c10 0x5606e68e6030 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 >> 172.21.15.173:0/1615133353 conn(0x5606e68d9cb0 msgr2=0x5606e68da0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 shutdown_connections 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/1615133353 wait complete. 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5606e68d4c00 msgr2=0x5606e68d7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5606e68d4c00 0x5606e68d7050 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e67cf4a0 msgr2=0x5606e68ce380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5606e67cf4a0 0x5606e68ce380 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e68d0c70 msgr2=0x5606e68d3060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5606e68d0c70 0x5606e68d3060 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0698036950 msgr2=0x7f0698038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f0698036950 0x7f0698038e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f07a4000c00 tx=0x7f07a40013b0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 msgr2=0x5606e68c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 --2- 172.21.15.173:0/2442474591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5606e67ccb70 0x5606e68c7140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f07a000a470 tx=0x7f07a0003020 comp rx=0 tx=0).stop 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b05d9640 1 -- 172.21.15.173:0/2442474591 reap_dead start 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 shutdown_connections 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 >> 172.21.15.173:0/2442474591 conn(0x5606e67c6540 msgr2=0x5606e67cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 shutdown_connections 2024-05-15T18:10:44.531 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.545+0000 7f07b4133800 1 -- 172.21.15.173:0/2442474591 wait complete. 2024-05-15T18:10:44.532 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-15T18:10:44.530872Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.530859Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.532 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-15T18:10:44.530872Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.530859Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.532 ERROR:root:0 2024-05-15T18:10:44.533 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:44.537 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:44.538 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-05-15T18:10:44.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-05-15T18:10:44.538 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-05-15T18:10:44.582 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:44.582 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:44.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.606+0000 7fee28933800 1 Processor -- start 2024-05-15T18:10:44.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.606+0000 7fee28933800 1 -- start start 2024-05-15T18:10:44.583 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.606+0000 7fee28933800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561513e77a00 0x561513e77e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.606+0000 7fee28933800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561513deca40 con 0x561513e78360 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.606+0000 7fee28933800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x561513d0a050 con 0x561513e77a00 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.607+0000 7fee245d1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561513e77a00 0x561513e77e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.607+0000 7fee245d1640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561513e77a00 0x561513e77e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50616/0 (socket says 172.21.15.173:50616) 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.607+0000 7fee245d1640 1 -- 172.21.15.173:0/3611352297 learned_addr learned my addr 172.21.15.173:0/3611352297 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.607+0000 7fee23dd0640 1 --1- 172.21.15.173:0/3611352297 >> v1:172.21.15.3:6789/0 conn(0x561513e78360 0x561513e78810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38654/0 (socket says 172.21.15.173:38654) 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.607+0000 7fee245d1640 1 -- 172.21.15.173:0/3611352297 >> v1:172.21.15.3:6789/0 conn(0x561513e78360 legacy=0x561513e78810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.607+0000 7fee235cf640 1 -- 172.21.15.173:0/3611352297 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820985515 0 0) 0x561513deca40 con 0x561513e78360 2024-05-15T18:10:44.584 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.607+0000 7fee245d1640 1 -- 172.21.15.173:0/3611352297 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513e78f20 con 0x561513e77a00 2024-05-15T18:10:44.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.609+0000 7fee245d1640 1 --2- 172.21.15.173:0/3611352297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513e77e20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fee1400a520 tx=0x7fee1401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6215357934a9564 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.609+0000 7fee235cf640 1 -- 172.21.15.173:0/3611352297 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14057070 con 0x561513e77a00 2024-05-15T18:10:44.585 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.609+0000 7fee235cf640 1 -- 172.21.15.173:0/3611352297 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14052570 con 0x561513e77a00 2024-05-15T18:10:44.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.609+0000 7fee235cf640 1 -- 172.21.15.173:0/3611352297 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee1404ae60 con 0x561513e77a00 2024-05-15T18:10:44.586 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.610+0000 7fee28933800 1 -- 172.21.15.173:0/3611352297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 msgr2=0x561513e77e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.610+0000 7fee28933800 1 --2- 172.21.15.173:0/3611352297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513e77e20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fee1400a520 tx=0x7fee1401d010 comp rx=0 tx=0).stop 2024-05-15T18:10:44.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.610+0000 7fee28933800 1 -- 172.21.15.173:0/3611352297 shutdown_connections 2024-05-15T18:10:44.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.610+0000 7fee28933800 1 --2- 172.21.15.173:0/3611352297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513e77e20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.610+0000 7fee28933800 1 -- 172.21.15.173:0/3611352297 >> 172.21.15.173:0/3611352297 conn(0x561513e735a0 msgr2=0x561513e759c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.610+0000 7fee28933800 1 -- 172.21.15.173:0/3611352297 shutdown_connections 2024-05-15T18:10:44.587 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.610+0000 7fee28933800 1 -- 172.21.15.173:0/3611352297 wait complete. 2024-05-15T18:10:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.623+0000 7fee28933800 1 Processor -- start 2024-05-15T18:10:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.623+0000 7fee28933800 1 -- start start 2024-05-15T18:10:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.623+0000 7fee28933800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f6c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.600 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.623+0000 7fee28933800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561513dc41d0 con 0x561513e77a00 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.623+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f6c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.624+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f6c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50624/0 (socket says 172.21.15.173:50624) 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.624+0000 7fee245d1640 1 -- 172.21.15.173:0/2960102429 learned_addr learned my addr 172.21.15.173:0/2960102429 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.624+0000 7fee245d1640 1 -- 172.21.15.173:0/2960102429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513f6cf70 con 0x561513e77a00 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.624+0000 7fee245d1640 1 --2- 172.21.15.173:0/2960102429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f6c9a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fee14055040 tx=0x7fee1404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a3a3c55c1d0ad server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.624+0000 7fed1260c640 1 -- 172.21.15.173:0/2960102429 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14057040 con 0x561513e77a00 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.624+0000 7fed1260c640 1 -- 172.21.15.173:0/2960102429 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14052720 con 0x561513e77a00 2024-05-15T18:10:44.601 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.624+0000 7fed1260c640 1 -- 172.21.15.173:0/2960102429 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14052a40 con 0x561513e77a00 2024-05-15T18:10:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 -- 172.21.15.173:0/2960102429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 msgr2=0x561513f6c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 --2- 172.21.15.173:0/2960102429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f6c9a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fee14055040 tx=0x7fee1404c000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 -- 172.21.15.173:0/2960102429 shutdown_connections 2024-05-15T18:10:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 --2- 172.21.15.173:0/2960102429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f6c9a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 -- 172.21.15.173:0/2960102429 >> 172.21.15.173:0/2960102429 conn(0x561513e735a0 msgr2=0x561513f682c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 -- 172.21.15.173:0/2960102429 shutdown_connections 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 -- 172.21.15.173:0/2960102429 wait complete. 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 Processor -- start 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 -- start start 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f74480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.625+0000 7fee28933800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561513e794b0 con 0x561513e77a00 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f74480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f74480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50626/0 (socket says 172.21.15.173:50626) 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fee245d1640 1 -- 172.21.15.173:0/656288652 learned_addr learned my addr 172.21.15.173:0/656288652 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fee245d1640 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513f749c0 con 0x561513e77a00 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fee245d1640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f74480 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fee14052540 tx=0x7fee14003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fed10e09640 1 -- 172.21.15.173:0/656288652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14073070 con 0x561513e77a00 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fed10e09640 1 -- 172.21.15.173:0/656288652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1405d440 con 0x561513e77a00 2024-05-15T18:10:44.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561513f74c50 con 0x561513e77a00 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fed10e09640 1 -- 172.21.15.173:0/656288652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14057070 con 0x561513e77a00 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.626+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561513f77860 con 0x561513e77a00 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.627+0000 7fed10e09640 1 -- 172.21.15.173:0/656288652 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fee14076070 con 0x561513e77a00 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.627+0000 7fed10e09640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed0c036950 0x7fed0c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.627+0000 7fed10e09640 1 -- 172.21.15.173:0/656288652 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fee1408db70 con 0x561513e77a00 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.627+0000 7fee23dd0640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed0c036950 0x7fed0c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513e78360 0x561513f7b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513f7bb60 con 0x561513e78360 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee24dd2640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513e78360 0x561513f7b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee23dd0640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed0c036950 0x7fed0c038e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee180013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee24dd2640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513e78360 0x561513f7b620 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee24dd2640 1 -- 172.21.15.173:0/656288652 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513e78360 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513f78bd0 con 0x561513e78360 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee24dd2640 1 -- 172.21.15.173:0/656288652 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513e78360 2024-05-15T18:10:44.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513f7de00 0x561513f801f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.628+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513f80890 con 0x561513f7de00 2024-05-15T18:10:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.629+0000 7fee245d1640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513f7de00 0x561513f801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.629+0000 7fee245d1640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513f7de00 0x561513f801f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.629+0000 7fee245d1640 1 -- 172.21.15.173:0/656288652 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee14075030 con 0x561513f7de00 2024-05-15T18:10:44.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.629+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513f7cdb0 con 0x561513e78360 2024-05-15T18:10:44.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.629+0000 7fee24dd2640 1 -- 172.21.15.173:0/656288652 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513e78360 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.629+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561513f81d40 0x561513f84190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.629+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513f848f0 con 0x561513f81d40 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.630+0000 7fee23dd0640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561513f81d40 0x561513f84190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.630+0000 7fee23dd0640 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561513f81d40 0x561513f84190 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.630+0000 7fee23dd0640 1 -- 172.21.15.173:0/656288652 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee1800f670 con 0x561513f81d40 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee28933800 1 Processor -- start 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee28933800 1 -- start start 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee28933800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f92d50 0x561513f93170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee28933800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561513d6acf0 con 0x561513f92d50 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f92d50 0x561513f93170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f92d50 0x561513f93170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50628/0 (socket says 172.21.15.173:50628) 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee245d1640 1 -- 172.21.15.173:0/3462291647 learned_addr learned my addr 172.21.15.173:0/3462291647 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.631+0000 7fee245d1640 1 -- 172.21.15.173:0/3462291647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513f936b0 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.632+0000 7fee245d1640 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f92d50 0x561513f93170 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fee14005280 tx=0x7fee1406e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.632+0000 7fed09ffb640 1 -- 172.21.15.173:0/3462291647 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14083040 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.632+0000 7fed09ffb640 1 -- 172.21.15.173:0/3462291647 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14054ca0 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.632+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561513f94120 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.632+0000 7fed09ffb640 1 -- 172.21.15.173:0/3462291647 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee1405ca80 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.632+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561513f94620 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.632+0000 7fed09ffb640 1 -- 172.21.15.173:0/3462291647 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fee1405cc20 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fed09ffb640 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecfc036900 0x7fecfc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fed09ffb640 1 -- 172.21.15.173:0/3462291647 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fee14098ba0 con 0x561513f92d50 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee23dd0640 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecfc036900 0x7fecfc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee28933800 1 Processor -- start 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee28933800 1 -- start start 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee23dd0640 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecfc036900 0x7fecfc038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x561513f78b10 tx=0x7fee18006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee28933800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee28933800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561513f6d230 con 0x561513f9ff10 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50634/0 (socket says 172.21.15.173:50634) 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.633+0000 7fee245d1640 1 -- 172.21.15.173:0/814710518 learned_addr learned my addr 172.21.15.173:0/814710518 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fee245d1640 1 -- 172.21.15.173:0/814710518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513fa0900 con 0x561513f9ff10 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fee245d1640 1 --2- 172.21.15.173:0/814710518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa0330 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fee1405c4b0 tx=0x7fee1405c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bae28173f18d27 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fed037fe640 1 -- 172.21.15.173:0/814710518 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee140a5030 con 0x561513f9ff10 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fed037fe640 1 -- 172.21.15.173:0/814710518 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1408a5a0 con 0x561513f9ff10 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fed037fe640 1 -- 172.21.15.173:0/814710518 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee1409c070 con 0x561513f9ff10 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fee28933800 1 -- 172.21.15.173:0/814710518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 msgr2=0x561513fa0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fee28933800 1 --2- 172.21.15.173:0/814710518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa0330 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fee1405c4b0 tx=0x7fee1405c4e0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fee28933800 1 -- 172.21.15.173:0/814710518 shutdown_connections 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fee28933800 1 --2- 172.21.15.173:0/814710518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa0330 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.634+0000 7fee28933800 1 -- 172.21.15.173:0/814710518 >> 172.21.15.173:0/814710518 conn(0x561513f9c220 msgr2=0x561513f9a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee28933800 1 -- 172.21.15.173:0/814710518 shutdown_connections 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee28933800 1 -- 172.21.15.173:0/814710518 wait complete. 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee28933800 1 Processor -- start 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee28933800 1 -- start start 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee28933800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee28933800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561513fa0f90 con 0x561513f9ff10 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee245d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50640/0 (socket says 172.21.15.173:50640) 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 learned_addr learned my addr 172.21.15.173:0/2513827676 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.635+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561513fa7860 con 0x561513f9ff10 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.636+0000 7fee245d1640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa7320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fee1407f530 tx=0x7fee14061fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.636+0000 7fed01ffb640 1 -- 172.21.15.173:0/2513827676 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14078e30 con 0x561513f9ff10 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.636+0000 7fed01ffb640 1 -- 172.21.15.173:0/2513827676 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee140bc070 con 0x561513f9ff10 2024-05-15T18:10:44.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.636+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561513fa7860 con 0x561513f9ff10 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.636+0000 7fed01ffb640 1 -- 172.21.15.173:0/2513827676 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee1406ac30 con 0x561513f9ff10 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.636+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561513fa7860 con 0x561513f9ff10 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.636+0000 7fed01ffb640 1 -- 172.21.15.173:0/2513827676 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fee140787d0 con 0x561513f9ff10 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.637+0000 7fed01ffb640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecf40368b0 0x7fecf4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.637+0000 7fed01ffb640 1 -- 172.21.15.173:0/2513827676 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fee140a9070 con 0x561513f9ff10 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.637+0000 7fee23dd0640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecf40368b0 0x7fecf4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.637+0000 7fee23dd0640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecf40368b0 0x7fecf4038d70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fee1800ffd0 tx=0x7fee18023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.637+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.637+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513fb28b0 0x561513fb4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.637+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fb54c0 con 0x561513fb28b0 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee24dd2640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513fb28b0 0x561513fb4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee24dd2640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513fb28b0 0x561513fb4d70 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 20 realm 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fb58d0 con 0x561513fb28b0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fb61a0 con 0x561513fb28b0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.638+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.624 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee28933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513fb72a0 0x561513fb9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fb9ca0 con 0x561513fb72a0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee245d1640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513fb72a0 0x561513fb9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee245d1640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513fb72a0 0x561513fb9690 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee28933800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee28933800 20 searching for the correct realm 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.639+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fbb5d0 con 0x561513fb72a0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee245d1640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fee14097020 0x7fee1406a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fbb5d0 con 0x7fee14097020 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee23dd0640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fee14097020 0x7fee1406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee23dd0640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fee14097020 0x7fee1406a360 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee23dd0640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fee1802e910 0x7fee1803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.640+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fbb5d0 con 0x7fee1802e910 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.641+0000 7fee24dd2640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fee1802e910 0x7fee1803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.641+0000 7fee24dd2640 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fee1802e910 0x7fee1803a3c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.641+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.641+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee1802e910 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee1802e910 2024-05-15T18:10:44.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.627 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.642+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee14097020 2024-05-15T18:10:44.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee1802e910 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.643+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee14097020 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.644+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee1802e910 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.645+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.646+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.646+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee1802e910 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.646+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.646+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.646+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.646+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee14097020 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.647+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.647+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.647+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.647+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee1802e910 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.647+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.647+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee1802e910 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee14097020 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb72a0 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.648+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee14097020 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x561513fb28b0 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561513fb6540 con 0x7fee14097020 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fba560 con 0x561513fb28b0 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.649+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fba950 con 0x561513fb28b0 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fba950 con 0x7fee1802e910 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 20 zone default found 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 4 Realm: () 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:44.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 20 zonegroup default 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.650+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fbba50 con 0x7fee1802e910 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fbd430 con 0x561513fb72a0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fbd7d0 con 0x561513fb72a0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 20 started sync module instance, tier type = 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.651+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbc8d0 con 0x7fee14097020 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.652+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.652+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94648529568800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbdb70 con 0x7fee14097020 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.652+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbe440 con 0x561513fb28b0 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.653+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94648529568800] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.654+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.654+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94648529575696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbe860 con 0x561513fb28b0 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.654+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbf2d0 con 0x561513fb72a0 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.655+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94648529575696] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.655+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.655+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94648529579424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbf6c0 con 0x561513fb72a0 2024-05-15T18:10:44.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.655+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc0140 con 0x7fee14097020 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.656+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94648529579424] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.656+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.656+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94648529583152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc0530 con 0x7fee14097020 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.656+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc0f70 con 0x561513fb28b0 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.657+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.657+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94648529583152] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.657+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94648529571056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc1360 con 0x561513fb28b0 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.657+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc1dc0 con 0x7fee1802e910 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.658+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.658+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94648529571056] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.658+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94648529590432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc1dc0 con 0x7fee1802e910 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.658+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc0a60 con 0x7fee1802e910 2024-05-15T18:10:44.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.659+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94648529590432] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.659+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.659+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94648529586784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc27d0 con 0x7fee1802e910 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.659+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc3190 con 0x7fee1802e910 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94648529586784] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94648529592752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc3190 con 0x7fee1802e910 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 20 add_watcher() i=0 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 20 add_watcher() i=1 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 20 add_watcher() i=2 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 20 add_watcher() i=3 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 20 add_watcher() i=4 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 20 add_watcher() i=5 2024-05-15T18:10:44.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.661+0000 7fee28933800 20 add_watcher() i=6 2024-05-15T18:10:44.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.662+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94648529592752] v31'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.662+0000 7fee28933800 20 add_watcher() i=7 2024-05-15T18:10:44.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.662+0000 7fee28933800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.662+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fc6590 con 0x561513fb28b0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.662+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.662+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94648529596080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc3ab0 con 0x561513fb28b0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.663+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94648529596080] v31'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.663+0000 7fecda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.663+0000 7fee28933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.663+0000 7fee28933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.663+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc6270 con 0x561513fb28b0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.664+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.665+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcf600 con 0x7fee1802e910 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.666+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.666+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcfab0 con 0x561513fb72a0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.667+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.667+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcfab0 con 0x561513fb28b0 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.668+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'249 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.668+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fd0020 con 0x7fee14097020 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.669+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.669+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fd0890 con 0x561513fb72a0 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.670+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.670+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fd0890 con 0x561513fb28b0 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.671+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.671+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fd0890 con 0x7fee1802e910 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.672+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.672+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fd0cf0 con 0x7fee14097020 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.673+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.673+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fd11a0 con 0x561513fb72a0 2024-05-15T18:10:44.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.674+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.674+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fd11a0 con 0x7fee14097020 2024-05-15T18:10:44.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.675+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.675+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcdc60 con 0x7fee1802e910 2024-05-15T18:10:44.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.676+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.676+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcdc60 con 0x7fee14097020 2024-05-15T18:10:44.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.677+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.677+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcdc60 con 0x7fee1802e910 2024-05-15T18:10:44.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.678+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.678+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb28b0 2024-05-15T18:10:44.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.679+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'250 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.679+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.680+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.680+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x7fee14097020 2024-05-15T18:10:44.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.681+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.681+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.682+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.682+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb28b0 2024-05-15T18:10:44.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.684+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.684+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb28b0 2024-05-15T18:10:44.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.684+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'251 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.685+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.686+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.686+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x7fee14097020 2024-05-15T18:10:44.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.687+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.687+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.688+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.688+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.689+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.689+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.690+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.690+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.691+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.691+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x7fee1802e910 2024-05-15T18:10:44.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.692+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.692+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.693+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.693+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x7fee1802e910 2024-05-15T18:10:44.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.694+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.670 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.694+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x561513fb72a0 2024-05-15T18:10:44.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.695+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.671 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.695+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x7fee1802e910 2024-05-15T18:10:44.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.696+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.672 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.696+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fcda90 con 0x7fee14097020 2024-05-15T18:10:44.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.697+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.697+0000 7fecd97e2640 20 reqs_thread_entry: start 2024-05-15T18:10:44.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.697+0000 7fee28933800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:44.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.698+0000 7fee28933800 20 Filter name: none 2024-05-15T18:10:44.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.698+0000 7fec4affd640 20 reqs_thread_entry: start 2024-05-15T18:10:44.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.698+0000 7fee28933800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-15T18:10:44.674 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.698+0000 7fee28933800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.675 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.698+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513ffc780 con 0x7fee1802e910 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee28933800 20 rados_obj.operate() r=0 bl.length=349 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee28933800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee28933800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee28933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513ffc2b0 con 0x7fee1802e910 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee28933800 10 removing key index: system_akey 2024-05-15T18:10:44.676 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.699+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513ffc2b0 con 0x561513fb72a0 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.700+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(96 system_akey [delete] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.700+0000 7fee28933800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.700+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94648529837040 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513fff5e0 con 0x561513fb28b0 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.700+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== watch-notify(notify (1) cookie 94648529575696 notify 133143986199 ret 0) ==== 203+0+0 (crc 0 0 0) 0x561513fce0a0 con 0x561513fb28b0 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.700+0000 7fed037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986199 cookie 94648529575696 notifier 4846 bl.length()=161 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.700+0000 7fed037fe640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fece8003d60 con 0x561513fb28b0 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.700+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(97 notify.1 [notify cookie 94648529837040 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.678 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.701+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.701+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== watch-notify(notify_complete (2) cookie 94648529837040 notify 133143986199 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561513f94120 con 0x561513fb28b0 2024-05-15T18:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.701+0000 7fee28933800 10 removing email index: 2024-05-15T18:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.701+0000 7fee28933800 10 removing user buckets index 2024-05-15T18:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.701+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513ffd040 con 0x7fee1802e910 2024-05-15T18:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.702+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(99 system_user.buckets [delete] v31'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.702+0000 7fee28933800 10 removing user index: system_user 2024-05-15T18:10:44.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.702+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513ffebb0 con 0x7fee1802e910 2024-05-15T18:10:44.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(100 system_user [call,call,delete] v31'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee28933800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-05-15T18:10:44.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee28933800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-15T18:10:44.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94648529832848 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561513ffe470 con 0x7fee14097020 2024-05-15T18:10:44.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== watch-notify(notify (1) cookie 94648529568800 notify 133143986200 ret 0) ==== 202+0+0 (crc 0 0 0) 0x561513fcfe50 con 0x7fee14097020 2024-05-15T18:10:44.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fed02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 94648529568800 notifier 4846 bl.length()=160 2024-05-15T18:10:44.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(101 notify.0 [notify cookie 94648529832848 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fed02ffd640 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fec580032c0 con 0x7fee14097020 2024-05-15T18:10:44.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.703+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== watch-notify(notify_complete (2) cookie 94648529832848 notify 133143986200 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561513fcf820 con 0x7fee14097020 2024-05-15T18:10:44.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.704+0000 7fecda7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.681 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.704+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94648529596080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513ffe860 con 0x561513fb28b0 2024-05-15T18:10:44.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.705+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94648529596080] v31'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.705+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94648529568800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc2e80 con 0x7fee14097020 2024-05-15T18:10:44.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.706+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94648529568800] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.706+0000 7fee28933800 20 remove_watcher() i=0 2024-05-15T18:10:44.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.706+0000 7fee28933800 2 removed watcher, disabling cache 2024-05-15T18:10:44.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.706+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94648529575696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbc420 con 0x561513fb28b0 2024-05-15T18:10:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.708+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94648529575696] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.708+0000 7fee28933800 20 remove_watcher() i=1 2024-05-15T18:10:44.684 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.708+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94648529579424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbc420 con 0x561513fb72a0 2024-05-15T18:10:44.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.709+0000 7fee245d1640 1 -- 172.21.15.173:0/2513827676 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94648529579424] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1409e070 con 0x561513fb72a0 2024-05-15T18:10:44.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.709+0000 7fee28933800 20 remove_watcher() i=2 2024-05-15T18:10:44.685 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.709+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94648529583152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbc420 con 0x7fee14097020 2024-05-15T18:10:44.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.710+0000 7fee23dd0640 1 -- 172.21.15.173:0/2513827676 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94648529583152] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee18037040 con 0x7fee14097020 2024-05-15T18:10:44.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.710+0000 7fee28933800 20 remove_watcher() i=3 2024-05-15T18:10:44.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.710+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94648529571056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbc420 con 0x561513fb28b0 2024-05-15T18:10:44.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.711+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94648529571056] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x561513fb28b0 2024-05-15T18:10:44.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.711+0000 7fee28933800 20 remove_watcher() i=4 2024-05-15T18:10:44.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.711+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94648529590432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbccf0 con 0x7fee1802e910 2024-05-15T18:10:44.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.712+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94648529590432] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.712+0000 7fee28933800 20 remove_watcher() i=5 2024-05-15T18:10:44.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.712+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94648529586784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fbccf0 con 0x7fee1802e910 2024-05-15T18:10:44.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.713+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94648529586784] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.713+0000 7fee28933800 20 remove_watcher() i=6 2024-05-15T18:10:44.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.713+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94648529592752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561513fc18a0 con 0x7fee1802e910 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94648529592752] v31'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee1c00a4a0 con 0x7fee1802e910 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 20 remove_watcher() i=7 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fee1802e910 msgr2=0x7fee1803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fee1802e910 0x7fee1803a3c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513fb28b0 msgr2=0x561513fb4d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513fb28b0 0x561513fb4d70 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fee14097020 msgr2=0x7fee1406a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fee14097020 0x7fee1406a360 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513fb72a0 msgr2=0x561513fb9690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.714+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513fb72a0 0x561513fb9690 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecf40368b0 msgr2=0x7fecf4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecf40368b0 0x7fecf4038d70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fee1800ffd0 tx=0x7fee18023040 comp rx=0 tx=0).stop 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 msgr2=0x561513fa7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/2513827676 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f9ff10 0x561513fa7320 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fee1407f530 tx=0x7fee14061fb0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 reap_dead start 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee24dd2640 1 -- 172.21.15.173:0/2513827676 reap_dead start 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 shutdown_connections 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 >> 172.21.15.173:0/2513827676 conn(0x561513f9c220 msgr2=0x561513f99880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 shutdown_connections 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/2513827676 wait complete. 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecfc036900 msgr2=0x7fecfc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecfc036900 0x7fecfc038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x561513f78b10 tx=0x7fee18006000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f92d50 msgr2=0x561513f93170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f92d50 0x561513f93170 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fee14005280 tx=0x7fee1406e6d0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 shutdown_connections 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fecfc036900 0x7fecfc038dc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/3462291647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513f92d50 0x561513f93170 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 >> 172.21.15.173:0/3462291647 conn(0x561513f86df0 msgr2=0x561513f871f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 shutdown_connections 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/3462291647 wait complete. 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561513f81d40 msgr2=0x561513f84190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561513f81d40 0x561513f84190 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513e78360 msgr2=0x561513f7b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561513e78360 0x561513f7b620 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513f7de00 msgr2=0x561513f801f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.715+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561513f7de00 0x561513f801f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed0c036950 msgr2=0x7fed0c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed0c036950 0x7fed0c038e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee180013b0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 msgr2=0x561513f74480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 --2- 172.21.15.173:0/656288652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561513e77a00 0x561513f74480 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fee14052540 tx=0x7fee14003020 comp rx=0 tx=0).stop 2024-05-15T18:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee24dd2640 1 -- 172.21.15.173:0/656288652 reap_dead start 2024-05-15T18:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 shutdown_connections 2024-05-15T18:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 >> 172.21.15.173:0/656288652 conn(0x561513e735a0 msgr2=0x561513f66ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 shutdown_connections 2024-05-15T18:10:44.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.716+0000 7fee28933800 1 -- 172.21.15.173:0/656288652 wait complete. 2024-05-15T18:10:44.701 ERROR:root:None 2024-05-15T18:10:44.701 ERROR:root:0 2024-05-15T18:10:44.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-15T18:10:44.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-15T18:10:44.701 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-05-15T18:10:44.754 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:44.754 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be8462800 1 Processor -- start 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be8462800 1 -- start start 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be8462800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5561a4c600e0 0x5561a4c60500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be8462800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561a4c60b80 con 0x5561a4c612f0 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be8462800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5561a4af1050 con 0x5561a4c600e0 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be5f68640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5561a4c600e0 0x5561a4c60500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be5f68640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5561a4c600e0 0x5561a4c60500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50642/0 (socket says 172.21.15.173:50642) 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be5767640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5561a4c612f0 0x5561a4c61770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38658/0 (socket says 172.21.15.173:38658) 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be5f68640 1 -- 172.21.15.173:0/3086042319 learned_addr learned my addr 172.21.15.173:0/3086042319 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be5f68640 1 -- 172.21.15.173:0/3086042319 >> v1:172.21.15.3:6789/0 conn(0x5561a4c612f0 legacy=0x5561a4c61770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be5f68640 1 -- 172.21.15.173:0/3086042319 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a4c61eb0 con 0x5561a4c600e0 2024-05-15T18:10:44.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.779+0000 7f5be4f66640 1 -- 172.21.15.173:0/3086042319 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644676122 0 0) 0x5561a4c60b80 con 0x5561a4c612f0 2024-05-15T18:10:44.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.781+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3086042319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4c60500 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800a520 tx=0x7f5bd801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42533a1642c956fd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.781+0000 7f5be4f66640 1 -- 172.21.15.173:0/3086042319 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8057070 con 0x5561a4c600e0 2024-05-15T18:10:44.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.781+0000 7f5be4f66640 1 -- 172.21.15.173:0/3086042319 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd8052570 con 0x5561a4c600e0 2024-05-15T18:10:44.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.781+0000 7f5be4f66640 1 -- 172.21.15.173:0/3086042319 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8052870 con 0x5561a4c600e0 2024-05-15T18:10:44.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.782+0000 7f5be8462800 1 -- 172.21.15.173:0/3086042319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 msgr2=0x5561a4c60500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.782+0000 7f5be8462800 1 --2- 172.21.15.173:0/3086042319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4c60500 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800a520 tx=0x7f5bd801d010 comp rx=0 tx=0).stop 2024-05-15T18:10:44.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.782+0000 7f5be8462800 1 -- 172.21.15.173:0/3086042319 shutdown_connections 2024-05-15T18:10:44.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.782+0000 7f5be8462800 1 --2- 172.21.15.173:0/3086042319 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4c60500 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.782+0000 7f5be8462800 1 -- 172.21.15.173:0/3086042319 >> 172.21.15.173:0/3086042319 conn(0x5561a4c5b720 msgr2=0x5561a4c5db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.782+0000 7f5be8462800 1 -- 172.21.15.173:0/3086042319 shutdown_connections 2024-05-15T18:10:44.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.782+0000 7f5be8462800 1 -- 172.21.15.173:0/3086042319 wait complete. 2024-05-15T18:10:44.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.795+0000 7f5be8462800 1 Processor -- start 2024-05-15T18:10:44.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.796+0000 7f5be8462800 1 -- start start 2024-05-15T18:10:44.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.796+0000 7f5be8462800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d51580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.796+0000 7f5be8462800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561a4bab170 con 0x5561a4c600e0 2024-05-15T18:10:44.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.796+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d51580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.796+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d51580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50650/0 (socket says 172.21.15.173:50650) 2024-05-15T18:10:44.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.796+0000 7f5be5f68640 1 -- 172.21.15.173:0/3100631323 learned_addr learned my addr 172.21.15.173:0/3100631323 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.796+0000 7f5be5f68640 1 -- 172.21.15.173:0/3100631323 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a4d51b50 con 0x5561a4c600e0 2024-05-15T18:10:44.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.797+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3100631323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d51580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8055040 tx=0x7f5bd804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9394b5bdc3e59d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.797+0000 7f5ad3e07640 1 -- 172.21.15.173:0/3100631323 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8057040 con 0x5561a4c600e0 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.797+0000 7f5ad3e07640 1 -- 172.21.15.173:0/3100631323 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd8052850 con 0x5561a4c600e0 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.797+0000 7f5ad3e07640 1 -- 172.21.15.173:0/3100631323 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8052b50 con 0x5561a4c600e0 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.797+0000 7f5be8462800 1 -- 172.21.15.173:0/3100631323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 msgr2=0x5561a4d51580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.797+0000 7f5be8462800 1 --2- 172.21.15.173:0/3100631323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d51580 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8055040 tx=0x7f5bd804c000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 -- 172.21.15.173:0/3100631323 shutdown_connections 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 --2- 172.21.15.173:0/3100631323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d51580 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 -- 172.21.15.173:0/3100631323 >> 172.21.15.173:0/3100631323 conn(0x5561a4c5b720 msgr2=0x5561a4d4cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 -- 172.21.15.173:0/3100631323 shutdown_connections 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 -- 172.21.15.173:0/3100631323 wait complete. 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 Processor -- start 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 -- start start 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d59010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be8462800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561a4c697c0 con 0x5561a4c600e0 2024-05-15T18:10:44.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d59010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d59010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50658/0 (socket says 172.21.15.173:50658) 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be5f68640 1 -- 172.21.15.173:0/3995254840 learned_addr learned my addr 172.21.15.173:0/3995254840 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.798+0000 7f5be5f68640 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a4d59550 con 0x5561a4c600e0 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.799+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d59010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8052540 tx=0x7f5bd8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.799+0000 7f5ad2604640 1 -- 172.21.15.173:0/3995254840 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8073070 con 0x5561a4c600e0 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.799+0000 7f5ad2604640 1 -- 172.21.15.173:0/3995254840 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd805d570 con 0x5561a4c600e0 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.799+0000 7f5ad2604640 1 -- 172.21.15.173:0/3995254840 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8057070 con 0x5561a4c600e0 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.799+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561a4d597e0 con 0x5561a4c600e0 2024-05-15T18:10:44.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.799+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561a4d5c490 con 0x5561a4c600e0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5ad2604640 1 -- 172.21.15.173:0/3995254840 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5bd8076070 con 0x5561a4c600e0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5ad2604640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5acc036950 0x7f5acc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5ad2604640 1 -- 172.21.15.173:0/3995254840 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5bd808dcc0 con 0x5561a4c600e0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5be5767640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5acc036950 0x7f5acc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4c612f0 0x5561a4d60250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d60790 con 0x5561a4c612f0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5be6769640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4c612f0 0x5561a4d60250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5be5767640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5acc036950 0x7f5acc038e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000c00 tx=0x7f5bdc0013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.800+0000 7f5be6769640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4c612f0 0x5561a4d60250 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.801+0000 7f5be6769640 1 -- 172.21.15.173:0/3995254840 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4c612f0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.801+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d5d800 con 0x5561a4c612f0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.801+0000 7f5be6769640 1 -- 172.21.15.173:0/3995254840 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4c612f0 2024-05-15T18:10:44.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.801+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d62ab0 0x5561a4d64ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.801+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d65590 con 0x5561a4d62ab0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.801+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d62ab0 0x5561a4d64ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.801+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d62ab0 0x5561a4d64ea0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.802+0000 7f5be5f68640 1 -- 172.21.15.173:0/3995254840 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5bd8075030 con 0x5561a4d62ab0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.802+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d61a60 con 0x5561a4c612f0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.802+0000 7f5be6769640 1 -- 172.21.15.173:0/3995254840 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4c612f0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.802+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5561a4d66a40 0x5561a4d68e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.802+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d695f0 con 0x5561a4d66a40 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.802+0000 7f5be5767640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5561a4d66a40 0x5561a4d68e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.803+0000 7f5be5767640 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5561a4d66a40 0x5561a4d68e90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.803+0000 7f5be5767640 1 -- 172.21.15.173:0/3995254840 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5bdc00f670 con 0x5561a4d66a40 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.803+0000 7f5be8462800 1 Processor -- start 2024-05-15T18:10:44.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.803+0000 7f5be8462800 1 -- start start 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.803+0000 7f5be8462800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d77a50 0x5561a4d77e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.803+0000 7f5be8462800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561a4b51cf0 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d77a50 0x5561a4d77e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d77a50 0x5561a4d77e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50670/0 (socket says 172.21.15.173:50670) 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5be5f68640 1 -- 172.21.15.173:0/1255469084 learned_addr learned my addr 172.21.15.173:0/1255469084 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5be5f68640 1 -- 172.21.15.173:0/1255469084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a4d783b0 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5be5f68640 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d77a50 0x5561a4d77e70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8006b30 tx=0x7f5bd8076650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5acb7fe640 1 -- 172.21.15.173:0/1255469084 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8091070 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5acb7fe640 1 -- 172.21.15.173:0/1255469084 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd8007df0 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561a4d78e20 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5acb7fe640 1 -- 172.21.15.173:0/1255469084 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8008110 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.804+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561a4d79320 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.805+0000 7f5acb7fe640 1 -- 172.21.15.173:0/1255469084 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5bd80773b0 con 0x5561a4d77a50 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.805+0000 7f5acb7fe640 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ac0036900 0x7f5ac0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.805+0000 7f5acb7fe640 1 -- 172.21.15.173:0/1255469084 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5bd8083040 con 0x5561a4d77a50 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.805+0000 7f5be5767640 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ac0036900 0x7f5ac0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.805+0000 7f5be8462800 1 Processor -- start 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.805+0000 7f5be8462800 1 -- start start 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be5767640 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ac0036900 0x7f5ac0038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5561a4d61060 tx=0x7f5bdc006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be8462800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d84f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be8462800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561a4d51e10 con 0x5561a4d84b70 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d84f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d84f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50678/0 (socket says 172.21.15.173:50678) 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be5f68640 1 -- 172.21.15.173:0/403923005 learned_addr learned my addr 172.21.15.173:0/403923005 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be5f68640 1 -- 172.21.15.173:0/403923005 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a4d85560 con 0x5561a4d84b70 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5be5f68640 1 --2- 172.21.15.173:0/403923005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d84f90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5bd805cf90 tx=0x7f5bd8096890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6f00d6a585b8f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5ac97fa640 1 -- 172.21.15.173:0/403923005 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd8079420 con 0x5561a4d84b70 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5ac97fa640 1 -- 172.21.15.173:0/403923005 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd80a6070 con 0x5561a4d84b70 2024-05-15T18:10:44.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.806+0000 7f5ac97fa640 1 -- 172.21.15.173:0/403923005 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd805c880 con 0x5561a4d84b70 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 -- 172.21.15.173:0/403923005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 msgr2=0x5561a4d84f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 --2- 172.21.15.173:0/403923005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d84f90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5bd805cf90 tx=0x7f5bd8096890 comp rx=0 tx=0).stop 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 -- 172.21.15.173:0/403923005 shutdown_connections 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 --2- 172.21.15.173:0/403923005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d84f90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 -- 172.21.15.173:0/403923005 >> 172.21.15.173:0/403923005 conn(0x5561a4d80e80 msgr2=0x5561a4d7eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 -- 172.21.15.173:0/403923005 shutdown_connections 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 -- 172.21.15.173:0/403923005 wait complete. 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 Processor -- start 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 -- start start 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d8bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.807+0000 7f5be8462800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561a4d85bf0 con 0x5561a4d84b70 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d8bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5be5f68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d8bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50684/0 (socket says 172.21.15.173:50684) 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 learned_addr learned my addr 172.21.15.173:0/3820282785 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a4d8c480 con 0x5561a4d84b70 2024-05-15T18:10:44.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d8bf40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5bd808af70 tx=0x7f5bd805d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5ab77fe640 1 -- 172.21.15.173:0/3820282785 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd80794f0 con 0x5561a4d84b70 2024-05-15T18:10:44.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5ab77fe640 1 -- 172.21.15.173:0/3820282785 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd808c4c0 con 0x5561a4d84b70 2024-05-15T18:10:44.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561a4d8c480 con 0x5561a4d84b70 2024-05-15T18:10:44.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5ab77fe640 1 -- 172.21.15.173:0/3820282785 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bd808c670 con 0x5561a4d84b70 2024-05-15T18:10:44.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.808+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561a4d8c480 con 0x5561a4d84b70 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.809+0000 7f5ab77fe640 1 -- 172.21.15.173:0/3820282785 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5bd80a8020 con 0x5561a4d84b70 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.809+0000 7f5ab77fe640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ab00368b0 0x7f5ab0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.809+0000 7f5ab77fe640 1 -- 172.21.15.173:0/3820282785 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f5bd8083420 con 0x5561a4d84b70 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.809+0000 7f5be5767640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ab00368b0 0x7f5ab0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.810+0000 7f5be5767640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ab00368b0 0x7f5ab0038d70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5561a4d699f0 tx=0x7f5bdc023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.810+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.810+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4d97680 0x5561a4d99b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.810+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9a290 con 0x5561a4d97680 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.810+0000 7f5be6769640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4d97680 0x5561a4d99b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.810+0000 7f5be6769640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4d97680 0x5561a4d99b40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 realm 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9a6a0 con 0x5561a4d97680 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9af70 con 0x5561a4d97680 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d9c070 0x5561a4d9e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9ea70 con 0x5561a4d9c070 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.811+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d9c070 0x5561a4d9e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d9c070 0x5561a4d9e460 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be8462800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be8462800 20 searching for the correct realm 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da03c0 con 0x5561a4d9c070 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be5f68640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5bd8083620 0x7f5bd8051880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da03c0 con 0x7f5bd8083620 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.812+0000 7f5be5767640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5bd8083620 0x7f5bd8051880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.813+0000 7f5be5767640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5bd8083620 0x7f5bd8051880 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.813+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.813+0000 7f5be5767640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5bdc03a3c0 0x7f5bdc03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.813+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da03c0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.813+0000 7f5be6769640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5bdc03a3c0 0x7f5bdc03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.814+0000 7f5be6769640 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5bdc03a3c0 0x7f5bdc03a810 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.814+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.814+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.814+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.814+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.814+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.814+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bd8083620 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.815+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.816+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.816+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.816+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.816+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bd8083620 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.817+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.818+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bd8083620 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.819+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bd8083620 2024-05-15T18:10:44.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.820+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d9c070 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bd8083620 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x5561a4d97680 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9b310 con 0x7f5bd8083620 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:44.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.821+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9f330 con 0x5561a4d97680 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9f720 con 0x5561a4d97680 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be8462800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.822+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d9f720 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 zone default found 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 4 Realm: () 2024-05-15T18:10:44.812 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 zonegroup default 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da0840 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da2220 con 0x5561a4d9c070 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da25c0 con 0x5561a4d9c070 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 started sync module instance, tier type = 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.823+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da16c0 con 0x7f5bd8083620 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.825+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.825+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93877865945824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da1320 con 0x7f5bd8083620 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.825+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da32c0 con 0x5561a4d97680 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.826+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93877865945824] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.826+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.826+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93877865950016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da35b0 con 0x5561a4d97680 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.826+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da40d0 con 0x5561a4d9c070 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.827+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93877865950016] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.827+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.827+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93877865954208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da44c0 con 0x5561a4d9c070 2024-05-15T18:10:44.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.827+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da4f10 con 0x7f5bd8083620 2024-05-15T18:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.828+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93877865954208] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.828+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.828+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93877865951232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da57b0 con 0x7f5bd8083620 2024-05-15T18:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.828+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da6170 con 0x5561a4d97680 2024-05-15T18:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.829+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93877865951232] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.829+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.829+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93877865962688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da6590 con 0x5561a4d97680 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.830+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da6f50 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.831+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.831+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93877865966240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da6ec0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.831+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da7f20 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.831+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93877865962688] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.832+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93877865966240] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.832+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.832+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93877865970192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da72f0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.832+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da8390 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.833+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93877865970192] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93877865963744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da8390 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 20 add_watcher() i=0 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 20 add_watcher() i=1 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 20 add_watcher() i=2 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 20 add_watcher() i=3 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 20 add_watcher() i=4 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 20 add_watcher() i=5 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.834+0000 7f5be8462800 20 add_watcher() i=6 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.835+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93877865963744] v31'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.835+0000 7f5be8462800 20 add_watcher() i=7 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.835+0000 7f5be8462800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.835+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4dab790 con 0x5561a4d97680 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.835+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.835+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93877865971888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da8cb0 con 0x5561a4d97680 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.836+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93877865971888] v31'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.836+0000 7f5a977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 5 note: GC not initialized 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5a967fc640 20 reqs_thread_entry: start 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 20 Filter name: none 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5a07fff640 20 reqs_thread_entry: start 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4ddecb0 con 0x5561a4d9c070 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-05-15T18:10:44.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.837+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4ddd450 con 0x5561a4d9c070 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.838+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.838+0000 7f5be8462800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.838+0000 7f5be8462800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.838+0000 7f5be8462800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.838+0000 7f5be8462800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.838+0000 7f5be8462800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.838+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4dddcf0 con 0x5561a4d9c070 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v31'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be8462800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be8462800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be8462800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-15T18:10:44.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93877866190912 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4de2140 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== watch-notify(notify (1) cookie 93877865954208 notify 133143986195 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5561a4ddd600 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5ac97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 93877865954208 notifier 4853 bl.length()=542 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5ac97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5ac97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5ac97fa640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5aa8003ea0 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(65 notify.2 [notify cookie 93877866190912 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.839+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.840+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== watch-notify(notify_complete (2) cookie 93877866190912 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561a4d783b0 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.840+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4dddc80 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v31'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5be8462800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5be8462800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-15T18:10:44.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5be8462800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93877866190800 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5561a4de20f0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== watch-notify(notify (1) cookie 93877865966240 notify 133143986224 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f5be001e040 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(68 notify.5 [notify cookie 93877866190800 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5ac8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986224 cookie 93877865966240 notifier 4853 bl.length()=175 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5ac8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5ac8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.841+0000 7f5ac8ff9640 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5a10003400 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.842+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.842+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== watch-notify(notify_complete (2) cookie 93877866190800 notify 133143986224 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5be0018de0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.827 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-05-15T18:10:44.838695Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.838683Z","tags":[],"group_ids":[]} 2024-05-15T18:10:44.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.843+0000 7f5a977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.843+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93877865971888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4d93820 con 0x5561a4d97680 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.844+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93877865971888] v31'254 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.844+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93877865945824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da8080 con 0x7f5bd8083620 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.845+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93877865945824] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.845+0000 7f5be8462800 20 remove_watcher() i=0 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.845+0000 7f5be8462800 2 removed watcher, disabling cache 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.845+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93877865950016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da1ae0 con 0x5561a4d97680 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.846+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93877865950016] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.846+0000 7f5be8462800 20 remove_watcher() i=1 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.846+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93877865954208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da1ae0 con 0x5561a4d9c070 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.847+0000 7f5be5f68640 1 -- 172.21.15.173:0/3820282785 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93877865954208] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bd8093070 con 0x5561a4d9c070 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.847+0000 7f5be8462800 20 remove_watcher() i=2 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.847+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93877865951232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da3ba0 con 0x7f5bd8083620 2024-05-15T18:10:44.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.848+0000 7f5be5767640 1 -- 172.21.15.173:0/3820282785 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93877865951232] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bdc037040 con 0x7f5bd8083620 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.848+0000 7f5be8462800 20 remove_watcher() i=3 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.848+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93877865962688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da1ae0 con 0x5561a4d97680 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.849+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93877865962688] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x5561a4d97680 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.849+0000 7f5be8462800 20 remove_watcher() i=4 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.849+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93877865966240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da3ba0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.850+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93877865966240] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.850+0000 7f5be8462800 20 remove_watcher() i=5 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.850+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93877865970192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da5cc0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.851+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93877865970192] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.851+0000 7f5be8462800 20 remove_watcher() i=6 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.851+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93877865963744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5561a4da1ae0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93877865963744] v31'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5be000a4a0 con 0x7f5bdc03a3c0 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 20 remove_watcher() i=7 2024-05-15T18:10:44.834 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5bdc03a3c0 msgr2=0x7f5bdc03a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f5bdc03a3c0 0x7f5bdc03a810 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4d97680 msgr2=0x5561a4d99b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4d97680 0x5561a4d99b40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5bd8083620 msgr2=0x7f5bd8051880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f5bd8083620 0x7f5bd8051880 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d9c070 msgr2=0x5561a4d9e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d9c070 0x5561a4d9e460 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ab00368b0 msgr2=0x7f5ab0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ab00368b0 0x7f5ab0038d70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5561a4d699f0 tx=0x7f5bdc023040 comp rx=0 tx=0).stop 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 msgr2=0x5561a4d8bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be6769640 1 -- 172.21.15.173:0/3820282785 reap_dead start 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d8bf40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5bd808af70 tx=0x7f5bd805d9f0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 shutdown_connections 2024-05-15T18:10:44.835 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/3820282785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d84b70 0x5561a4d8bf40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 >> 172.21.15.173:0/3820282785 conn(0x5561a4d80e80 msgr2=0x5561a4d7e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 shutdown_connections 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/3820282785 wait complete. 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ac0036900 msgr2=0x7f5ac0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ac0036900 0x7f5ac0038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5561a4d61060 tx=0x7f5bdc006000 comp rx=0 tx=0).stop 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d77a50 msgr2=0x5561a4d77e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d77a50 0x5561a4d77e70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8006b30 tx=0x7f5bd8076650 comp rx=0 tx=0).stop 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 shutdown_connections 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5ac0036900 0x7f5ac0038dc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 --2- 172.21.15.173:0/1255469084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4d77a50 0x5561a4d77e70 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.852+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 >> 172.21.15.173:0/1255469084 conn(0x5561a4d6baf0 msgr2=0x5561a4d6bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 shutdown_connections 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/1255469084 wait complete. 2024-05-15T18:10:44.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5561a4d66a40 msgr2=0x5561a4d68e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5561a4d66a40 0x5561a4d68e90 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4c612f0 msgr2=0x5561a4d60250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5561a4c612f0 0x5561a4d60250 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d62ab0 msgr2=0x5561a4d64ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5561a4d62ab0 0x5561a4d64ea0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5acc036950 msgr2=0x7f5acc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5acc036950 0x7f5acc038e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000c00 tx=0x7f5bdc0013b0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 msgr2=0x5561a4d59010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 --2- 172.21.15.173:0/3995254840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561a4c600e0 0x5561a4d59010 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8052540 tx=0x7f5bd8003020 comp rx=0 tx=0).stop 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be6769640 1 -- 172.21.15.173:0/3995254840 reap_dead start 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 shutdown_connections 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 >> 172.21.15.173:0/3995254840 conn(0x5561a4c5b720 msgr2=0x5561a4d4b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 shutdown_connections 2024-05-15T18:10:44.837 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.853+0000 7f5be8462800 1 -- 172.21.15.173:0/3995254840 wait complete. 2024-05-15T18:10:44.838 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-15T18:10:44.838695Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.838683Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.839 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-15T18:10:44.838695Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.838683Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:44.839 ERROR:root:0 2024-05-15T18:10:44.839 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:44.844 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:44.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-05-15T18:10:44.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-05-15T18:10:44.844 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-05-15T18:10:44.888 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:44.888 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb72892b800 1 Processor -- start 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb72892b800 1 -- start start 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb72892b800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55661254d6e0 0x55661254fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb72892b800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556612550010 con 0x556612549bd0 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb72892b800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x5566123da050 con 0x55661254d6e0 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb71bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55661254d6e0 0x55661254fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb7245ab640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x556612549bd0 0x55661254bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38666/0 (socket says 172.21.15.173:38666) 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb71bfff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55661254d6e0 0x55661254fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50700/0 (socket says 172.21.15.173:50700) 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.913+0000 7fb7245ab640 1 -- 172.21.15.173:0/2128322596 learned_addr learned my addr 172.21.15.173:0/2128322596 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.914+0000 7fb71bfff640 1 -- 172.21.15.173:0/2128322596 >> v1:172.21.15.3:6789/0 conn(0x556612549bd0 legacy=0x55661254bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.890 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.914+0000 7fb723daa640 1 -- 172.21.15.173:0/2128322596 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508440381 0 0) 0x556612550010 con 0x556612549bd0 2024-05-15T18:10:44.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.914+0000 7fb71bfff640 1 -- 172.21.15.173:0/2128322596 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566125511f0 con 0x55661254d6e0 2024-05-15T18:10:44.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.915+0000 7fb71bfff640 1 --2- 172.21.15.173:0/2128322596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55661254d6e0 0x55661254fad0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00a470 tx=0x7fb70c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e47a4856a1361f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb723daa640 1 -- 172.21.15.173:0/2128322596 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb70c057070 con 0x55661254d6e0 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb723daa640 1 -- 172.21.15.173:0/2128322596 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c052570 con 0x55661254d6e0 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb723daa640 1 -- 172.21.15.173:0/2128322596 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb70c052870 con 0x55661254d6e0 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb72892b800 1 -- 172.21.15.173:0/2128322596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55661254d6e0 msgr2=0x55661254fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb72892b800 1 --2- 172.21.15.173:0/2128322596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55661254d6e0 0x55661254fad0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00a470 tx=0x7fb70c01ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb72892b800 1 -- 172.21.15.173:0/2128322596 shutdown_connections 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb72892b800 1 --2- 172.21.15.173:0/2128322596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55661254d6e0 0x55661254fad0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb72892b800 1 -- 172.21.15.173:0/2128322596 >> 172.21.15.173:0/2128322596 conn(0x5566125435a0 msgr2=0x5566125459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb72892b800 1 -- 172.21.15.173:0/2128322596 shutdown_connections 2024-05-15T18:10:44.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.916+0000 7fb72892b800 1 -- 172.21.15.173:0/2128322596 wait complete. 2024-05-15T18:10:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.930+0000 7fb72892b800 1 Processor -- start 2024-05-15T18:10:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.930+0000 7fb72892b800 1 -- start start 2024-05-15T18:10:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.930+0000 7fb72892b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x55661263a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.930+0000 7fb72892b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5566124941d0 con 0x556612549bd0 2024-05-15T18:10:44.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.931+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x55661263a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.931+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x55661263a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50712/0 (socket says 172.21.15.173:50712) 2024-05-15T18:10:44.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.931+0000 7fb7245ab640 1 -- 172.21.15.173:0/2806922254 learned_addr learned my addr 172.21.15.173:0/2806922254 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.908 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.931+0000 7fb7245ab640 1 -- 172.21.15.173:0/2806922254 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661263aa20 con 0x556612549bd0 2024-05-15T18:10:44.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.932+0000 7fb7245ab640 1 --2- 172.21.15.173:0/2806922254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x55661263a450 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb71400b210 tx=0x7fb71400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84382332f267587 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.932+0000 7fb61260c640 1 -- 172.21.15.173:0/2806922254 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb714008070 con 0x556612549bd0 2024-05-15T18:10:44.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.932+0000 7fb61260c640 1 -- 172.21.15.173:0/2806922254 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71400d500 con 0x556612549bd0 2024-05-15T18:10:44.909 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.932+0000 7fb61260c640 1 -- 172.21.15.173:0/2806922254 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71400d840 con 0x556612549bd0 2024-05-15T18:10:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 -- 172.21.15.173:0/2806922254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 msgr2=0x55661263a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 --2- 172.21.15.173:0/2806922254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x55661263a450 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb71400b210 tx=0x7fb71400b6d0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 -- 172.21.15.173:0/2806922254 shutdown_connections 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 --2- 172.21.15.173:0/2806922254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x55661263a450 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 -- 172.21.15.173:0/2806922254 >> 172.21.15.173:0/2806922254 conn(0x5566125435a0 msgr2=0x556612635d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 -- 172.21.15.173:0/2806922254 shutdown_connections 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 -- 172.21.15.173:0/2806922254 wait complete. 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 Processor -- start 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 -- start start 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x556612549510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb72892b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5566125504e0 con 0x556612549bd0 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x556612549510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x556612549510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50714/0 (socket says 172.21.15.173:50714) 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.933+0000 7fb7245ab640 1 -- 172.21.15.173:0/1714594659 learned_addr learned my addr 172.21.15.173:0/1714594659 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.934+0000 7fb7245ab640 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556612547c00 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.934+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x556612549510 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb71400b210 tx=0x7fb714000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.934+0000 7fb610e09640 1 -- 172.21.15.173:0/1714594659 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71400f950 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.934+0000 7fb610e09640 1 -- 172.21.15.173:0/1714594659 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71400faf0 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.934+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556612547e90 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.934+0000 7fb610e09640 1 -- 172.21.15.173:0/1714594659 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71400fdd0 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.934+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566125483b0 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.935+0000 7fb610e09640 1 -- 172.21.15.173:0/1714594659 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb714017040 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.935+0000 7fb610e09640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb60c036900 0x7fb60c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.935+0000 7fb610e09640 1 -- 172.21.15.173:0/1714594659 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb714015020 con 0x556612549bd0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.935+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb60c036900 0x7fb60c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.935+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55661254d6e0 0x55661264b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.935+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661264b9a0 con 0x55661254d6e0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.935+0000 7fb724dac640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55661254d6e0 0x55661264b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb60c036900 0x7fb60c038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb70c054000 tx=0x7fb70c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb724dac640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55661254d6e0 0x55661264b420 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb724dac640 1 -- 172.21.15.173:0/1714594659 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb71c00a4a0 con 0x55661254d6e0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661264c260 con 0x55661254d6e0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb724dac640 1 -- 172.21.15.173:0/1714594659 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb71c00a4a0 con 0x55661254d6e0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55661264dce0 0x5566126501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556612650930 con 0x55661264dce0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.936+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55661264dce0 0x5566126501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.937+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55661264dce0 0x5566126501a0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.937+0000 7fb7245ab640 1 -- 172.21.15.173:0/1714594659 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb71402d070 con 0x55661264dce0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.937+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661264cae0 con 0x55661254d6e0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.937+0000 7fb724dac640 1 -- 172.21.15.173:0/1714594659 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb71c00a4a0 con 0x55661254d6e0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.937+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556612651de0 0x556612654250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.937+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566126549b0 con 0x556612651de0 2024-05-15T18:10:44.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.937+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556612651de0 0x556612654250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.938+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556612651de0 0x556612654250 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.938+0000 7fb71bfff640 1 -- 172.21.15.173:0/1714594659 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb70c05a040 con 0x556612651de0 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb72892b800 1 Processor -- start 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb72892b800 1 -- start start 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb72892b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612662e10 0x556612663230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb72892b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556612549a50 con 0x556612662e10 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612662e10 0x556612663230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612662e10 0x556612663230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50716/0 (socket says 172.21.15.173:50716) 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb7245ab640 1 -- 172.21.15.173:0/1644074333 learned_addr learned my addr 172.21.15.173:0/1644074333 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb7245ab640 1 -- 172.21.15.173:0/1644074333 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556612663770 con 0x556612662e10 2024-05-15T18:10:44.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.939+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612662e10 0x556612663230 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb71404b350 tx=0x7fb71401aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb609ffb640 1 -- 172.21.15.173:0/1644074333 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71401a540 con 0x556612662e10 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb609ffb640 1 -- 172.21.15.173:0/1644074333 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714034070 con 0x556612662e10 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566126641e0 con 0x556612662e10 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb609ffb640 1 -- 172.21.15.173:0/1644074333 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140195a0 con 0x556612662e10 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566126646e0 con 0x556612662e10 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb609ffb640 1 -- 172.21.15.173:0/1644074333 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb714019740 con 0x556612662e10 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb609ffb640 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5fc036900 0x7fb5fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.940+0000 7fb609ffb640 1 -- 172.21.15.173:0/1644074333 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb71403ac60 con 0x556612662e10 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5fc036900 0x7fb5fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb72892b800 1 Processor -- start 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb72892b800 1 -- start start 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5fc036900 0x7fb5fc038dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5566125488d0 tx=0x7fb70c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb72892b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612670590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb72892b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55661243acf0 con 0x556612670170 2024-05-15T18:10:44.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612670590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612670590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50732/0 (socket says 172.21.15.173:50732) 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb7245ab640 1 -- 172.21.15.173:0/2501802099 learned_addr learned my addr 172.21.15.173:0/2501802099 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.941+0000 7fb7245ab640 1 -- 172.21.15.173:0/2501802099 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556612670b60 con 0x556612670170 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb7245ab640 1 --2- 172.21.15.173:0/2501802099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612670590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb71401d190 tx=0x7fb714030f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d03379d886618a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb6037fe640 1 -- 172.21.15.173:0/2501802099 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71405b070 con 0x556612670170 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb6037fe640 1 -- 172.21.15.173:0/2501802099 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714031dc0 con 0x556612670170 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb6037fe640 1 -- 172.21.15.173:0/2501802099 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71403e040 con 0x556612670170 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 -- 172.21.15.173:0/2501802099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 msgr2=0x556612670590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 --2- 172.21.15.173:0/2501802099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612670590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb71401d190 tx=0x7fb714030f70 comp rx=0 tx=0).stop 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 -- 172.21.15.173:0/2501802099 shutdown_connections 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 --2- 172.21.15.173:0/2501802099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612670590 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 -- 172.21.15.173:0/2501802099 >> 172.21.15.173:0/2501802099 conn(0x55661266c3f0 msgr2=0x55661266a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 -- 172.21.15.173:0/2501802099 shutdown_connections 2024-05-15T18:10:44.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 -- 172.21.15.173:0/2501802099 wait complete. 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.942+0000 7fb72892b800 1 Processor -- start 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb72892b800 1 -- start start 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb72892b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612677320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb72892b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556612671050 con 0x556612670170 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612677320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb7245ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612677320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50742/0 (socket says 172.21.15.173:50742) 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 learned_addr learned my addr 172.21.15.173:0/1704818897 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556612677860 con 0x556612670170 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612677320 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb71401b5b0 tx=0x7fb71403ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb601ffb640 1 -- 172.21.15.173:0/1704818897 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71403e050 con 0x556612670170 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb601ffb640 1 -- 172.21.15.173:0/1704818897 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb714030820 con 0x556612670170 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556612677860 con 0x556612670170 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.943+0000 7fb601ffb640 1 -- 172.21.15.173:0/1704818897 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7140441d0 con 0x556612670170 2024-05-15T18:10:44.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.944+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556612677860 con 0x556612670170 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.944+0000 7fb601ffb640 1 -- 172.21.15.173:0/1704818897 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb71405e070 con 0x556612670170 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.944+0000 7fb601ffb640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4036900 0x7fb5f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.944+0000 7fb601ffb640 1 -- 172.21.15.173:0/1704818897 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb714068070 con 0x556612670170 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.945+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4036900 0x7fb5f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.945+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4036900 0x7fb5f4038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb70c01ced0 tx=0x7fb70c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.945+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.945+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556612682a40 0x556612684f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.945+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556612685650 con 0x556612682a40 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.945+0000 7fb724dac640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556612682a40 0x556612684f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb724dac640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556612682a40 0x556612684f00 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 20 realm 2024-05-15T18:10:44.935 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556612685a60 con 0x556612682a40 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556612686330 con 0x556612682a40 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.946+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb72892b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.936 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556612687430 0x556612689820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556612689e30 con 0x556612687430 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556612687430 0x556612689820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556612687430 0x556612689820 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb72892b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb72892b800 20 searching for the correct realm 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.947+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55661268b760 con 0x556612687430 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb7245ab640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb714060070 0x7fb71403a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55661268b760 con 0x7fb714060070 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb714060070 0x7fb71403a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb714060070 0x7fb71403a470 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.937 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb71bfff640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb70c083040 0x7fb70c075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55661268b760 con 0x7fb70c083040 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.948+0000 7fb724dac640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb70c083040 0x7fb70c075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.949+0000 7fb724dac640 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb70c083040 0x7fb70c075430 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.949+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb71c00a4a0 con 0x7fb70c083040 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.949+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.949+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.949+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.949+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.949+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb70c083040 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x7fb70c083040 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb70c083040 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x7fb70c083040 2024-05-15T18:10:44.938 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb714060070 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.950+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb70c083040 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x7fb70c083040 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb714060070 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.951+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb70c083040 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x7fb70c083040 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.952+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb71c00a4a0 con 0x556612682a40 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb70c083040 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c033040 con 0x7fb70c083040 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.953+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb714060070 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb70c083040 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.954+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb70c083040 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb714060070 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612687430 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.955+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb714060070 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x556612682a40 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5566126866d0 con 0x7fb714060070 2024-05-15T18:10:44.950 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.956+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661268a6f0 con 0x556612682a40 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661268aae0 con 0x556612682a40 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661268aae0 con 0x7fb70c083040 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 zone default found 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 4 Realm: () 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 zonegroup default 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.957+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661268a350 con 0x7fb70c083040 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.952 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661268a350 con 0x556612687430 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55661268d6a0 con 0x556612687430 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 20 started sync module instance, tier type = 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.958+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268ca60 con 0x7fb714060070 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.959+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.953 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.959+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93896883883600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268c6c0 con 0x7fb714060070 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.959+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268e5d0 con 0x556612682a40 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.960+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93896883883600] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.960+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.960+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93896883888416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268e540 con 0x556612682a40 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.961+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268f490 con 0x556612687430 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.962+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93896883888416] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.963+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.963+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93896883890624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268f490 con 0x556612687430 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.963+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268fe90 con 0x7fb714060070 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.964+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.964+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93896883894688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612690730 con 0x7fb714060070 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.964+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612691250 con 0x556612682a40 2024-05-15T18:10:44.954 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.964+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93896883890624] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.965+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93896883894688] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.965+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.965+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93896883896960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268efe0 con 0x556612682a40 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.965+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612691b30 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.966+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.966+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93896883901936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612691f50 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.966+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612692a70 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.966+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93896883896960] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.967+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.967+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93896883905856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612692a30 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.967+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612693470 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.967+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93896883901936] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93896883905856] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.955 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93896883899680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612691a10 con 0x7fb70c083040 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 20 add_watcher() i=0 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 20 add_watcher() i=1 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 20 add_watcher() i=2 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 20 add_watcher() i=3 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 20 add_watcher() i=4 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 20 add_watcher() i=5 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.968+0000 7fb72892b800 20 add_watcher() i=6 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.969+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93896883899680] v31'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.969+0000 7fb72892b800 20 add_watcher() i=7 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.969+0000 7fb72892b800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.969+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556612696460 con 0x556612682a40 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.969+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.956 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.970+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93896883908416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126938e0 con 0x556612682a40 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.970+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93896883908416] v31'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.971+0000 7fb5da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.971+0000 7fb72892b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.971+0000 7fb72892b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.971+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661269ec90 con 0x556612682a40 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.972+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.972+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661269f2e0 con 0x7fb70c083040 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.973+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.973+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661269f740 con 0x556612687430 2024-05-15T18:10:44.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.974+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.974+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661269f600 con 0x556612682a40 2024-05-15T18:10:44.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.975+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'256 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.975+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661269fcb0 con 0x7fb714060070 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.976+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.976+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a06d0 con 0x556612687430 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.977+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.977+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a06d0 con 0x556612682a40 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.978+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.979+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a06d0 con 0x7fb70c083040 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.979+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.980+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a0760 con 0x7fb714060070 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.981+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.981+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a0cf0 con 0x556612687430 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.981+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.981+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a0cf0 con 0x7fb714060070 2024-05-15T18:10:44.960 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.983+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.983+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb70c083040 2024-05-15T18:10:44.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.984+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.984+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb714060070 2024-05-15T18:10:44.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.985+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.985+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb70c083040 2024-05-15T18:10:44.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.986+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.986+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612682a40 2024-05-15T18:10:44.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.987+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'257 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.963 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.987+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.988+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.964 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.988+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb714060070 2024-05-15T18:10:44.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.989+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.965 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.989+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.990+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.966 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.990+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612682a40 2024-05-15T18:10:44.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.991+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.967 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.991+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612682a40 2024-05-15T18:10:44.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.992+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'258 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.992+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.993+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.993+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb714060070 2024-05-15T18:10:44.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.994+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.994+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.995+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.995+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.996+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.996+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.997+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.997+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.998+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.974 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.998+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb70c083040 2024-05-15T18:10:44.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.999+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.976 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:44.999+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.000+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.000+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb70c083040 2024-05-15T18:10:44.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.001+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.001+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x556612687430 2024-05-15T18:10:44.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.003+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.003+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb70c083040 2024-05-15T18:10:44.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.004+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.004+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126a11a0 con 0x7fb714060070 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.005+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.005+0000 7fb5d97e2640 20 reqs_thread_entry: start 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.005+0000 7fb72892b800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 20 Filter name: none 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb54affd640 20 reqs_thread_entry: start 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:44.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566126cc270 con 0x556612687430 2024-05-15T18:10:44.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 20 rados_obj.operate() r=0 bl.length=363 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566126ceba0 con 0x556612687430 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.006+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fb714072020 con 0x556612687430 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.007+0000 7fb72892b800 10 removing key index: true_admin_akey 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.007+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126ccb80 con 0x556612687430 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.007+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(96 true_admin_akey [delete] v31'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fb714094040 con 0x556612687430 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.007+0000 7fb72892b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.007+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93896884147856 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566126cf0b0 con 0x7fb70c083040 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== watch-notify(notify (1) cookie 93896883901936 notify 133143986225 ret 0) ==== 207+0+0 (crc 0 0 0) 0x5566126a0220 con 0x7fb70c083040 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb6037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986225 cookie 93896883901936 notifier 4860 bl.length()=165 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb6037fe640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb5e8003d60 con 0x7fb70c083040 2024-05-15T18:10:44.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(97 notify.5 [notify cookie 93896884147856 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== watch-notify(notify_complete (2) cookie 93896884147856 notify 133143986225 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566126646e0 con 0x7fb70c083040 2024-05-15T18:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb72892b800 10 removing email index: 2024-05-15T18:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb72892b800 10 removing user buckets index 2024-05-15T18:10:44.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.008+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126cefb0 con 0x556612687430 2024-05-15T18:10:44.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.009+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(99 a_user.buckets [delete] v31'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fb714094040 con 0x556612687430 2024-05-15T18:10:44.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.009+0000 7fb72892b800 10 removing user index: a_user 2024-05-15T18:10:44.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.009+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5566126cefb0 con 0x556612687430 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(100 a_user [call,call,delete] v31'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fb714094040 con 0x556612687430 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb72892b800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb72892b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93896884153088 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5566126cef20 con 0x556612687430 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== watch-notify(notify (1) cookie 93896883890624 notify 133143986196 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5566126a0760 con 0x556612687430 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb602ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 93896883890624 notifier 4860 bl.length()=155 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb602ffd640 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fb5580032c0 con 0x556612687430 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.010+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(101 notify.2 [notify cookie 93896884153088 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb714094040 con 0x556612687430 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.011+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== watch-notify(notify_complete (2) cookie 93896884153088 notify 133143986196 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5566126641e0 con 0x556612687430 2024-05-15T18:10:44.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.011+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb714094040 con 0x556612687430 2024-05-15T18:10:44.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.012+0000 7fb5da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:44.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.012+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93896883908416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661269c920 con 0x556612682a40 2024-05-15T18:10:44.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.013+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93896883908416] v31'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.989 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.013+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93896883883600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612692f40 con 0x7fb714060070 2024-05-15T18:10:44.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.014+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93896883883600] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.014+0000 7fb72892b800 20 remove_watcher() i=0 2024-05-15T18:10:44.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.014+0000 7fb72892b800 2 removed watcher, disabling cache 2024-05-15T18:10:44.990 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.014+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93896883888416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612692f40 con 0x556612682a40 2024-05-15T18:10:44.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.015+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93896883888416] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.015+0000 7fb72892b800 20 remove_watcher() i=1 2024-05-15T18:10:44.991 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.015+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93896883890624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268e120 con 0x556612687430 2024-05-15T18:10:44.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.016+0000 7fb7245ab640 1 -- 172.21.15.173:0/1704818897 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93896883890624] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb714094040 con 0x556612687430 2024-05-15T18:10:44.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.016+0000 7fb72892b800 20 remove_watcher() i=2 2024-05-15T18:10:44.992 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.016+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93896883894688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612692f40 con 0x7fb714060070 2024-05-15T18:10:44.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.017+0000 7fb71bfff640 1 -- 172.21.15.173:0/1704818897 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93896883894688] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb70c070030 con 0x7fb714060070 2024-05-15T18:10:44.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.017+0000 7fb72892b800 20 remove_watcher() i=3 2024-05-15T18:10:44.994 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.017+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93896883896960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268e120 con 0x556612682a40 2024-05-15T18:10:44.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.019+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93896883896960] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x556612682a40 2024-05-15T18:10:44.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.019+0000 7fb72892b800 20 remove_watcher() i=4 2024-05-15T18:10:44.995 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.019+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93896883901936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612692f40 con 0x7fb70c083040 2024-05-15T18:10:44.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.020+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93896883901936] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.020+0000 7fb72892b800 20 remove_watcher() i=5 2024-05-15T18:10:44.996 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.020+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93896883905856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556612690280 con 0x7fb70c083040 2024-05-15T18:10:44.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.021+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93896883905856] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:44.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.021+0000 7fb72892b800 20 remove_watcher() i=6 2024-05-15T18:10:44.997 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.021+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93896883899680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55661268e120 con 0x7fb70c083040 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93896883899680] v31'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71c031040 con 0x7fb70c083040 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 20 remove_watcher() i=7 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb70c083040 msgr2=0x7fb70c075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fb70c083040 0x7fb70c075430 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556612682a40 msgr2=0x556612684f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x556612682a40 0x556612684f00 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb714060070 msgr2=0x7fb71403a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fb714060070 0x7fb71403a470 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556612687430 msgr2=0x556612689820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x556612687430 0x556612689820 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4036900 msgr2=0x7fb5f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4036900 0x7fb5f4038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb70c01ced0 tx=0x7fb70c04f000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 msgr2=0x556612677320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb724dac640 1 -- 172.21.15.173:0/1704818897 reap_dead start 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612677320 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb71401b5b0 tx=0x7fb71403ff70 comp rx=0 tx=0).stop 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 shutdown_connections 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 --2- 172.21.15.173:0/1704818897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612670170 0x556612677320 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 >> 172.21.15.173:0/1704818897 conn(0x55661266c3f0 msgr2=0x556612669a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 shutdown_connections 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.022+0000 7fb72892b800 1 -- 172.21.15.173:0/1704818897 wait complete. 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5fc036900 msgr2=0x7fb5fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5fc036900 0x7fb5fc038dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5566125488d0 tx=0x7fb70c005a00 comp rx=0 tx=0).stop 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612662e10 msgr2=0x556612663230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612662e10 0x556612663230 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb71404b350 tx=0x7fb71401aaf0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 shutdown_connections 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5fc036900 0x7fb5fc038dc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1644074333 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612662e10 0x556612663230 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 >> 172.21.15.173:0/1644074333 conn(0x556612656eb0 msgr2=0x5566126572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 shutdown_connections 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1644074333 wait complete. 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556612651de0 msgr2=0x556612654250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x556612651de0 0x556612654250 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55661254d6e0 msgr2=0x55661264b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55661254d6e0 0x55661264b420 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55661264dce0 msgr2=0x5566126501a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55661264dce0 0x5566126501a0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb60c036900 msgr2=0x7fb60c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb60c036900 0x7fb60c038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb70c054000 tx=0x7fb70c04e000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 msgr2=0x556612549510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 --2- 172.21.15.173:0/1714594659 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556612549bd0 0x556612549510 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb71400b210 tx=0x7fb714000ed0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb724dac640 1 -- 172.21.15.173:0/1714594659 reap_dead start 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 shutdown_connections 2024-05-15T18:10:45.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 >> 172.21.15.173:0/1714594659 conn(0x5566125435a0 msgr2=0x556612634570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 shutdown_connections 2024-05-15T18:10:45.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.023+0000 7fb72892b800 1 -- 172.21.15.173:0/1714594659 wait complete. 2024-05-15T18:10:45.008 ERROR:root:None 2024-05-15T18:10:45.008 ERROR:root:0 2024-05-15T18:10:45.008 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-15T18:10:45.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-15T18:10:45.009 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-05-15T18:10:45.054 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.055 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.079+0000 7fa954c12800 1 Processor -- start 2024-05-15T18:10:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.079+0000 7fa954c12800 1 -- start start 2024-05-15T18:10:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.079+0000 7fa954c12800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55c70d536fd0 0x55c70d5373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.079+0000 7fa954c12800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c70d537a70 con 0x55c70d538230 2024-05-15T18:10:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.079+0000 7fa954c12800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55c70d3c9050 con 0x55c70d536fd0 2024-05-15T18:10:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.080+0000 7fa95035c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55c70d536fd0 0x55c70d5373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.080+0000 7fa947fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x55c70d538230 0x55c70d5386b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38682/0 (socket says 172.21.15.173:38682) 2024-05-15T18:10:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.080+0000 7fa947fff640 1 -- 172.21.15.173:0/2169971025 learned_addr learned my addr 172.21.15.173:0/2169971025 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.080+0000 7fa95035c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x55c70d536fd0 0x55c70d5373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50748/0 (socket says 172.21.15.173:50748) 2024-05-15T18:10:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.080+0000 7fa95035c640 1 -- 172.21.15.173:0/2169971025 >> v1:172.21.15.3:6789/0 conn(0x55c70d538230 legacy=0x55c70d5386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.080+0000 7fa95035c640 1 -- 172.21.15.173:0/2169971025 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70d538df0 con 0x55c70d536fd0 2024-05-15T18:10:45.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.082+0000 7fa95035c640 1 --2- 172.21.15.173:0/2169971025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d5373f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa94000a600 tx=0x7fa94001ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9f1e655e8e7fdd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.082+0000 7fa94fb5b640 1 -- 172.21.15.173:0/2169971025 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94000a200 con 0x55c70d536fd0 2024-05-15T18:10:45.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.082+0000 7fa94fb5b640 1 -- 172.21.15.173:0/2169971025 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94000a3a0 con 0x55c70d536fd0 2024-05-15T18:10:45.058 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.082+0000 7fa94fb5b640 1 -- 172.21.15.173:0/2169971025 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9400086e0 con 0x55c70d536fd0 2024-05-15T18:10:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.082+0000 7fa954c12800 1 -- 172.21.15.173:0/2169971025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 msgr2=0x55c70d5373f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.082+0000 7fa954c12800 1 --2- 172.21.15.173:0/2169971025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d5373f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa94000a600 tx=0x7fa94001ed70 comp rx=0 tx=0).stop 2024-05-15T18:10:45.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.083+0000 7fa954c12800 1 -- 172.21.15.173:0/2169971025 shutdown_connections 2024-05-15T18:10:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.083+0000 7fa954c12800 1 --2- 172.21.15.173:0/2169971025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d5373f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.083+0000 7fa954c12800 1 -- 172.21.15.173:0/2169971025 >> 172.21.15.173:0/2169971025 conn(0x55c70d5325b0 msgr2=0x55c70d5349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.083+0000 7fa954c12800 1 -- 172.21.15.173:0/2169971025 shutdown_connections 2024-05-15T18:10:45.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.083+0000 7fa954c12800 1 -- 172.21.15.173:0/2169971025 wait complete. 2024-05-15T18:10:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.096+0000 7fa954c12800 1 Processor -- start 2024-05-15T18:10:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.096+0000 7fa954c12800 1 -- start start 2024-05-15T18:10:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.096+0000 7fa954c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d627660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.096+0000 7fa954c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c70d4831c0 con 0x55c70d536fd0 2024-05-15T18:10:45.073 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.096+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d627660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.096+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d627660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50762/0 (socket says 172.21.15.173:50762) 2024-05-15T18:10:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.096+0000 7fa95035c640 1 -- 172.21.15.173:0/4268769847 learned_addr learned my addr 172.21.15.173:0/4268769847 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.097+0000 7fa95035c640 1 -- 172.21.15.173:0/4268769847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70d627c30 con 0x55c70d536fd0 2024-05-15T18:10:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.097+0000 7fa95035c640 1 --2- 172.21.15.173:0/4268769847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d627660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c00 tx=0x7fa94004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383825dbfb9b428f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.097+0000 7fa83e60c640 1 -- 172.21.15.173:0/4268769847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940065070 con 0x55c70d536fd0 2024-05-15T18:10:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.097+0000 7fa83e60c640 1 -- 172.21.15.173:0/4268769847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9400086c0 con 0x55c70d536fd0 2024-05-15T18:10:45.074 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.097+0000 7fa83e60c640 1 -- 172.21.15.173:0/4268769847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9400089c0 con 0x55c70d536fd0 2024-05-15T18:10:45.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 -- 172.21.15.173:0/4268769847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 msgr2=0x55c70d627660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 --2- 172.21.15.173:0/4268769847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d627660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c00 tx=0x7fa94004e000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 -- 172.21.15.173:0/4268769847 shutdown_connections 2024-05-15T18:10:45.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 --2- 172.21.15.173:0/4268769847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d627660 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 -- 172.21.15.173:0/4268769847 >> 172.21.15.173:0/4268769847 conn(0x55c70d5325b0 msgr2=0x55c70d622f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 -- 172.21.15.173:0/4268769847 shutdown_connections 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 -- 172.21.15.173:0/4268769847 wait complete. 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 Processor -- start 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 -- start start 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d62f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.098+0000 7fa954c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c70d4aade0 con 0x55c70d536fd0 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d62f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d62f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50772/0 (socket says 172.21.15.173:50772) 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa95035c640 1 -- 172.21.15.173:0/3332065330 learned_addr learned my addr 172.21.15.173:0/3332065330 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa95035c640 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70d62f6d0 con 0x55c70d536fd0 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa95035c640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d62f190 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c00 tx=0x7fa940002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa83ce09640 1 -- 172.21.15.173:0/3332065330 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94006d020 con 0x55c70d536fd0 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa83ce09640 1 -- 172.21.15.173:0/3332065330 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa940060680 con 0x55c70d536fd0 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c70d62f960 con 0x55c70d536fd0 2024-05-15T18:10:45.078 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa83ce09640 1 -- 172.21.15.173:0/3332065330 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940065040 con 0x55c70d536fd0 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.099+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c70d632610 con 0x55c70d536fd0 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.100+0000 7fa83ce09640 1 -- 172.21.15.173:0/3332065330 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa940070020 con 0x55c70d536fd0 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.100+0000 7fa83ce09640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa838036950 0x7fa838038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa83ce09640 1 -- 172.21.15.173:0/3332065330 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fa94008fb90 con 0x55c70d536fd0 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa947fff640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa838036950 0x7fa838038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d538230 0x55c70d6363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6369b0 con 0x55c70d538230 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa950b5d640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d538230 0x55c70d6363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa947fff640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa838036950 0x7fa838038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa938000f60 tx=0x7fa9380012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.079 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa950b5d640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d538230 0x55c70d6363d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa950b5d640 1 -- 172.21.15.173:0/3332065330 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d538230 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.101+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6339a0 con 0x55c70d538230 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.102+0000 7fa950b5d640 1 -- 172.21.15.173:0/3332065330 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d538230 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.102+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d638ce0 0x55c70d63b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.102+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d63b770 con 0x55c70d638ce0 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.102+0000 7fa95035c640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d638ce0 0x55c70d63b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.102+0000 7fa95035c640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d638ce0 0x55c70d63b0d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.102+0000 7fa95035c640 1 -- 172.21.15.173:0/3332065330 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d638ce0 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.102+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d637bd0 con 0x55c70d538230 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.103+0000 7fa950b5d640 1 -- 172.21.15.173:0/3332065330 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d538230 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.103+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c70d63cbd0 0x55c70d63efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.086 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.103+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d63f720 con 0x55c70d63cbd0 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.103+0000 7fa947fff640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c70d63cbd0 0x55c70d63efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.103+0000 7fa947fff640 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c70d63cbd0 0x55c70d63efc0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa947fff640 1 -- 172.21.15.173:0/3332065330 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa938009050 con 0x55c70d63cbd0 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa954c12800 1 Processor -- start 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa954c12800 1 -- start start 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa954c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d64db80 0x55c70d64dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa954c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c70d429cf0 con 0x55c70d64db80 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d64db80 0x55c70d64dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d64db80 0x55c70d64dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50788/0 (socket says 172.21.15.173:50788) 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa95035c640 1 -- 172.21.15.173:0/3035029213 learned_addr learned my addr 172.21.15.173:0/3035029213 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.104+0000 7fa95035c640 1 -- 172.21.15.173:0/3035029213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70d64e4e0 con 0x55c70d64db80 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.105+0000 7fa95035c640 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d64db80 0x55c70d64dfa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa940053fd0 tx=0x7fa940053a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.105+0000 7fa835ffb640 1 -- 172.21.15.173:0/3035029213 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9400547f0 con 0x55c70d64db80 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.105+0000 7fa835ffb640 1 -- 172.21.15.173:0/3035029213 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94008f040 con 0x55c70d64db80 2024-05-15T18:10:45.087 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.105+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c70d64ef50 con 0x55c70d64db80 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.105+0000 7fa835ffb640 1 -- 172.21.15.173:0/3035029213 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940060ab0 con 0x55c70d64db80 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.105+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c70d64ef50 con 0x55c70d64db80 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa835ffb640 1 -- 172.21.15.173:0/3035029213 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa940068070 con 0x55c70d64db80 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa835ffb640 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa828036950 0x7fa828038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa835ffb640 1 -- 172.21.15.173:0/3035029213 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fa94009abe0 con 0x55c70d64db80 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa947fff640 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa828036950 0x7fa828038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa954c12800 1 Processor -- start 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa954c12800 1 -- start start 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa947fff640 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa828036950 0x7fa828038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa93800bf50 tx=0x7fa93800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa954c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d65af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.106+0000 7fa954c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c70d627f50 con 0x55c70d65aaf0 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d65af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d65af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50802/0 (socket says 172.21.15.173:50802) 2024-05-15T18:10:45.088 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa95035c640 1 -- 172.21.15.173:0/2251732362 learned_addr learned my addr 172.21.15.173:0/2251732362 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa95035c640 1 -- 172.21.15.173:0/2251732362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70d65b4e0 con 0x55c70d65aaf0 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa95035c640 1 --2- 172.21.15.173:0/2251732362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d65af10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa940053bc0 tx=0x7fa9400759d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c3e2c73fadb32c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa82f7fe640 1 -- 172.21.15.173:0/2251732362 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9400a6020 con 0x55c70d65aaf0 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa82f7fe640 1 -- 172.21.15.173:0/2251732362 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94006adf0 con 0x55c70d65aaf0 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.107+0000 7fa82f7fe640 1 -- 172.21.15.173:0/2251732362 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940075250 con 0x55c70d65aaf0 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 -- 172.21.15.173:0/2251732362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 msgr2=0x55c70d65af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 --2- 172.21.15.173:0/2251732362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d65af10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa940053bc0 tx=0x7fa9400759d0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 -- 172.21.15.173:0/2251732362 shutdown_connections 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 --2- 172.21.15.173:0/2251732362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d65af10 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 -- 172.21.15.173:0/2251732362 >> 172.21.15.173:0/2251732362 conn(0x55c70d656e50 msgr2=0x55c70d654eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 -- 172.21.15.173:0/2251732362 shutdown_connections 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 -- 172.21.15.173:0/2251732362 wait complete. 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 Processor -- start 2024-05-15T18:10:45.089 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 -- start start 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d666300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa954c12800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c70d65bb90 con 0x55c70d65aaf0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d666300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa95035c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d666300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50814/0 (socket says 172.21.15.173:50814) 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.108+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 learned_addr learned my addr 172.21.15.173:0/1185224926 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.109+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70d666840 con 0x55c70d65aaf0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.109+0000 7fa95035c640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d666300 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa94007e7e0 tx=0x7fa94007ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.109+0000 7fa82dffb640 1 -- 172.21.15.173:0/1185224926 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa940008040 con 0x55c70d65aaf0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.109+0000 7fa82dffb640 1 -- 172.21.15.173:0/1185224926 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9400081e0 con 0x55c70d65aaf0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.109+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c70d666840 con 0x55c70d65aaf0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.109+0000 7fa82dffb640 1 -- 172.21.15.173:0/1185224926 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa94005d3c0 con 0x55c70d65aaf0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.109+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c70d666840 con 0x55c70d65aaf0 2024-05-15T18:10:45.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.110+0000 7fa82dffb640 1 -- 172.21.15.173:0/1185224926 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa9400a9020 con 0x55c70d65aaf0 2024-05-15T18:10:45.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.110+0000 7fa82dffb640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa820036950 0x7fa820038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.110+0000 7fa82dffb640 1 -- 172.21.15.173:0/1185224926 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fa94009f040 con 0x55c70d65aaf0 2024-05-15T18:10:45.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.110+0000 7fa947fff640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa820036950 0x7fa820038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.110+0000 7fa947fff640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa820036950 0x7fa820038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa938001b60 tx=0x7fa938010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.103 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d671900 0x55c70d673dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d674510 con 0x55c70d671900 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa950b5d640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d671900 0x55c70d673dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa950b5d640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d671900 0x55c70d673dc0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa954c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa954c12800 20 realm 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.111+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d674920 con 0x55c70d671900 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6751f0 con 0x55c70d671900 2024-05-15T18:10:45.104 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d6762f0 0x55c70d6786e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d678cf0 con 0x55c70d6762f0 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa95035c640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d6762f0 0x55c70d6786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.112+0000 7fa95035c640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d6762f0 0x55c70d6786e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa954c12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa954c12800 20 searching for the correct realm 2024-05-15T18:10:45.105 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67a620 con 0x55c70d6762f0 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa95035c640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa9400ab050 0x7fa940078900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67a620 con 0x7fa9400ab050 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.113+0000 7fa947fff640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa9400ab050 0x7fa940078900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.114+0000 7fa947fff640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa9400ab050 0x7fa940078900 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.114+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa938009050 con 0x7fa9400ab050 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.114+0000 7fa947fff640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa938038040 0x7fa93801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.114+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67a620 con 0x7fa938038040 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.114+0000 7fa950b5d640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa938038040 0x7fa93801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.114+0000 7fa950b5d640 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa938038040 0x7fa93801bab0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa94800a4a0 con 0x7fa938038040 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.106 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa938038040 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x7fa938038040 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.115+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa938038040 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x7fa938038040 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa9400ab050 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa938009050 con 0x7fa9400ab050 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.116+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa938038040 2024-05-15T18:10:45.107 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x7fa938038040 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa9400ab050 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa938009050 con 0x7fa9400ab050 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.117+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa938038040 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.118+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x7fa938038040 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.118+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.118+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.118+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.118+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.118+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa94800a4a0 con 0x55c70d671900 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa938038040 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa948033040 con 0x7fa938038040 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.119+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa9400ab050 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa938009050 con 0x7fa9400ab050 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa938038040 2024-05-15T18:10:45.109 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.120+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa938038040 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa9400ab050 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa938009050 con 0x7fa9400ab050 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d6762f0 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa9400ab050 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.121+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x55c70d671900 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.110 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c70d675590 con 0x7fa9400ab050 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6795b0 con 0x55c70d671900 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6799a0 con 0x55c70d671900 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.122+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6799a0 con 0x7fa938038040 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 20 zone default found 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 4 Realm: () 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 20 zonegroup default 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d679150 con 0x7fa938038040 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.123+0000 7fa954c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67c480 con 0x55c70d6762f0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67c820 con 0x55c70d6762f0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 20 started sync module instance, tier type = 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.124+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67b920 con 0x7fa9400ab050 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.125+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.125+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94313411753072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67cbc0 con 0x7fa9400ab050 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.125+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67d470 con 0x55c70d671900 2024-05-15T18:10:45.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.126+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94313411753072] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.126+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.126+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94313411759968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67d860 con 0x55c70d671900 2024-05-15T18:10:45.114 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.126+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67e2a0 con 0x55c70d6762f0 2024-05-15T18:10:45.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.127+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.127+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94313411763568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67eb40 con 0x55c70d6762f0 2024-05-15T18:10:45.119 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.127+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67f620 con 0x7fa9400ab050 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.128+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94313411759968] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.128+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94313411763568] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.129+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.129+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94313411755280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67fa40 con 0x7fa9400ab050 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.129+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6802d0 con 0x55c70d671900 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.130+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.130+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94313411771872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d680b70 con 0x55c70d671900 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.130+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d681630 con 0x7fa938038040 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.130+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94313411755280] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.131+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.131+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94313411776864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d681630 con 0x7fa938038040 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.131+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6820b0 con 0x7fa938038040 2024-05-15T18:10:45.120 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.131+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94313411771872] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.132+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94313411776864] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.132+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.132+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94313411768624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d681bc0 con 0x7fa938038040 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.132+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d682580 con 0x7fa938038040 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94313411768624] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94313411774144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d682580 con 0x7fa938038040 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 20 add_watcher() i=0 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 20 add_watcher() i=1 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 20 add_watcher() i=2 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 20 add_watcher() i=3 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 20 add_watcher() i=4 2024-05-15T18:10:45.121 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 20 add_watcher() i=5 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.133+0000 7fa954c12800 20 add_watcher() i=6 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.134+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94313411774144] v31'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.134+0000 7fa954c12800 20 add_watcher() i=7 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.134+0000 7fa954c12800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.134+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6858c0 con 0x55c70d671900 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.134+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.134+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94313411781184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d682b10 con 0x55c70d671900 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.135+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94313411781184] v31'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa948031040 con 0x55c70d671900 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.135+0000 7fa8067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.135+0000 7fa954c12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.135+0000 7fa954c12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.135+0000 7fa954c12800 5 note: GC not initialized 2024-05-15T18:10:45.122 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa8057e2640 20 reqs_thread_entry: start 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa954c12800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa954c12800 20 Filter name: none 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa776ffd640 20 reqs_thread_entry: start 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa954c12800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa954c12800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6b8e70 con 0x7fa938038040 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.136+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fa948031040 con 0x7fa938038040 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.137+0000 7fa954c12800 20 rados_obj.operate() r=0 bl.length=460 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.137+0000 7fa954c12800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.137+0000 7fa954c12800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.137+0000 7fa954c12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.137+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6bf1d0 con 0x7fa938038040 2024-05-15T18:10:45.123 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa948042040 con 0x7fa938038040 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa954c12800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa954c12800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa954c12800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94313412029504 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6ba9e0 con 0x55c70d671900 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 94313411771872 notify 133143986200 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fa94801e040 con 0x55c70d671900 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa82f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986200 cookie 94313411771872 notifier 4867 bl.length()=666 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 94313412029504 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa948042040 con 0x55c70d671900 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa82f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa82f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa82f7fe640 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa814003ea0 con 0x55c70d671900 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948042040 con 0x55c70d671900 2024-05-15T18:10:45.124 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.138+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 94313412029504 notify 133143986200 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa948018dd0 con 0x55c70d671900 2024-05-15T18:10:45.125 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.139+0000 7fa8067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.139+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94313411781184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d684aa0 con 0x55c70d671900 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.140+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94313411781184] v31'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa948042040 con 0x55c70d671900 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.140+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94313411753072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d682240 con 0x7fa9400ab050 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.141+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94313411753072] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.141+0000 7fa954c12800 20 remove_watcher() i=0 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.141+0000 7fa954c12800 2 removed watcher, disabling cache 2024-05-15T18:10:45.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.141+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94313411759968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6b8250 con 0x55c70d671900 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.142+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94313411759968] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948042040 con 0x55c70d671900 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.143+0000 7fa954c12800 20 remove_watcher() i=1 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.143+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94313411763568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6b8250 con 0x55c70d6762f0 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.144+0000 7fa95035c640 1 -- 172.21.15.173:0/1185224926 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94313411763568] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa94005dcc0 con 0x55c70d6762f0 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.144+0000 7fa954c12800 20 remove_watcher() i=2 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.144+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94313411755280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6b8250 con 0x7fa9400ab050 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.145+0000 7fa947fff640 1 -- 172.21.15.173:0/1185224926 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94313411755280] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa938045040 con 0x7fa9400ab050 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.145+0000 7fa954c12800 20 remove_watcher() i=3 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.145+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94313411771872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6b8250 con 0x55c70d671900 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.146+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94313411771872] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948042040 con 0x55c70d671900 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.146+0000 7fa954c12800 20 remove_watcher() i=4 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.146+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94313411776864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d6b8250 con 0x7fa938038040 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.147+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94313411776864] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948042040 con 0x7fa938038040 2024-05-15T18:10:45.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.147+0000 7fa954c12800 20 remove_watcher() i=5 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.147+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94313411768624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67cf60 con 0x7fa938038040 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.147+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94313411768624] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948042040 con 0x7fa938038040 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.147+0000 7fa954c12800 20 remove_watcher() i=6 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.147+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94313411774144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c70d67f130 con 0x7fa938038040 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94313411774144] v31'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa948042040 con 0x7fa938038040 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 20 remove_watcher() i=7 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa938038040 msgr2=0x7fa93801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa938038040 0x7fa93801bab0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d671900 msgr2=0x55c70d673dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d671900 0x55c70d673dc0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa9400ab050 msgr2=0x7fa940078900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa9400ab050 0x7fa940078900 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d6762f0 msgr2=0x55c70d6786e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d6762f0 0x55c70d6786e0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa820036950 msgr2=0x7fa820038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa820036950 0x7fa820038e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa938001b60 tx=0x7fa938010000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 msgr2=0x55c70d666300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa950b5d640 1 -- 172.21.15.173:0/1185224926 reap_dead start 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d666300 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa94007e7e0 tx=0x7fa94007ef10 comp rx=0 tx=0).stop 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 shutdown_connections 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/1185224926 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d65aaf0 0x55c70d666300 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 >> 172.21.15.173:0/1185224926 conn(0x55c70d656e50 msgr2=0x55c70d6544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 shutdown_connections 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/1185224926 wait complete. 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa828036950 msgr2=0x7fa828038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa828036950 0x7fa828038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa93800bf50 tx=0x7fa93800f000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d64db80 msgr2=0x55c70d64dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d64db80 0x55c70d64dfa0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa940053fd0 tx=0x7fa940053a10 comp rx=0 tx=0).stop 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 shutdown_connections 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa828036950 0x7fa828038e10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 --2- 172.21.15.173:0/3035029213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d64db80 0x55c70d64dfa0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 >> 172.21.15.173:0/3035029213 conn(0x55c70d641c20 msgr2=0x55c70d642020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 shutdown_connections 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.149+0000 7fa954c12800 1 -- 172.21.15.173:0/3035029213 wait complete. 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c70d63cbd0 msgr2=0x55c70d63efc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x55c70d63cbd0 0x55c70d63efc0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d538230 msgr2=0x55c70d6363d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x55c70d538230 0x55c70d6363d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d638ce0 msgr2=0x55c70d63b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55c70d638ce0 0x55c70d63b0d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa838036950 msgr2=0x7fa838038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa838036950 0x7fa838038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa938000f60 tx=0x7fa9380012b0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 msgr2=0x55c70d62f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 --2- 172.21.15.173:0/3332065330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c70d536fd0 0x55c70d62f190 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa940000c00 tx=0x7fa940002fb0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa950b5d640 1 -- 172.21.15.173:0/3332065330 reap_dead start 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 shutdown_connections 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 >> 172.21.15.173:0/3332065330 conn(0x55c70d5325b0 msgr2=0x55c70d621780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 shutdown_connections 2024-05-15T18:10:45.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.150+0000 7fa954c12800 1 -- 172.21.15.173:0/3332065330 wait complete. 2024-05-15T18:10:45.136 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.136 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.136 ERROR:root:0 2024-05-15T18:10:45.136 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:45.141 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:45.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-15T18:10:45.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-15T18:10:45.141 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-05-15T18:10:45.190 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.191 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfc0812800 1 Processor -- start 2024-05-15T18:10:45.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfc0812800 1 -- start start 2024-05-15T18:10:45.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfc0812800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561b2b988550 0x561b2b991050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfc0812800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561b2b8fb910 con 0x561b2b986a10 2024-05-15T18:10:45.192 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfc0812800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x561b2b819050 con 0x561b2b988550 2024-05-15T18:10:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfb3fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561b2b988550 0x561b2b991050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfb3fff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x561b2b988550 0x561b2b991050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50824/0 (socket says 172.21.15.173:50824) 2024-05-15T18:10:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfb3fff640 1 -- 172.21.15.173:0/2159719447 learned_addr learned my addr 172.21.15.173:0/2159719447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.215+0000 7fdfbbdee640 1 --1- 172.21.15.173:0/2159719447 >> v1:172.21.15.3:6789/0 conn(0x561b2b986a10 0x561b2b986e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38688/0 (socket says 172.21.15.173:38688) 2024-05-15T18:10:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.216+0000 7fdfb3fff640 1 -- 172.21.15.173:0/2159719447 >> v1:172.21.15.3:6789/0 conn(0x561b2b986a10 legacy=0x561b2b986e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.216+0000 7fdfbb5ed640 1 -- 172.21.15.173:0/2159719447 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934124683 0 0) 0x561b2b8fb910 con 0x561b2b986a10 2024-05-15T18:10:45.193 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.216+0000 7fdfb3fff640 1 -- 172.21.15.173:0/2159719447 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2b8fbae0 con 0x561b2b988550 2024-05-15T18:10:45.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/2159719447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b988550 0x561b2b991050 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400a520 tx=0x7fdfa401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b8900ac712aad server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfbb5ed640 1 -- 172.21.15.173:0/2159719447 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa4057070 con 0x561b2b988550 2024-05-15T18:10:45.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfbb5ed640 1 -- 172.21.15.173:0/2159719447 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa4052570 con 0x561b2b988550 2024-05-15T18:10:45.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfbb5ed640 1 -- 172.21.15.173:0/2159719447 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa404ae60 con 0x561b2b988550 2024-05-15T18:10:45.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfc0812800 1 -- 172.21.15.173:0/2159719447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b988550 msgr2=0x561b2b991050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2159719447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b988550 0x561b2b991050 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400a520 tx=0x7fdfa401d010 comp rx=0 tx=0).stop 2024-05-15T18:10:45.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfc0812800 1 -- 172.21.15.173:0/2159719447 shutdown_connections 2024-05-15T18:10:45.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2159719447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b988550 0x561b2b991050 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfc0812800 1 -- 172.21.15.173:0/2159719447 >> 172.21.15.173:0/2159719447 conn(0x561b2b9825b0 msgr2=0x561b2b9849d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfc0812800 1 -- 172.21.15.173:0/2159719447 shutdown_connections 2024-05-15T18:10:45.195 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.218+0000 7fdfc0812800 1 -- 172.21.15.173:0/2159719447 wait complete. 2024-05-15T18:10:45.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfc0812800 1 Processor -- start 2024-05-15T18:10:45.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfc0812800 1 -- start start 2024-05-15T18:10:45.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfc0812800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba7b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfc0812800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561b2b8d31c0 con 0x561b2b986a10 2024-05-15T18:10:45.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba7b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba7b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50836/0 (socket says 172.21.15.173:50836) 2024-05-15T18:10:45.209 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfbbdee640 1 -- 172.21.15.173:0/193495466 learned_addr learned my addr 172.21.15.173:0/193495466 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.232+0000 7fdfbbdee640 1 -- 172.21.15.173:0/193495466 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2ba7bd30 con 0x561b2b986a10 2024-05-15T18:10:45.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/193495466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba7b760 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b210 tx=0x7fdfac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f0eab673c30cb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdea9e0b640 1 -- 172.21.15.173:0/193495466 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac008070 con 0x561b2b986a10 2024-05-15T18:10:45.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdea9e0b640 1 -- 172.21.15.173:0/193495466 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac00d500 con 0x561b2b986a10 2024-05-15T18:10:45.210 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdea9e0b640 1 -- 172.21.15.173:0/193495466 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac00d840 con 0x561b2b986a10 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdfc0812800 1 -- 172.21.15.173:0/193495466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 msgr2=0x561b2ba7b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdfc0812800 1 --2- 172.21.15.173:0/193495466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba7b760 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b210 tx=0x7fdfac00b6d0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdfc0812800 1 -- 172.21.15.173:0/193495466 shutdown_connections 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdfc0812800 1 --2- 172.21.15.173:0/193495466 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba7b760 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdfc0812800 1 -- 172.21.15.173:0/193495466 >> 172.21.15.173:0/193495466 conn(0x561b2b9825b0 msgr2=0x561b2ba77080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.233+0000 7fdfc0812800 1 -- 172.21.15.173:0/193495466 shutdown_connections 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfc0812800 1 -- 172.21.15.173:0/193495466 wait complete. 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfc0812800 1 Processor -- start 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfc0812800 1 -- start start 2024-05-15T18:10:45.214 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfc0812800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba832e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfc0812800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561b2b991860 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba832e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba832e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50846/0 (socket says 172.21.15.173:50846) 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.234+0000 7fdfbbdee640 1 -- 172.21.15.173:0/2950975134 learned_addr learned my addr 172.21.15.173:0/2950975134 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.235+0000 7fdfbbdee640 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2ba83820 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.235+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba832e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b210 tx=0x7fdfac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.235+0000 7fdea3fff640 1 -- 172.21.15.173:0/2950975134 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac00f950 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.235+0000 7fdea3fff640 1 -- 172.21.15.173:0/2950975134 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac00faf0 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.235+0000 7fdea3fff640 1 -- 172.21.15.173:0/2950975134 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac00fdd0 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.235+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b2ba83ab0 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.235+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2ba86760 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdea3fff640 1 -- 172.21.15.173:0/2950975134 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdfac017040 con 0x561b2b986a10 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdea3fff640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdea40368b0 0x7fdea4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.215 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdea3fff640 1 -- 172.21.15.173:0/2950975134 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fdfac015020 con 0x561b2b986a10 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdea40368b0 0x7fdea4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2b988550 0x561b2ba8a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2ba8aab0 con 0x561b2b988550 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdfbc5ef640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2b988550 0x561b2ba8a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdea40368b0 0x7fdea4038d70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4054000 tx=0x7fdfa404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.236+0000 7fdfbc5ef640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2b988550 0x561b2ba8a520 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.237+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/2950975134 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2b988550 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.237+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2ba87af0 con 0x561b2b988550 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.237+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/2950975134 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2b988550 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.237+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2ba8cde0 0x561b2ba8f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.237+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2ba8f870 con 0x561b2ba8cde0 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.237+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2ba8cde0 0x561b2ba8f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.216 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.237+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2ba8cde0 0x561b2ba8f1d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.238+0000 7fdfbbdee640 1 -- 172.21.15.173:0/2950975134 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2ba8cde0 2024-05-15T18:10:45.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.238+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2ba8bd90 con 0x561b2b988550 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.238+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/2950975134 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2b988550 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.238+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561b2ba90d20 0x561b2ba93170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.238+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2ba938d0 con 0x561b2ba90d20 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.238+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561b2ba90d20 0x561b2ba93170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.239+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561b2ba90d20 0x561b2ba93170 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.239+0000 7fdfb3fff640 1 -- 172.21.15.173:0/2950975134 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdfa405a040 con 0x561b2ba90d20 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.239+0000 7fdfc0812800 1 Processor -- start 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.239+0000 7fdfc0812800 1 -- start start 2024-05-15T18:10:45.229 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.239+0000 7fdfc0812800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baa1d30 0x561b2baa2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.239+0000 7fdfc0812800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561b2b879cf0 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baa1d30 0x561b2baa2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baa1d30 0x561b2baa2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50848/0 (socket says 172.21.15.173:50848) 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdfbbdee640 1 -- 172.21.15.173:0/3444440966 learned_addr learned my addr 172.21.15.173:0/3444440966 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdfbbdee640 1 -- 172.21.15.173:0/3444440966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2baa2690 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baa1d30 0x561b2baa2150 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b710 tx=0x7fdfac041d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdea17fa640 1 -- 172.21.15.173:0/3444440966 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac0195a0 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdea17fa640 1 -- 172.21.15.173:0/3444440966 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac019740 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b2baa3100 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdea17fa640 1 -- 172.21.15.173:0/3444440966 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac044af0 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.240+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2baa3600 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.241+0000 7fdea17fa640 1 -- 172.21.15.173:0/3444440966 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdfac044c90 con 0x561b2baa1d30 2024-05-15T18:10:45.230 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.241+0000 7fdea17fa640 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde94036900 0x7fde94038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.241+0000 7fdea17fa640 1 -- 172.21.15.173:0/3444440966 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fdfac03bbd0 con 0x561b2baa1d30 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.241+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde94036900 0x7fde94038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.241+0000 7fdfc0812800 1 Processor -- start 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.241+0000 7fdfc0812800 1 -- start start 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde94036900 0x7fde94038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x561b2ba87a10 tx=0x7fdfa4005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfc0812800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2baaf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfc0812800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561b2ba7c0b0 con 0x561b2baaf040 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2baaf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2baaf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50860/0 (socket says 172.21.15.173:50860) 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfbbdee640 1 -- 172.21.15.173:0/3879464297 learned_addr learned my addr 172.21.15.173:0/3879464297 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfbbdee640 1 -- 172.21.15.173:0/3879464297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2baafa30 con 0x561b2baaf040 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/3879464297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2baaf460 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ef90 tx=0x7fdfac030f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dadfb591bf4581 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fde9affd640 1 -- 172.21.15.173:0/3879464297 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac03f050 con 0x561b2baaf040 2024-05-15T18:10:45.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fde9affd640 1 -- 172.21.15.173:0/3879464297 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac03f740 con 0x561b2baaf040 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.242+0000 7fde9affd640 1 -- 172.21.15.173:0/3879464297 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac01ca00 con 0x561b2baaf040 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 -- 172.21.15.173:0/3879464297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 msgr2=0x561b2baaf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 --2- 172.21.15.173:0/3879464297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2baaf460 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ef90 tx=0x7fdfac030f30 comp rx=0 tx=0).stop 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 -- 172.21.15.173:0/3879464297 shutdown_connections 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 --2- 172.21.15.173:0/3879464297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2baaf460 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 -- 172.21.15.173:0/3879464297 >> 172.21.15.173:0/3879464297 conn(0x561b2baab310 msgr2=0x561b2baa9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 -- 172.21.15.173:0/3879464297 shutdown_connections 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 -- 172.21.15.173:0/3879464297 wait complete. 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 Processor -- start 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 -- start start 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2bab6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.243+0000 7fdfc0812800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561b2baaff10 con 0x561b2baaf040 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2bab6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.232 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fdfbbdee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2bab6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50868/0 (socket says 172.21.15.173:50868) 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 learned_addr learned my addr 172.21.15.173:0/1647451814 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b2bab6740 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2bab6200 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdfac01aa80 tx=0x7fdfac04bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fde997fa640 1 -- 172.21.15.173:0/1647451814 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac01cdf0 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fde997fa640 1 -- 172.21.15.173:0/1647451814 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac069070 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b2bab6740 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fde997fa640 1 -- 172.21.15.173:0/1647451814 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac01d170 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.244+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b2bab6740 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.245+0000 7fde997fa640 1 -- 172.21.15.173:0/1647451814 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdfac01d310 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.245+0000 7fde997fa640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde84036af0 0x7fde84038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.245+0000 7fde997fa640 1 -- 172.21.15.173:0/1647451814 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fdfac06fc10 con 0x561b2baaf040 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.245+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde84036af0 0x7fde84038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde84036af0 0x7fde84038fb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x561b2ba93cd0 tx=0x7fdfa404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2bac1740 0x561b2bac3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac4350 con 0x561b2bac1740 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfbc5ef640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2bac1740 0x561b2bac3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfbc5ef640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2bac1740 0x561b2bac3c00 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfc0812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfc0812800 20 realm 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.246+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac4760 con 0x561b2bac1740 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac5030 con 0x561b2bac1740 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x561b2bac1740 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2bac6130 0x561b2bac8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac8b30 con 0x561b2bac6130 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2bac6130 0x561b2bac8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.247+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2bac6130 0x561b2bac8520 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfc0812800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:45.235 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfc0812800 20 searching for the correct realm 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2baca460 con 0x561b2bac6130 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfbbdee640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fdfac01dbd0 0x7fdfac00c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2baca460 con 0x7fdfac01dbd0 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fdfac01dbd0 0x7fdfac00c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.248+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fdfac01dbd0 0x7fdfac00c7f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.249+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.249+0000 7fdfb3fff640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fdfa4074040 0x7fdfa4081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.249+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2baca460 con 0x7fdfa4074040 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.249+0000 7fdfbc5ef640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fdfa4074040 0x7fdfa4081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.249+0000 7fdfbc5ef640 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fdfa4074040 0x7fdfa4081410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdfb400a4a0 con 0x7fdfa4074040 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x561b2bac1740 2024-05-15T18:10:45.236 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x561b2bac1740 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x7fdfa4074040 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x7fdfa4074040 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.250+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x7fdfa4074040 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x7fdfa4074040 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x7fdfac01dbd0 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x561b2bac6130 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x561b2bac1740 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.251+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x7fdfa4074040 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x7fdfa4074040 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x561b2bac1740 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac53d0 con 0x7fdfac01dbd0 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac6130 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.252+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac6130 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.253+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.238 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.253+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfa4074040 2024-05-15T18:10:45.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.253+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x7fdfa4074040 2024-05-15T18:10:45.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.253+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac6130 2024-05-15T18:10:45.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.253+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.253+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac6130 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac1740 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac1740 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdfb400a4a0 con 0x561b2bac1740 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfa4074040 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb4033040 con 0x7fdfa4074040 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac6130 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.254+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfac01dbd0 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac1740 2024-05-15T18:10:45.251 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfa4074040 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac6130 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.255+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfa4074040 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfac01dbd0 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac6130 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfac01dbd0 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.256+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x561b2bac1740 2024-05-15T18:10:45.252 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7fdfa408e060 con 0x7fdfac01dbd0 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac93f0 con 0x561b2bac1740 2024-05-15T18:10:45.253 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac97e0 con 0x561b2bac1740 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.257+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac97e0 con 0x7fdfa4074040 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 20 zone default found 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 4 Realm: () 2024-05-15T18:10:45.254 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 20 zonegroup default 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac9050 con 0x7fdfa4074040 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.258+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bac9050 con 0x561b2bac6130 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfc0812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacc380 con 0x561b2bac6130 2024-05-15T18:10:45.255 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfc0812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfc0812800 20 started sync module instance, tier type = 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfc0812800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.259+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacb760 con 0x7fdfac01dbd0 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.260+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.260+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94674696846208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacb3c0 con 0x7fdfac01dbd0 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.260+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacd2b0 con 0x561b2bac1740 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.261+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94674696846208] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.261+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.261+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94674696850944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacd6d0 con 0x561b2bac1740 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.261+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bace0d0 con 0x561b2bac6130 2024-05-15T18:10:45.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.262+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94674696850944] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.263+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.263+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94674696852000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacd640 con 0x561b2bac6130 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.263+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacef90 con 0x7fdfac01dbd0 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.264+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94674696852000] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.264+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.264+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94674696856768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacf830 con 0x7fdfac01dbd0 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.264+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad00e0 con 0x561b2bac1740 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.265+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.265+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94674696862672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad09b0 con 0x561b2bac1740 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.265+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94674696856768] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.265+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad1480 con 0x7fdfa4074040 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.266+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.266+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94674696867696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad1440 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.266+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad1e90 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.266+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94674696862672] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.267+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.267+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94674696865024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad1e90 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.267+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad2850 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.267+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94674696867696] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94674696865024] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94674696870368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad1e00 con 0x7fdfa4074040 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 20 add_watcher() i=0 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 20 add_watcher() i=1 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 20 add_watcher() i=2 2024-05-15T18:10:45.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 20 add_watcher() i=3 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 20 add_watcher() i=4 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 20 add_watcher() i=5 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.268+0000 7fdfc0812800 20 add_watcher() i=6 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.269+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94674696870368] v31'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.269+0000 7fdfc0812800 20 add_watcher() i=7 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.269+0000 7fdfc0812800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.269+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad5880 con 0x561b2bac1740 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.269+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.269+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94674696872864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bad2c70 con 0x561b2bac1740 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.270+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94674696872864] v31'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.270+0000 7fde71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.270+0000 7fdfc0812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.270+0000 7fdfc0812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:45.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fdfc0812800 5 note: GC not initialized 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fde70fe1640 20 reqs_thread_entry: start 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fdfc0812800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fdfc0812800 20 Filter name: none 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fddea7fc640 20 reqs_thread_entry: start 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fdfc0812800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fdfc0812800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.271+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bb08c10 con 0x7fdfa4074040 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.272+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.272+0000 7fdfc0812800 20 rados_obj.operate() r=0 bl.length=490 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.272+0000 7fdfc0812800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.272+0000 7fdfc0812800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.272+0000 7fdfc0812800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.272+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bb0f080 con 0x7fdfa4074040 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fdfc0812800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fdfc0812800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fdfc0812800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94674697120496 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561b2bb0dbd0 con 0x561b2bac1740 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 94674696862672 notify 133143986201 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fdfb401e040 con 0x561b2bac1740 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fde9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986201 cookie 94674696862672 notifier 4874 bl.length()=666 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 94674697120496 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fde9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fde9affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.273+0000 7fde9affd640 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fde80003ea0 con 0x561b2bac1740 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.274+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.274+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 94674697120496 notify 133143986201 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdfb4018db0 con 0x561b2bac1740 2024-05-15T18:10:45.262 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:45.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.275+0000 7fde71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.275+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94674696872864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bb09200 con 0x561b2bac1740 2024-05-15T18:10:45.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.276+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94674696872864] v31'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.276+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94674696846208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bb09200 con 0x7fdfac01dbd0 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.277+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94674696846208] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.277+0000 7fdfc0812800 20 remove_watcher() i=0 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.277+0000 7fdfc0812800 2 removed watcher, disabling cache 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.277+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94674696850944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacbb80 con 0x561b2bac1740 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.278+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94674696850944] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.278+0000 7fdfc0812800 20 remove_watcher() i=1 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.278+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94674696852000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacce00 con 0x561b2bac6130 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.279+0000 7fdfbbdee640 1 -- 172.21.15.173:0/1647451814 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94674696852000] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfac02d070 con 0x561b2bac6130 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.279+0000 7fdfc0812800 20 remove_watcher() i=2 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.279+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94674696856768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bacbb80 con 0x7fdfac01dbd0 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.280+0000 7fdfb3fff640 1 -- 172.21.15.173:0/1647451814 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94674696856768] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfa407f070 con 0x7fdfac01dbd0 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.280+0000 7fdfc0812800 20 remove_watcher() i=3 2024-05-15T18:10:45.268 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.280+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94674696862672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bace4c0 con 0x561b2bac1740 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.281+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94674696862672] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x561b2bac1740 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.281+0000 7fdfc0812800 20 remove_watcher() i=4 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.281+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94674696867696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bace4c0 con 0x7fdfa4074040 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.282+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94674696867696] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.282+0000 7fdfc0812800 20 remove_watcher() i=5 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.282+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94674696865024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bace4c0 con 0x7fdfa4074040 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.283+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94674696865024] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.283+0000 7fdfc0812800 20 remove_watcher() i=6 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.283+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94674696870368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561b2bace4c0 con 0x7fdfa4074040 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94674696870368] v31'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdfb4031040 con 0x7fdfa4074040 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 20 remove_watcher() i=7 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fdfa4074040 msgr2=0x7fdfa4081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fdfa4074040 0x7fdfa4081410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2bac1740 msgr2=0x561b2bac3c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.269 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2bac1740 0x561b2bac3c00 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fdfac01dbd0 msgr2=0x7fdfac00c7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fdfac01dbd0 0x7fdfac00c7f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2bac6130 msgr2=0x561b2bac8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2bac6130 0x561b2bac8520 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde84036af0 msgr2=0x7fde84038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde84036af0 0x7fde84038fb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x561b2ba93cd0 tx=0x7fdfa404f000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 msgr2=0x561b2bab6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 --2- 172.21.15.173:0/1647451814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baaf040 0x561b2bab6200 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdfac01aa80 tx=0x7fdfac04bef0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 reap_dead start 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/1647451814 reap_dead start 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 shutdown_connections 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.284+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 >> 172.21.15.173:0/1647451814 conn(0x561b2baab310 msgr2=0x561b2baa8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 shutdown_connections 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/1647451814 wait complete. 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde94036900 msgr2=0x7fde94038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde94036900 0x7fde94038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x561b2ba87a10 tx=0x7fdfa4005ac0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baa1d30 msgr2=0x561b2baa2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baa1d30 0x561b2baa2150 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b710 tx=0x7fdfac041d50 comp rx=0 tx=0).stop 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 shutdown_connections 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fde94036900 0x7fde94038dc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/3444440966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2baa1d30 0x561b2baa2150 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 >> 172.21.15.173:0/3444440966 conn(0x561b2ba95dd0 msgr2=0x561b2ba961d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 shutdown_connections 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/3444440966 wait complete. 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561b2ba90d20 msgr2=0x561b2ba93170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x561b2ba90d20 0x561b2ba93170 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2b988550 msgr2=0x561b2ba8a520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x561b2b988550 0x561b2ba8a520 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2ba8cde0 msgr2=0x561b2ba8f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x561b2ba8cde0 0x561b2ba8f1d0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdea40368b0 msgr2=0x7fdea4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fdea40368b0 0x7fdea4038d70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4054000 tx=0x7fdfa404e000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 msgr2=0x561b2ba832e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 --2- 172.21.15.173:0/2950975134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561b2b986a10 0x561b2ba832e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b210 tx=0x7fdfac000ed0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfbc5ef640 1 -- 172.21.15.173:0/2950975134 reap_dead start 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 shutdown_connections 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.285+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 >> 172.21.15.173:0/2950975134 conn(0x561b2b9825b0 msgr2=0x561b2ba75880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.286+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 shutdown_connections 2024-05-15T18:10:45.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.286+0000 7fdfc0812800 1 -- 172.21.15.173:0/2950975134 wait complete. 2024-05-15T18:10:45.273 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.273 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.274 ERROR:root:0 2024-05-15T18:10:45.274 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:45.278 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:45.278 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:45.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:45.278 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-15T18:10:45.324 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.324 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f5192b800 1 Processor -- start 2024-05-15T18:10:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f5192b800 1 -- start start 2024-05-15T18:10:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f5192b800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555fb13b85e0 0x555fb144cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f5192b800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555fb13b8b00 con 0x555fb13b99c0 2024-05-15T18:10:45.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f5192b800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x555fb12d5050 con 0x555fb13b85e0 2024-05-15T18:10:45.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f44d51640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555fb13b85e0 0x555fb144cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f4d552640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x555fb13b99c0 0x555fb13b7ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38692/0 (socket says 172.21.15.173:38692) 2024-05-15T18:10:45.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.349+0000 7f3f4d552640 1 -- 172.21.15.173:0/2224040424 learned_addr learned my addr 172.21.15.173:0/2224040424 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:45.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.350+0000 7f3f44d51640 1 -- 172.21.15.173:0/2224040424 >> v1:172.21.15.3:6789/0 conn(0x555fb13b99c0 legacy=0x555fb13b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.350+0000 7f3f44d51640 1 -- 172.21.15.173:0/2224040424 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb144e540 con 0x555fb13b85e0 2024-05-15T18:10:45.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.351+0000 7f3f44d51640 1 --2- 172.21.15.173:0/2224040424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb144cff0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800a470 tx=0x7f3f3801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00f37e7ce04f4e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f4cd51640 1 -- 172.21.15.173:0/2224040424 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38057070 con 0x555fb13b85e0 2024-05-15T18:10:45.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f4cd51640 1 -- 172.21.15.173:0/2224040424 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f38052570 con 0x555fb13b85e0 2024-05-15T18:10:45.328 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f4cd51640 1 -- 172.21.15.173:0/2224040424 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38052870 con 0x555fb13b85e0 2024-05-15T18:10:45.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f5192b800 1 -- 172.21.15.173:0/2224040424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 msgr2=0x555fb144cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2224040424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb144cff0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800a470 tx=0x7f3f3801ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:45.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f5192b800 1 -- 172.21.15.173:0/2224040424 shutdown_connections 2024-05-15T18:10:45.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2224040424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb144cff0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f5192b800 1 -- 172.21.15.173:0/2224040424 >> 172.21.15.173:0/2224040424 conn(0x555fb143f790 msgr2=0x555fb1441bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f5192b800 1 -- 172.21.15.173:0/2224040424 shutdown_connections 2024-05-15T18:10:45.329 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.352+0000 7f3f5192b800 1 -- 172.21.15.173:0/2224040424 wait complete. 2024-05-15T18:10:45.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.366+0000 7f3f5192b800 1 Processor -- start 2024-05-15T18:10:45.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.366+0000 7f3f5192b800 1 -- start start 2024-05-15T18:10:45.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.366+0000 7f3f5192b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb1537910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.343 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.366+0000 7f3f5192b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555fb138f1c0 con 0x555fb13b85e0 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.366+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb1537910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.366+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb1537910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50894/0 (socket says 172.21.15.173:50894) 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.366+0000 7f3f4d552640 1 -- 172.21.15.173:0/3950596324 learned_addr learned my addr 172.21.15.173:0/3950596324 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.367+0000 7f3f4d552640 1 -- 172.21.15.173:0/3950596324 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb1537ee0 con 0x555fb13b85e0 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.367+0000 7f3f4d552640 1 --2- 172.21.15.173:0/3950596324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb1537910 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3f40001dd0 tx=0x7f3f4000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf241f0b3c56ad14 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.367+0000 7f3e3b606640 1 -- 172.21.15.173:0/3950596324 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40012020 con 0x555fb13b85e0 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.367+0000 7f3e3b606640 1 -- 172.21.15.173:0/3950596324 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4000e5a0 con 0x555fb13b85e0 2024-05-15T18:10:45.344 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.367+0000 7f3e3b606640 1 -- 172.21.15.173:0/3950596324 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4000e900 con 0x555fb13b85e0 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 -- 172.21.15.173:0/3950596324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 msgr2=0x555fb1537910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3950596324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb1537910 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3f40001dd0 tx=0x7f3f4000b6c0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 -- 172.21.15.173:0/3950596324 shutdown_connections 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3950596324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb1537910 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 -- 172.21.15.173:0/3950596324 >> 172.21.15.173:0/3950596324 conn(0x555fb143f790 msgr2=0x555fb1533230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 -- 172.21.15.173:0/3950596324 shutdown_connections 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 -- 172.21.15.173:0/3950596324 wait complete. 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 Processor -- start 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 -- start start 2024-05-15T18:10:45.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb153f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f5192b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555fb144d770 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb153f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb153f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50904/0 (socket says 172.21.15.173:50904) 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.368+0000 7f3f4d552640 1 -- 172.21.15.173:0/590438069 learned_addr learned my addr 172.21.15.173:0/590438069 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.369+0000 7f3f4d552640 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb153f9c0 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.369+0000 7f3f4d552640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb153f480 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3f40001dd0 tx=0x7f3f40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.369+0000 7f3e39e03640 1 -- 172.21.15.173:0/590438069 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40012030 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.369+0000 7f3e39e03640 1 -- 172.21.15.173:0/590438069 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4001a720 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.369+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fb153fc50 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.369+0000 7f3e39e03640 1 -- 172.21.15.173:0/590438069 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4001aa40 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.369+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb1542900 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3e39e03640 1 -- 172.21.15.173:0/590438069 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3f40015020 con 0x555fb13b85e0 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3e39e03640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e34036900 0x7f3e34038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.356 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3e39e03640 1 -- 172.21.15.173:0/590438069 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3f40020030 con 0x555fb13b85e0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3f44d51640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e34036900 0x7f3e34038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb13b99c0 0x555fb15466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1546c00 con 0x555fb13b99c0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3f4dd53640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb13b99c0 0x555fb15466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.370+0000 7f3f44d51640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e34036900 0x7f3e34038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3f38054000 tx=0x7f3f3804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f4dd53640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb13b99c0 0x555fb15466c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f4dd53640 1 -- 172.21.15.173:0/590438069 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb13b99c0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1543c90 con 0x555fb13b99c0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f4dd53640 1 -- 172.21.15.173:0/590438069 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb13b99c0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1548f10 0x555fb154b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb154b9f0 con 0x555fb1548f10 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f4d552640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1548f10 0x555fb154b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.371+0000 7f3f4d552640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1548f10 0x555fb154b300 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.372+0000 7f3f4d552640 1 -- 172.21.15.173:0/590438069 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f40018950 con 0x555fb1548f10 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.372+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1547ec0 con 0x555fb13b99c0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.372+0000 7f3f4dd53640 1 -- 172.21.15.173:0/590438069 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb13b99c0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.372+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555fb154cea0 0x555fb154f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.372+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb154fa50 con 0x555fb154cea0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.372+0000 7f3f44d51640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555fb154cea0 0x555fb154f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.373+0000 7f3f44d51640 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555fb154cea0 0x555fb154f2f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.373+0000 7f3f44d51640 1 -- 172.21.15.173:0/590438069 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f3805a040 con 0x555fb154cea0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.373+0000 7f3f5192b800 1 Processor -- start 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.373+0000 7f3f5192b800 1 -- start start 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f5192b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb155deb0 0x555fb155e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f5192b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555fb1335cf0 con 0x555fb155deb0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb155deb0 0x555fb155e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.358 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb155deb0 0x555fb155e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50914/0 (socket says 172.21.15.173:50914) 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f4d552640 1 -- 172.21.15.173:0/3880299024 learned_addr learned my addr 172.21.15.173:0/3880299024 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f4d552640 1 -- 172.21.15.173:0/3880299024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb155e810 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f4d552640 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb155deb0 0x555fb155e2d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3f4004ab70 tx=0x7f3f40024e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3e32ffd640 1 -- 172.21.15.173:0/3880299024 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40017c50 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3e32ffd640 1 -- 172.21.15.173:0/3880299024 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f40017df0 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fb155f280 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3e32ffd640 1 -- 172.21.15.173:0/3880299024 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4004c180 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.374+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb155f780 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.375+0000 7f3e32ffd640 1 -- 172.21.15.173:0/3880299024 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3f4003c060 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.375+0000 7f3e32ffd640 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e24036950 0x7f3e24038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.375+0000 7f3e32ffd640 1 -- 172.21.15.173:0/3880299024 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3f40036bf0 con 0x555fb155deb0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.375+0000 7f3f44d51640 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e24036950 0x7f3e24038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.375+0000 7f3f5192b800 1 Processor -- start 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f5192b800 1 -- start start 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f44d51640 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e24036950 0x7f3e24038e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555fb15474c0 tx=0x7f3f38005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f5192b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb156b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f5192b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555fb1538260 con 0x555fb156b060 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb156b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb156b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50924/0 (socket says 172.21.15.173:50924) 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f4d552640 1 -- 172.21.15.173:0/3760919906 learned_addr learned my addr 172.21.15.173:0/3760919906 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f4d552640 1 -- 172.21.15.173:0/3760919906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb156ba50 con 0x555fb156b060 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3f4d552640 1 --2- 172.21.15.173:0/3760919906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb156b480 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3f4003ffa0 tx=0x7f3f40034d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c10173b588c9553 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3e30ff9640 1 -- 172.21.15.173:0/3760919906 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4005d070 con 0x555fb156b060 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3e30ff9640 1 -- 172.21.15.173:0/3760919906 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4004c500 con 0x555fb156b060 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.376+0000 7f3e30ff9640 1 -- 172.21.15.173:0/3760919906 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40052040 con 0x555fb156b060 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 -- 172.21.15.173:0/3760919906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 msgr2=0x555fb156b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3760919906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb156b480 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3f4003ffa0 tx=0x7f3f40034d80 comp rx=0 tx=0).stop 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 -- 172.21.15.173:0/3760919906 shutdown_connections 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3760919906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb156b480 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 -- 172.21.15.173:0/3760919906 >> 172.21.15.173:0/3760919906 conn(0x555fb15672e0 msgr2=0x555fb1565340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 -- 172.21.15.173:0/3760919906 shutdown_connections 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 -- 172.21.15.173:0/3760919906 wait complete. 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 Processor -- start 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 -- start start 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb15723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f5192b800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555fb156c0c0 con 0x555fb156b060 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.377+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb15723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3f4d552640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb15723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50934/0 (socket says 172.21.15.173:50934) 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 learned_addr learned my addr 172.21.15.173:0/2696337988 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb1572900 con 0x555fb156b060 2024-05-15T18:10:45.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3f4d552640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb15723c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3f4002efd0 tx=0x7f3f40003270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3e22ffd640 1 -- 172.21.15.173:0/2696337988 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f40066070 con 0x555fb156b060 2024-05-15T18:10:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3e22ffd640 1 -- 172.21.15.173:0/2696337988 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f400442a0 con 0x555fb156b060 2024-05-15T18:10:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3e22ffd640 1 -- 172.21.15.173:0/2696337988 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f4005d040 con 0x555fb156b060 2024-05-15T18:10:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fb1572900 con 0x555fb156b060 2024-05-15T18:10:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.378+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb1572900 con 0x555fb156b060 2024-05-15T18:10:45.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.379+0000 7f3e22ffd640 1 -- 172.21.15.173:0/2696337988 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3f40069070 con 0x555fb156b060 2024-05-15T18:10:45.377 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.379+0000 7f3e22ffd640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e180368b0 0x7f3e18038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.379+0000 7f3e22ffd640 1 -- 172.21.15.173:0/2696337988 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3f4006cbf0 con 0x555fb156b060 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.379+0000 7f3f44d51640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e180368b0 0x7f3e18038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f44d51640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e180368b0 0x7f3e18038d70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x555fb154fe50 tx=0x7f3f3804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb157db30 0x555fb157fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1580740 con 0x555fb157db30 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f4dd53640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb157db30 0x555fb157fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f4dd53640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb157db30 0x555fb157fff0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f5192b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f5192b800 20 realm 2024-05-15T18:10:45.378 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.380+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1580b50 con 0x555fb157db30 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1581420 con 0x555fb157db30 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x555fb157db30 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.379 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1582520 0x555fb1584910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1584f20 con 0x555fb1582520 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f4d552640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1582520 0x555fb1584910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.381+0000 7f3f4d552640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1582520 0x555fb1584910 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f5192b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f5192b800 20 searching for the correct realm 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb1586850 con 0x555fb1582520 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f4d552640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3f4006b070 0x7f3f4004c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb1586850 con 0x7f3f4006b070 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f44d51640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3f4006b070 0x7f3f4004c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.382+0000 7f3f44d51640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3f4006b070 0x7f3f4004c940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.383+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.380 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.383+0000 7f3f44d51640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3f38074040 0x7f3f38081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.383+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb1586850 con 0x7f3f38074040 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.383+0000 7f3f4dd53640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3f38074040 0x7f3f38081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.383+0000 7f3f4dd53640 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3f38074040 0x7f3f38081410 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f4800a4a0 con 0x7f3f38074040 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x555fb157db30 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x555fb157db30 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x7f3f38074040 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x7f3f38074040 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.384+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x7f3f38074040 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x7f3f38074040 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x7f3f4006b070 2024-05-15T18:10:45.381 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x555fb1582520 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x555fb157db30 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.385+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x7f3f38074040 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x7f3f38074040 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x555fb157db30 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x555fb15817c0 con 0x7f3f4006b070 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb1582520 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb1582520 2024-05-15T18:10:45.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.386+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f38074040 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x7f3f38074040 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb1582520 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb1582520 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb157db30 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.387+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb157db30 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f4800a4a0 con 0x555fb157db30 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f38074040 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f48033040 con 0x7f3f38074040 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb1582520 2024-05-15T18:10:45.383 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f4006b070 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.388+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb157db30 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f38074040 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb1582520 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f38074040 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.389+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f4006b070 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb1582520 2024-05-15T18:10:45.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f4006b070 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x555fb157db30 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.390+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f3808e060 con 0x7f3f4006b070 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb15857e0 con 0x555fb157db30 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1585bd0 con 0x555fb157db30 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.391+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1585bd0 con 0x7f3f38074040 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 zone default found 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 4 Realm: () 2024-05-15T18:10:45.386 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 zonegroup default 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb15860f0 con 0x7f3f38074040 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb15886b0 con 0x555fb1582520 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb1588a50 con 0x555fb1582520 2024-05-15T18:10:45.387 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 started sync module instance, tier type = 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.392+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb1587b50 con 0x7f3f4006b070 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.393+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.393+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93869485618848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb1588df0 con 0x7f3f4006b070 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.393+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb1589680 con 0x555fb157db30 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.394+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93869485618848] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.395+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.395+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93869485621056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb1589a70 con 0x555fb157db30 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.395+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158a4d0 con 0x555fb1582520 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.396+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.396+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93869485629360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158ad70 con 0x555fb1582520 2024-05-15T18:10:45.388 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.396+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158b850 con 0x7f3f4006b070 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.396+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93869485621056] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.397+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93869485629360] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.397+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.397+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93869485625744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158ad70 con 0x7f3f4006b070 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.397+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158c130 con 0x555fb157db30 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.398+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.398+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93869485625744] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.398+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93869485631680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158c550 con 0x555fb157db30 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.398+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158cf50 con 0x7f3f38074040 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.399+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.399+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93869485631680] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.399+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93869485640288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158cec0 con 0x7f3f38074040 2024-05-15T18:10:45.389 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.399+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158bc70 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.400+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93869485640288] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.400+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.400+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93869485636672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158d9c0 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.400+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e380 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93869485645520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e7a0 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93869485636672] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 20 add_watcher() i=0 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 20 add_watcher() i=1 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 20 add_watcher() i=2 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 20 add_watcher() i=3 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 20 add_watcher() i=4 2024-05-15T18:10:45.390 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 20 add_watcher() i=5 2024-05-15T18:10:45.391 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.401+0000 7f3f5192b800 20 add_watcher() i=6 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.402+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93869485645520] v31'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.402+0000 7f3f5192b800 20 add_watcher() i=7 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.402+0000 7f3f5192b800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.402+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e7a0 con 0x555fb157db30 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.403+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.403+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93869485646576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e740 con 0x555fb157db30 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93869485646576] v31'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3e037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3f5192b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3f5192b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3f5192b800 5 note: GC not initialized 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3e027e4640 20 reqs_thread_entry: start 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3f5192b800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3f5192b800 20 Filter name: none 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.404+0000 7f3d73fff640 20 reqs_thread_entry: start 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb15c4c70 con 0x7f3f38074040 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 20 rados_obj.operate() r=0 bl.length=490 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:45.395 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.405+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb15cb0c0 con 0x7f3f38074040 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.406+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v31'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.406+0000 7f3f5192b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.406+0000 7f3f5192b800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.406+0000 7f3f5192b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.406+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93869485894448 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555fb15c9c50 con 0x555fb157db30 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 93869485631680 notify 133143986202 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f3f4801e040 con 0x555fb157db30 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3e30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986202 cookie 93869485631680 notifier 4881 bl.length()=679 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3e30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3e30ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 93869485894448 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3e30ff9640 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3e10003ea0 con 0x555fb157db30 2024-05-15T18:10:45.396 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.397 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.407+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 93869485894448 notify 133143986202 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3f48018db0 con 0x555fb157db30 2024-05-15T18:10:45.397 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.408+0000 7f3e037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.408+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93869485646576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb15c5260 con 0x555fb157db30 2024-05-15T18:10:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.409+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93869485646576] v31'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.409+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93869485618848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e2f0 con 0x7f3f4006b070 2024-05-15T18:10:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.410+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93869485618848] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.410+0000 7f3f5192b800 20 remove_watcher() i=0 2024-05-15T18:10:45.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.410+0000 7f3f5192b800 2 removed watcher, disabling cache 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.410+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93869485621056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e2f0 con 0x555fb157db30 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.411+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93869485621056] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.411+0000 7f3f5192b800 20 remove_watcher() i=1 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.411+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93869485629360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e2f0 con 0x555fb1582520 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.412+0000 7f3f4d552640 1 -- 172.21.15.173:0/2696337988 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93869485629360] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f40072070 con 0x555fb1582520 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.412+0000 7f3f5192b800 20 remove_watcher() i=2 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.412+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93869485625744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb1589fb0 con 0x7f3f4006b070 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.413+0000 7f3f44d51640 1 -- 172.21.15.173:0/2696337988 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93869485625744] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f3807f070 con 0x7f3f4006b070 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.413+0000 7f3f5192b800 20 remove_watcher() i=3 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.413+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93869485631680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e2f0 con 0x555fb157db30 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.414+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93869485631680] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x555fb157db30 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.414+0000 7f3f5192b800 20 remove_watcher() i=4 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.414+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93869485640288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb1589fb0 con 0x7f3f38074040 2024-05-15T18:10:45.403 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.415+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93869485640288] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.415+0000 7f3f5192b800 20 remove_watcher() i=5 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.415+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93869485636672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158a8c0 con 0x7f3f38074040 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.416+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93869485636672] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.416+0000 7f3f5192b800 20 remove_watcher() i=6 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.416+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93869485645520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555fb158e2f0 con 0x7f3f38074040 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93869485645520] v31'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f48031040 con 0x7f3f38074040 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 20 remove_watcher() i=7 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3f38074040 msgr2=0x7f3f38081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3f38074040 0x7f3f38081410 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb157db30 msgr2=0x555fb157fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb157db30 0x555fb157fff0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3f4006b070 msgr2=0x7f3f4004c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3f4006b070 0x7f3f4004c940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.404 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1582520 msgr2=0x555fb1584910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1582520 0x555fb1584910 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e180368b0 msgr2=0x7f3e18038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e180368b0 0x7f3e18038d70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x555fb154fe50 tx=0x7f3f3804f000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f4dd53640 1 -- 172.21.15.173:0/2696337988 reap_dead start 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 msgr2=0x555fb15723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb15723c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3f4002efd0 tx=0x7f3f40003270 comp rx=0 tx=0).stop 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 shutdown_connections 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/2696337988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb156b060 0x555fb15723c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 >> 172.21.15.173:0/2696337988 conn(0x555fb15672e0 msgr2=0x555fb1564940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 shutdown_connections 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/2696337988 wait complete. 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e24036950 msgr2=0x7f3e24038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.405 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e24036950 0x7f3e24038e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555fb15474c0 tx=0x7f3f38005a00 comp rx=0 tx=0).stop 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb155deb0 msgr2=0x555fb155e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb155deb0 0x555fb155e2d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3f4004ab70 tx=0x7f3f40024e60 comp rx=0 tx=0).stop 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 shutdown_connections 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e24036950 0x7f3e24038e10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 --2- 172.21.15.173:0/3880299024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb155deb0 0x555fb155e2d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 >> 172.21.15.173:0/3880299024 conn(0x555fb1551f50 msgr2=0x555fb1552350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 shutdown_connections 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.418+0000 7f3f5192b800 1 -- 172.21.15.173:0/3880299024 wait complete. 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555fb154cea0 msgr2=0x555fb154f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555fb154cea0 0x555fb154f2f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb13b99c0 msgr2=0x555fb15466c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555fb13b99c0 0x555fb15466c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1548f10 msgr2=0x555fb154b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.406 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x555fb1548f10 0x555fb154b300 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e34036900 msgr2=0x7f3e34038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3e34036900 0x7f3e34038dc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3f38054000 tx=0x7f3f3804e000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 msgr2=0x555fb153f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 --2- 172.21.15.173:0/590438069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555fb13b85e0 0x555fb153f480 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3f40001dd0 tx=0x7f3f40000ed0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f4dd53640 1 -- 172.21.15.173:0/590438069 reap_dead start 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 shutdown_connections 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 >> 172.21.15.173:0/590438069 conn(0x555fb143f790 msgr2=0x555fb1531a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 shutdown_connections 2024-05-15T18:10:45.407 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.419+0000 7f3f5192b800 1 -- 172.21.15.173:0/590438069 wait complete. 2024-05-15T18:10:45.408 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.408 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.408 ERROR:root:0 2024-05-15T18:10:45.408 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:45.413 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:45.413 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-15T18:10:45.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-15T18:10:45.413 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-05-15T18:10:45.459 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.459 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5f575800 1 Processor -- start 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5f575800 1 -- start start 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5f575800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558f792743e0 0x558f792768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5f575800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f79276f50 con 0x558f791e38b0 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5f575800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x558f79101050 con 0x558f792743e0 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5c873640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x558f792743e0 0x558f792768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5d074640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x558f791e38b0 0x558f79272c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38694/0 (socket says 172.21.15.173:38694) 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.484+0000 7f2e5d074640 1 -- 172.21.15.173:0/240290081 learned_addr learned my addr 172.21.15.173:0/240290081 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.485+0000 7f2e5c873640 1 -- 172.21.15.173:0/240290081 >> v1:172.21.15.3:6789/0 conn(0x558f791e38b0 legacy=0x558f79272c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.461 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.485+0000 7f2e5c873640 1 -- 172.21.15.173:0/240290081 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f79278180 con 0x558f792743e0 2024-05-15T18:10:45.462 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.485+0000 7f2e57fff640 1 -- 172.21.15.173:0/240290081 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937546971 0 0) 0x558f79276f50 con 0x558f791e38b0 2024-05-15T18:10:45.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.486+0000 7f2e5c873640 1 --2- 172.21.15.173:0/240290081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f792743e0 0x558f792768a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800a470 tx=0x7f2e4801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e126f93406f7af server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e57fff640 1 -- 172.21.15.173:0/240290081 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e48057070 con 0x558f792743e0 2024-05-15T18:10:45.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e57fff640 1 -- 172.21.15.173:0/240290081 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e48052570 con 0x558f792743e0 2024-05-15T18:10:45.463 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e57fff640 1 -- 172.21.15.173:0/240290081 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e48052870 con 0x558f792743e0 2024-05-15T18:10:45.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e5f575800 1 -- 172.21.15.173:0/240290081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f792743e0 msgr2=0x558f792768a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e5f575800 1 --2- 172.21.15.173:0/240290081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f792743e0 0x558f792768a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800a470 tx=0x7f2e4801ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:45.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e5f575800 1 -- 172.21.15.173:0/240290081 shutdown_connections 2024-05-15T18:10:45.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e5f575800 1 --2- 172.21.15.173:0/240290081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f792743e0 0x558f792768a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e5f575800 1 -- 172.21.15.173:0/240290081 >> 172.21.15.173:0/240290081 conn(0x558f7926a5b0 msgr2=0x558f7926c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e5f575800 1 -- 172.21.15.173:0/240290081 shutdown_connections 2024-05-15T18:10:45.464 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.487+0000 7f2e5f575800 1 -- 172.21.15.173:0/240290081 wait complete. 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.501+0000 7f2e5f575800 1 Processor -- start 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.501+0000 7f2e5f575800 1 -- start start 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.501+0000 7f2e5f575800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f792705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.501+0000 7f2e5f575800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558f791bb1c0 con 0x558f791e38b0 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f792705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f792705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50944/0 (socket says 172.21.15.173:50944) 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2e5d074640 1 -- 172.21.15.173:0/539891235 learned_addr learned my addr 172.21.15.173:0/539891235 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2e5d074640 1 -- 172.21.15.173:0/539891235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7926eb80 con 0x558f791e38b0 2024-05-15T18:10:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2e5d074640 1 --2- 172.21.15.173:0/539891235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f792705c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e58001630 tx=0x7f2e58001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c660ed79f18d6f3e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2d4b606640 1 -- 172.21.15.173:0/539891235 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58003450 con 0x558f791e38b0 2024-05-15T18:10:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2d4b606640 1 -- 172.21.15.173:0/539891235 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e580035f0 con 0x558f791e38b0 2024-05-15T18:10:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.502+0000 7f2d4b606640 1 -- 172.21.15.173:0/539891235 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58003990 con 0x558f791e38b0 2024-05-15T18:10:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 -- 172.21.15.173:0/539891235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 msgr2=0x558f792705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 --2- 172.21.15.173:0/539891235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f792705c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2e58001630 tx=0x7f2e58001af0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.482 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 -- 172.21.15.173:0/539891235 shutdown_connections 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 --2- 172.21.15.173:0/539891235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f792705c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 -- 172.21.15.173:0/539891235 >> 172.21.15.173:0/539891235 conn(0x558f7926a5b0 msgr2=0x558f7935cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 -- 172.21.15.173:0/539891235 shutdown_connections 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 -- 172.21.15.173:0/539891235 wait complete. 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 Processor -- start 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 -- start start 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.503+0000 7f2e5f575800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f7936b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5f575800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558f79277420 con 0x558f791e38b0 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f7936b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f7936b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50956/0 (socket says 172.21.15.173:50956) 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5d074640 1 -- 172.21.15.173:0/1657860600 learned_addr learned my addr 172.21.15.173:0/1657860600 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5d074640 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7936b870 con 0x558f791e38b0 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5d074640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f7936b330 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006fa0 tx=0x7f2e58001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2d49e03640 1 -- 172.21.15.173:0/1657860600 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58013820 con 0x558f791e38b0 2024-05-15T18:10:45.483 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2d49e03640 1 -- 172.21.15.173:0/1657860600 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58023070 con 0x558f791e38b0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f7936bb00 con 0x558f791e38b0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2d49e03640 1 -- 172.21.15.173:0/1657860600 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58013af0 con 0x558f791e38b0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.504+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7936e7b0 con 0x558f791e38b0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.505+0000 7f2d49e03640 1 -- 172.21.15.173:0/1657860600 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2e58010070 con 0x558f791e38b0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.505+0000 7f2d49e03640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d44036950 0x7f2d44038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.505+0000 7f2d49e03640 1 -- 172.21.15.173:0/1657860600 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f2e58018070 con 0x558f791e38b0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.505+0000 7f2e5c873640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d44036950 0x7f2d44038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.505+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f792743e0 0x558f79372400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.505+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f79372a50 con 0x558f792743e0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5d875640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f792743e0 0x558f79372400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5c873640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d44036950 0x7f2d44038e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e48054000 tx=0x7f2e4804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.484 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5d875640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f792743e0 0x558f79372400 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5d875640 1 -- 172.21.15.173:0/1657860600 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f792743e0 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f7936fb20 con 0x558f792743e0 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5d875640 1 -- 172.21.15.173:0/1657860600 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e500083e0 con 0x558f792743e0 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f79374d60 0x558f79377150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.506+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f79377840 con 0x558f79374d60 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.507+0000 7f2e5d074640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f79374d60 0x558f79377150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.507+0000 7f2e5d074640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f79374d60 0x558f79377150 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.507+0000 7f2e5d074640 1 -- 172.21.15.173:0/1657860600 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e5801b420 con 0x558f79374d60 2024-05-15T18:10:45.491 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.507+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f79373d10 con 0x558f792743e0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.507+0000 7f2e5d875640 1 -- 172.21.15.173:0/1657860600 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e500083e0 con 0x558f792743e0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.507+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558f79378ca0 0x558f7937b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.507+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f7937b870 con 0x558f79378ca0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.508+0000 7f2e5c873640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558f79378ca0 0x558f7937b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.508+0000 7f2e5c873640 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558f79378ca0 0x558f7937b110 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.508+0000 7f2e5c873640 1 -- 172.21.15.173:0/1657860600 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e4805a040 con 0x558f79378ca0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5f575800 1 Processor -- start 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5f575800 1 -- start start 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5f575800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79389cd0 0x558f7938a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5f575800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558f79161cf0 con 0x558f79389cd0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79389cd0 0x558f7938a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79389cd0 0x558f7938a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50958/0 (socket says 172.21.15.173:50958) 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5d074640 1 -- 172.21.15.173:0/1182479962 learned_addr learned my addr 172.21.15.173:0/1182479962 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.492 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.509+0000 7f2e5d074640 1 -- 172.21.15.173:0/1182479962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7938a630 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.510+0000 7f2e5d074640 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79389cd0 0x558f7938a0f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2e58001b30 tx=0x7f2e5801b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.510+0000 7f2d42ffd640 1 -- 172.21.15.173:0/1182479962 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58028de0 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.510+0000 7f2d42ffd640 1 -- 172.21.15.173:0/1182479962 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5804c0b0 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.510+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f7938b0a0 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.510+0000 7f2d42ffd640 1 -- 172.21.15.173:0/1182479962 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5804c260 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.510+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7938b5a0 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.510+0000 7f2d42ffd640 1 -- 172.21.15.173:0/1182479962 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2e58028460 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2d42ffd640 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d34036920 0x7f2d34038de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2d42ffd640 1 -- 172.21.15.173:0/1182479962 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f2e5804dd00 con 0x558f79389cd0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5c873640 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d34036920 0x7f2d34038de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5f575800 1 Processor -- start 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5f575800 1 -- start start 2024-05-15T18:10:45.493 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5c873640 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d34036920 0x7f2d34038de0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x558f79373310 tx=0x7f2e48005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5f575800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f79397470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5f575800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558f7926ef00 con 0x558f79397050 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f79397470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f79397470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50974/0 (socket says 172.21.15.173:50974) 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.511+0000 7f2e5d074640 1 -- 172.21.15.173:0/3843023421 learned_addr learned my addr 172.21.15.173:0/3843023421 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5d074640 1 -- 172.21.15.173:0/3843023421 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f79397a40 con 0x558f79397050 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5d074640 1 --2- 172.21.15.173:0/3843023421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f79397470 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2e58033fd0 tx=0x7f2e58033830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846725040dc41283 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2d40ff9640 1 -- 172.21.15.173:0/3843023421 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5805b020 con 0x558f79397050 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2d40ff9640 1 -- 172.21.15.173:0/3843023421 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e580273c0 con 0x558f79397050 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2d40ff9640 1 -- 172.21.15.173:0/3843023421 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58028750 con 0x558f79397050 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5f575800 1 -- 172.21.15.173:0/3843023421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 msgr2=0x558f79397470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5f575800 1 --2- 172.21.15.173:0/3843023421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f79397470 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f2e58033fd0 tx=0x7f2e58033830 comp rx=0 tx=0).stop 2024-05-15T18:10:45.494 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5f575800 1 -- 172.21.15.173:0/3843023421 shutdown_connections 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5f575800 1 --2- 172.21.15.173:0/3843023421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f79397470 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5f575800 1 -- 172.21.15.173:0/3843023421 >> 172.21.15.173:0/3843023421 conn(0x558f793932d0 msgr2=0x558f79391330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5f575800 1 -- 172.21.15.173:0/3843023421 shutdown_connections 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.512+0000 7f2e5f575800 1 -- 172.21.15.173:0/3843023421 wait complete. 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5f575800 1 Processor -- start 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5f575800 1 -- start start 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5f575800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f7939e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5f575800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558f793980b0 con 0x558f79397050 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f7939e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5d074640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f7939e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50990/0 (socket says 172.21.15.173:50990) 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 learned_addr learned my addr 172.21.15.173:0/296521693 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.513+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7939e8b0 con 0x558f79397050 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.514+0000 7f2e5d074640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f7939e370 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2e58033c20 tx=0x7f2e5801ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.495 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.514+0000 7f2d32ffd640 1 -- 172.21.15.173:0/296521693 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e58070070 con 0x558f79397050 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.514+0000 7f2d32ffd640 1 -- 172.21.15.173:0/296521693 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58033e10 con 0x558f79397050 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.514+0000 7f2d32ffd640 1 -- 172.21.15.173:0/296521693 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e5801bcc0 con 0x558f79397050 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.514+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f7939e8b0 con 0x558f79397050 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.514+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7939e8b0 con 0x558f79397050 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.514+0000 7f2d32ffd640 1 -- 172.21.15.173:0/296521693 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2e58073070 con 0x558f79397050 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2d32ffd640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d28036900 0x7f2d28038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2d32ffd640 1 -- 172.21.15.173:0/296521693 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f2e58067030 con 0x558f79397050 2024-05-15T18:10:45.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2e5c873640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d28036900 0x7f2d28038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2e5c873640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d28036900 0x7f2d28038dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x558f7937bc70 tx=0x7f2e4804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f793a9b10 0x558f793abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793ac720 con 0x558f793a9b10 2024-05-15T18:10:45.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.515+0000 7f2e5d875640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f793a9b10 0x558f793abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5d875640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f793a9b10 0x558f793abfd0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.510 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 20 realm 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793acb50 con 0x558f793a9b10 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x558f793a9b10 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.516+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad7c0 con 0x558f793a9b10 2024-05-15T18:10:45.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5f575800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f793ae180 0x558f793b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793b0b80 con 0x558f793ae180 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5d074640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f793ae180 0x558f793b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5d074640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f793ae180 0x558f793b0570 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5f575800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5f575800 20 searching for the correct realm 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.517+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793b2490 con 0x558f793ae180 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5d074640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2e58075060 0x7f2e58050a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793b2490 con 0x7f2e58075060 2024-05-15T18:10:45.512 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5c873640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2e58075060 0x7f2e58050a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5c873640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2e58075060 0x7f2e58050a80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5c873640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2e48074040 0x7f2e48081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.518+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793b2490 con 0x7f2e48074040 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.519+0000 7f2e5d875640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2e48074040 0x7f2e48081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.519+0000 7f2e5d875640 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2e48074040 0x7f2e48081410 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.519+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.519+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x558f793a9b10 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.519+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.519+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x558f793a9b10 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x7f2e48074040 2024-05-15T18:10:45.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x7f2e48074040 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x7f2e58075060 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.520+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x558f793ae180 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x558f793a9b10 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x7f2e48074040 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x558f793a9b10 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.514 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.521+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558f793ad420 con 0x7f2e58075060 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e4808e060 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e4808e060 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e4808e060 con 0x7f2e48074040 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.522+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793a9b10 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793a9b10 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.523+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x7f2e48074040 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793ae180 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x7f2e58075060 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793a9b10 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.524+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x7f2e48074040 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.525+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.525+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793ae180 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.525+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.525+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x7f2e48074040 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.525+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.525+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x7f2e58075060 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793ae180 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x7f2e58075060 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x558f793a9b10 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.526+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f2e50026040 con 0x7f2e58075060 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:45.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793b0f20 con 0x558f793a9b10 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793b0f20 con 0x558f793a9b10 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.527+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793b0f20 con 0x7f2e48074040 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 zone default found 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 4 Realm: () 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 zonegroup default 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793b1850 con 0x7f2e48074040 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793b1850 con 0x558f793ae180 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.528+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793b42f0 con 0x558f793ae180 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.529+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.529+0000 7f2e5f575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.529+0000 7f2e5f575800 20 started sync module instance, tier type = 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.529+0000 7f2e5f575800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.529+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b3790 con 0x7f2e58075060 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.530+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.530+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94074702607072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b4690 con 0x7f2e58075060 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.530+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b4f40 con 0x558f793a9b10 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.531+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94074702607072] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.531+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.531+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94074702613040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b5330 con 0x558f793a9b10 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.531+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b5d90 con 0x558f793ae180 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.532+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.532+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94074702616688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b6630 con 0x558f793ae180 2024-05-15T18:10:45.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.532+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b70f0 con 0x7f2e58075060 2024-05-15T18:10:45.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.532+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94074702613040] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.533+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94074702616688] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.533+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.533+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94074702619008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b3bb0 con 0x7f2e58075060 2024-05-15T18:10:45.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.533+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b7ab0 con 0x558f793a9b10 2024-05-15T18:10:45.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.534+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.534+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94074702624256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b7ed0 con 0x558f793a9b10 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.534+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b89a0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.534+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94074702619008] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.535+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.535+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94074702627984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b8960 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.535+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b93f0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.535+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94074702624256] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.536+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(56 notify.6 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.536+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94074702625312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b93b0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.536+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b9e00 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.536+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94074702627984] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94074702625312] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94074702621632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b9950 con 0x7f2e48074040 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 20 add_watcher() i=0 2024-05-15T18:10:45.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 20 add_watcher() i=1 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 20 add_watcher() i=2 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 20 add_watcher() i=3 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 20 add_watcher() i=4 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 20 add_watcher() i=5 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.537+0000 7f2e5f575800 20 add_watcher() i=6 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.538+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94074702621632] v31'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.538+0000 7f2e5f575800 20 add_watcher() i=7 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.538+0000 7f2e5f575800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.538+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793bce30 con 0x558f793a9b10 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.539+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.539+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94074702633296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793ba220 con 0x558f793a9b10 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94074702633296] v31'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2d137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:45.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 5 note: GC not initialized 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2d127e4640 20 reqs_thread_entry: start 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 20 Filter name: none 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2c83fff640 20 reqs_thread_entry: start 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.540+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793f0200 con 0x7f2e48074040 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.541+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.541+0000 7f2e5f575800 20 rados_obj.operate() r=0 bl.length=503 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.541+0000 7f2e5f575800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.541+0000 7f2e5f575800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.541+0000 7f2e5f575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.541+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793f68f0 con 0x7f2e48074040 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5f575800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5f575800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5f575800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94074702881632 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558f793f2180 con 0x558f793a9b10 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 94074702624256 notify 133143986203 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f2e50010040 con 0x558f793a9b10 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2d40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986203 cookie 94074702624256 notifier 4888 bl.length()=636 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2d40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2d40ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 94074702881632 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2d40ff9640 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2d20003ea0 con 0x558f793a9b10 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.543+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.544+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 94074702881632 notify 133143986203 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2e5000be20 con 0x558f793a9b10 2024-05-15T18:10:45.529 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.544+0000 7f2d137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.544+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94074702633296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793f5850 con 0x558f793a9b10 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.545+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94074702633296] v31'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.545+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94074702607072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b9950 con 0x7f2e58075060 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.546+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94074702607072] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.546+0000 7f2e5f575800 20 remove_watcher() i=0 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.546+0000 7f2e5f575800 2 removed watcher, disabling cache 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.546+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94074702613040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b9950 con 0x558f793a9b10 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.548+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94074702613040] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.548+0000 7f2e5f575800 20 remove_watcher() i=1 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.548+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94074702616688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b4a30 con 0x558f793ae180 2024-05-15T18:10:45.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.549+0000 7f2e5d074640 1 -- 172.21.15.173:0/296521693 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94074702616688] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e58072030 con 0x558f793ae180 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.549+0000 7f2e5f575800 20 remove_watcher() i=2 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.549+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94074702619008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b9950 con 0x7f2e58075060 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.550+0000 7f2e5c873640 1 -- 172.21.15.173:0/296521693 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94074702619008] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e4807f070 con 0x7f2e58075060 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.550+0000 7f2e5f575800 20 remove_watcher() i=3 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.550+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94074702624256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b5870 con 0x558f793a9b10 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.551+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94074702624256] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x558f793a9b10 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.551+0000 7f2e5f575800 20 remove_watcher() i=4 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.551+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94074702627984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b4a30 con 0x7f2e48074040 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.552+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94074702627984] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.552+0000 7f2e5f575800 20 remove_watcher() i=5 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.552+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94074702625312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b9950 con 0x7f2e48074040 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.553+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94074702625312] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.553+0000 7f2e5f575800 20 remove_watcher() i=6 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.553+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94074702621632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558f793b5870 con 0x7f2e48074040 2024-05-15T18:10:45.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94074702621632] v31'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e500083e0 con 0x7f2e48074040 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 20 remove_watcher() i=7 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2e48074040 msgr2=0x7f2e48081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f2e48074040 0x7f2e48081410 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f793a9b10 msgr2=0x558f793abfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f793a9b10 0x558f793abfd0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2e58075060 msgr2=0x7f2e58050a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f2e58075060 0x7f2e58050a80 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f793ae180 msgr2=0x558f793b0570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f793ae180 0x558f793b0570 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d28036900 msgr2=0x7f2d28038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d28036900 0x7f2d28038dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x558f7937bc70 tx=0x7f2e4804f000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 msgr2=0x558f7939e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5d875640 1 -- 172.21.15.173:0/296521693 reap_dead start 2024-05-15T18:10:45.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f7939e370 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2e58033c20 tx=0x7f2e5801ded0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 shutdown_connections 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 --2- 172.21.15.173:0/296521693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79397050 0x558f7939e370 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 >> 172.21.15.173:0/296521693 conn(0x558f793932d0 msgr2=0x558f79390930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 shutdown_connections 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.554+0000 7f2e5f575800 1 -- 172.21.15.173:0/296521693 wait complete. 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d34036920 msgr2=0x7f2d34038de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d34036920 0x7f2d34038de0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x558f79373310 tx=0x7f2e48005a00 comp rx=0 tx=0).stop 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79389cd0 msgr2=0x558f7938a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79389cd0 0x558f7938a0f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2e58001b30 tx=0x7f2e5801b3b0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 shutdown_connections 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d34036920 0x7f2d34038de0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1182479962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f79389cd0 0x558f7938a0f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 >> 172.21.15.173:0/1182479962 conn(0x558f7937dd70 msgr2=0x558f7937e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 shutdown_connections 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1182479962 wait complete. 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558f79378ca0 msgr2=0x558f7937b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x558f79378ca0 0x558f7937b110 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f792743e0 msgr2=0x558f79372400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x558f792743e0 0x558f79372400 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f79374d60 msgr2=0x558f79377150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x558f79374d60 0x558f79377150 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d44036950 msgr2=0x7f2d44038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f2d44036950 0x7f2d44038e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e48054000 tx=0x7f2e4804e000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 msgr2=0x558f7936b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 --2- 172.21.15.173:0/1657860600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558f791e38b0 0x558f7936b330 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006fa0 tx=0x7f2e58001250 comp rx=0 tx=0).stop 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5d875640 1 -- 172.21.15.173:0/1657860600 reap_dead start 2024-05-15T18:10:45.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 shutdown_connections 2024-05-15T18:10:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 >> 172.21.15.173:0/1657860600 conn(0x558f7926a5b0 msgr2=0x558f7926f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 shutdown_connections 2024-05-15T18:10:45.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.555+0000 7f2e5f575800 1 -- 172.21.15.173:0/1657860600 wait complete. 2024-05-15T18:10:45.541 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.541 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.541 ERROR:root:0 2024-05-15T18:10:45.541 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-15T18:10:45.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-15T18:10:45.541 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-05-15T18:10:45.587 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.587 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.611+0000 7fa810487800 1 Processor -- start 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.611+0000 7fa810487800 1 -- start start 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.611+0000 7fa810487800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557aa1c789f0 0x557aa1c78e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.611+0000 7fa810487800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557aa1beda70 con 0x557aa1c79350 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.611+0000 7fa810487800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x557aa1b0b050 con 0x557aa1c789f0 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.612+0000 7fa80df86640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557aa1c789f0 0x557aa1c78e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.612+0000 7fa805785640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x557aa1c79350 0x557aa1c79800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38698/0 (socket says 172.21.15.173:38698) 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.612+0000 7fa80df86640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x557aa1c789f0 0x557aa1c78e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:50996/0 (socket says 172.21.15.173:50996) 2024-05-15T18:10:45.588 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.612+0000 7fa805785640 1 -- 172.21.15.173:0/2550401689 learned_addr learned my addr 172.21.15.173:0/2550401689 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.612+0000 7fa80df86640 1 -- 172.21.15.173:0/2550401689 >> v1:172.21.15.3:6789/0 conn(0x557aa1c79350 legacy=0x557aa1c79800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.612+0000 7fa80d785640 1 -- 172.21.15.173:0/2550401689 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546910768 0 0) 0x557aa1beda70 con 0x557aa1c79350 2024-05-15T18:10:45.589 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.612+0000 7fa80df86640 1 -- 172.21.15.173:0/2550401689 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa1c79f10 con 0x557aa1c789f0 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.614+0000 7fa80df86640 1 --2- 172.21.15.173:0/2550401689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1c78e10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa80000a470 tx=0x7fa80001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acd779cc39bc11 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.614+0000 7fa80d785640 1 -- 172.21.15.173:0/2550401689 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800057070 con 0x557aa1c789f0 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.614+0000 7fa80d785640 1 -- 172.21.15.173:0/2550401689 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800052570 con 0x557aa1c789f0 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.614+0000 7fa80d785640 1 -- 172.21.15.173:0/2550401689 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800052870 con 0x557aa1c789f0 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.614+0000 7fa810487800 1 -- 172.21.15.173:0/2550401689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 msgr2=0x557aa1c78e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.614+0000 7fa810487800 1 --2- 172.21.15.173:0/2550401689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1c78e10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa80000a470 tx=0x7fa80001ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.615+0000 7fa810487800 1 -- 172.21.15.173:0/2550401689 shutdown_connections 2024-05-15T18:10:45.591 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.615+0000 7fa810487800 1 --2- 172.21.15.173:0/2550401689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1c78e10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.615+0000 7fa810487800 1 -- 172.21.15.173:0/2550401689 >> 172.21.15.173:0/2550401689 conn(0x557aa1c745b0 msgr2=0x557aa1c769d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.615+0000 7fa810487800 1 -- 172.21.15.173:0/2550401689 shutdown_connections 2024-05-15T18:10:45.592 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.615+0000 7fa810487800 1 -- 172.21.15.173:0/2550401689 wait complete. 2024-05-15T18:10:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.628+0000 7fa810487800 1 Processor -- start 2024-05-15T18:10:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.628+0000 7fa810487800 1 -- start start 2024-05-15T18:10:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.628+0000 7fa810487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d6d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.628+0000 7fa810487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557aa1bc51c0 con 0x557aa1c789f0 2024-05-15T18:10:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.629+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d6d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.629+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d6d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51002/0 (socket says 172.21.15.173:51002) 2024-05-15T18:10:45.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.629+0000 7fa80df86640 1 -- 172.21.15.173:0/3456422390 learned_addr learned my addr 172.21.15.173:0/3456422390 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.606 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.629+0000 7fa80df86640 1 -- 172.21.15.173:0/3456422390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa1d6df80 con 0x557aa1c789f0 2024-05-15T18:10:45.608 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.629+0000 7fa80df86640 1 --2- 172.21.15.173:0/3456422390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d6d9b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa800055040 tx=0x7fa80004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c684a86d44a67e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa6fbe07640 1 -- 172.21.15.173:0/3456422390 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800057040 con 0x557aa1c789f0 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa6fbe07640 1 -- 172.21.15.173:0/3456422390 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800052990 con 0x557aa1c789f0 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa6fbe07640 1 -- 172.21.15.173:0/3456422390 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800052c70 con 0x557aa1c789f0 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa810487800 1 -- 172.21.15.173:0/3456422390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 msgr2=0x557aa1d6d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa810487800 1 --2- 172.21.15.173:0/3456422390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d6d9b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa800055040 tx=0x7fa80004c000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa810487800 1 -- 172.21.15.173:0/3456422390 shutdown_connections 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa810487800 1 --2- 172.21.15.173:0/3456422390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d6d9b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa810487800 1 -- 172.21.15.173:0/3456422390 >> 172.21.15.173:0/3456422390 conn(0x557aa1c745b0 msgr2=0x557aa1d692d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa810487800 1 -- 172.21.15.173:0/3456422390 shutdown_connections 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.630+0000 7fa810487800 1 -- 172.21.15.173:0/3456422390 wait complete. 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.631+0000 7fa810487800 1 Processor -- start 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.631+0000 7fa810487800 1 -- start start 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.631+0000 7fa810487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d75430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.631+0000 7fa810487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557aa1c7a4a0 con 0x557aa1c789f0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.631+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d75430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.631+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d75430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51006/0 (socket says 172.21.15.173:51006) 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.631+0000 7fa80df86640 1 -- 172.21.15.173:0/2896610865 learned_addr learned my addr 172.21.15.173:0/2896610865 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.632+0000 7fa80df86640 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa1d75970 con 0x557aa1c789f0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.632+0000 7fa80df86640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d75430 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa80000a470 tx=0x7fa800003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.632+0000 7fa6fa604640 1 -- 172.21.15.173:0/2896610865 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800073070 con 0x557aa1c789f0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.632+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aa1d75c00 con 0x557aa1c789f0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.632+0000 7fa6fa604640 1 -- 172.21.15.173:0/2896610865 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80005d650 con 0x557aa1c789f0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.632+0000 7fa6fa604640 1 -- 172.21.15.173:0/2896610865 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800057070 con 0x557aa1c789f0 2024-05-15T18:10:45.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.632+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa1d78860 con 0x557aa1c789f0 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.633+0000 7fa6fa604640 1 -- 172.21.15.173:0/2896610865 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa800076070 con 0x557aa1c789f0 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.633+0000 7fa6fa604640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6f4036900 0x7fa6f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.633+0000 7fa6fa604640 1 -- 172.21.15.173:0/2896610865 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fa80008ded0 con 0x557aa1c789f0 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.633+0000 7fa805785640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6f4036900 0x7fa6f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.633+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1c79350 0x557aa1d7c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.633+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1d7cba0 con 0x557aa1c79350 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.633+0000 7fa80e787640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1c79350 0x557aa1d7c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.618 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa805785640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6f4036900 0x7fa6f4038dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000c00 tx=0x7fa7f80013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa80e787640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1c79350 0x557aa1d7c620 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa80e787640 1 -- 172.21.15.173:0/2896610865 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1c79350 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1d79bd0 con 0x557aa1c79350 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa80e787640 1 -- 172.21.15.173:0/2896610865 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1c79350 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1d7eea0 0x557aa1d81290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1d81960 con 0x557aa1d7eea0 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.634+0000 7fa80df86640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1d7eea0 0x557aa1d81290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.635+0000 7fa80df86640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1d7eea0 0x557aa1d81290 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.635+0000 7fa80df86640 1 -- 172.21.15.173:0/2896610865 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa800075030 con 0x557aa1d7eea0 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.635+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1d7de50 con 0x557aa1c79350 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.635+0000 7fa80e787640 1 -- 172.21.15.173:0/2896610865 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1c79350 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.635+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557aa1d82da0 0x557aa1d85260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.635+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1d859f0 con 0x557aa1d82da0 2024-05-15T18:10:45.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.636+0000 7fa805785640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557aa1d82da0 0x557aa1d85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.636+0000 7fa805785640 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557aa1d82da0 0x557aa1d85260 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.636+0000 7fa805785640 1 -- 172.21.15.173:0/2896610865 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7f800f670 con 0x557aa1d82da0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.636+0000 7fa810487800 1 Processor -- start 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa810487800 1 -- start start 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa810487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1d93ea0 0x557aa1d942c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa810487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557aa1b6bcf0 con 0x557aa1d93ea0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1d93ea0 0x557aa1d942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1d93ea0 0x557aa1d942c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51016/0 (socket says 172.21.15.173:51016) 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa80df86640 1 -- 172.21.15.173:0/3409944327 learned_addr learned my addr 172.21.15.173:0/3409944327 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa80df86640 1 -- 172.21.15.173:0/3409944327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa1d94800 con 0x557aa1d93ea0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa80df86640 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1d93ea0 0x557aa1d942c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa80008c390 tx=0x7fa80005ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.637+0000 7fa6f37fe640 1 -- 172.21.15.173:0/3409944327 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8000776f0 con 0x557aa1d93ea0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.638+0000 7fa6f37fe640 1 -- 172.21.15.173:0/3409944327 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80008a070 con 0x557aa1d93ea0 2024-05-15T18:10:45.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.638+0000 7fa6f37fe640 1 -- 172.21.15.173:0/3409944327 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80005d970 con 0x557aa1d93ea0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.638+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aa1d95270 con 0x557aa1d93ea0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.638+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa1d95770 con 0x557aa1d93ea0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.638+0000 7fa6f37fe640 1 -- 172.21.15.173:0/3409944327 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa80005db30 con 0x557aa1d93ea0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.638+0000 7fa6f37fe640 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6e8036900 0x7fa6e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.638+0000 7fa6f37fe640 1 -- 172.21.15.173:0/3409944327 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fa800094c50 con 0x557aa1d93ea0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa805785640 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6e8036900 0x7fa6e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa810487800 1 Processor -- start 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa810487800 1 -- start start 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa805785640 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6e8036900 0x7fa6e8038dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557aa1d7d040 tx=0x7fa7f8006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa810487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa810487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557aa1d6e240 con 0x557aa1da1030 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51028/0 (socket says 172.21.15.173:51028) 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa80df86640 1 -- 172.21.15.173:0/3919411417 learned_addr learned my addr 172.21.15.173:0/3919411417 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.639+0000 7fa80df86640 1 -- 172.21.15.173:0/3919411417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa1da1a20 con 0x557aa1da1030 2024-05-15T18:10:45.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa80df86640 1 --2- 172.21.15.173:0/3919411417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da1450 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa800077a20 tx=0x7fa80004bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28247deb46fc5367 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa6f17fa640 1 -- 172.21.15.173:0/3919411417 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa80006cd40 con 0x557aa1da1030 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa6f17fa640 1 -- 172.21.15.173:0/3919411417 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80006c300 con 0x557aa1da1030 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa6f17fa640 1 -- 172.21.15.173:0/3919411417 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800076880 con 0x557aa1da1030 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 -- 172.21.15.173:0/3919411417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 msgr2=0x557aa1da1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 --2- 172.21.15.173:0/3919411417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da1450 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa800077a20 tx=0x7fa80004bf40 comp rx=0 tx=0).stop 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 -- 172.21.15.173:0/3919411417 shutdown_connections 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 --2- 172.21.15.173:0/3919411417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da1450 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 -- 172.21.15.173:0/3919411417 >> 172.21.15.173:0/3919411417 conn(0x557aa1d9d340 msgr2=0x557aa1d9b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 -- 172.21.15.173:0/3919411417 shutdown_connections 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 -- 172.21.15.173:0/3919411417 wait complete. 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.640+0000 7fa810487800 1 Processor -- start 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa810487800 1 -- start start 2024-05-15T18:10:45.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa810487800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa810487800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557aa1da20b0 con 0x557aa1da1030 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa80df86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51042/0 (socket says 172.21.15.173:51042) 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 learned_addr learned my addr 172.21.15.173:0/1100229222 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa1da8920 con 0x557aa1da1030 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa80df86640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da83e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa800077a20 tx=0x7fa80007ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa6df7fe640 1 -- 172.21.15.173:0/1100229222 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8000b8070 con 0x557aa1da1030 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.641+0000 7fa6df7fe640 1 -- 172.21.15.173:0/1100229222 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa800086430 con 0x557aa1da1030 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.642+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557aa1da8920 con 0x557aa1da1030 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.642+0000 7fa6df7fe640 1 -- 172.21.15.173:0/1100229222 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa800086710 con 0x557aa1da1030 2024-05-15T18:10:45.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.642+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa1da8920 con 0x557aa1da1030 2024-05-15T18:10:45.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.642+0000 7fa6df7fe640 1 -- 172.21.15.173:0/1100229222 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa8000bb070 con 0x557aa1da1030 2024-05-15T18:10:45.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.642+0000 7fa6df7fe640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6d8036950 0x7fa6d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.642+0000 7fa6df7fe640 1 -- 172.21.15.173:0/1100229222 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fa8000a4070 con 0x557aa1da1030 2024-05-15T18:10:45.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.643+0000 7fa805785640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6d8036950 0x7fa6d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.643+0000 7fa805785640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6d8036950 0x7fa6d8038e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x557aa1d85df0 tx=0x7fa7f8023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.643+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.643+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1db3ad0 0x557aa1db5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.643+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db66e0 con 0x557aa1db3ad0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.643+0000 7fa80e787640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1db3ad0 0x557aa1db5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa80e787640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1db3ad0 0x557aa1db5f90 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 realm 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db6af0 con 0x557aa1db3ad0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db73c0 con 0x557aa1db3ad0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.644+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1db84c0 0x557aa1dba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbae70 con 0x557aa1db84c0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa80df86640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1db84c0 0x557aa1dba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa80df86640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1db84c0 0x557aa1dba8b0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa810487800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa810487800 20 searching for the correct realm 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbc7a0 con 0x557aa1db84c0 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa80df86640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa8000bd060 0x7fa8000a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.645+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbc7a0 con 0x7fa8000bd060 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.646+0000 7fa805785640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa8000bd060 0x7fa8000a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.646+0000 7fa805785640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa8000bd060 0x7fa8000a85d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.646+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.646+0000 7fa805785640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa7f803a3c0 0x7fa7f803a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.646+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbc7a0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.646+0000 7fa80e787640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa7f803a3c0 0x7fa7f803a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.647+0000 7fa80e787640 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa7f803a3c0 0x7fa7f803a7e0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.647+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa80800a4a0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.647+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.647+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.647+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.647+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.647+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa7f803a3c0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa7f803a3c0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa8000bd060 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.648+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa7f803a3c0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa8000bd060 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.649+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.650+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.650+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.650+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa7f803a3c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.650+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.650+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.650+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.650+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa80800a4a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa7f803a3c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa808033040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.651+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.652+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa8000bd060 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.652+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.652+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.652+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.652+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa7f803a3c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.652+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.652+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa7f803a3c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa8000bd060 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db84c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.653+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa8000bd060 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x557aa1db3ad0 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557aa1db7760 con 0x7fa8000bd060 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbb730 con 0x557aa1db3ad0 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.654+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbbb20 con 0x557aa1db3ad0 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbbb20 con 0x7fa7f803a3c0 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 zone default found 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 4 Realm: () 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:45.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 zonegroup default 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbb2d0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.655+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbe600 con 0x557aa1db84c0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa810487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbe9a0 con 0x557aa1db84c0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa810487800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa810487800 20 started sync module instance, tier type = 2024-05-15T18:10:45.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa810487800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.656+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbdaa0 con 0x7fa8000bd060 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.657+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.657+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93985189912208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbd700 con 0x7fa8000bd060 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.657+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbf6a0 con 0x557aa1db3ad0 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.658+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93985189912208] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.658+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.658+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93985189916448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbfa90 con 0x557aa1db3ad0 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.658+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc0490 con 0x557aa1db84c0 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.659+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93985189916448] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.660+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.660+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93985189917632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc08b0 con 0x557aa1db84c0 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.660+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc1310 con 0x7fa8000bd060 2024-05-15T18:10:45.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.661+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93985189917632] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.661+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.661+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93985189920672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc1bb0 con 0x7fa8000bd060 2024-05-15T18:10:45.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.661+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc2570 con 0x557aa1db3ad0 2024-05-15T18:10:45.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.662+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.662+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93985189929664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc2e10 con 0x557aa1db3ad0 2024-05-15T18:10:45.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.662+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc38e0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.662+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93985189920672] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.663+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93985189929664] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.663+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.663+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93985189934032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc29a0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.663+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc3f70 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.664+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93985189934032] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.664+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.664+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93985189926656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc3f70 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.664+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc47c0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93985189926656] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93985189936288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc4610 con 0x7fa7f803a3c0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 20 add_watcher() i=0 2024-05-15T18:10:45.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 20 add_watcher() i=1 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 20 add_watcher() i=2 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 20 add_watcher() i=3 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 20 add_watcher() i=4 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 20 add_watcher() i=5 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.665+0000 7fa810487800 20 add_watcher() i=6 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.666+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93985189936288] v31'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.666+0000 7fa810487800 20 add_watcher() i=7 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.666+0000 7fa810487800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.666+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc7b80 con 0x557aa1db3ad0 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.666+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.667+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93985189937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc5030 con 0x557aa1db3ad0 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.667+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93985189937344] v31'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa808031040 con 0x557aa1db3ad0 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa6bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 5 note: GC not initialized 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa6be7fc640 20 reqs_thread_entry: start 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 20 Filter name: none 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa62ffff640 20 reqs_thread_entry: start 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.668+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dfaff0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.669+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fa808031040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.669+0000 7fa810487800 20 rados_obj.operate() r=0 bl.length=460 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.669+0000 7fa810487800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.669+0000 7fa810487800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.669+0000 7fa810487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.669+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1e01370 con 0x7fa7f803a3c0 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v31'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa808042040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa810487800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa810487800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa810487800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93985190186464 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dffec0 con 0x557aa1db3ad0 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 93985189929664 notify 133143986204 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fa80801e040 con 0x557aa1db3ad0 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa6f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986204 cookie 93985189929664 notifier 4895 bl.length()=666 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa6f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa6f17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa6f17fa640 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa6d0003ea0 con 0x557aa1db3ad0 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.671+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 93985190186464 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa808042040 con 0x557aa1db3ad0 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.672+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808042040 con 0x557aa1db3ad0 2024-05-15T18:10:45.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.672+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 93985190186464 notify 133143986204 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa808018db0 con 0x557aa1db3ad0 2024-05-15T18:10:45.658 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:45.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.673+0000 7fa6bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.673+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93985189937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc7250 con 0x557aa1db3ad0 2024-05-15T18:10:45.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.674+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93985189937344] v31'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa808042040 con 0x557aa1db3ad0 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.674+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93985189912208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc40c0 con 0x7fa8000bd060 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.675+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93985189912208] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.675+0000 7fa810487800 20 remove_watcher() i=0 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.675+0000 7fa810487800 2 removed watcher, disabling cache 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.675+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93985189916448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbde90 con 0x557aa1db3ad0 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.676+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93985189916448] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808042040 con 0x557aa1db3ad0 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.676+0000 7fa810487800 20 remove_watcher() i=1 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.676+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93985189917632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbde90 con 0x557aa1db84c0 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.677+0000 7fa80df86640 1 -- 172.21.15.173:0/1100229222 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93985189917632] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa8000ba030 con 0x557aa1db84c0 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.677+0000 7fa810487800 20 remove_watcher() i=2 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.677+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93985189920672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbef20 con 0x7fa8000bd060 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.678+0000 7fa805785640 1 -- 172.21.15.173:0/1100229222 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93985189920672] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7f8037040 con 0x7fa8000bd060 2024-05-15T18:10:45.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.678+0000 7fa810487800 20 remove_watcher() i=3 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.678+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93985189929664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbffa0 con 0x557aa1db3ad0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.679+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93985189929664] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808042040 con 0x557aa1db3ad0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.679+0000 7fa810487800 20 remove_watcher() i=4 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.679+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93985189934032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dbffa0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.680+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93985189934032] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808042040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.680+0000 7fa810487800 20 remove_watcher() i=5 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.680+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93985189926656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc33d0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.682+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93985189926656] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808042040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.682+0000 7fa810487800 20 remove_watcher() i=6 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.682+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93985189936288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557aa1dc33d0 con 0x7fa7f803a3c0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93985189936288] v31'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa808042040 con 0x7fa7f803a3c0 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 20 remove_watcher() i=7 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa7f803a3c0 msgr2=0x7fa7f803a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fa7f803a3c0 0x7fa7f803a7e0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1db3ad0 msgr2=0x557aa1db5f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1db3ad0 0x557aa1db5f90 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa8000bd060 msgr2=0x7fa8000a85d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7fa8000bd060 0x7fa8000a85d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1db84c0 msgr2=0x557aa1dba8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1db84c0 0x557aa1dba8b0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6d8036950 msgr2=0x7fa6d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6d8036950 0x7fa6d8038e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x557aa1d85df0 tx=0x7fa7f8023040 comp rx=0 tx=0).stop 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 msgr2=0x557aa1da83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa80e787640 1 -- 172.21.15.173:0/1100229222 reap_dead start 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da83e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa800077a20 tx=0x7fa80007ff20 comp rx=0 tx=0).stop 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 shutdown_connections 2024-05-15T18:10:45.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/1100229222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1da1030 0x557aa1da83e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 >> 172.21.15.173:0/1100229222 conn(0x557aa1d9d340 msgr2=0x557aa1d9a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 shutdown_connections 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/1100229222 wait complete. 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6e8036900 msgr2=0x7fa6e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6e8036900 0x7fa6e8038dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557aa1d7d040 tx=0x7fa7f8006000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1d93ea0 msgr2=0x557aa1d942c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.683+0000 7fa810487800 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1d93ea0 0x557aa1d942c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa80008c390 tx=0x7fa80005ccc0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 shutdown_connections 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6e8036900 0x7fa6e8038dc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 --2- 172.21.15.173:0/3409944327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1d93ea0 0x557aa1d942c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 >> 172.21.15.173:0/3409944327 conn(0x557aa1d87f40 msgr2=0x557aa1d88340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 shutdown_connections 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/3409944327 wait complete. 2024-05-15T18:10:45.667 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557aa1d82da0 msgr2=0x557aa1d85260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x557aa1d82da0 0x557aa1d85260 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1c79350 msgr2=0x557aa1d7c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x557aa1c79350 0x557aa1d7c620 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1d7eea0 msgr2=0x557aa1d81290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x557aa1d7eea0 0x557aa1d81290 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6f4036900 msgr2=0x7fa6f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fa6f4036900 0x7fa6f4038dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000c00 tx=0x7fa7f80013b0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 msgr2=0x557aa1d75430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 --2- 172.21.15.173:0/2896610865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557aa1c789f0 0x557aa1d75430 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa80000a470 tx=0x7fa800003020 comp rx=0 tx=0).stop 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa80e787640 1 -- 172.21.15.173:0/2896610865 reap_dead start 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 shutdown_connections 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 >> 172.21.15.173:0/2896610865 conn(0x557aa1c745b0 msgr2=0x557aa1d67ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.668 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 shutdown_connections 2024-05-15T18:10:45.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.684+0000 7fa810487800 1 -- 172.21.15.173:0/2896610865 wait complete. 2024-05-15T18:10:45.670 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.670 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.670 ERROR:root:0 2024-05-15T18:10:45.670 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:45.675 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000049261cdd25cac082-006644faa5-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:10:45.675 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-15T18:10:45.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-15T18:10:45.675 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-05-15T18:10:45.722 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.722 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.746+0000 7f3ba0b33800 1 Processor -- start 2024-05-15T18:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.746+0000 7f3ba0b33800 1 -- start start 2024-05-15T18:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.746+0000 7f3ba0b33800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555598677a00 0x555598677e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.746+0000 7f3ba0b33800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555985ec1e0 con 0x555598678360 2024-05-15T18:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.746+0000 7f3ba0b33800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x55559850a050 con 0x555598677a00 2024-05-15T18:10:45.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.747+0000 7f3b9c7f5640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x555598677a00 0x555598677e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.747+0000 7f3b93fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x555598678360 0x555598678810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38708/0 (socket says 172.21.15.173:38708) 2024-05-15T18:10:45.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.747+0000 7f3b93fff640 1 -- 172.21.15.173:0/2280785527 learned_addr learned my addr 172.21.15.173:0/2280785527 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:45.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.747+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2280785527 >> v1:172.21.15.3:6789/0 conn(0x555598678360 legacy=0x555598678810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.747+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2280785527 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555598678f20 con 0x555598677a00 2024-05-15T18:10:45.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.749+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/2280785527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598677e20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00a470 tx=0x7f3b8c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f4bd7ad5b884fb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.749+0000 7f3b9bff4640 1 -- 172.21.15.173:0/2280785527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c057070 con 0x555598677a00 2024-05-15T18:10:45.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.749+0000 7f3b9bff4640 1 -- 172.21.15.173:0/2280785527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c04ac70 con 0x555598677a00 2024-05-15T18:10:45.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.749+0000 7f3b9bff4640 1 -- 172.21.15.173:0/2280785527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c052440 con 0x555598677a00 2024-05-15T18:10:45.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.750+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2280785527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 msgr2=0x555598677e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.750+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2280785527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598677e20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00a470 tx=0x7f3b8c01cce0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.750+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2280785527 shutdown_connections 2024-05-15T18:10:45.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.750+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2280785527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598677e20 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.750+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2280785527 >> 172.21.15.173:0/2280785527 conn(0x5555986735c0 msgr2=0x5555986759e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.750+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2280785527 shutdown_connections 2024-05-15T18:10:45.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.750+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2280785527 wait complete. 2024-05-15T18:10:45.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.763+0000 7f3ba0b33800 1 Processor -- start 2024-05-15T18:10:45.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.763+0000 7f3ba0b33800 1 -- start start 2024-05-15T18:10:45.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.764+0000 7f3ba0b33800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x55559876cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.764+0000 7f3ba0b33800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5555985c41c0 con 0x555598677a00 2024-05-15T18:10:45.740 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.764+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x55559876cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.764+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x55559876cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51060/0 (socket says 172.21.15.173:51060) 2024-05-15T18:10:45.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.764+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/1497582946 learned_addr learned my addr 172.21.15.173:0/1497582946 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.741 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.764+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/1497582946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55559876d1d0 con 0x555598677a00 2024-05-15T18:10:45.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.764+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/1497582946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x55559876cc00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c055040 tx=0x7f3b8c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5712eb5fd9ee9d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3a8a60c640 1 -- 172.21.15.173:0/1497582946 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c057040 con 0x555598677a00 2024-05-15T18:10:45.744 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3a8a60c640 1 -- 172.21.15.173:0/1497582946 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c063070 con 0x555598677a00 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3a8a60c640 1 -- 172.21.15.173:0/1497582946 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c0527e0 con 0x555598677a00 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1497582946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 msgr2=0x55559876cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1497582946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x55559876cc00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c055040 tx=0x7f3b8c04c000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1497582946 shutdown_connections 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1497582946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x55559876cc00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1497582946 >> 172.21.15.173:0/1497582946 conn(0x5555986735c0 msgr2=0x555598768520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1497582946 shutdown_connections 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.765+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1497582946 wait complete. 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3ba0b33800 1 Processor -- start 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3ba0b33800 1 -- start start 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3ba0b33800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598774650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3ba0b33800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5555986794b0 con 0x555598677a00 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598774650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.745 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598774650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51074/0 (socket says 172.21.15.173:51074) 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/1391763624 learned_addr learned my addr 172.21.15.173:0/1391763624 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.766+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555598774b90 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.767+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598774650 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c060040 tx=0x7f3b8c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.767+0000 7f3a88e09640 1 -- 172.21.15.173:0/1391763624 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c057050 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.767+0000 7f3a88e09640 1 -- 172.21.15.173:0/1391763624 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c052ce0 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.767+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555598774e20 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.767+0000 7f3a88e09640 1 -- 172.21.15.173:0/1391763624 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c05d470 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.767+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555598777ad0 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3a88e09640 1 -- 172.21.15.173:0/1391763624 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3b8c05d610 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3a88e09640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a84036950 0x7f3a84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3a88e09640 1 -- 172.21.15.173:0/1391763624 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3b8c08dba0 con 0x555598677a00 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3b93fff640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a84036950 0x7f3a84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.746 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555598678360 0x55559877b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55559877bdd0 con 0x555598678360 2024-05-15T18:10:45.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3b9cff6640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555598678360 0x55559877b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3b93fff640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a84036950 0x7f3a84038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400b340 tx=0x7f3b84001520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.747 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.768+0000 7f3b9cff6640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555598678360 0x55559877b890 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.769+0000 7f3b9cff6640 1 -- 172.21.15.173:0/1391763624 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9400a4a0 con 0x555598678360 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.769+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555598778e20 con 0x555598678360 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.769+0000 7f3b9cff6640 1 -- 172.21.15.173:0/1391763624 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b9400a4a0 con 0x555598678360 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.769+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55559877e0f0 0x5555987804e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.769+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555598780b80 con 0x55559877e0f0 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.769+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55559877e0f0 0x5555987804e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.769+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55559877e0f0 0x5555987804e0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.770+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/1391763624 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b8c078070 con 0x55559877e0f0 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.770+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55559877d0a0 con 0x555598678360 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.770+0000 7f3b9cff6640 1 -- 172.21.15.173:0/1391763624 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b9400a4a0 con 0x555598678360 2024-05-15T18:10:45.753 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.770+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555598781fc0 0x555598784450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.770+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x555598784be0 con 0x555598781fc0 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.770+0000 7f3b93fff640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555598781fc0 0x555598784450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.771+0000 7f3b93fff640 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555598781fc0 0x555598784450 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.771+0000 7f3b93fff640 1 -- 172.21.15.173:0/1391763624 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b8400f870 con 0x555598781fc0 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.771+0000 7f3ba0b33800 1 Processor -- start 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.771+0000 7f3ba0b33800 1 -- start start 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3ba0b33800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598793040 0x555598793460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3ba0b33800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55559856acf0 con 0x555598793040 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598793040 0x555598793460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598793040 0x555598793460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51084/0 (socket says 172.21.15.173:51084) 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2620334940 learned_addr learned my addr 172.21.15.173:0/2620334940 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2620334940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555987939a0 con 0x555598793040 2024-05-15T18:10:45.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598793040 0x555598793460 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00a470 tx=0x7f3b8c05c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3a81ffb640 1 -- 172.21.15.173:0/2620334940 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c076040 con 0x555598793040 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3a81ffb640 1 -- 172.21.15.173:0/2620334940 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c05ea30 con 0x555598793040 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555598794410 con 0x555598793040 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3a81ffb640 1 -- 172.21.15.173:0/2620334940 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c05ed50 con 0x555598793040 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.772+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555598794410 con 0x555598793040 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.773+0000 7f3a81ffb640 1 -- 172.21.15.173:0/2620334940 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3b8c084030 con 0x555598793040 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.773+0000 7f3a81ffb640 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a74036970 0x7f3a74038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.773+0000 7f3a81ffb640 1 -- 172.21.15.173:0/2620334940 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3b8c06a070 con 0x555598793040 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.773+0000 7f3b93fff640 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a74036970 0x7f3a74038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3ba0b33800 1 Processor -- start 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3ba0b33800 1 -- start start 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3b93fff640 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a74036970 0x7f3a74038e30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x555598778d80 tx=0x7f3b84006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3ba0b33800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3ba0b33800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55559876d490 con 0x5555987a0050 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51090/0 (socket says 172.21.15.173:51090) 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2713395470 learned_addr learned my addr 172.21.15.173:0/2713395470 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2713395470 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555987a0a40 con 0x5555987a0050 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.774+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/2713395470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a0470 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c06df70 tx=0x7f3b8c0653d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3a22f3c6b323d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3a7b7fe640 1 -- 172.21.15.173:0/2713395470 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c0654d0 con 0x5555987a0050 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3a7b7fe640 1 -- 172.21.15.173:0/2713395470 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c05b370 con 0x5555987a0050 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3a7b7fe640 1 -- 172.21.15.173:0/2713395470 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c07b3f0 con 0x5555987a0050 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2713395470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 msgr2=0x5555987a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2713395470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a0470 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c06df70 tx=0x7f3b8c0653d0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2713395470 shutdown_connections 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2713395470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a0470 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2713395470 >> 172.21.15.173:0/2713395470 conn(0x55559879c2d0 msgr2=0x55559879a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.756 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2713395470 shutdown_connections 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2713395470 wait complete. 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 Processor -- start 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.775+0000 7f3ba0b33800 1 -- start start 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3ba0b33800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3ba0b33800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5555987a10b0 con 0x5555987a0050 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3b9c7f5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51098/0 (socket says 172.21.15.173:51098) 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 learned_addr learned my addr 172.21.15.173:0/2330186520 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555987a78b0 con 0x5555987a0050 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a7370 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0872d0 tx=0x7f3b8c06df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3a79ffb640 1 -- 172.21.15.173:0/2330186520 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c07bd00 con 0x5555987a0050 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3a79ffb640 1 -- 172.21.15.173:0/2330186520 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8c0867f0 con 0x5555987a0050 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3a79ffb640 1 -- 172.21.15.173:0/2330186520 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c086ad0 con 0x5555987a0050 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555987a78b0 con 0x5555987a0050 2024-05-15T18:10:45.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.776+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555987a78b0 con 0x5555987a0050 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.777+0000 7f3a79ffb640 1 -- 172.21.15.173:0/2330186520 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3b8c065790 con 0x5555987a0050 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.777+0000 7f3a79ffb640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a6c036950 0x7f3a6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.777+0000 7f3a79ffb640 1 -- 172.21.15.173:0/2330186520 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3b8c0b0070 con 0x5555987a0050 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.777+0000 7f3b93fff640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a6c036950 0x7f3a6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.778+0000 7f3b93fff640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a6c036950 0x7f3a6c038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x555598784fe0 tx=0x7f3b84010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.778+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.778+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5555987b2af0 0x5555987b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.778+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987b5700 con 0x5555987b2af0 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.778+0000 7f3b9cff6640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5555987b2af0 0x5555987b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.778+0000 7f3b9cff6640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5555987b2af0 0x5555987b4fb0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 realm 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987b5b10 con 0x5555987b2af0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987b63e0 con 0x5555987b2af0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5555987b74e0 0x5555987b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987b9ee0 con 0x5555987b74e0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.779+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5555987b74e0 0x5555987b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5555987b74e0 0x5555987b98d0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3ba0b33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3ba0b33800 20 searching for the correct realm 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987bb7a0 con 0x5555987b74e0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3b9c7f5640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3b8c0b3030 0x7f3b8c0bc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987bb7a0 con 0x7f3b8c0b3030 2024-05-15T18:10:45.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.780+0000 7f3b93fff640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3b8c0b3030 0x7f3b8c0bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.781+0000 7f3b93fff640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3b8c0b3030 0x7f3b8c0bc440 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.781+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.781+0000 7f3b93fff640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3b8403a3c0 0x7f3b8403a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.781+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987bb7a0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.781+0000 7f3b9cff6640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3b8403a3c0 0x7f3b8403a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3b8403a3c0 0x7f3b8403a7f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b9400a4a0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8403a3c0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.782+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8403a3c0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8c0b3030 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.783+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8403a3c0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.784+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.784+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.784+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.784+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8c0b3030 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.784+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.784+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.784+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.785+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.785+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.785+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8403a3c0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.785+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.785+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.785+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.785+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b9400a4a0 con 0x5555987b2af0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8403a3c0 2024-05-15T18:10:45.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b94033040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.786+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8c0b3030 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8403a3c0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.787+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8403a3c0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8c0b3030 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b74e0 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.788+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8c0b3030 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x5555987b2af0 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5555987b6780 con 0x7f3b8c0b3030 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:45.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987ba730 con 0x5555987b2af0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.789+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987baad0 con 0x5555987b2af0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987baad0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:45.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 20 zone default found 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 4 Realm: () 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 20 zonegroup default 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.790+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987bbc20 con 0x7f3b8403a3c0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987bd600 con 0x5555987b74e0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987bd9a0 con 0x5555987b74e0 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 20 started sync module instance, tier type = 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.791+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987bcaa0 con 0x7f3b8c0b3030 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.792+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.792+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826118829552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987bdd40 con 0x7f3b8c0b3030 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.792+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987be700 con 0x5555987b2af0 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.793+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93826118829552] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.794+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.794+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826118836816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987beb20 con 0x5555987b2af0 2024-05-15T18:10:45.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.794+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987bf4e0 con 0x5555987b74e0 2024-05-15T18:10:45.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.795+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.795+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826118840368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987bfd80 con 0x5555987b74e0 2024-05-15T18:10:45.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.795+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c0860 con 0x7f3b8c0b3030 2024-05-15T18:10:45.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.795+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93826118836816] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.796+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93826118840368] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.796+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.796+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826118845296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c0c50 con 0x7f3b8c0b3030 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.796+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c1520 con 0x5555987b2af0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.797+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.797+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826118848496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c1dc0 con 0x5555987b2af0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.797+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c28a0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.797+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93826118845296] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.798+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93826118848496] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.798+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.798+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826118837872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c18c0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.798+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c3170 con 0x7f3b8403a3c0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.799+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93826118837872] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.799+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.799+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826118853552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c18c0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.799+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c3790 con 0x7f3b8403a3c0 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(58 notify.7 [create] v31'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93826118853552] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826118857440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c3bb0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 20 add_watcher() i=0 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 20 add_watcher() i=1 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 20 add_watcher() i=2 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 20 add_watcher() i=3 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 20 add_watcher() i=4 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 20 add_watcher() i=5 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.800+0000 7f3ba0b33800 20 add_watcher() i=6 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.801+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93826118857440] v31'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.801+0000 7f3ba0b33800 20 add_watcher() i=7 2024-05-15T18:10:45.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.801+0000 7f3ba0b33800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.801+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987c6fd0 con 0x5555987b2af0 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.802+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.802+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826118858496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c4450 con 0x5555987b2af0 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93826118858496] v31'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3a52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3ba0b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3ba0b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3ba0b33800 5 note: GC not initialized 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3a51fe3640 20 reqs_thread_entry: start 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3ba0b33800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3ba0b33800 20 Filter name: none 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.803+0000 7f3a4affd640 20 reqs_thread_entry: start 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:45.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987fa0c0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 20 rados_obj.operate() r=0 bl.length=490 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.804+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x555598800530 con 0x7f3b8403a3c0 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v31'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3ba0b33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3ba0b33800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3ba0b33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93826119106464 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5555987ff080 con 0x5555987b2af0 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 93826118848496 notify 133143986205 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f3b9401e040 con 0x5555987b2af0 2024-05-15T18:10:45.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3a7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986205 cookie 93826118848496 notifier 4902 bl.length()=636 2024-05-15T18:10:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3a7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3a7b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3a7b7fe640 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3a60003ea0 con 0x5555987b2af0 2024-05-15T18:10:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 93826119106464 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.806+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 93826119106464 notify 133143986205 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3b94018db0 con 0x5555987b2af0 2024-05-15T18:10:45.793 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.807+0000 7f3a52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.807+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826118858496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987fab60 con 0x5555987b2af0 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.808+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93826118858496] v31'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.808+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826118829552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c3700 con 0x7f3b8c0b3030 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.809+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93826118829552] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.809+0000 7f3ba0b33800 20 remove_watcher() i=0 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.809+0000 7f3ba0b33800 2 removed watcher, disabling cache 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.809+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826118836816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987bc5f0 con 0x5555987b2af0 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.810+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93826118836816] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.810+0000 7f3ba0b33800 20 remove_watcher() i=1 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.810+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826118840368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987be250 con 0x5555987b74e0 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.811+0000 7f3b9c7f5640 1 -- 172.21.15.173:0/2330186520 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93826118840368] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b8c0b9020 con 0x5555987b74e0 2024-05-15T18:10:45.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.811+0000 7f3ba0b33800 20 remove_watcher() i=2 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.811+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826118845296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987be250 con 0x7f3b8c0b3030 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.812+0000 7f3b93fff640 1 -- 172.21.15.173:0/2330186520 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93826118845296] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b84037040 con 0x7f3b8c0b3030 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.812+0000 7f3ba0b33800 20 remove_watcher() i=3 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.812+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826118848496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987be250 con 0x5555987b2af0 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.813+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93826118848496] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x5555987b2af0 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.813+0000 7f3ba0b33800 20 remove_watcher() i=4 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.813+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826118837872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987be250 con 0x7f3b8403a3c0 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.815+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93826118837872] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.815+0000 7f3ba0b33800 20 remove_watcher() i=5 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.815+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826118853552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c0370 con 0x7f3b8403a3c0 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.816+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93826118853552] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.816+0000 7f3ba0b33800 20 remove_watcher() i=6 2024-05-15T18:10:45.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.816+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826118857440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5555987c23b0 con 0x7f3b8403a3c0 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93826118857440] v31'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b94031040 con 0x7f3b8403a3c0 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 20 remove_watcher() i=7 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3b8403a3c0 msgr2=0x7f3b8403a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f3b8403a3c0 0x7f3b8403a7f0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5555987b2af0 msgr2=0x5555987b4fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5555987b2af0 0x5555987b4fb0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3b8c0b3030 msgr2=0x7f3b8c0bc440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3b8c0b3030 0x7f3b8c0bc440 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5555987b74e0 msgr2=0x5555987b98d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5555987b74e0 0x5555987b98d0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a6c036950 msgr2=0x7f3a6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a6c036950 0x7f3a6c038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x555598784fe0 tx=0x7f3b84010000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 msgr2=0x5555987a7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3b9cff6640 1 -- 172.21.15.173:0/2330186520 reap_dead start 2024-05-15T18:10:45.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a7370 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0872d0 tx=0x7f3b8c06df00 comp rx=0 tx=0).stop 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 shutdown_connections 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2330186520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5555987a0050 0x5555987a7370 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 >> 172.21.15.173:0/2330186520 conn(0x55559879c2d0 msgr2=0x555598799930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 shutdown_connections 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.817+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2330186520 wait complete. 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a74036970 msgr2=0x7f3a74038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a74036970 0x7f3a74038e30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x555598778d80 tx=0x7f3b84006000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598793040 msgr2=0x555598793460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598793040 0x555598793460 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00a470 tx=0x7f3b8c05c490 comp rx=0 tx=0).stop 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 shutdown_connections 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a74036970 0x7f3a74038e30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/2620334940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598793040 0x555598793460 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 >> 172.21.15.173:0/2620334940 conn(0x5555987870e0 msgr2=0x5555987874e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 shutdown_connections 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/2620334940 wait complete. 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555598781fc0 msgr2=0x555598784450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x555598781fc0 0x555598784450 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555598678360 msgr2=0x55559877b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x555598678360 0x55559877b890 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55559877e0f0 msgr2=0x5555987804e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x55559877e0f0 0x5555987804e0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a84036950 msgr2=0x7f3a84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3a84036950 0x7f3a84038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400b340 tx=0x7f3b84001520 comp rx=0 tx=0).stop 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 msgr2=0x555598774650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 --2- 172.21.15.173:0/1391763624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555598677a00 0x555598774650 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c060040 tx=0x7f3b8c002fb0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3b9cff6640 1 -- 172.21.15.173:0/1391763624 reap_dead start 2024-05-15T18:10:45.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 shutdown_connections 2024-05-15T18:10:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 >> 172.21.15.173:0/1391763624 conn(0x5555986735c0 msgr2=0x555598766d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 shutdown_connections 2024-05-15T18:10:45.804 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.818+0000 7f3ba0b33800 1 -- 172.21.15.173:0/1391763624 wait complete. 2024-05-15T18:10:45.805 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.805 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.805 ERROR:root:0 2024-05-15T18:10:45.805 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:45.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:45.805 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-15T18:10:45.851 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.851 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.875+0000 7f9947a10800 1 Processor -- start 2024-05-15T18:10:45.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.875+0000 7f9947a10800 1 -- start start 2024-05-15T18:10:45.852 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f9947a10800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562f4aa0bfe0 0x562f4aa0c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f9947a10800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f4aa0ca80 con 0x562f4aa0d240 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f9947a10800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x562f4a89e050 con 0x562f4aa0bfe0 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f99431b9640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x562f4aa0bfe0 0x562f4aa0c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f99429b8640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x562f4aa0d240 0x562f4aa0d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38724/0 (socket says 172.21.15.173:38724) 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f99429b8640 1 -- 172.21.15.173:0/2722695711 learned_addr learned my addr 172.21.15.173:0/2722695711 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f99431b9640 1 -- 172.21.15.173:0/2722695711 >> v1:172.21.15.3:6789/0 conn(0x562f4aa0d240 legacy=0x562f4aa0d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f99421b7640 1 -- 172.21.15.173:0/2722695711 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178108224 0 0) 0x562f4aa0ca80 con 0x562f4aa0d240 2024-05-15T18:10:45.853 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.876+0000 7f99431b9640 1 -- 172.21.15.173:0/2722695711 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4aa0de00 con 0x562f4aa0bfe0 2024-05-15T18:10:45.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.878+0000 7f99431b9640 1 --2- 172.21.15.173:0/2722695711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4aa0c400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f993400a470 tx=0x7f993401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d3efd1acfe3f5f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.878+0000 7f99421b7640 1 -- 172.21.15.173:0/2722695711 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934057070 con 0x562f4aa0bfe0 2024-05-15T18:10:45.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.878+0000 7f99421b7640 1 -- 172.21.15.173:0/2722695711 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993404adc0 con 0x562f4aa0bfe0 2024-05-15T18:10:45.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.878+0000 7f99421b7640 1 -- 172.21.15.173:0/2722695711 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934052590 con 0x562f4aa0bfe0 2024-05-15T18:10:45.855 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.879+0000 7f9947a10800 1 -- 172.21.15.173:0/2722695711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 msgr2=0x562f4aa0c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.879+0000 7f9947a10800 1 --2- 172.21.15.173:0/2722695711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4aa0c400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f993400a470 tx=0x7f993401ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:45.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.879+0000 7f9947a10800 1 -- 172.21.15.173:0/2722695711 shutdown_connections 2024-05-15T18:10:45.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.879+0000 7f9947a10800 1 --2- 172.21.15.173:0/2722695711 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4aa0c400 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.879+0000 7f9947a10800 1 -- 172.21.15.173:0/2722695711 >> 172.21.15.173:0/2722695711 conn(0x562f4aa075c0 msgr2=0x562f4aa099e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.879+0000 7f9947a10800 1 -- 172.21.15.173:0/2722695711 shutdown_connections 2024-05-15T18:10:45.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.879+0000 7f9947a10800 1 -- 172.21.15.173:0/2722695711 wait complete. 2024-05-15T18:10:45.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.892+0000 7f9947a10800 1 Processor -- start 2024-05-15T18:10:45.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.893+0000 7f9947a10800 1 -- start start 2024-05-15T18:10:45.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.893+0000 7f9947a10800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4a97fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.893+0000 7f9947a10800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f4a9581c0 con 0x562f4aa0bfe0 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.893+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4a97fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.893+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4a97fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51108/0 (socket says 172.21.15.173:51108) 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.893+0000 7f99431b9640 1 -- 172.21.15.173:0/1146887727 learned_addr learned my addr 172.21.15.173:0/1146887727 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.893+0000 7f99431b9640 1 -- 172.21.15.173:0/1146887727 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ab013e0 con 0x562f4aa0bfe0 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f99431b9640 1 --2- 172.21.15.173:0/1146887727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4a97fe50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9934055040 tx=0x7f993404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df2e0a9112c1e48 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f983160a640 1 -- 172.21.15.173:0/1146887727 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934057040 con 0x562f4aa0bfe0 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f983160a640 1 -- 172.21.15.173:0/1146887727 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934063070 con 0x562f4aa0bfe0 2024-05-15T18:10:45.871 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f983160a640 1 -- 172.21.15.173:0/1146887727 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993405d790 con 0x562f4aa0bfe0 2024-05-15T18:10:45.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f9947a10800 1 -- 172.21.15.173:0/1146887727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 msgr2=0x562f4a97fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f9947a10800 1 --2- 172.21.15.173:0/1146887727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4a97fe50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9934055040 tx=0x7f993404c000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f9947a10800 1 -- 172.21.15.173:0/1146887727 shutdown_connections 2024-05-15T18:10:45.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f9947a10800 1 --2- 172.21.15.173:0/1146887727 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4a97fe50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.875 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f9947a10800 1 -- 172.21.15.173:0/1146887727 >> 172.21.15.173:0/1146887727 conn(0x562f4aa075c0 msgr2=0x562f4aaf8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f9947a10800 1 -- 172.21.15.173:0/1146887727 shutdown_connections 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.894+0000 7f9947a10800 1 -- 172.21.15.173:0/1146887727 wait complete. 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f9947a10800 1 Processor -- start 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f9947a10800 1 -- start start 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f9947a10800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4ab060e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f9947a10800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f4aa15710 con 0x562f4aa0bfe0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4ab060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4ab060e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51124/0 (socket says 172.21.15.173:51124) 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f99431b9640 1 -- 172.21.15.173:0/460739061 learned_addr learned my addr 172.21.15.173:0/460739061 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.895+0000 7f99431b9640 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ab06620 con 0x562f4aa0bfe0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.896+0000 7f99431b9640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4ab060e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9934060040 tx=0x7f9934002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.896+0000 7f982fe07640 1 -- 172.21.15.173:0/460739061 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934057050 con 0x562f4aa0bfe0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.896+0000 7f982fe07640 1 -- 172.21.15.173:0/460739061 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993405dcd0 con 0x562f4aa0bfe0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.896+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f4ab068b0 con 0x562f4aa0bfe0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.896+0000 7f982fe07640 1 -- 172.21.15.173:0/460739061 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934052440 con 0x562f4aa0bfe0 2024-05-15T18:10:45.876 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.896+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4ab09560 con 0x562f4aa0bfe0 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f982fe07640 1 -- 172.21.15.173:0/460739061 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9934052650 con 0x562f4aa0bfe0 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f982fe07640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9828036900 0x7f9828038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f982fe07640 1 -- 172.21.15.173:0/460739061 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f993408dbe0 con 0x562f4aa0bfe0 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f99429b8640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9828036900 0x7f9828038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4aa0d240 0x562f4ab0d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab0d860 con 0x562f4aa0d240 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f99439ba640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4aa0d240 0x562f4ab0d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f99429b8640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9828036900 0x7f9828038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9938000c00 tx=0x7f99380013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.897+0000 7f99439ba640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4aa0d240 0x562f4ab0d320 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.898+0000 7f99439ba640 1 -- 172.21.15.173:0/460739061 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4aa0d240 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.898+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab0a8d0 con 0x562f4aa0d240 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.898+0000 7f99439ba640 1 -- 172.21.15.173:0/460739061 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4aa0d240 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.898+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab0fb50 0x562f4ab11f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.877 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.898+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab12610 con 0x562f4ab0fb50 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.898+0000 7f99431b9640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab0fb50 0x562f4ab11f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.898+0000 7f99431b9640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab0fb50 0x562f4ab11f40 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.899+0000 7f99431b9640 1 -- 172.21.15.173:0/460739061 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9934078070 con 0x562f4ab0fb50 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.899+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab0eb00 con 0x562f4aa0d240 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.899+0000 7f99439ba640 1 -- 172.21.15.173:0/460739061 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4aa0d240 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.899+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562f4ab13a50 0x562f4ab15f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.899+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab166a0 con 0x562f4ab13a50 2024-05-15T18:10:45.878 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.899+0000 7f99429b8640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562f4ab13a50 0x562f4ab15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.900+0000 7f99429b8640 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562f4ab13a50 0x562f4ab15f10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.900+0000 7f99429b8640 1 -- 172.21.15.173:0/460739061 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f993800f670 con 0x562f4ab13a50 2024-05-15T18:10:45.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.900+0000 7f9947a10800 1 Processor -- start 2024-05-15T18:10:45.891 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.900+0000 7f9947a10800 1 -- start start 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.900+0000 7f9947a10800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab24b50 0x562f4ab24f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.900+0000 7f9947a10800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f4a8fecf0 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab24b50 0x562f4ab24f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab24b50 0x562f4ab24f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51134/0 (socket says 172.21.15.173:51134) 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f99431b9640 1 -- 172.21.15.173:0/3987266088 learned_addr learned my addr 172.21.15.173:0/3987266088 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f99431b9640 1 -- 172.21.15.173:0/3987266088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ab254b0 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f99431b9640 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab24b50 0x562f4ab24f70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f993408c100 tx=0x7f9934066380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f982d602640 1 -- 172.21.15.173:0/3987266088 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934076040 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f982d602640 1 -- 172.21.15.173:0/3987266088 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993405bdc0 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f4ab25f20 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f982d602640 1 -- 172.21.15.173:0/3987266088 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993405ea50 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.901+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4ab26420 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.902+0000 7f982d602640 1 -- 172.21.15.173:0/3987266088 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9934084030 con 0x562f4ab24b50 2024-05-15T18:10:45.892 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.902+0000 7f982d602640 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f981c036900 0x7f981c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.902+0000 7f982d602640 1 -- 172.21.15.173:0/3987266088 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f993406a070 con 0x562f4ab24b50 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.902+0000 7f99429b8640 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f981c036900 0x7f981c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.902+0000 7f9947a10800 1 Processor -- start 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f9947a10800 1 -- start start 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f99429b8640 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f981c036900 0x7f981c038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x562f4ab0dcf0 tx=0x7f9938006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f9947a10800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab33f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f9947a10800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f4ab01670 con 0x562f4ab33b40 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab33f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab33f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51144/0 (socket says 172.21.15.173:51144) 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f99431b9640 1 -- 172.21.15.173:0/3276379628 learned_addr learned my addr 172.21.15.173:0/3276379628 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f99431b9640 1 -- 172.21.15.173:0/3276379628 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ab34530 con 0x562f4ab33b40 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f99431b9640 1 --2- 172.21.15.173:0/3276379628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab33f60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9934074ff0 tx=0x7f993408d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb19a18b9316d81d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.903+0000 7f9826ffd640 1 -- 172.21.15.173:0/3276379628 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99340a8070 con 0x562f4ab33b40 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9826ffd640 1 -- 172.21.15.173:0/3276379628 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99340517a0 con 0x562f4ab33b40 2024-05-15T18:10:45.893 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9826ffd640 1 -- 172.21.15.173:0/3276379628 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934051cc0 con 0x562f4ab33b40 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 -- 172.21.15.173:0/3276379628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 msgr2=0x562f4ab33f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 --2- 172.21.15.173:0/3276379628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab33f60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9934074ff0 tx=0x7f993408d380 comp rx=0 tx=0).stop 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 -- 172.21.15.173:0/3276379628 shutdown_connections 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 --2- 172.21.15.173:0/3276379628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab33f60 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 -- 172.21.15.173:0/3276379628 >> 172.21.15.173:0/3276379628 conn(0x562f4aafd420 msgr2=0x562f4aafd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 -- 172.21.15.173:0/3276379628 shutdown_connections 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 -- 172.21.15.173:0/3276379628 wait complete. 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 Processor -- start 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 -- start start 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab3b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.904+0000 7f9947a10800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f4ab34f60 con 0x562f4ab33b40 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f99431b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab3b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51152/0 (socket says 172.21.15.173:51152) 2024-05-15T18:10:45.894 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 learned_addr learned my addr 172.21.15.173:0/2440667927 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4ab3b7a0 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f99431b9640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab3b260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9934074ff0 tx=0x7f9934061f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f98257fa640 1 -- 172.21.15.173:0/2440667927 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99340b3020 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f98257fa640 1 -- 172.21.15.173:0/2440667927 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993407bb00 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f4ab3b7a0 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f98257fa640 1 -- 172.21.15.173:0/2440667927 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99340a8040 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.905+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4ab3b7a0 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.906+0000 7f98257fa640 1 -- 172.21.15.173:0/2440667927 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f99340b6020 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.906+0000 7f98257fa640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f980c036950 0x7f980c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.906+0000 7f98257fa640 1 -- 172.21.15.173:0/2440667927 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f99340a0070 con 0x562f4ab33b40 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.906+0000 7f99429b8640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f980c036950 0x7f980c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.907+0000 7f99429b8640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f980c036950 0x7f980c038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x562f4ab16aa0 tx=0x7f9938023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.907+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.907+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4ab46980 0x562f4ab48e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.907+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab49590 con 0x562f4ab46980 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.907+0000 7f99439ba640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4ab46980 0x562f4ab48e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.907+0000 7f99439ba640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4ab46980 0x562f4ab48e40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 realm 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab499a0 con 0x562f4ab46980 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a270 con 0x562f4ab46980 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.896 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab4b370 0x562f4ab4d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.908+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4dd20 con 0x562f4ab4b370 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f99431b9640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab4b370 0x562f4ab4d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f99431b9640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab4b370 0x562f4ab4d760 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f9947a10800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f9947a10800 20 searching for the correct realm 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4f650 con 0x562f4ab4b370 2024-05-15T18:10:45.897 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f99431b9640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f99340b8020 0x7f99340af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.909+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4f650 con 0x7f99340b8020 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.910+0000 7f99429b8640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f99340b8020 0x7f99340af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.910+0000 7f99429b8640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f99340b8020 0x7f99340af640 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.910+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.910+0000 7f99429b8640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f993803a3c0 0x7f993803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.910+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4f650 con 0x7f993803a3c0 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.910+0000 7f99439ba640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f993803a3c0 0x7f993803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.911+0000 7f99439ba640 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f993803a3c0 0x7f993803a810 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.911+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f993c00a4a0 con 0x7f993803a3c0 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.911+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.911+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.898 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.911+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.911+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.911+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f993803a3c0 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x7f993803a3c0 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f993803a3c0 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x7f993803a3c0 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f99340b8020 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.912+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f993803a3c0 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x7f993803a3c0 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.899 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f99340b8020 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.913+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f993803a3c0 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x7f993803a3c0 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.900 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.914+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f993c00a4a0 con 0x562f4ab46980 2024-05-15T18:10:45.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f993803a3c0 2024-05-15T18:10:45.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c033040 con 0x7f993803a3c0 2024-05-15T18:10:45.901 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.915+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f99340b8020 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f993803a3c0 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.916+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f993803a3c0 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.912 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f99340b8020 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab4b370 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f99340b8020 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.917+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x562f4ab46980 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4a610 con 0x7f99340b8020 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:45.913 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4e5e0 con 0x562f4ab46980 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4e9d0 con 0x562f4ab46980 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.918+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4e9d0 con 0x7f993803a3c0 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:45.914 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 zone default found 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 4 Realm: () 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 zonegroup default 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab4e160 con 0x7f993803a3c0 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab514b0 con 0x562f4ab4b370 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.915 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.919+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab51850 con 0x562f4ab4b370 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.920+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.920+0000 7f9947a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.920+0000 7f9947a10800 20 started sync module instance, tier type = 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.920+0000 7f9947a10800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.920+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab50950 con 0x7f99340b8020 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.921+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.921+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94761116828832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab51bf0 con 0x7f99340b8020 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.921+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab524a0 con 0x562f4ab46980 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.922+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94761116828832] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.922+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.922+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94761116835728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab52890 con 0x562f4ab46980 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.922+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab53310 con 0x562f4ab4b370 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.923+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94761116835728] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.923+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.916 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.923+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94761116839424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab532d0 con 0x562f4ab4b370 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.923+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab53d70 con 0x7f99340b8020 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.924+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94761116839424] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.925+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.925+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94761116842144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab54110 con 0x7f99340b8020 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.925+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab54bb0 con 0x562f4ab46980 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.926+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.926+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94761116845696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab55450 con 0x562f4ab46980 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.926+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab55f30 con 0x7f993803a3c0 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.926+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94761116842144] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.927+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94761116845696] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.927+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.927+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94761116831040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab54f50 con 0x7f993803a3c0 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.927+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab56800 con 0x7f993803a3c0 2024-05-15T18:10:45.917 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.928+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94761116831040] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.928+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.928+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94761116850752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab54f50 con 0x7f993803a3c0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.928+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab56e20 con 0x7f993803a3c0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94761116850752] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94761116852864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab56e20 con 0x7f993803a3c0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 20 add_watcher() i=0 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 20 add_watcher() i=1 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 20 add_watcher() i=2 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 20 add_watcher() i=3 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 20 add_watcher() i=4 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 20 add_watcher() i=5 2024-05-15T18:10:45.918 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.929+0000 7f9947a10800 20 add_watcher() i=6 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.930+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94761116852864] v31'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.930+0000 7f9947a10800 20 add_watcher() i=7 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.930+0000 7f9947a10800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.930+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab5a280 con 0x562f4ab46980 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.930+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.930+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94761116855216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab57710 con 0x562f4ab46980 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.931+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94761116855216] v31'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993c031040 con 0x562f4ab46980 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f97f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 5 note: GC not initialized 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f97f8fe1640 20 reqs_thread_entry: start 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:45.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 20 Filter name: none 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f97727fc640 20 reqs_thread_entry: start 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 20 rados->read ofs=0 len=0 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.932+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab8d720 con 0x7f993803a3c0 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.933+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f993c031040 con 0x7f993803a3c0 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.933+0000 7f9947a10800 20 rados_obj.operate() r=0 bl.length=460 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.933+0000 7f9947a10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.933+0000 7f9947a10800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.933+0000 7f9947a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.933+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab93a60 con 0x7f993803a3c0 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v31'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f993c042040 con 0x7f993803a3c0 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9947a10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9947a10800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9947a10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:45.920 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94761117103312 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab925f0 con 0x562f4ab46980 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 94761116845696 notify 133143986206 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f993c01e040 con 0x562f4ab46980 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9826ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986206 cookie 94761116845696 notifier 4909 bl.length()=649 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 94761117103312 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f993c042040 con 0x562f4ab46980 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9826ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9826ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.934+0000 7f9826ffd640 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9808003ea0 con 0x562f4ab46980 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.935+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c042040 con 0x562f4ab46980 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.935+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 94761117103312 notify 133143986206 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f993c018db0 con 0x562f4ab46980 2024-05-15T18:10:45.921 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.936+0000 7f97f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.936+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94761116855216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab92db0 con 0x562f4ab46980 2024-05-15T18:10:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.936+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94761116855216] v31'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993c042040 con 0x562f4ab46980 2024-05-15T18:10:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.937+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94761116828832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab92db0 con 0x7f99340b8020 2024-05-15T18:10:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.938+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94761116828832] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.938+0000 7f9947a10800 20 remove_watcher() i=0 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.938+0000 7f9947a10800 2 removed watcher, disabling cache 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.938+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94761116835728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab504a0 con 0x562f4ab46980 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.939+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94761116835728] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c042040 con 0x562f4ab46980 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.939+0000 7f9947a10800 20 remove_watcher() i=1 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.939+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94761116839424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab51f90 con 0x562f4ab4b370 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.940+0000 7f99431b9640 1 -- 172.21.15.173:0/2440667927 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94761116839424] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99340ab040 con 0x562f4ab4b370 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.940+0000 7f9947a10800 20 remove_watcher() i=2 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.940+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94761116842144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab51f90 con 0x7f99340b8020 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.941+0000 7f99429b8640 1 -- 172.21.15.173:0/2440667927 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94761116842144] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9938037040 con 0x7f99340b8020 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.941+0000 7f9947a10800 20 remove_watcher() i=3 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.941+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94761116845696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab51f90 con 0x562f4ab46980 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.942+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94761116845696] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c042040 con 0x562f4ab46980 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.942+0000 7f9947a10800 20 remove_watcher() i=4 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.942+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94761116831040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab51f90 con 0x7f993803a3c0 2024-05-15T18:10:45.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.943+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94761116831040] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c042040 con 0x7f993803a3c0 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.943+0000 7f9947a10800 20 remove_watcher() i=5 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.943+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94761116850752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab50d40 con 0x7f993803a3c0 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.944+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94761116850752] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c042040 con 0x7f993803a3c0 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.944+0000 7f9947a10800 20 remove_watcher() i=6 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.944+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94761116852864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562f4ab51f90 con 0x7f993803a3c0 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94761116852864] v31'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c042040 con 0x7f993803a3c0 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 20 remove_watcher() i=7 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f993803a3c0 msgr2=0x7f993803a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f993803a3c0 0x7f993803a810 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4ab46980 msgr2=0x562f4ab48e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4ab46980 0x562f4ab48e40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f99340b8020 msgr2=0x7f99340af640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f99340b8020 0x7f99340af640 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab4b370 msgr2=0x562f4ab4d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab4b370 0x562f4ab4d760 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f980c036950 msgr2=0x7f980c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.945+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f980c036950 0x7f980c038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x562f4ab16aa0 tx=0x7f9938023040 comp rx=0 tx=0).stop 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 msgr2=0x562f4ab3b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab3b260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9934074ff0 tx=0x7f9934061f90 comp rx=0 tx=0).stop 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f99439ba640 1 -- 172.21.15.173:0/2440667927 reap_dead start 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 shutdown_connections 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/2440667927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab33b40 0x562f4ab3b260 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 >> 172.21.15.173:0/2440667927 conn(0x562f4aafd420 msgr2=0x562f4ab2b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 shutdown_connections 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/2440667927 wait complete. 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f981c036900 msgr2=0x7f981c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.930 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f981c036900 0x7f981c038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x562f4ab0dcf0 tx=0x7f9938006000 comp rx=0 tx=0).stop 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab24b50 msgr2=0x562f4ab24f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab24b50 0x562f4ab24f70 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f993408c100 tx=0x7f9934066380 comp rx=0 tx=0).stop 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 shutdown_connections 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f981c036900 0x7f981c038dc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/3987266088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4ab24b50 0x562f4ab24f70 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 >> 172.21.15.173:0/3987266088 conn(0x562f4ab18bf0 msgr2=0x562f4ab18ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 shutdown_connections 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/3987266088 wait complete. 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562f4ab13a50 msgr2=0x562f4ab15f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x562f4ab13a50 0x562f4ab15f10 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4aa0d240 msgr2=0x562f4ab0d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x562f4aa0d240 0x562f4ab0d320 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab0fb50 msgr2=0x562f4ab11f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.931 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x562f4ab0fb50 0x562f4ab11f40 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9828036900 msgr2=0x7f9828038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.946+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9828036900 0x7f9828038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9938000c00 tx=0x7f99380013b0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.947+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 msgr2=0x562f4ab060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.947+0000 7f9947a10800 1 --2- 172.21.15.173:0/460739061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f4aa0bfe0 0x562f4ab060e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9934060040 tx=0x7f9934002fb0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.947+0000 7f99439ba640 1 -- 172.21.15.173:0/460739061 reap_dead start 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.947+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 shutdown_connections 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.947+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 >> 172.21.15.173:0/460739061 conn(0x562f4aa075c0 msgr2=0x562f4aaf76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.947+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 shutdown_connections 2024-05-15T18:10:45.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:45.947+0000 7f9947a10800 1 -- 172.21.15.173:0/460739061 wait complete. 2024-05-15T18:10:45.933 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.933 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:45.933 ERROR:root:0 2024-05-15T18:10:45.934 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:45.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-15T18:10:45.934 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-15T18:10:45.980 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:10:45.980 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f367d016800 1 Processor -- start 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f367d016800 1 -- start start 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f367d016800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5646012ea3a0 0x5646012ea7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f367d016800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646012eae40 con 0x5646012ed3e0 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f367d016800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56460117d050 con 0x5646012ea3a0 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f3678684640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5646012ea3a0 0x5646012ea7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f366ffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x5646012ed3e0 0x5646012ed860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:38740/0 (socket says 172.21.15.173:38740) 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.005+0000 7f366ffff640 1 -- 172.21.15.173:0/3528251880 learned_addr learned my addr 172.21.15.173:0/3528251880 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.006+0000 7f3678684640 1 -- 172.21.15.173:0/3528251880 >> v1:172.21.15.3:6789/0 conn(0x5646012ed3e0 legacy=0x5646012ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.006+0000 7f3677e83640 1 -- 172.21.15.173:0/3528251880 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380091803 0 0) 0x5646012eae40 con 0x5646012ed3e0 2024-05-15T18:10:45.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.006+0000 7f3678684640 1 -- 172.21.15.173:0/3528251880 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646012edf70 con 0x5646012ea3a0 2024-05-15T18:10:45.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.007+0000 7f3678684640 1 --2- 172.21.15.173:0/3528251880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646012ea7c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f366800a470 tx=0x7f366801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a04ae11aa6e4604 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:45.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f3677e83640 1 -- 172.21.15.173:0/3528251880 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3668057070 con 0x5646012ea3a0 2024-05-15T18:10:45.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f3677e83640 1 -- 172.21.15.173:0/3528251880 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366804adc0 con 0x5646012ea3a0 2024-05-15T18:10:45.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f3677e83640 1 -- 172.21.15.173:0/3528251880 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3668052590 con 0x5646012ea3a0 2024-05-15T18:10:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f367d016800 1 -- 172.21.15.173:0/3528251880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 msgr2=0x5646012ea7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f367d016800 1 --2- 172.21.15.173:0/3528251880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646012ea7c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f366800a470 tx=0x7f366801ce90 comp rx=0 tx=0).stop 2024-05-15T18:10:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f367d016800 1 -- 172.21.15.173:0/3528251880 shutdown_connections 2024-05-15T18:10:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f367d016800 1 --2- 172.21.15.173:0/3528251880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646012ea7c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f367d016800 1 -- 172.21.15.173:0/3528251880 >> 172.21.15.173:0/3528251880 conn(0x5646012e5d40 msgr2=0x5646012e8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f367d016800 1 -- 172.21.15.173:0/3528251880 shutdown_connections 2024-05-15T18:10:45.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.008+0000 7f367d016800 1 -- 172.21.15.173:0/3528251880 wait complete. 2024-05-15T18:10:45.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.022+0000 7f367d016800 1 Processor -- start 2024-05-15T18:10:45.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.022+0000 7f367d016800 1 -- start start 2024-05-15T18:10:45.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.022+0000 7f367d016800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013dd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:45.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.022+0000 7f367d016800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5646012371c0 con 0x5646012ea3a0 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.022+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013dd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.022+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013dd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51174/0 (socket says 172.21.15.173:51174) 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.022+0000 7f3678684640 1 -- 172.21.15.173:0/3876828538 learned_addr learned my addr 172.21.15.173:0/3876828538 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.023+0000 7f3678684640 1 -- 172.21.15.173:0/3876828538 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646013ddc80 con 0x5646012ea3a0 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.023+0000 7f3678684640 1 --2- 172.21.15.173:0/3876828538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013dd6b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3668055040 tx=0x7f366804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a4e4ebb0d1503 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.023+0000 7f356660c640 1 -- 172.21.15.173:0/3876828538 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3668057040 con 0x5646012ea3a0 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.023+0000 7f356660c640 1 -- 172.21.15.173:0/3876828538 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3668063070 con 0x5646012ea3a0 2024-05-15T18:10:46.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.023+0000 7f356660c640 1 -- 172.21.15.173:0/3876828538 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366805d790 con 0x5646012ea3a0 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 -- 172.21.15.173:0/3876828538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 msgr2=0x5646013dd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 --2- 172.21.15.173:0/3876828538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013dd6b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3668055040 tx=0x7f366804c000 comp rx=0 tx=0).stop 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 -- 172.21.15.173:0/3876828538 shutdown_connections 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 --2- 172.21.15.173:0/3876828538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013dd6b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 -- 172.21.15.173:0/3876828538 >> 172.21.15.173:0/3876828538 conn(0x5646012e5d40 msgr2=0x5646013d8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 -- 172.21.15.173:0/3876828538 shutdown_connections 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 -- 172.21.15.173:0/3876828538 wait complete. 2024-05-15T18:10:46.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 Processor -- start 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 -- start start 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.024+0000 7f367d016800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5646012f5880 con 0x5646012ea3a0 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013e50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51184/0 (socket says 172.21.15.173:51184) 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3678684640 1 -- 172.21.15.173:0/1037504663 learned_addr learned my addr 172.21.15.173:0/1037504663 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3678684640 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646013e5610 con 0x5646012ea3a0 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3678684640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013e50d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3668060040 tx=0x7f3668002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3564e09640 1 -- 172.21.15.173:0/1037504663 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3668057050 con 0x5646012ea3a0 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3564e09640 1 -- 172.21.15.173:0/1037504663 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366805dcd0 con 0x5646012ea3a0 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646013e58a0 con 0x5646012ea3a0 2024-05-15T18:10:46.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f3564e09640 1 -- 172.21.15.173:0/1037504663 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3668052440 con 0x5646012ea3a0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.025+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646013e8550 con 0x5646012ea3a0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.026+0000 7f3564e09640 1 -- 172.21.15.173:0/1037504663 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3668052650 con 0x5646012ea3a0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.026+0000 7f3564e09640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3560036900 0x7f3560038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.026+0000 7f3564e09640 1 -- 172.21.15.173:0/1037504663 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f366808dc60 con 0x5646012ea3a0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.026+0000 7f366ffff640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3560036900 0x7f3560038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.026+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5646012ed3e0 0x5646013ec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.026+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5646013ec890 con 0x5646012ed3e0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.027+0000 7f3678e85640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5646012ed3e0 0x5646013ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.027+0000 7f366ffff640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3560036900 0x7f3560038dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3660000c00 tx=0x7f36600013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.027+0000 7f3678e85640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5646012ed3e0 0x5646013ec310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.027+0000 7f3678e85640 1 -- 172.21.15.173:0/1037504663 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x5646012ed3e0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.027+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5646013e98c0 con 0x5646012ed3e0 2024-05-15T18:10:46.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f3678e85640 1 -- 172.21.15.173:0/1037504663 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f367000a4a0 con 0x5646012ed3e0 2024-05-15T18:10:46.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5646013eebb0 0x5646013f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5646013f1640 con 0x5646013eebb0 2024-05-15T18:10:46.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f3678684640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5646013eebb0 0x5646013f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.007 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f3678684640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5646013eebb0 0x5646013f0fa0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f3678684640 1 -- 172.21.15.173:0/1037504663 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3668078070 con 0x5646013eebb0 2024-05-15T18:10:46.027 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5646013edb60 con 0x5646012ed3e0 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f3678e85640 1 -- 172.21.15.173:0/1037504663 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f367000a4a0 con 0x5646012ed3e0 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5646013f2af0 0x5646013f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.028+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5646013f56a0 con 0x5646013f2af0 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.029+0000 7f366ffff640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5646013f2af0 0x5646013f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.029+0000 7f366ffff640 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5646013f2af0 0x5646013f4f40 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.029+0000 7f366ffff640 1 -- 172.21.15.173:0/1037504663 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f366000f670 con 0x5646013f2af0 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f367d016800 1 Processor -- start 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f367d016800 1 -- start start 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f367d016800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601403b00 0x564601403f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f367d016800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5646011ddcf0 con 0x564601403b00 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601403b00 0x564601403f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.028 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601403b00 0x564601403f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51198/0 (socket says 172.21.15.173:51198) 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f3678684640 1 -- 172.21.15.173:0/3406961042 learned_addr learned my addr 172.21.15.173:0/3406961042 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f3678684640 1 -- 172.21.15.173:0/3406961042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564601404460 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.030+0000 7f3678684640 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601403b00 0x564601403f20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f366805ce80 tx=0x7f3668066f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.031+0000 7f355dffb640 1 -- 172.21.15.173:0/3406961042 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3668076040 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.031+0000 7f355dffb640 1 -- 172.21.15.173:0/3406961042 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366805bbb0 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.031+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564601404ed0 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.031+0000 7f355dffb640 1 -- 172.21.15.173:0/3406961042 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366805e900 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.031+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564601404ed0 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.031+0000 7f355dffb640 1 -- 172.21.15.173:0/3406961042 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f366805eaa0 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f355dffb640 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3550036950 0x7f3550038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f355dffb640 1 -- 172.21.15.173:0/3406961042 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f366806a070 con 0x564601403b00 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f366ffff640 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3550036950 0x7f3550038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f367d016800 1 Processor -- start 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f367d016800 1 -- start start 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f366ffff640 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3550036950 0x7f3550038e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5646013e9800 tx=0x7f3660006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f367d016800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601410f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f367d016800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5646013ddf40 con 0x564601410b00 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601410f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601410f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51208/0 (socket says 172.21.15.173:51208) 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.032+0000 7f3678684640 1 -- 172.21.15.173:0/1624895600 learned_addr learned my addr 172.21.15.173:0/1624895600 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f3678684640 1 -- 172.21.15.173:0/1624895600 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646014114f0 con 0x564601410b00 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f3678684640 1 --2- 172.21.15.173:0/1624895600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601410f20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3668071730 tx=0x7f3668071870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9975284b4fb0712 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f35577fe640 1 -- 172.21.15.173:0/1624895600 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36680a0070 con 0x564601410b00 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f35577fe640 1 -- 172.21.15.173:0/1624895600 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366805b370 con 0x564601410b00 2024-05-15T18:10:46.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f35577fe640 1 -- 172.21.15.173:0/1624895600 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366804dad0 con 0x564601410b00 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f367d016800 1 -- 172.21.15.173:0/1624895600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 msgr2=0x564601410f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f367d016800 1 --2- 172.21.15.173:0/1624895600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601410f20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3668071730 tx=0x7f3668071870 comp rx=0 tx=0).stop 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f367d016800 1 -- 172.21.15.173:0/1624895600 shutdown_connections 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f367d016800 1 --2- 172.21.15.173:0/1624895600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601410f20 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f367d016800 1 -- 172.21.15.173:0/1624895600 >> 172.21.15.173:0/1624895600 conn(0x56460140ce10 msgr2=0x56460140ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f367d016800 1 -- 172.21.15.173:0/1624895600 shutdown_connections 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.033+0000 7f367d016800 1 -- 172.21.15.173:0/1624895600 wait complete. 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f367d016800 1 Processor -- start 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f367d016800 1 -- start start 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f367d016800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601417f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f367d016800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564601411b80 con 0x564601410b00 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601417f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f3678684640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601417f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51220/0 (socket says 172.21.15.173:51220) 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 learned_addr learned my addr 172.21.15.173:0/224360224 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564601418440 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.034+0000 7f3678684640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601417f00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3668086d70 tx=0x7f3668063eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.035+0000 7f3555ffb640 1 -- 172.21.15.173:0/224360224 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36680aa070 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.035+0000 7f3555ffb640 1 -- 172.21.15.173:0/224360224 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3668051a10 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.035+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564601418440 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.035+0000 7f3555ffb640 1 -- 172.21.15.173:0/224360224 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3668051cf0 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.035+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564601418440 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.035+0000 7f3555ffb640 1 -- 172.21.15.173:0/224360224 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f366804d160 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f3555ffb640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3548036950 0x7f3548038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f3555ffb640 1 -- 172.21.15.173:0/224360224 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3668056170 con 0x564601410b00 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f366ffff640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3548036950 0x7f3548038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f366ffff640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3548036950 0x7f3548038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5646013f5aa0 tx=0x7f3660023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564601423600 0x564601425ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564601426210 con 0x564601423600 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.036+0000 7f3678e85640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564601423600 0x564601425ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f3678e85640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564601423600 0x564601425ac0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 20 realm 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564601426620 con 0x564601423600 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:46.033 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564601426ef0 con 0x564601423600 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.037+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f367d016800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564601427ff0 0x56460142a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460142a9f0 con 0x564601427ff0 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f3678684640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564601427ff0 0x56460142a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.034 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f3678684640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564601427ff0 0x56460142a3e0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f367d016800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f367d016800 20 searching for the correct realm 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.038+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56460142c340 con 0x564601427ff0 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f3678684640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3668085070 0x7f3668086460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56460142c340 con 0x7f3668085070 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f366ffff640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3668085070 0x7f3668086460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f366ffff640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3668085070 0x7f3668086460 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f366ffff640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f366003a3c0 0x7f366003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.039+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56460142c340 con 0x7f366003a3c0 2024-05-15T18:10:46.035 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.040+0000 7f3678e85640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f366003a3c0 0x7f366003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.040+0000 7f3678e85640 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f366003a3c0 0x7f366003a810 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.040+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.040+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.040+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.040+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f366003a3c0 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f366003a3c0 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f3668085070 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.041+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f366003a3c0 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.042+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f3668085070 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f366003a3c0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.043+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.044+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f366003a3c0 2024-05-15T18:10:46.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f3668085070 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.045+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f366003a3c0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f366003a3c0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f3668085070 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.046+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601427ff0 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f3668085070 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x564601423600 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x564601427290 con 0x7f3668085070 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f367d016800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f367d016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f367d016800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:10:46.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f367d016800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f367d016800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.047+0000 7f367d016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460142b2b0 con 0x564601423600 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460142b6a0 con 0x564601423600 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.048+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460142b6a0 con 0x7f366003a3c0 2024-05-15T18:10:46.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 zone default found 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 4 Realm: () 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 zonegroup default 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460142c7c0 con 0x7f366003a3c0 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460142e1a0 con 0x564601427ff0 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460142e540 con 0x564601427ff0 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 started sync module instance, tier type = 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.049+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142d640 con 0x7f3668085070 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.050+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.050+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94858668855696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142e8e0 con 0x7f3668085070 2024-05-15T18:10:46.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.050+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142f2a0 con 0x564601423600 2024-05-15T18:10:46.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.051+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94858668855696] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.052+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.052+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94858668862960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142f6c0 con 0x564601423600 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.052+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601430080 con 0x564601427ff0 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.053+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94858668862960] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.053+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.053+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94858668864016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142f630 con 0x564601427ff0 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.053+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601430f40 con 0x7f3668085070 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.054+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94858668864016] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.054+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.054+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94858668868720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5646014317e0 con 0x7f3668085070 2024-05-15T18:10:46.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.054+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5646014321a0 con 0x564601423600 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.055+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.055+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94858668875472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601432940 con 0x564601423600 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.055+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601433460 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.055+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94858668868720] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.056+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94858668875472] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.056+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.056+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94858668879664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601433420 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.056+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601433d00 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.057+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94858668879664] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.057+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.057+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94858668872496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601433420 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.058+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601434320 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94858668872496] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94858668881408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601434320 con 0x7f366003a3c0 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 20 add_watcher() i=0 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 20 add_watcher() i=1 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 20 add_watcher() i=2 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 20 add_watcher() i=3 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 20 add_watcher() i=4 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 20 add_watcher() i=5 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.059+0000 7f367d016800 20 add_watcher() i=6 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.060+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94858668881408] v31'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.060+0000 7f367d016800 20 add_watcher() i=7 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.060+0000 7f367d016800 2 all 8 watchers are set, enabling cache 2024-05-15T18:10:46.053 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.060+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564601437660 con 0x564601423600 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.060+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.060+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94858668896384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601434490 con 0x564601423600 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.061+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94858668896384] v31'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x564601423600 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.061+0000 7f352e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.061+0000 7f367d016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.061+0000 7f367d016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.061+0000 7f367d016800 5 note: GC not initialized 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.062+0000 7f352d7e2640 20 reqs_thread_entry: start 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.062+0000 7f367d016800 20 init_complete bucket index max shards: 11 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.062+0000 7f367d016800 20 Filter name: none 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.062+0000 7f349effd640 20 reqs_thread_entry: start 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.062+0000 7f367d016800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-15T18:10:46.054 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.062+0000 7f367d016800 20 rados->read ofs=0 len=0 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.062+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460146ac20 con 0x7f366003a3c0 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.063+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.063+0000 7f367d016800 20 rados_obj.operate() r=0 bl.length=473 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.063+0000 7f367d016800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.063+0000 7f367d016800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.063+0000 7f367d016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.063+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601471270 con 0x7f366003a3c0 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v31'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f367000a4a0 con 0x7f366003a3c0 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f367d016800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f367d016800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f367d016800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94858669133024 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56460146ca80 con 0x564601423600 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== watch-notify(notify (1) cookie 94858668875472 notify 133143986207 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f367001e040 con 0x564601423600 2024-05-15T18:10:46.055 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f35577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986207 cookie 94858668875472 notifier 4916 bl.length()=649 2024-05-15T18:10:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f35577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-15T18:10:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(64 notify.4 [notify cookie 94858669133024 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3670040020 con 0x564601423600 2024-05-15T18:10:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f35577fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-15T18:10:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f35577fe640 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f353c003ea0 con 0x564601423600 2024-05-15T18:10:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3670040020 con 0x564601423600 2024-05-15T18:10:46.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.064+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== watch-notify(notify_complete (2) cookie 94858669133024 notify 133143986207 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3670018dd0 con 0x564601423600 2024-05-15T18:10:46.056 INFO:teuthology.orchestra.run.smithi173.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-15T18:10:44.195001Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-15T18:10:44.194989Z","tags":[],"group_ids":[]} 2024-05-15T18:10:46.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.065+0000 7f352e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.065+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94858668896384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601470170 con 0x564601423600 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.066+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94858668896384] v31'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3670040020 con 0x564601423600 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.066+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94858668855696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601437080 con 0x7f3668085070 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.067+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94858668855696] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.067+0000 7f367d016800 20 remove_watcher() i=0 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.067+0000 7f367d016800 2 removed watcher, disabling cache 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.067+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94858668862960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142d190 con 0x564601423600 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.069+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94858668862960] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3670040020 con 0x564601423600 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.069+0000 7f367d016800 20 remove_watcher() i=1 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.069+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94858668864016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142d190 con 0x564601427ff0 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.070+0000 7f3678684640 1 -- 172.21.15.173:0/224360224 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94858668864016] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3668078070 con 0x564601427ff0 2024-05-15T18:10:46.063 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.070+0000 7f367d016800 20 remove_watcher() i=2 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.070+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94858668868720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142d190 con 0x7f3668085070 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.071+0000 7f366ffff640 1 -- 172.21.15.173:0/224360224 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94858668868720] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660037040 con 0x7f3668085070 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.071+0000 7f367d016800 20 remove_watcher() i=3 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.071+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94858668875472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142d190 con 0x564601423600 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.072+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94858668875472] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3670040020 con 0x564601423600 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.072+0000 7f367d016800 20 remove_watcher() i=4 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.072+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94858668879664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142d190 con 0x7f366003a3c0 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.073+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94858668879664] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3670040020 con 0x7f366003a3c0 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.073+0000 7f367d016800 20 remove_watcher() i=5 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.073+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94858668872496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x564601432f30 con 0x7f366003a3c0 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.074+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94858668872496] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3670040020 con 0x7f366003a3c0 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.074+0000 7f367d016800 20 remove_watcher() i=6 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.074+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94858668881408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56460142d190 con 0x7f366003a3c0 2024-05-15T18:10:46.064 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94858668881408] v31'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3670040020 con 0x7f366003a3c0 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 20 remove_watcher() i=7 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f366003a3c0 msgr2=0x7f366003a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7f366003a3c0 0x7f366003a810 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564601423600 msgr2=0x564601425ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x564601423600 0x564601425ac0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3668085070 msgr2=0x7f3668086460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3668085070 0x7f3668086460 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564601427ff0 msgr2=0x56460142a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x564601427ff0 0x56460142a3e0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3548036950 msgr2=0x7f3548038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3548036950 0x7f3548038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x5646013f5aa0 tx=0x7f3660023040 comp rx=0 tx=0).stop 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 msgr2=0x564601417f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.065 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f3678e85640 1 -- 172.21.15.173:0/224360224 reap_dead start 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601417f00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3668086d70 tx=0x7f3668063eb0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 shutdown_connections 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 --2- 172.21.15.173:0/224360224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601410b00 0x564601417f00 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 >> 172.21.15.173:0/224360224 conn(0x56460140ce10 msgr2=0x56460140a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 shutdown_connections 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.075+0000 7f367d016800 1 -- 172.21.15.173:0/224360224 wait complete. 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3550036950 msgr2=0x7f3550038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3550036950 0x7f3550038e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x5646013e9800 tx=0x7f3660006000 comp rx=0 tx=0).stop 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601403b00 msgr2=0x564601403f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601403b00 0x564601403f20 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f366805ce80 tx=0x7f3668066f90 comp rx=0 tx=0).stop 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 shutdown_connections 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3550036950 0x7f3550038e10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/3406961042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564601403b00 0x564601403f20 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 >> 172.21.15.173:0/3406961042 conn(0x5646013f7ba0 msgr2=0x5646013f7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 shutdown_connections 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/3406961042 wait complete. 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5646013f2af0 msgr2=0x5646013f4f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5646013f2af0 0x5646013f4f40 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5646012ed3e0 msgr2=0x5646013ec310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5646012ed3e0 0x5646013ec310 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5646013eebb0 msgr2=0x5646013f0fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5646013eebb0 0x5646013f0fa0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3560036900 msgr2=0x7f3560038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3560036900 0x7f3560038dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3660000c00 tx=0x7f36600013b0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.067 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 msgr2=0x5646013e50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:10:46.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 --2- 172.21.15.173:0/1037504663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5646012ea3a0 0x5646013e50d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3668060040 tx=0x7f3668002fb0 comp rx=0 tx=0).stop 2024-05-15T18:10:46.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f3678e85640 1 -- 172.21.15.173:0/1037504663 reap_dead start 2024-05-15T18:10:46.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 shutdown_connections 2024-05-15T18:10:46.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 >> 172.21.15.173:0/1037504663 conn(0x5646012e5d40 msgr2=0x5646013d77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:10:46.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 shutdown_connections 2024-05-15T18:10:46.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:10:46.076+0000 7f367d016800 1 -- 172.21.15.173:0/1037504663 wait complete. 2024-05-15T18:10:46.068 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:46.068 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-15T18:10:44.195001Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-15T18:10:44.194989Z', 'tags': [], 'group_ids': []} 2024-05-15T18:10:46.068 ERROR:root:0 2024-05-15T18:10:46.069 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-15T18:10:46.075 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.076 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.079 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.079 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-15T18:10:46.085 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.085 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.089 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.089 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-05-15T18:10:46.097 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-05-15T18:10:46.098 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.102 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.103 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-05-15T18:10:46.110 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.110 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.114 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.114 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-05-15T18:10:46.122 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-05-15T18:10:46.122 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.126 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.126 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-05-15T18:10:46.134 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-05-15T18:10:46.134 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.138 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.138 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-05-15T18:10:46.145 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.145 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.149 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.149 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-05-15T18:10:46.155 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.155 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.158 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.159 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-05-15T18:10:46.165 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.166 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.169 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.169 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.174 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-15T18:10:46.174 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-15T18:10:46.178 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-15T18:10:46.190 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-15T18:10:46.194 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-05-15T18:10:46.195 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-15T18:10:46.199 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:10:46.210242Z', 'creation_time': '2024-05-15T18:10:46.207446Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-15T18:10:46.199 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-15T18:10:46.204 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:10:46.210242Z', 'creation_time': '2024-05-15T18:10:46.207446Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-15T18:10:46.208 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-15T18:10:46.213 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:10:46.210242Z', 'creation_time': '2024-05-15T18:10:46.207446Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-15T18:10:46.213 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-05-15T18:10:46.218 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000903c2b52fb925e7b-006644faa6-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:10:46.222 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-05-15T18:10:46.229 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.229 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-05-15T18:10:46.238 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:10:46.246 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11'} 2024-05-15T18:10:46.257 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.305 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11'} 2024-05-15T18:10:46.316 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.316 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-05-15T18:10:46.326 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.333 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-05-15T18:10:46.339 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:10:46.340 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-15T18:10:46.344 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0a7d7418-39f7-493f-89f0-016c6637672d', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'marker': '74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-15T18:10:46.335510Z', 'creation_time': '2024-05-15T18:10:46.207446Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-15T18:11:46.393 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-05-15T18:11:46.412 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-05-15T18:11:46.413 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-05-15T18:11:46.428 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-05-15T18:11:46.428 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-15T18:11:46.435 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-05-15T18:11:46.436 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-05-15T18:11:46.442 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-05-15T18:11:46.442 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-05-15T18:11:46.447 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-05-15T18:11:46.447 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-05-15T18:11:46.452 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-05-15T18:11:46.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-05-15T18:11:46.456 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-05-15T18:00:00.000000Z', 'epoch': 1715796000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-05-15T18:11:46.457 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-05-15T18:11:46.463 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:11:46.463 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-15T18:11:46.468 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-05-15T18:11:46.468 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-15T18:11:46.477 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:11:46.481 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-15T18:11:46.490 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:11:46.742 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-15T18:11:46.747 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000005b95c4b89cf6ed04-006644fae2-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:46.851 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-15T18:11:46.856 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-15T18:11:46.861 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-15T18:11:46.865 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-15T18:11:46.979 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-05-15T18:11:47.015 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:11:47.015 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-15T18:11:47.022 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-05-15T18:11:47.022 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-15T18:11:47.028 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-15T18:11:47.042 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-15T18:11:47.047 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000072237629a3b921d0-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.064 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-05-15T18:11:47.099 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:11:47.099 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-15T18:11:47.104 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000000a79c0e054e4ad24-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.104 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-05-15T18:11:47.108 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'b091c162-becd-4424-b394-ddcc165a450a'}]}} 2024-05-15T18:11:47.108 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-05-15T18:11:47.118 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-15T18:11:47.119 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-15T18:11:47.123 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-15T18:11:47.123 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-05-15T18:11:47.127 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000042ee1956afcbe1c0-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-05-15T18:11:47.130 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000c87e7433aa074f87-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.142 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-15T18:11:47.146 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-15T18:11:47.146 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-05-15T18:11:47.150 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000080ce56b1d2043378-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.150 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-05-15T18:11:47.154 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000009ca883cb042965e9-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.154 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-05-15T18:11:47.160 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-15T18:11:47.161 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-05-15T18:11:47.164 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000f8f5d1474129e6ac-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.165 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-05-15T18:11:47.168 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000325cdbb31344d1b2-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.169 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-05-15T18:11:47.172 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000a5be3d8e42802c3e-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.172 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-05-15T18:11:47.176 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d2937570d3bc2e26-006644fae3-4224-default', 'HostId': '4224-default-default'} 2024-05-15T18:11:47.176 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-05-15T18:11:47.184 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:11:47.185 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-15T18:11:47.189 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-05-15T18:11:47.189 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-05-15T18:11:47.194 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:11:47.195 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-15T18:11:47.198 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-05-15T18:11:47.198 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-05-15T18:11:47.204 INFO:tasks.radosgw_admin_rest: empty result 2024-05-15T18:11:47.208 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-15T18:11:47.218 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-15T18:11:47.218 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T18:11:47.220 INFO:tasks.rgw.client.0.smithi173.stdout:2024-05-15T18:11:47.242+0000 7f2a0bc77640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36694) UID: 0 2024-05-15T18:11:47.221 INFO:tasks.rgw.client.0.smithi173.stdout:2024-05-15T18:11:47.242+0000 7f2a11520880 -1 shutting down 2024-05-15T18:11:51.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-15T18:11:53.322 INFO:tasks.rgw.client.0:Stopped 2024-05-15T18:11:53.323 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-15T18:11:53.342 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/vault-root-token 2024-05-15T18:11:53.413 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-15T18:11:53.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-15T18:11:53.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-15T18:11:53.484 DEBUG:teuthology.orchestra.run.smithi173:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-15T18:11:53.573 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setuser ceph since I am not root 2024-05-15T18:11:53.574 INFO:teuthology.orchestra.run.smithi173.stderr:ignoring --setgroup ceph since I am not root 2024-05-15T18:11:53.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.597+0000 7eff8972d800 1 Processor -- start 2024-05-15T18:11:53.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.597+0000 7eff8972d800 1 -- start start 2024-05-15T18:11:53.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.597+0000 7eff8972d800 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5626a0062fd0 0x5626a00633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.575 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.597+0000 7eff8972d800 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626a0063a70 con 0x5626a0064230 2024-05-15T18:11:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.597+0000 7eff8972d800 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x56269fef5050 con 0x5626a0062fd0 2024-05-15T18:11:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.598+0000 7eff8542f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5626a0062fd0 0x5626a00633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.598+0000 7eff8542f640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x5626a0062fd0 0x5626a00633f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51246/0 (socket says 172.21.15.173:51246) 2024-05-15T18:11:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.598+0000 7eff8542f640 1 -- 172.21.15.173:0/3034851376 learned_addr learned my addr 172.21.15.173:0/3034851376 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:11:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.598+0000 7eff84c2e640 1 --1- 172.21.15.173:0/3034851376 >> v1:172.21.15.3:6789/0 conn(0x5626a0064230 0x5626a00646b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.173:35138/0 (socket says 172.21.15.173:35138) 2024-05-15T18:11:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.598+0000 7eff8542f640 1 -- 172.21.15.173:0/3034851376 >> v1:172.21.15.3:6789/0 conn(0x5626a0064230 legacy=0x5626a00646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.576 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.598+0000 7eff8542f640 1 -- 172.21.15.173:0/3034851376 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a0064df0 con 0x5626a0062fd0 2024-05-15T18:11:53.577 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.600+0000 7eff8542f640 1 --2- 172.21.15.173:0/3034851376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a00633f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c710 tx=0x7eff7801f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa64792bcb45f64 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.600+0000 7eff77fff640 1 -- 172.21.15.173:0/3034851376 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7804d710 con 0x5626a0062fd0 2024-05-15T18:11:53.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.600+0000 7eff77fff640 1 -- 172.21.15.173:0/3034851376 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff78051070 con 0x5626a0062fd0 2024-05-15T18:11:53.578 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.600+0000 7eff77fff640 1 -- 172.21.15.173:0/3034851376 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7804da40 con 0x5626a0062fd0 2024-05-15T18:11:53.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.601+0000 7eff8972d800 1 -- 172.21.15.173:0/3034851376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 msgr2=0x5626a00633f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.601+0000 7eff8972d800 1 --2- 172.21.15.173:0/3034851376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a00633f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c710 tx=0x7eff7801f450 comp rx=0 tx=0).stop 2024-05-15T18:11:53.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.601+0000 7eff8972d800 1 -- 172.21.15.173:0/3034851376 shutdown_connections 2024-05-15T18:11:53.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.601+0000 7eff8972d800 1 --2- 172.21.15.173:0/3034851376 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a00633f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.601+0000 7eff8972d800 1 -- 172.21.15.173:0/3034851376 >> 172.21.15.173:0/3034851376 conn(0x5626a005e5b0 msgr2=0x5626a00609d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:53.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.601+0000 7eff8972d800 1 -- 172.21.15.173:0/3034851376 shutdown_connections 2024-05-15T18:11:53.580 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.601+0000 7eff8972d800 1 -- 172.21.15.173:0/3034851376 wait complete. 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.616+0000 7eff8972d800 1 Processor -- start 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.616+0000 7eff8972d800 1 -- start start 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.616+0000 7eff8972d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.616+0000 7eff8972d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56269ffaf1d0 con 0x5626a0062fd0 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.617+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.617+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a0157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51258/0 (socket says 172.21.15.173:51258) 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.617+0000 7eff8542f640 1 -- 172.21.15.173:0/2620720464 learned_addr learned my addr 172.21.15.173:0/2620720464 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:11:53.594 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.617+0000 7eff8542f640 1 -- 172.21.15.173:0/2620720464 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a0158060 con 0x5626a0062fd0 2024-05-15T18:11:53.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.617+0000 7eff8542f640 1 --2- 172.21.15.173:0/2620720464 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a0157a90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7eff78057040 tx=0x7eff7804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24b49d5908f62e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.597 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.617+0000 7efe73606640 1 -- 172.21.15.173:0/2620720464 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7804d9a0 con 0x5626a0062fd0 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7efe73606640 1 -- 172.21.15.173:0/2620720464 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7804db40 con 0x5626a0062fd0 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7efe73606640 1 -- 172.21.15.173:0/2620720464 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7804de20 con 0x5626a0062fd0 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7eff8972d800 1 -- 172.21.15.173:0/2620720464 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 msgr2=0x5626a0157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7eff8972d800 1 --2- 172.21.15.173:0/2620720464 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a0157a90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7eff78057040 tx=0x7eff7804f000 comp rx=0 tx=0).stop 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7eff8972d800 1 -- 172.21.15.173:0/2620720464 shutdown_connections 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7eff8972d800 1 --2- 172.21.15.173:0/2620720464 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a0157a90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7eff8972d800 1 -- 172.21.15.173:0/2620720464 >> 172.21.15.173:0/2620720464 conn(0x5626a005e5b0 msgr2=0x5626a014efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7eff8972d800 1 -- 172.21.15.173:0/2620720464 shutdown_connections 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.618+0000 7eff8972d800 1 -- 172.21.15.173:0/2620720464 wait complete. 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.619+0000 7eff8972d800 1 Processor -- start 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.619+0000 7eff8972d800 1 -- start start 2024-05-15T18:11:53.598 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.619+0000 7eff8972d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a015f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.619+0000 7eff8972d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56269ffd6540 con 0x5626a0062fd0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.619+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a015f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.619+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a015f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51266/0 (socket says 172.21.15.173:51266) 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.619+0000 7eff8542f640 1 -- 172.21.15.173:0/680797447 learned_addr learned my addr 172.21.15.173:0/680797447 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.620+0000 7eff8542f640 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a015fa30 con 0x5626a0062fd0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.620+0000 7eff8542f640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a015f4f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7eff78061040 tx=0x7eff78003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.620+0000 7efe71e03640 1 -- 172.21.15.173:0/680797447 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7806c070 con 0x5626a0062fd0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.620+0000 7efe71e03640 1 -- 172.21.15.173:0/680797447 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7805f900 con 0x5626a0062fd0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.620+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626a015fcc0 con 0x5626a0062fd0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.620+0000 7efe71e03640 1 -- 172.21.15.173:0/680797447 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7805fbe0 con 0x5626a0062fd0 2024-05-15T18:11:53.599 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.620+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a0162920 con 0x5626a0062fd0 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.621+0000 7efe71e03640 1 -- 172.21.15.173:0/680797447 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff7806f070 con 0x5626a0062fd0 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.621+0000 7efe71e03640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe6c036900 0x7efe6c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.621+0000 7efe71e03640 1 -- 172.21.15.173:0/680797447 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7eff78064070 con 0x5626a0062fd0 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.621+0000 7eff84c2e640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe6c036900 0x7efe6c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.621+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a0064230 0x5626a01666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.621+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a0166c60 con 0x5626a0064230 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.621+0000 7eff85c30640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a0064230 0x5626a01666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.622+0000 7eff84c2e640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe6c036900 0x7efe6c038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff7c000f60 tx=0x7eff7c001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.622+0000 7eff85c30640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a0064230 0x5626a01666e0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.622+0000 7eff85c30640 1 -- 172.21.15.173:0/680797447 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a0064230 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.622+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a0163c90 con 0x5626a0064230 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.622+0000 7eff85c30640 1 -- 172.21.15.173:0/680797447 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff800083e0 con 0x5626a0064230 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.622+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a0168f80 0x5626a016b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.622+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:3 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a016ba60 con 0x5626a0168f80 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.623+0000 7eff8542f640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a0168f80 0x5626a016b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.623+0000 7eff8542f640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a0168f80 0x5626a016b370 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.623+0000 7eff8542f640 1 -- 172.21.15.173:0/680797447 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(3 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff7806e030 con 0x5626a0168f80 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.623+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a0167f30 con 0x5626a0064230 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.623+0000 7eff85c30640 1 -- 172.21.15.173:0/680797447 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff800083e0 con 0x5626a0064230 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.623+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5626a016cec0 0x5626a016f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.623+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:5 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a016fa90 con 0x5626a016cec0 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.624+0000 7eff84c2e640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5626a016cec0 0x5626a016f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.604 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.624+0000 7eff84c2e640 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5626a016cec0 0x5626a016f330 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.625+0000 7eff84c2e640 1 -- 172.21.15.173:0/680797447 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(5 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff7c00f690 con 0x5626a016cec0 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.625+0000 7eff8972d800 1 Processor -- start 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.625+0000 7eff8972d800 1 -- start start 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.625+0000 7eff8972d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a017def0 0x5626a017e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.625+0000 7eff8972d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56269ff55cf0 con 0x5626a017def0 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a017def0 0x5626a017e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a017def0 0x5626a017e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51274/0 (socket says 172.21.15.173:51274) 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7eff8542f640 1 -- 172.21.15.173:0/3723603154 learned_addr learned my addr 172.21.15.173:0/3723603154 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:11:53.605 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7eff8542f640 1 -- 172.21.15.173:0/3723603154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a017e850 con 0x5626a017def0 2024-05-15T18:11:53.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7eff8542f640 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a017def0 0x5626a017e310 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7eff7808ce10 tx=0x7eff78055b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7efe6affd640 1 -- 172.21.15.173:0/3723603154 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff78076040 con 0x5626a017def0 2024-05-15T18:11:53.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626a017f2c0 con 0x5626a017def0 2024-05-15T18:11:53.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7efe6affd640 1 -- 172.21.15.173:0/3723603154 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7808eae0 con 0x5626a017def0 2024-05-15T18:11:53.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7efe6affd640 1 -- 172.21.15.173:0/3723603154 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7808edc0 con 0x5626a017def0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.626+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a017f7c0 con 0x5626a017def0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.627+0000 7efe6affd640 1 -- 172.21.15.173:0/3723603154 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff78053030 con 0x5626a017def0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.627+0000 7efe6affd640 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe5c036920 0x7efe5c038de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7efe6affd640 1 -- 172.21.15.173:0/3723603154 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7eff78085050 con 0x5626a017def0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff84c2e640 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe5c036920 0x7efe5c038de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff8972d800 1 Processor -- start 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff8972d800 1 -- start start 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff84c2e640 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe5c036920 0x7efe5c038de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5626a0167530 tx=0x7eff7c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff8972d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a018b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff8972d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5626a0158320 con 0x5626a018b0a0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a018b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.636 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a018b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51284/0 (socket says 172.21.15.173:51284) 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.628+0000 7eff8542f640 1 -- 172.21.15.173:0/673627422 learned_addr learned my addr 172.21.15.173:0/673627422 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.629+0000 7eff8542f640 1 -- 172.21.15.173:0/673627422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a018ba90 con 0x5626a018b0a0 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.629+0000 7eff8542f640 1 --2- 172.21.15.173:0/673627422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a018b4c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7eff7808e010 tx=0x7eff7807b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b69f660c5b64fd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.629+0000 7efe68ff9640 1 -- 172.21.15.173:0/673627422 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7806f570 con 0x5626a018b0a0 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.629+0000 7efe68ff9640 1 -- 172.21.15.173:0/673627422 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff780a7070 con 0x5626a018b0a0 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.629+0000 7efe68ff9640 1 -- 172.21.15.173:0/673627422 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7807fe00 con 0x5626a018b0a0 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.629+0000 7eff8972d800 1 -- 172.21.15.173:0/673627422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 msgr2=0x5626a018b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.629+0000 7eff8972d800 1 --2- 172.21.15.173:0/673627422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a018b4c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7eff7808e010 tx=0x7eff7807b6d0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 -- 172.21.15.173:0/673627422 shutdown_connections 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 --2- 172.21.15.173:0/673627422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a018b4c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 -- 172.21.15.173:0/673627422 >> 172.21.15.173:0/673627422 conn(0x5626a01873b0 msgr2=0x5626a0185410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 -- 172.21.15.173:0/673627422 shutdown_connections 2024-05-15T18:11:53.637 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 -- 172.21.15.173:0/673627422 wait complete. 2024-05-15T18:11:53.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 Processor -- start 2024-05-15T18:11:53.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 -- start start 2024-05-15T18:11:53.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a0192450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8972d800 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5626a018c120 con 0x5626a018b0a0 2024-05-15T18:11:53.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a0192450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.638 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8542f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a0192450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.173:51296/0 (socket says 172.21.15.173:51296) 2024-05-15T18:11:53.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 learned_addr learned my addr 172.21.15.173:0/249413357 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-05-15T18:11:53.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.630+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a0192990 con 0x5626a018b0a0 2024-05-15T18:11:53.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.631+0000 7eff8542f640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a0192450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7eff7807bbc0 tx=0x7eff78053f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.631+0000 7efe5affd640 1 -- 172.21.15.173:0/249413357 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff780ba070 con 0x5626a018b0a0 2024-05-15T18:11:53.639 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.631+0000 7efe5affd640 1 -- 172.21.15.173:0/249413357 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff78061e40 con 0x5626a018b0a0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.631+0000 7efe5affd640 1 -- 172.21.15.173:0/249413357 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff7807a930 con 0x5626a018b0a0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.631+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626a0192990 con 0x5626a018b0a0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.631+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a0192990 con 0x5626a018b0a0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.632+0000 7efe5affd640 1 -- 172.21.15.173:0/249413357 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff780bd070 con 0x5626a018b0a0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.632+0000 7efe5affd640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe50036900 0x7efe50038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.632+0000 7efe5affd640 1 -- 172.21.15.173:0/249413357 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7eff780c0be0 con 0x5626a018b0a0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.632+0000 7eff84c2e640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe50036900 0x7efe50038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.632+0000 7eff84c2e640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe50036900 0x7efe50038dc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5626a016fe90 tx=0x7eff7c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a019da80 0x5626a019ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a0690 con 0x5626a019da80 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff85c30640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a019da80 0x5626a019ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff85c30640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a019da80 0x5626a019ff40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff8972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff8972d800 20 realm 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.633+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a0ac0 con 0x5626a019da80 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a019da80 2024-05-15T18:11:53.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:11:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1730 con 0x5626a019da80 2024-05-15T18:11:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:11:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a01a20f0 0x5626a01a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:5 5.15 5:abd3512f:::zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a4af0 con 0x5626a01a20f0 2024-05-15T18:11:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.634+0000 7eff8542f640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a01a20f0 0x5626a01a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8542f640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a01a20f0 0x5626a01a44e0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== osd_op_reply(5 zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8972d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-15T18:11:53.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8972d800 20 searching for the correct realm 2024-05-15T18:11:53.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a6400 con 0x5626a01a20f0 2024-05-15T18:11:53.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8542f640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7eff780bf060 0x7eff78072680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a6400 con 0x7eff780bf060 2024-05-15T18:11:53.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.635+0000 7eff84c2e640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7eff780bf060 0x7eff78072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.636+0000 7eff84c2e640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7eff780bf060 0x7eff78072680 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.636+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.636+0000 7eff84c2e640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7eff7c00f070 0x7eff7c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.636+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a6400 con 0x7eff7c00f070 2024-05-15T18:11:53.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.636+0000 7eff85c30640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7eff7c00f070 0x7eff7c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.637+0000 7eff85c30640 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7eff7c00f070 0x7eff7c02e910 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.637+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=112b] v22'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.645 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.637+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a019da80 2024-05-15T18:11:53.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.637+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.637+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a019da80 2024-05-15T18:11:53.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.637+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.637+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x7eff7c00f070 2024-05-15T18:11:53.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.638+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.638+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x7eff7c00f070 2024-05-15T18:11:53.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.638+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.638+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x7eff780bf060 2024-05-15T18:11:53.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.638+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.638+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a01a20f0 2024-05-15T18:11:53.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 3 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a019da80 2024-05-15T18:11:53.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x7eff7c00f070 2024-05-15T18:11:53.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a019da80 2024-05-15T18:11:53.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.639+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x7eff780bf060 2024-05-15T18:11:53.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.640+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v22'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.640+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a01a20f0 2024-05-15T18:11:53.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.640+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 4 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.640+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a01a20f0 2024-05-15T18:11:53.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.640+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 5 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.640+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x7eff7c00f070 2024-05-15T18:11:53.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.641+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.641+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a01a20f0 2024-05-15T18:11:53.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.641+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 6 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.641+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a01a20f0 2024-05-15T18:11:53.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.641+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 7 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.641+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a019da80 2024-05-15T18:11:53.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a019da80 2024-05-15T18:11:53.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v31'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x7eff7c00f070 2024-05-15T18:11:53.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a01a20f0 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 8 ==== osd_op_reply(27 [pgnls start_epoch 31 out=107b] v31'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.642+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x7eff780bf060 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.643+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.643+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a019da80 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.643+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.643+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x7eff7c00f070 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.643+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=82b] v31'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.643+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a01a20f0 2024-05-15T18:11:53.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.644+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 9 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.644+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x7eff7c00f070 2024-05-15T18:11:53.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.644+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.644+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x7eff780bf060 2024-05-15T18:11:53.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.644+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.644+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a01a20f0 2024-05-15T18:11:53.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 10 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x7eff780bf060 2024-05-15T18:11:53.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 6 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x5626a019da80 2024-05-15T18:11:53.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v31'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7eff80026040 con 0x7eff780bf060 2024-05-15T18:11:53.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 RGWRados::pool_iterate: got zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d 2024-05-15T18:11:53.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-15T18:11:53.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-15T18:11:53.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 RGWRados::pool_iterate: got zone_info.74ac2443-e34d-4255-b728-cefe496e7fb2 2024-05-15T18:11:53.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 RGWRados::pool_iterate: got period_config.default 2024-05-15T18:11:53.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-15T18:11:53.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-15T18:11:53.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a1390 con 0x5626a019da80 2024-05-15T18:11:53.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.645+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:11:53.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a4e90 con 0x5626a019da80 2024-05-15T18:11:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-15T18:11:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:40 5.8 5:143b2385:::zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a4e90 con 0x7eff7c00f070 2024-05-15T18:11:53.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 9 ==== osd_op_reply(40 zonegroup_info.0a7d7418-39f7-493f-89f0-016c6637672d [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-15T18:11:53.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 zone default found 2024-05-15T18:11:53.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 4 Realm: () 2024-05-15T18:11:53.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 4 ZoneGroup: default (0a7d7418-39f7-493f-89f0-016c6637672d) 2024-05-15T18:11:53.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 4 Zone: default (74ac2443-e34d-4255-b728-cefe496e7fb2) 2024-05-15T18:11:53.658 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-15T18:11:53.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 zonegroup default 2024-05-15T18:11:53.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.646+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a5fb0 con 0x7eff7c00f070 2024-05-15T18:11:53.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8972d800 20 rados_obj.operate() r=0 bl.length=187 2024-05-15T18:11:53.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a58a0 con 0x5626a01a20f0 2024-05-15T18:11:53.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:11:53.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8972d800 20 rados->read ofs=0 len=0 2024-05-15T18:11:53.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a8260 con 0x5626a01a20f0 2024-05-15T18:11:53.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.647+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.648+0000 7eff8972d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-15T18:11:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.648+0000 7eff8972d800 20 started sync module instance, tier type = 2024-05-15T18:11:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.648+0000 7eff8972d800 20 started zone id=74ac2443-e34d-4255-b728-cefe496e7fb2 (name=default) with tier type = 2024-05-15T18:11:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.648+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a7700 con 0x7eff780bf060 2024-05-15T18:11:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.649+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 8 ==== osd_op_reply(44 notify.0 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.649+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94723894836000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a7360 con 0x7eff780bf060 2024-05-15T18:11:53.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.649+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a8fa0 con 0x5626a019da80 2024-05-15T18:11:53.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.650+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94723894836000] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.650+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 15 ==== osd_op_reply(46 notify.1 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.650+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94723894838784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a9390 con 0x5626a019da80 2024-05-15T18:11:53.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.650+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a9d50 con 0x5626a01a20f0 2024-05-15T18:11:53.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.652+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94723894838784] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.652+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 13 ==== osd_op_reply(48 notify.2 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.652+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94723894843552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01aa140 con 0x5626a01a20f0 2024-05-15T18:11:53.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.652+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01aab40 con 0x7eff780bf060 2024-05-15T18:11:53.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.653+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 10 ==== osd_op_reply(50 notify.3 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.653+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94723894849376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ab830 con 0x7eff780bf060 2024-05-15T18:11:53.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.653+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ac250 con 0x5626a019da80 2024-05-15T18:11:53.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.653+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94723894843552] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.654+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94723894849376] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.654+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 17 ==== osd_op_reply(52 notify.4 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.654+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94723894850432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01a8a20 con 0x5626a019da80 2024-05-15T18:11:53.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.654+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01acb20 con 0x7eff7c00f070 2024-05-15T18:11:53.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.656+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94723894850432] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.656+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 11 ==== osd_op_reply(54 notify.5 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.656+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94723894852928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01acad0 con 0x7eff7c00f070 2024-05-15T18:11:53.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.656+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ad530 con 0x7eff7c00f070 2024-05-15T18:11:53.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.657+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94723894852928] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.657+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 13 ==== osd_op_reply(56 notify.6 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.657+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94723894858336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01acad0 con 0x7eff7c00f070 2024-05-15T18:11:53.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.657+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01adf40 con 0x7eff7c00f070 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94723894858336] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 15 ==== osd_op_reply(58 notify.7 [create] v31'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94723894855680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01adf40 con 0x7eff7c00f070 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 20 add_watcher() i=0 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 20 add_watcher() i=1 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 20 add_watcher() i=2 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 20 add_watcher() i=3 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 20 add_watcher() i=4 2024-05-15T18:11:53.686 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 20 add_watcher() i=5 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.658+0000 7eff8972d800 20 add_watcher() i=6 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.659+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94723894855680] v31'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.659+0000 7eff8972d800 20 add_watcher() i=7 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.659+0000 7eff8972d800 2 all 8 watchers are set, enabling cache 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.659+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01b1370 con 0x5626a019da80 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.660+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.660+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94723894860896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ae830 con 0x5626a019da80 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.661+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94723894860896] v31'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.661+0000 7efe3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.661+0000 7eff8972d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.661+0000 7eff8972d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.661+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01b0f30 con 0x5626a019da80 2024-05-15T18:11:53.687 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.663+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.663+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ba3a0 con 0x7eff7c00f070 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.664+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.664+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ba850 con 0x5626a01a20f0 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.665+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.665+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01babf0 con 0x5626a019da80 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.666+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'278 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.666+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bb0a0 con 0x7eff780bf060 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.667+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.667+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bb930 con 0x5626a01a20f0 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.668+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.668+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bb930 con 0x5626a019da80 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.669+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.669+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bb930 con 0x7eff7c00f070 2024-05-15T18:11:53.688 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.670+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.670+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bb9c0 con 0x7eff780bf060 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.672+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.672+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bbf70 con 0x5626a01a20f0 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.673+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.673+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bbf70 con 0x7eff780bf060 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.674+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'85 uv83 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.674+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc000 con 0x7eff7c00f070 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.675+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'42 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.675+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc000 con 0x7eff780bf060 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.676+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.676+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x7eff7c00f070 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.677+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.689 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.677+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a019da80 2024-05-15T18:11:53.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.678+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'279 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.678+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.679+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.679+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x7eff780bf060 2024-05-15T18:11:53.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.680+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.680+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.690 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.681+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.681+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a019da80 2024-05-15T18:11:53.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.683+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.683+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a019da80 2024-05-15T18:11:53.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.684+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'280 uv169 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.684+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.685+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.691 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.685+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x7eff780bf060 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.686+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.686+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.687+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.687+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.688+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.688+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.689+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.689+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.692 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.690+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.690+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x7eff7c00f070 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.691+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.691+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.692+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.692+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x7eff7c00f070 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.694+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.694+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x5626a01a20f0 2024-05-15T18:11:53.693 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.695+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.695+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x7eff7c00f070 2024-05-15T18:11:53.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.696+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.696+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01bc100 con 0x7eff780bf060 2024-05-15T18:11:53.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.698+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.694 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.698+0000 7efe3a7e4640 20 reqs_thread_entry: start 2024-05-15T18:11:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.698+0000 7eff8972d800 20 init_complete bucket index max shards: 11 2024-05-15T18:11:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.698+0000 7eff8972d800 20 Filter name: none 2024-05-15T18:11:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.698+0000 7efdabfff640 20 reqs_thread_entry: start 2024-05-15T18:11:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.698+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-15T18:11:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.698+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:94 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.695 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.699+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 27 ==== osd_op_reply(94 gc.5 [call] v31'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.699+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:95 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.699+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 28 ==== osd_op_reply(95 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.699+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.699+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:96 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7de0 con 0x5626a01a20f0 2024-05-15T18:11:53.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 29 ==== osd_op_reply(96 gc.5 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:97 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.696 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 30 ==== osd_op_reply(97 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:98 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 31 ==== osd_op_reply(98 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.700+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:99 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.701+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 32 ==== osd_op_reply(99 gc.5 [call] v31'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.697 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.701+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.701+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:100 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a019da80 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 27 ==== osd_op_reply(100 gc.6 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:101 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a019da80 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 28 ==== osd_op_reply(101 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:102 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7de0 con 0x5626a019da80 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 29 ==== osd_op_reply(102 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.698 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:103 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a019da80 2024-05-15T18:11:53.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 30 ==== osd_op_reply(103 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:104 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a019da80 2024-05-15T18:11:53.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 31 ==== osd_op_reply(104 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.699 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.703+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:105 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a019da80 2024-05-15T18:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.705+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 32 ==== osd_op_reply(105 gc.6 [call] v31'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.705+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-15T18:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.705+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:106 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff7c00f070 2024-05-15T18:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.706+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 24 ==== osd_op_reply(106 gc.7 [call] v31'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.706+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:107 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff7c00f070 2024-05-15T18:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.706+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 25 ==== osd_op_reply(107 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.700 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.706+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.706+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:108 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7de0 con 0x7eff7c00f070 2024-05-15T18:11:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 26 ==== osd_op_reply(108 gc.7 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:109 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff7c00f070 2024-05-15T18:11:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 27 ==== osd_op_reply(109 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.701 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:110 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff7c00f070 2024-05-15T18:11:53.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 28 ==== osd_op_reply(110 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.707+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:111 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff7c00f070 2024-05-15T18:11:53.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.708+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 29 ==== osd_op_reply(111 gc.7 [call] v31'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.702 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.708+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-15T18:11:53.703 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.708+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:112 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.709+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 19 ==== osd_op_reply(112 gc.8 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.709+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:113 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.719 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.709+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 20 ==== osd_op_reply(113 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.709+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.709+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:114 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7de0 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 21 ==== osd_op_reply(114 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:115 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 22 ==== osd_op_reply(115 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:116 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 23 ==== osd_op_reply(116 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.710+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:117 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.711+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 24 ==== osd_op_reply(117 gc.8 [call] v31'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.712+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.712+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:118 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.720 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 33 ==== osd_op_reply(118 gc.9 [call] v31'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:119 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 34 ==== osd_op_reply(119 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:120 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7de0 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 35 ==== osd_op_reply(120 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 36 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 37 ==== osd_op_reply(122 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.713+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.714+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.715+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 38 ==== osd_op_reply(123 gc.9 [call] v31'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.721 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.715+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.715+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.715+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 25 ==== osd_op_reply(124 gc.10 [call] v31'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.715+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 26 ==== osd_op_reply(125 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7de0 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 27 ==== osd_op_reply(126 gc.10 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:127 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 28 ==== osd_op_reply(127 gc.10 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:128 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e8df0 con 0x7eff780bf060 2024-05-15T18:11:53.722 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 29 ==== osd_op_reply(128 gc.10 [call out=1715b] v0'0 uv87 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 20 garbage collection: RGWGC::process iterating over entry tag='74ac2443-e34d-4255-b728-cefe496e7fb2.4224.6941507106086900515', time=2024-05-15T18:12:01.764778+0000, chain.objs.size()=7 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_1 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:129 3.23 3:c76ff552:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e90f0 con 0x7eff7c00f070 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_2 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:130 3.33 3:cde2535c:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ebd20 con 0x7eff7c00f070 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_3 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.716+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:131 3.20 3:07b860ab:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ee630 con 0x7eff780bf060 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_4 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:132 3.d 3:b145fb01:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f0ea0 con 0x5626a01a20f0 2024-05-15T18:11:53.723 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_5 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:133 3.15 3:aaf3ecf7:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f3710 con 0x7eff780bf060 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_6 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:134 3.28 3:1631bb5c:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f60c0 con 0x5626a01a20f0 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_7 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.717+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:135 3.25 3:a7ec729a:::74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f8ac0 con 0x5626a019da80 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.719+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 33 ==== osd_op_reply(135 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_7 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.719+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 39 ==== osd_op_reply(132 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_4 [call] v31'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.720+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 30 ==== osd_op_reply(133 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_5 [call] v31'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.720+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 30 ==== osd_op_reply(129 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_1 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.720+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 40 ==== osd_op_reply(134 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_6 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.720+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 31 ==== osd_op_reply(130 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_2 [call] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.724 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.720+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 31 ==== osd_op_reply(131 74ac2443-e34d-4255-b728-cefe496e7fb2.4224.11__shadow_.PnBJBjFKuanJHm1WwS6BJbn6Ya5UCE6_3 [call] v31'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.720+0000 7eff8972d800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.720+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:136 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.722+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 32 ==== osd_op_reply(136 gc.10 [call] v31'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.722+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:137 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.725+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 33 ==== osd_op_reply(137 gc.10 [call] v31'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.725+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.725+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:138 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.726+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 32 ==== osd_op_reply(138 gc.11 [call] v31'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:139 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 33 ==== osd_op_reply(139 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:140 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.725 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 34 ==== osd_op_reply(140 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:141 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 35 ==== osd_op_reply(141 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.727+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:142 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.728+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 36 ==== osd_op_reply(142 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.728+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.728+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:143 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.729+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 37 ==== osd_op_reply(143 gc.11 [call] v31'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.729+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.729+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:144 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.726 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.730+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 34 ==== osd_op_reply(144 gc.12 [call] v31'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.730+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:145 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.730+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 35 ==== osd_op_reply(145 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.730+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.730+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:146 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.730+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 36 ==== osd_op_reply(146 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.730+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:147 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.731+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 37 ==== osd_op_reply(147 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.731+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.731+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:148 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.731+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 38 ==== osd_op_reply(148 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.731+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.731+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:149 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.732+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 39 ==== osd_op_reply(149 gc.12 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.727 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.732+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.732+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:150 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.733+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 38 ==== osd_op_reply(150 gc.13 [call] v31'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.733+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:151 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.733+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 39 ==== osd_op_reply(151 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.733+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.733+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:152 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 40 ==== osd_op_reply(152 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:153 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 41 ==== osd_op_reply(153 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.728 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:154 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 42 ==== osd_op_reply(154 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.734+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:155 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x7eff7c00f070 2024-05-15T18:11:53.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.735+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 43 ==== osd_op_reply(155 gc.13 [call] v31'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.729 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.735+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-15T18:11:53.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.735+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:156 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a019da80 2024-05-15T18:11:53.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.736+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 34 ==== osd_op_reply(156 gc.14 [call] v31'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.736+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:157 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a019da80 2024-05-15T18:11:53.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 35 ==== osd_op_reply(157 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.730 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:158 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a019da80 2024-05-15T18:11:53.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 36 ==== osd_op_reply(158 gc.14 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:159 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a019da80 2024-05-15T18:11:53.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 37 ==== osd_op_reply(159 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.731 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:160 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a019da80 2024-05-15T18:11:53.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 38 ==== osd_op_reply(160 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.733 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.737+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:161 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a019da80 2024-05-15T18:11:53.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.738+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 39 ==== osd_op_reply(161 gc.14 [call] v31'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.738+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-15T18:11:53.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.738+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:162 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a01a20f0 2024-05-15T18:11:53.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.740+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 41 ==== osd_op_reply(162 gc.15 [call] v31'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.740+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:163 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a01a20f0 2024-05-15T18:11:53.734 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.740+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 42 ==== osd_op_reply(163 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.740+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.740+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:164 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a01a20f0 2024-05-15T18:11:53.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.740+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 43 ==== osd_op_reply(164 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.741+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:165 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01f6020 con 0x5626a01a20f0 2024-05-15T18:11:53.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.741+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 44 ==== osd_op_reply(165 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.735 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.741+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.741+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:166 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.741+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 45 ==== osd_op_reply(166 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.741+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.741+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:167 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.742+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 46 ==== osd_op_reply(167 gc.15 [call] v31'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.736 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.742+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-15T18:11:53.737 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.742+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:168 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.743+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 40 ==== osd_op_reply(168 gc.16 [call] v31'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.743+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:169 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 41 ==== osd_op_reply(169 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:170 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 42 ==== osd_op_reply(170 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:171 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 43 ==== osd_op_reply(171 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:172 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 44 ==== osd_op_reply(172 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.744+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:173 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.745+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 45 ==== osd_op_reply(173 gc.16 [call] v31'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.745+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.745+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:174 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.746+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 47 ==== osd_op_reply(174 gc.17 [call] v31'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.746+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:175 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 48 ==== osd_op_reply(175 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:176 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 49 ==== osd_op_reply(176 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:177 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 50 ==== osd_op_reply(177 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:178 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 51 ==== osd_op_reply(178 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.747+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:179 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.748+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 52 ==== osd_op_reply(179 gc.17 [call] v31'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.748+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.748+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:180 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 40 ==== osd_op_reply(180 gc.18 [call] v31'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:181 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 41 ==== osd_op_reply(181 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:182 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 42 ==== osd_op_reply(182 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:183 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 43 ==== osd_op_reply(183 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.750+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:184 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.751+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 44 ==== osd_op_reply(184 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.751+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.751+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:185 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.752+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 45 ==== osd_op_reply(185 gc.18 [call] v31'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.752+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.752+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:186 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.753+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 46 ==== osd_op_reply(186 gc.19 [call] v31'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.753+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:187 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.753+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 47 ==== osd_op_reply(187 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.753+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.753+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:188 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 48 ==== osd_op_reply(188 gc.19 [call out=24b] v0'0 uv283 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:189 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 49 ==== osd_op_reply(189 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:190 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 50 ==== osd_op_reply(190 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.754+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:191 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.755+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 51 ==== osd_op_reply(191 gc.19 [call] v31'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.755+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.755+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:192 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 53 ==== osd_op_reply(192 gc.20 [call] v31'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:193 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 54 ==== osd_op_reply(193 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:194 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 55 ==== osd_op_reply(194 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:195 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 56 ==== osd_op_reply(195 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.757+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:196 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.758+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 57 ==== osd_op_reply(196 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.758+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.758+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:197 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.759+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 58 ==== osd_op_reply(197 gc.20 [call] v31'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.759+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.759+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:198 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.760+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 46 ==== osd_op_reply(198 gc.21 [call] v31'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.760+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:199 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.760+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 47 ==== osd_op_reply(199 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.760+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.760+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:200 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 48 ==== osd_op_reply(200 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:201 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 49 ==== osd_op_reply(201 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:202 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 50 ==== osd_op_reply(202 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.761+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:203 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.762+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 51 ==== osd_op_reply(203 gc.21 [call] v31'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.762+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.762+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:204 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.763+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 59 ==== osd_op_reply(204 gc.22 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.763+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:205 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.763+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 60 ==== osd_op_reply(205 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.763+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.763+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:206 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.763+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 61 ==== osd_op_reply(206 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.763+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:207 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.764+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 62 ==== osd_op_reply(207 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.764+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.764+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:208 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.764+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 63 ==== osd_op_reply(208 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.764+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.764+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:209 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.765+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 64 ==== osd_op_reply(209 gc.22 [call] v31'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.765+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.765+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:210 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.766+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 65 ==== osd_op_reply(210 gc.23 [call] v31'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.766+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:211 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.766+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 66 ==== osd_op_reply(211 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.787 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.766+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.766+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:212 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.766+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 67 ==== osd_op_reply(212 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.766+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:213 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.767+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 68 ==== osd_op_reply(213 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.767+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.767+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:214 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.767+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 69 ==== osd_op_reply(214 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.767+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.767+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:215 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.768+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 70 ==== osd_op_reply(215 gc.23 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.768+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.768+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:216 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 71 ==== osd_op_reply(216 gc.24 [call] v31'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:217 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 72 ==== osd_op_reply(217 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:218 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 73 ==== osd_op_reply(218 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:219 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 74 ==== osd_op_reply(219 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:220 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.769+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 75 ==== osd_op_reply(220 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.770+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.770+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:221 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.770+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 76 ==== osd_op_reply(221 gc.24 [call] v31'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.771+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.771+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:222 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.771+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 77 ==== osd_op_reply(222 gc.25 [call] v31'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.771+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:223 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 78 ==== osd_op_reply(223 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:224 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 79 ==== osd_op_reply(224 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:225 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 80 ==== osd_op_reply(225 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:226 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 81 ==== osd_op_reply(226 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.772+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:227 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.773+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 82 ==== osd_op_reply(227 gc.25 [call] v31'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.773+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.773+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:228 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.774+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 44 ==== osd_op_reply(228 gc.26 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.774+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:229 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.775+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 45 ==== osd_op_reply(229 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.775+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.775+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:230 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.775+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 46 ==== osd_op_reply(230 gc.26 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.775+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:231 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.775+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 47 ==== osd_op_reply(231 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.776+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.776+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:232 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.776+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 48 ==== osd_op_reply(232 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.776+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.776+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:233 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.778+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 49 ==== osd_op_reply(233 gc.26 [call] v31'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.792 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.778+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.778+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:234 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.779+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 83 ==== osd_op_reply(234 gc.27 [call] v31'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.779+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:235 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.779+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 84 ==== osd_op_reply(235 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.779+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.779+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:236 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.779+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 85 ==== osd_op_reply(236 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.779+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:237 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.780+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 86 ==== osd_op_reply(237 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.780+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.793 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.780+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:238 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.780+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 87 ==== osd_op_reply(238 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.780+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.780+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:239 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.781+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 88 ==== osd_op_reply(239 gc.27 [call] v31'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.781+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.781+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:240 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.782+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 50 ==== osd_op_reply(240 gc.28 [call] v31'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.782+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:241 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.782+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 51 ==== osd_op_reply(241 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.794 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.782+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.782+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:242 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 52 ==== osd_op_reply(242 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:243 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 53 ==== osd_op_reply(243 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:244 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 54 ==== osd_op_reply(244 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.783+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:245 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.795 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.784+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 55 ==== osd_op_reply(245 gc.28 [call] v31'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.784+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.784+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:246 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.785+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 89 ==== osd_op_reply(246 gc.29 [call] v31'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.785+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:247 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 90 ==== osd_op_reply(247 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:248 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 91 ==== osd_op_reply(248 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:249 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 92 ==== osd_op_reply(249 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.796 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:250 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 93 ==== osd_op_reply(250 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.786+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:251 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.788+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 94 ==== osd_op_reply(251 gc.29 [call] v31'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.788+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.788+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:252 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.789+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 56 ==== osd_op_reply(252 gc.30 [call] v31'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.797 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.789+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:253 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.789+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 57 ==== osd_op_reply(253 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.789+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.789+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:254 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 58 ==== osd_op_reply(254 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:255 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 59 ==== osd_op_reply(255 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:256 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 60 ==== osd_op_reply(256 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.798 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.790+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:257 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.792+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 61 ==== osd_op_reply(257 gc.30 [call] v31'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.792+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.792+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:258 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.793+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 52 ==== osd_op_reply(258 gc.31 [call] v31'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.793+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:259 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.793+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 53 ==== osd_op_reply(259 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.793+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.793+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:260 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.799 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 54 ==== osd_op_reply(260 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:261 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 55 ==== osd_op_reply(261 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:262 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 56 ==== osd_op_reply(262 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.794+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:263 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.795+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 57 ==== osd_op_reply(263 gc.31 [call] v31'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.795+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-15T18:11:53.800 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.795+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:264 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 52 ==== osd_op_reply(264 gc.0 [call] v31'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:265 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 53 ==== osd_op_reply(265 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:266 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 54 ==== osd_op_reply(266 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:267 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 55 ==== osd_op_reply(267 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.797+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:268 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.798+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 56 ==== osd_op_reply(268 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.801 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.798+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.798+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:269 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.799+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 57 ==== osd_op_reply(269 gc.0 [call] v31'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.799+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.799+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:270 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.800+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 62 ==== osd_op_reply(270 gc.1 [call] v31'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.800+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:271 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.800+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 63 ==== osd_op_reply(271 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.800+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.800+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:272 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.801+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 64 ==== osd_op_reply(272 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.801+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:273 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.801+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 65 ==== osd_op_reply(273 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.801+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.801+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:274 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.802+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 66 ==== osd_op_reply(274 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.802+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.802+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:275 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.813 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.803+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 67 ==== osd_op_reply(275 gc.1 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.803+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.803+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:276 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.804+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 95 ==== osd_op_reply(276 gc.2 [call] v31'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.804+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:277 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.804+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 96 ==== osd_op_reply(277 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.804+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.804+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:278 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.804+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 97 ==== osd_op_reply(278 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.804+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:279 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.814 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.805+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 98 ==== osd_op_reply(279 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.805+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.805+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:280 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01e7f80 con 0x5626a01a20f0 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.805+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 99 ==== osd_op_reply(280 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.805+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.805+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:281 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.806+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 100 ==== osd_op_reply(281 gc.2 [call] v31'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.806+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.806+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:282 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 58 ==== osd_op_reply(282 gc.3 [call] v31'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:283 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 59 ==== osd_op_reply(283 gc.3 [call out=15b] v0'0 uv285 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:284 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 60 ==== osd_op_reply(284 gc.3 [call out=24b] v0'0 uv285 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:285 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 61 ==== osd_op_reply(285 gc.3 [call out=15b] v0'0 uv285 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.807+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:286 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.808+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 62 ==== osd_op_reply(286 gc.3 [call out=15b] v0'0 uv285 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.808+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.808+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:287 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.809+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 63 ==== osd_op_reply(287 gc.3 [call] v31'286 uv286 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.809+0000 7eff8972d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-15T18:11:53.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.809+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:288 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 58 ==== osd_op_reply(288 gc.4 [call] v31'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:289 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 59 ==== osd_op_reply(289 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:290 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 60 ==== osd_op_reply(290 gc.4 [call out=24b] v0'0 uv92 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:291 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 61 ==== osd_op_reply(291 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.810+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:292 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.811+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 62 ==== osd_op_reply(292 gc.4 [call out=15b] v0'0 uv92 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.811+0000 7eff8972d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-15T18:11:53.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.811+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:293 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.811+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 63 ==== osd_op_reply(293 gc.4 [call] v31'93 uv93 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.812+0000 7efe3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.812+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94723894860896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.813+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94723894860896] v31'287 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.813+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94723894836000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.814+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94723894836000] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.814+0000 7eff8972d800 20 remove_watcher() i=0 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.814+0000 7eff8972d800 2 removed watcher, disabling cache 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.814+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94723894838784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.816+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94723894838784] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.816+0000 7eff8972d800 20 remove_watcher() i=1 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.816+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94723894843552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a01a20f0 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.817+0000 7eff8542f640 1 -- 172.21.15.173:0/249413357 <== osd.3 v2:172.21.15.173:6814/3793320597 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94723894843552] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff780bc030 con 0x5626a01a20f0 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.817+0000 7eff8972d800 20 remove_watcher() i=2 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.817+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94723894849376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff780bf060 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.818+0000 7eff84c2e640 1 -- 172.21.15.173:0/249413357 <== osd.2 v2:172.21.15.173:6808/3098545592 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94723894849376] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff7c037040 con 0x7eff780bf060 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.818+0000 7eff8972d800 20 remove_watcher() i=3 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.818+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94723894850432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x5626a019da80 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.819+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.1 v2:172.21.15.173:6800/3225970667 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94723894850432] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x5626a019da80 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.819+0000 7eff8972d800 20 remove_watcher() i=4 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.819+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94723894852928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.820+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94723894852928] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.819 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.820+0000 7eff8972d800 20 remove_watcher() i=5 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.820+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94723894858336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.821+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94723894858336] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.821+0000 7eff8972d800 20 remove_watcher() i=6 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.821+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94723894855680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5626a01ec0c0 con 0x7eff7c00f070 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 <== osd.0 v2:172.21.15.3:6800/774076599 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94723894855680] v31'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff800083e0 con 0x7eff7c00f070 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 20 remove_watcher() i=7 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7eff7c00f070 msgr2=0x7eff7c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7eff7c00f070 0x7eff7c02e910 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a019da80 msgr2=0x5626a019ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a019da80 0x5626a019ff40 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.820 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7eff780bf060 msgr2=0x7eff78072680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7eff780bf060 0x7eff78072680 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a01a20f0 msgr2=0x5626a01a44e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.822+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a01a20f0 0x5626a01a44e0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe50036900 msgr2=0x7efe50038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe50036900 0x7efe50038dc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5626a016fe90 tx=0x7eff7c010000 comp rx=0 tx=0).stop 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 msgr2=0x5626a0192450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/249413357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a018b0a0 0x5626a0192450 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7eff7807bbc0 tx=0x7eff78053f20 comp rx=0 tx=0).stop 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 reap_dead start 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff85c30640 1 -- 172.21.15.173:0/249413357 reap_dead start 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 shutdown_connections 2024-05-15T18:11:53.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 >> 172.21.15.173:0/249413357 conn(0x5626a01873b0 msgr2=0x5626a0184a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 shutdown_connections 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/249413357 wait complete. 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe5c036920 msgr2=0x7efe5c038de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe5c036920 0x7efe5c038de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5626a0167530 tx=0x7eff7c00f000 comp rx=0 tx=0).stop 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a017def0 msgr2=0x5626a017e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a017def0 0x5626a017e310 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7eff7808ce10 tx=0x7eff78055b10 comp rx=0 tx=0).stop 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 shutdown_connections 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe5c036920 0x7efe5c038de0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/3723603154 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a017def0 0x5626a017e310 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 >> 172.21.15.173:0/3723603154 conn(0x5626a0171f90 msgr2=0x5626a0172390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 shutdown_connections 2024-05-15T18:11:53.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/3723603154 wait complete. 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5626a016cec0 msgr2=0x5626a016f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x5626a016cec0 0x5626a016f330 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a0064230 msgr2=0x5626a01666e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.823+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x5626a0064230 0x5626a01666e0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a0168f80 msgr2=0x5626a016b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x5626a0168f80 0x5626a016b370 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe6c036900 msgr2=0x7efe6c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7efe6c036900 0x7efe6c038dc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff7c000f60 tx=0x7eff7c001370 comp rx=0 tx=0).stop 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 msgr2=0x5626a015f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 --2- 172.21.15.173:0/680797447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626a0062fd0 0x5626a015f4f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7eff78061040 tx=0x7eff78003330 comp rx=0 tx=0).stop 2024-05-15T18:11:53.823 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff85c30640 1 -- 172.21.15.173:0/680797447 reap_dead start 2024-05-15T18:11:53.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 shutdown_connections 2024-05-15T18:11:53.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 >> 172.21.15.173:0/680797447 conn(0x5626a005e5b0 msgr2=0x5626a014d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:53.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 shutdown_connections 2024-05-15T18:11:53.824 INFO:teuthology.orchestra.run.smithi173.stderr:2024-05-15T18:11:53.824+0000 7eff8972d800 1 -- 172.21.15.173:0/680797447 wait complete. 2024-05-15T18:11:53.824 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-15T18:11:53.834 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T18:11:53.834 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.968+0000 7f24059e6640 1 Processor -- start 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.968+0000 7f24059e6640 1 -- start start 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f24059e6640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f240006d9d0 0x7f240006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f24059e6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2400072290 con 0x7f240012e390 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f24059e6640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f240006eec0 con 0x7f240006d9d0 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f23feffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f240006d9d0 0x7f240006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f23fe7fc640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f240012e390 0x7f240012e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60888/0 (socket says 172.21.15.3:60888) 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f23fe7fc640 1 -- 172.21.15.3:0/828473915 learned_addr learned my addr 172.21.15.3:0/828473915 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f23feffd640 1 -- 172.21.15.3:0/828473915 >> v1:172.21.15.3:6789/0 conn(0x7f240012e390 legacy=0x7f240012e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f23fdffb640 1 -- 172.21.15.3:0/828473915 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238710424 0 0) 0x7f2400072290 con 0x7f240012e390 2024-05-15T18:11:53.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.969+0000 7f23feffd640 1 -- 172.21.15.3:0/828473915 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240006d4f0 con 0x7f240006d9d0 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.970+0000 7f23feffd640 1 --2- 172.21.15.3:0/828473915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240006ddb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009720 tx=0x7f23f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76531642b892bcd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.970+0000 7f23fdffb640 1 -- 172.21.15.3:0/828473915 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23f0035020 con 0x7f240006d9d0 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.970+0000 7f23fdffb640 1 -- 172.21.15.3:0/828473915 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f0031760 con 0x7f240006d9d0 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.970+0000 7f23fdffb640 1 -- 172.21.15.3:0/828473915 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23f0031a60 con 0x7f240006d9d0 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.971+0000 7f24059e6640 1 -- 172.21.15.3:0/828473915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 msgr2=0x7f240006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.971+0000 7f24059e6640 1 --2- 172.21.15.3:0/828473915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240006ddb0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009720 tx=0x7f23f002b8d0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.971+0000 7f24059e6640 1 -- 172.21.15.3:0/828473915 shutdown_connections 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.971+0000 7f24059e6640 1 --2- 172.21.15.3:0/828473915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240006ddb0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.971+0000 7f24059e6640 1 -- 172.21.15.3:0/828473915 >> 172.21.15.3:0/828473915 conn(0x7f240009d750 msgr2=0x7f240009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.971+0000 7f24059e6640 1 -- 172.21.15.3:0/828473915 shutdown_connections 2024-05-15T18:11:53.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.971+0000 7f24059e6640 1 -- 172.21.15.3:0/828473915 wait complete. 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.972+0000 7f24059e6640 1 Processor -- start 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.972+0000 7f24059e6640 1 -- start start 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.972+0000 7f24059e6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240012a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.972+0000 7f24059e6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f240006f4e0 con 0x7f240006d9d0 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.972+0000 7f23feffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240012a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.972+0000 7f23feffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240012a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49218/0 (socket says 172.21.15.3:49218) 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.972+0000 7f23feffd640 1 -- 172.21.15.3:0/1445917224 learned_addr learned my addr 172.21.15.3:0/1445917224 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.973+0000 7f23feffd640 1 -- 172.21.15.3:0/1445917224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240008ec60 con 0x7f240006d9d0 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.973+0000 7f23feffd640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240012a6c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009840 tx=0x7f23f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.973+0000 7f23e7fff640 1 -- 172.21.15.3:0/1445917224 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23f003cb50 con 0x7f240006d9d0 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.973+0000 7f23e7fff640 1 -- 172.21.15.3:0/1445917224 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f003ccf0 con 0x7f240006d9d0 2024-05-15T18:11:53.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.973+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240008ea60 con 0x7f240006d9d0 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.973+0000 7f23e7fff640 1 -- 172.21.15.3:0/1445917224 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23f0004030 con 0x7f240006d9d0 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.973+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240008eff0 con 0x7f240006d9d0 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.974+0000 7f23e7fff640 1 -- 172.21.15.3:0/1445917224 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23f0038020 con 0x7f240006d9d0 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.974+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240006e640 con 0x7f240006d9d0 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.974+0000 7f23e7fff640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f23ec038060 0x7f23ec03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.974+0000 7f23e7fff640 1 -- 172.21.15.3:0/1445917224 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f23f006e050 con 0x7f240006d9d0 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.974+0000 7f23fe7fc640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f23ec038060 0x7f23ec03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:53.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.975+0000 7f23fe7fc640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f23ec038060 0x7f23ec03a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23f4000c00 tx=0x7f23f4007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:53.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:53.979+0000 7f23e7fff640 1 -- 172.21.15.3:0/1445917224 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f23f0041070 con 0x7f240006d9d0 2024-05-15T18:11:54.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.160+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2400062e90 con 0x7f23ec038060 2024-05-15T18:11:54.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.177+0000 7f23e7fff640 1 -- 172.21.15.3:0/1445917224 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665435 (secure 0 0 0) 0x7f2400062e90 con 0x7f23ec038060 2024-05-15T18:11:54.161 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:11:54.168 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f23ec038060 msgr2=0x7f23ec03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f23ec038060 0x7f23ec03a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23f4000c00 tx=0x7f23f4007910 comp rx=0 tx=0).stop 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 msgr2=0x7f240012a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240012a6c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009840 tx=0x7f23f00046c0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 shutdown_connections 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f23ec038060 0x7f23ec03a520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 --2- 172.21.15.3:0/1445917224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f240006d9d0 0x7f240012a6c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 >> 172.21.15.3:0/1445917224 conn(0x7f240009d750 msgr2=0x7f240009cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 shutdown_connections 2024-05-15T18:11:54.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.181+0000 7f24059e6640 1 -- 172.21.15.3:0/1445917224 wait complete. 2024-05-15T18:11:54.172 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-05-15T18:11:52.376043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4881,"num_read_kb":4462,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198696,"kb_used_data":53192,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288664,"statfs":{"total":386547056640,"available":386343591936,"internally_reserved":0,"allocated":54468608,"data_stored":53322798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":148956946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004237"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.335908+0000","last_change":"2024-05-15T18:08:37.185277+0000","last_active":"2024-05-15T18:09:20.335908+0000","last_peered":"2024-05-15T18:09:20.335908+0000","last_clean":"2024-05-15T18:09:20.335908+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:09:20.335908+0000","last_undegraded":"2024-05-15T18:09:20.335908+0000","last_fullsized":"2024-05-15T18:09:20.335908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101814+0000","last_change":"2024-05-15T18:08:39.181950+0000","last_active":"2024-05-15T18:11:47.101814+0000","last_peered":"2024-05-15T18:11:47.101814+0000","last_clean":"2024-05-15T18:11:47.101814+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:11:47.101814+0000","last_undegraded":"2024-05-15T18:11:47.101814+0000","last_fullsized":"2024-05-15T18:11:47.101814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400383+0000","last_change":"2024-05-15T18:08:37.180815+0000","last_active":"2024-05-15T18:09:19.400383+0000","last_peered":"2024-05-15T18:09:19.400383+0000","last_clean":"2024-05-15T18:09:19.400383+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:09:19.400383+0000","last_undegraded":"2024-05-15T18:09:19.400383+0000","last_fullsized":"2024-05-15T18:09:19.400383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:11:28.156751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801449+0000","last_change":"2024-05-15T18:08:39.183780+0000","last_active":"2024-05-15T18:11:46.801449+0000","last_peered":"2024-05-15T18:11:46.801449+0000","last_clean":"2024-05-15T18:11:46.801449+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:11:46.801449+0000","last_undegraded":"2024-05-15T18:11:46.801449+0000","last_fullsized":"2024-05-15T18:11:46.801449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:15.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403839+0000","last_change":"2024-05-15T18:08:37.186280+0000","last_active":"2024-05-15T18:09:19.403839+0000","last_peered":"2024-05-15T18:09:19.403839+0000","last_clean":"2024-05-15T18:09:19.403839+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:09:19.403839+0000","last_undegraded":"2024-05-15T18:09:19.403839+0000","last_fullsized":"2024-05-15T18:09:19.403839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:41.112234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413763+0000","last_change":"2024-05-15T18:08:39.184797+0000","last_active":"2024-05-15T18:10:46.413763+0000","last_peered":"2024-05-15T18:10:46.413763+0000","last_clean":"2024-05-15T18:10:46.413763+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:10:46.413763+0000","last_undegraded":"2024-05-15T18:10:46.413763+0000","last_fullsized":"2024-05-15T18:10:46.413763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:31.818225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.386408+0000","last_change":"2024-05-15T18:08:37.174049+0000","last_active":"2024-05-15T18:10:46.386408+0000","last_peered":"2024-05-15T18:10:46.386408+0000","last_clean":"2024-05-15T18:10:46.386408+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:10:46.386408+0000","last_undegraded":"2024-05-15T18:10:46.386408+0000","last_fullsized":"2024-05-15T18:10:46.386408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'11","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397038+0000","last_change":"2024-05-15T18:08:39.181113+0000","last_active":"2024-05-15T18:11:08.397038+0000","last_peered":"2024-05-15T18:11:08.397038+0000","last_clean":"2024-05-15T18:11:08.397038+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:11:08.397038+0000","last_undegraded":"2024-05-15T18:11:08.397038+0000","last_fullsized":"2024-05-15T18:11:08.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:57.396932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399830+0000","last_change":"2024-05-15T18:08:37.179942+0000","last_active":"2024-05-15T18:09:19.399830+0000","last_peered":"2024-05-15T18:09:19.399830+0000","last_clean":"2024-05-15T18:09:19.399830+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:09:19.399830+0000","last_undegraded":"2024-05-15T18:09:19.399830+0000","last_fullsized":"2024-05-15T18:09:19.399830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:34.419734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.842198+0000","last_change":"2024-05-15T18:08:39.185769+0000","last_active":"2024-05-15T18:10:02.842198+0000","last_peered":"2024-05-15T18:10:02.842198+0000","last_clean":"2024-05-15T18:10:02.842198+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:10:02.842198+0000","last_undegraded":"2024-05-15T18:10:02.842198+0000","last_fullsized":"2024-05-15T18:10:02.842198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:44.743277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405752+0000","last_change":"2024-05-15T18:08:37.178875+0000","last_active":"2024-05-15T18:09:19.405752+0000","last_peered":"2024-05-15T18:09:19.405752+0000","last_clean":"2024-05-15T18:09:19.405752+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:09:19.405752+0000","last_undegraded":"2024-05-15T18:09:19.405752+0000","last_fullsized":"2024-05-15T18:09:19.405752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027476+0000","last_change":"2024-05-15T18:08:39.189004+0000","last_active":"2024-05-15T18:11:47.027476+0000","last_peered":"2024-05-15T18:11:47.027476+0000","last_clean":"2024-05-15T18:11:47.027476+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:11:47.027476+0000","last_undegraded":"2024-05-15T18:11:47.027476+0000","last_fullsized":"2024-05-15T18:11:47.027476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:55.844079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401251+0000","last_change":"2024-05-15T18:08:37.177010+0000","last_active":"2024-05-15T18:09:19.401251+0000","last_peered":"2024-05-15T18:09:19.401251+0000","last_clean":"2024-05-15T18:09:19.401251+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:09:19.401251+0000","last_undegraded":"2024-05-15T18:09:19.401251+0000","last_fullsized":"2024-05-15T18:09:19.401251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:17:38.714290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'5","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392579+0000","last_change":"2024-05-15T18:08:39.187168+0000","last_active":"2024-05-15T18:10:43.392579+0000","last_peered":"2024-05-15T18:10:43.392579+0000","last_clean":"2024-05-15T18:10:43.392579+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:10:43.392579+0000","last_undegraded":"2024-05-15T18:10:43.392579+0000","last_fullsized":"2024-05-15T18:10:43.392579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398685+0000","last_change":"2024-05-15T18:08:37.180981+0000","last_active":"2024-05-15T18:09:19.398685+0000","last_peered":"2024-05-15T18:09:19.398685+0000","last_clean":"2024-05-15T18:09:19.398685+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:09:19.398685+0000","last_undegraded":"2024-05-15T18:09:19.398685+0000","last_fullsized":"2024-05-15T18:09:19.398685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102117+0000","last_change":"2024-05-15T18:08:39.185117+0000","last_active":"2024-05-15T18:11:47.102117+0000","last_peered":"2024-05-15T18:11:47.102117+0000","last_clean":"2024-05-15T18:11:47.102117+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:11:47.102117+0000","last_undegraded":"2024-05-15T18:11:47.102117+0000","last_fullsized":"2024-05-15T18:11:47.102117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102111+0000","last_change":"2024-05-15T18:08:39.186238+0000","last_active":"2024-05-15T18:11:47.102111+0000","last_peered":"2024-05-15T18:11:47.102111+0000","last_clean":"2024-05-15T18:11:47.102111+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:11:47.102111+0000","last_undegraded":"2024-05-15T18:11:47.102111+0000","last_fullsized":"2024-05-15T18:11:47.102111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:18.269525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401873+0000","last_change":"2024-05-15T18:08:37.177868+0000","last_active":"2024-05-15T18:09:19.401873+0000","last_peered":"2024-05-15T18:09:19.401873+0000","last_clean":"2024-05-15T18:09:19.401873+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:09:19.401873+0000","last_undegraded":"2024-05-15T18:09:19.401873+0000","last_fullsized":"2024-05-15T18:09:19.401873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901911+0000","last_change":"2024-05-15T18:08:39.184998+0000","last_active":"2024-05-15T18:11:46.901911+0000","last_peered":"2024-05-15T18:11:46.901911+0000","last_clean":"2024-05-15T18:11:46.901911+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:11:46.901911+0000","last_undegraded":"2024-05-15T18:11:46.901911+0000","last_fullsized":"2024-05-15T18:11:46.901911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:52.199938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.309110+0000","last_change":"2024-05-15T18:08:37.179232+0000","last_active":"2024-05-15T18:10:43.309110+0000","last_peered":"2024-05-15T18:10:43.309110+0000","last_clean":"2024-05-15T18:10:43.309110+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:10:43.309110+0000","last_undegraded":"2024-05-15T18:10:43.309110+0000","last_fullsized":"2024-05-15T18:10:43.309110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353249+0000","last_change":"2024-05-15T18:08:39.187737+0000","last_active":"2024-05-15T18:09:20.353249+0000","last_peered":"2024-05-15T18:09:20.353249+0000","last_clean":"2024-05-15T18:09:20.353249+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:09:20.353249+0000","last_undegraded":"2024-05-15T18:09:20.353249+0000","last_fullsized":"2024-05-15T18:09:20.353249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403507+0000","last_change":"2024-05-15T18:08:37.176725+0000","last_active":"2024-05-15T18:09:19.403507+0000","last_peered":"2024-05-15T18:09:19.403507+0000","last_clean":"2024-05-15T18:09:19.403507+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:09:19.403507+0000","last_undegraded":"2024-05-15T18:09:19.403507+0000","last_fullsized":"2024-05-15T18:09:19.403507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:14:09.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075342+0000","last_change":"2024-05-15T18:08:39.183706+0000","last_active":"2024-05-15T18:11:47.075342+0000","last_peered":"2024-05-15T18:11:47.075342+0000","last_clean":"2024-05-15T18:11:47.075342+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:11:47.075342+0000","last_undegraded":"2024-05-15T18:11:47.075342+0000","last_fullsized":"2024-05-15T18:11:47.075342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403416+0000","last_change":"2024-05-15T18:08:37.173166+0000","last_active":"2024-05-15T18:09:19.403416+0000","last_peered":"2024-05-15T18:09:19.403416+0000","last_clean":"2024-05-15T18:09:19.403416+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:09:19.403416+0000","last_undegraded":"2024-05-15T18:09:19.403416+0000","last_fullsized":"2024-05-15T18:09:19.403416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820262+0000","last_change":"2024-05-15T18:08:39.183490+0000","last_active":"2024-05-15T18:09:20.820262+0000","last_peered":"2024-05-15T18:09:20.820262+0000","last_clean":"2024-05-15T18:09:20.820262+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:09:20.820262+0000","last_undegraded":"2024-05-15T18:09:20.820262+0000","last_fullsized":"2024-05-15T18:09:20.820262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:04.391798+0000","last_change":"2024-05-15T18:08:37.180056+0000","last_active":"2024-05-15T18:11:04.391798+0000","last_peered":"2024-05-15T18:11:04.391798+0000","last_clean":"2024-05-15T18:11:04.391798+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:11:04.391798+0000","last_undegraded":"2024-05-15T18:11:04.391798+0000","last_fullsized":"2024-05-15T18:11:04.391798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.638104+0000","last_change":"2024-05-15T18:08:39.180165+0000","last_active":"2024-05-15T18:10:02.638104+0000","last_peered":"2024-05-15T18:10:02.638104+0000","last_clean":"2024-05-15T18:10:02.638104+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:10:02.638104+0000","last_undegraded":"2024-05-15T18:10:02.638104+0000","last_fullsized":"2024-05-15T18:10:02.638104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398920+0000","last_change":"2024-05-15T18:08:37.181235+0000","last_active":"2024-05-15T18:09:19.398920+0000","last_peered":"2024-05-15T18:09:19.398920+0000","last_clean":"2024-05-15T18:09:19.398920+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:09:19.398920+0000","last_undegraded":"2024-05-15T18:09:19.398920+0000","last_fullsized":"2024-05-15T18:09:19.398920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:24.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.052271+0000","last_change":"2024-05-15T18:08:47.223064+0000","last_active":"2024-05-15T18:11:47.052271+0000","last_peered":"2024-05-15T18:11:47.052271+0000","last_clean":"2024-05-15T18:11:47.052271+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:11:47.052271+0000","last_undegraded":"2024-05-15T18:11:47.052271+0000","last_fullsized":"2024-05-15T18:11:47.052271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:52.698600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101931+0000","last_change":"2024-05-15T18:09:19.408744+0000","last_active":"2024-05-15T18:11:47.101931+0000","last_peered":"2024-05-15T18:11:47.101931+0000","last_clean":"2024-05-15T18:11:47.101931+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:11:47.101931+0000","last_undegraded":"2024-05-15T18:11:47.101931+0000","last_fullsized":"2024-05-15T18:11:47.101931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:44.669224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398972+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:09:19.398972+0000","last_peered":"2024-05-15T18:09:19.398972+0000","last_clean":"2024-05-15T18:09:19.398972+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:09:19.398972+0000","last_undegraded":"2024-05-15T18:09:19.398972+0000","last_fullsized":"2024-05-15T18:09:19.398972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:34.978659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.039167+0000","last_change":"2024-05-15T18:08:41.191864+0000","last_active":"2024-05-15T18:10:46.039167+0000","last_peered":"2024-05-15T18:10:46.039167+0000","last_clean":"2024-05-15T18:10:46.039167+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:10:46.039167+0000","last_undegraded":"2024-05-15T18:10:46.039167+0000","last_fullsized":"2024-05-15T18:10:46.039167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.990907+0000","last_change":"2024-05-15T18:08:43.205617+0000","last_active":"2024-05-15T18:10:44.990907+0000","last_peered":"2024-05-15T18:10:44.990907+0000","last_clean":"2024-05-15T18:10:44.990907+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:10:44.990907+0000","last_undegraded":"2024-05-15T18:10:44.990907+0000","last_fullsized":"2024-05-15T18:10:44.990907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:54.834292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401260+0000","last_change":"2024-05-15T18:08:45.209245+0000","last_active":"2024-05-15T18:09:19.401260+0000","last_peered":"2024-05-15T18:09:19.401260+0000","last_clean":"2024-05-15T18:09:19.401260+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:09:19.401260+0000","last_undegraded":"2024-05-15T18:09:19.401260+0000","last_fullsized":"2024-05-15T18:09:19.401260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.077076+0000","last_change":"2024-05-15T18:08:47.223088+0000","last_active":"2024-05-15T18:11:47.077076+0000","last_peered":"2024-05-15T18:11:47.077076+0000","last_clean":"2024-05-15T18:11:47.077076+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:11:47.077076+0000","last_undegraded":"2024-05-15T18:11:47.077076+0000","last_fullsized":"2024-05-15T18:11:47.077076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:02.637943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102151+0000","last_change":"2024-05-15T18:08:39.182435+0000","last_active":"2024-05-15T18:11:47.102151+0000","last_peered":"2024-05-15T18:11:47.102151+0000","last_clean":"2024-05-15T18:11:47.102151+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:11:47.102151+0000","last_undegraded":"2024-05-15T18:11:47.102151+0000","last_fullsized":"2024-05-15T18:11:47.102151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:54.513611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406138+0000","last_change":"2024-05-15T18:08:37.176655+0000","last_active":"2024-05-15T18:09:19.406138+0000","last_peered":"2024-05-15T18:09:19.406138+0000","last_clean":"2024-05-15T18:09:19.406138+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:09:19.406138+0000","last_undegraded":"2024-05-15T18:09:19.406138+0000","last_fullsized":"2024-05-15T18:09:19.406138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399967+0000","last_change":"2024-05-15T18:08:41.190513+0000","last_active":"2024-05-15T18:09:19.399967+0000","last_peered":"2024-05-15T18:09:19.399967+0000","last_clean":"2024-05-15T18:09:19.399967+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:09:19.399967+0000","last_undegraded":"2024-05-15T18:09:19.399967+0000","last_fullsized":"2024-05-15T18:09:19.399967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:24:07.182527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.415322+0000","last_change":"2024-05-15T18:08:43.193059+0000","last_active":"2024-05-15T18:10:46.415322+0000","last_peered":"2024-05-15T18:10:46.415322+0000","last_clean":"2024-05-15T18:10:46.415322+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:10:46.415322+0000","last_undegraded":"2024-05-15T18:10:46.415322+0000","last_fullsized":"2024-05-15T18:10:46.415322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:03:54.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401523+0000","last_change":"2024-05-15T18:08:45.200547+0000","last_active":"2024-05-15T18:09:19.401523+0000","last_peered":"2024-05-15T18:09:19.401523+0000","last_clean":"2024-05-15T18:09:19.401523+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:09:19.401523+0000","last_undegraded":"2024-05-15T18:09:19.401523+0000","last_fullsized":"2024-05-15T18:09:19.401523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.731935+0000","last_change":"2024-05-15T18:08:47.215478+0000","last_active":"2024-05-15T18:09:19.731935+0000","last_peered":"2024-05-15T18:09:19.731935+0000","last_clean":"2024-05-15T18:09:19.731935+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:09:19.731935+0000","last_undegraded":"2024-05-15T18:09:19.731935+0000","last_fullsized":"2024-05-15T18:09:19.731935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736547+0000","last_change":"2024-05-15T18:08:39.180798+0000","last_active":"2024-05-15T18:09:19.736547+0000","last_peered":"2024-05-15T18:09:19.736547+0000","last_clean":"2024-05-15T18:09:19.736547+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:09:19.736547+0000","last_undegraded":"2024-05-15T18:09:19.736547+0000","last_fullsized":"2024-05-15T18:09:19.736547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:49.260782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.341191+0000","last_change":"2024-05-15T18:08:37.185177+0000","last_active":"2024-05-15T18:09:20.341191+0000","last_peered":"2024-05-15T18:09:20.341191+0000","last_clean":"2024-05-15T18:09:20.341191+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:09:20.341191+0000","last_undegraded":"2024-05-15T18:09:20.341191+0000","last_fullsized":"2024-05-15T18:09:20.341191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:50.301378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:23.381565+0000","last_change":"2024-05-15T18:09:19.410089+0000","last_active":"2024-05-15T18:09:23.381565+0000","last_peered":"2024-05-15T18:09:23.381565+0000","last_clean":"2024-05-15T18:09:23.381565+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:09:23.381565+0000","last_undegraded":"2024-05-15T18:09:23.381565+0000","last_fullsized":"2024-05-15T18:09:23.381565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:15:56.615789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407814+0000","last_change":"2024-05-15T18:08:43.198970+0000","last_active":"2024-05-15T18:09:19.407814+0000","last_peered":"2024-05-15T18:09:19.407814+0000","last_clean":"2024-05-15T18:09:19.407814+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:09:19.407814+0000","last_undegraded":"2024-05-15T18:09:19.407814+0000","last_fullsized":"2024-05-15T18:09:19.407814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:48.849846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274331+0000","last_change":"2024-05-15T18:08:45.210771+0000","last_active":"2024-05-15T18:11:46.274331+0000","last_peered":"2024-05-15T18:11:46.274331+0000","last_clean":"2024-05-15T18:11:46.274331+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:11:46.274331+0000","last_undegraded":"2024-05-15T18:11:46.274331+0000","last_fullsized":"2024-05-15T18:11:46.274331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:10.645906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.408911+0000","last_change":"2024-05-15T18:08:47.220509+0000","last_active":"2024-05-15T18:10:46.408911+0000","last_peered":"2024-05-15T18:10:46.408911+0000","last_clean":"2024-05-15T18:10:46.408911+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:10:46.408911+0000","last_undegraded":"2024-05-15T18:10:46.408911+0000","last_fullsized":"2024-05-15T18:10:46.408911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:56.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'23","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111340+0000","last_change":"2024-05-15T18:08:39.187144+0000","last_active":"2024-05-15T18:11:47.111340+0000","last_peered":"2024-05-15T18:11:47.111340+0000","last_clean":"2024-05-15T18:11:47.111340+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:11:47.111340+0000","last_undegraded":"2024-05-15T18:11:47.111340+0000","last_fullsized":"2024-05-15T18:11:47.111340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399530+0000","last_change":"2024-05-15T18:08:37.176800+0000","last_active":"2024-05-15T18:09:19.399530+0000","last_peered":"2024-05-15T18:09:19.399530+0000","last_clean":"2024-05-15T18:09:19.399530+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:09:19.399530+0000","last_undegraded":"2024-05-15T18:09:19.399530+0000","last_fullsized":"2024-05-15T18:09:19.399530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400987+0000","last_change":"2024-05-15T18:08:41.191184+0000","last_active":"2024-05-15T18:09:19.400987+0000","last_peered":"2024-05-15T18:09:19.400987+0000","last_clean":"2024-05-15T18:09:19.400987+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:09:19.400987+0000","last_undegraded":"2024-05-15T18:09:19.400987+0000","last_fullsized":"2024-05-15T18:09:19.400987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:25.413878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.985510+0000","last_change":"2024-05-15T18:08:43.199596+0000","last_active":"2024-05-15T18:10:44.985510+0000","last_peered":"2024-05-15T18:10:44.985510+0000","last_clean":"2024-05-15T18:10:44.985510+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:10:44.985510+0000","last_undegraded":"2024-05-15T18:10:44.985510+0000","last_fullsized":"2024-05-15T18:10:44.985510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:22.284084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":435,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.107028+0000","last_change":"2024-05-15T18:08:45.198740+0000","last_active":"2024-05-15T18:11:47.107028+0000","last_peered":"2024-05-15T18:11:47.107028+0000","last_clean":"2024-05-15T18:11:47.107028+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:47.107028+0000","last_undegraded":"2024-05-15T18:11:47.107028+0000","last_fullsized":"2024-05-15T18:11:47.107028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:30.679986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.798859+0000","last_change":"2024-05-15T18:08:39.194038+0000","last_active":"2024-05-15T18:11:46.798859+0000","last_peered":"2024-05-15T18:11:46.798859+0000","last_clean":"2024-05-15T18:11:46.798859+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:11:46.798859+0000","last_undegraded":"2024-05-15T18:11:46.798859+0000","last_fullsized":"2024-05-15T18:11:46.798859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:23:21.748030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408742+0000","last_change":"2024-05-15T18:08:37.173486+0000","last_active":"2024-05-15T18:09:19.408742+0000","last_peered":"2024-05-15T18:09:19.408742+0000","last_clean":"2024-05-15T18:09:19.408742+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:09:19.408742+0000","last_undegraded":"2024-05-15T18:09:19.408742+0000","last_fullsized":"2024-05-15T18:09:19.408742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402302+0000","last_change":"2024-05-15T18:08:41.193621+0000","last_active":"2024-05-15T18:09:19.402302+0000","last_peered":"2024-05-15T18:09:19.402302+0000","last_clean":"2024-05-15T18:09:19.402302+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:09:19.402302+0000","last_undegraded":"2024-05-15T18:09:19.402302+0000","last_fullsized":"2024-05-15T18:09:19.402302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:49.471489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'41","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.995296+0000","last_change":"2024-05-15T18:08:43.190370+0000","last_active":"2024-05-15T18:10:44.995296+0000","last_peered":"2024-05-15T18:10:44.995296+0000","last_clean":"2024-05-15T18:10:44.995296+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:10:44.995296+0000","last_undegraded":"2024-05-15T18:10:44.995296+0000","last_fullsized":"2024-05-15T18:10:44.995296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:30:17.103247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399470+0000","last_change":"2024-05-15T18:08:45.198524+0000","last_active":"2024-05-15T18:09:19.399470+0000","last_peered":"2024-05-15T18:09:19.399470+0000","last_clean":"2024-05-15T18:09:19.399470+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:09:19.399470+0000","last_undegraded":"2024-05-15T18:09:19.399470+0000","last_fullsized":"2024-05-15T18:09:19.399470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.647715+0000","last_change":"2024-05-15T18:08:47.221822+0000","last_active":"2024-05-15T18:10:02.647715+0000","last_peered":"2024-05-15T18:10:02.647715+0000","last_clean":"2024-05-15T18:10:02.647715+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:10:02.647715+0000","last_undegraded":"2024-05-15T18:10:02.647715+0000","last_fullsized":"2024-05-15T18:10:02.647715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:13.338228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.411141+0000","last_change":"2024-05-15T18:08:39.186448+0000","last_active":"2024-05-15T18:10:46.411141+0000","last_peered":"2024-05-15T18:10:46.411141+0000","last_clean":"2024-05-15T18:10:46.411141+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:10:46.411141+0000","last_undegraded":"2024-05-15T18:10:46.411141+0000","last_fullsized":"2024-05-15T18:10:46.411141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:19.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.409682+0000","last_change":"2024-05-15T18:08:37.179060+0000","last_active":"2024-05-15T18:09:19.409682+0000","last_peered":"2024-05-15T18:09:19.409682+0000","last_clean":"2024-05-15T18:09:19.409682+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:09:19.409682+0000","last_undegraded":"2024-05-15T18:09:19.409682+0000","last_fullsized":"2024-05-15T18:09:19.409682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"22'1","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.049391+0000","last_change":"2024-05-15T18:08:41.193828+0000","last_active":"2024-05-15T18:10:46.049391+0000","last_peered":"2024-05-15T18:10:46.049391+0000","last_clean":"2024-05-15T18:10:46.049391+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:10:46.049391+0000","last_undegraded":"2024-05-15T18:10:46.049391+0000","last_fullsized":"2024-05-15T18:10:46.049391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:53.033474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.975080+0000","last_change":"2024-05-15T18:08:43.205152+0000","last_active":"2024-05-15T18:10:44.975080+0000","last_peered":"2024-05-15T18:10:44.975080+0000","last_clean":"2024-05-15T18:10:44.975080+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:10:44.975080+0000","last_undegraded":"2024-05-15T18:10:44.975080+0000","last_fullsized":"2024-05-15T18:10:44.975080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:54:29.654507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399047+0000","last_change":"2024-05-15T18:08:45.207980+0000","last_active":"2024-05-15T18:09:19.399047+0000","last_peered":"2024-05-15T18:09:19.399047+0000","last_clean":"2024-05-15T18:09:19.399047+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:09:19.399047+0000","last_undegraded":"2024-05-15T18:09:19.399047+0000","last_fullsized":"2024-05-15T18:09:19.399047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:57.088948+0000","last_change":"2024-05-15T18:08:47.217227+0000","last_active":"2024-05-15T18:09:57.088948+0000","last_peered":"2024-05-15T18:09:57.088948+0000","last_clean":"2024-05-15T18:09:57.088948+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:09:57.088948+0000","last_undegraded":"2024-05-15T18:09:57.088948+0000","last_fullsized":"2024-05-15T18:09:57.088948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102085+0000","last_change":"2024-05-15T18:08:39.185744+0000","last_active":"2024-05-15T18:11:47.102085+0000","last_peered":"2024-05-15T18:11:47.102085+0000","last_clean":"2024-05-15T18:11:47.102085+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:11:47.102085+0000","last_undegraded":"2024-05-15T18:11:47.102085+0000","last_fullsized":"2024-05-15T18:11:47.102085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:26.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.761148+0000","last_change":"2024-05-15T18:08:37.181644+0000","last_active":"2024-05-15T18:11:46.761148+0000","last_peered":"2024-05-15T18:11:46.761148+0000","last_clean":"2024-05-15T18:11:46.761148+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:11:46.761148+0000","last_undegraded":"2024-05-15T18:11:46.761148+0000","last_fullsized":"2024-05-15T18:11:46.761148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:40.709421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400858+0000","last_change":"2024-05-15T18:08:41.191195+0000","last_active":"2024-05-15T18:09:19.400858+0000","last_peered":"2024-05-15T18:09:19.400858+0000","last_clean":"2024-05-15T18:09:19.400858+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:09:19.400858+0000","last_undegraded":"2024-05-15T18:09:19.400858+0000","last_fullsized":"2024-05-15T18:09:19.400858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:55.559496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997111+0000","last_change":"2024-05-15T18:08:43.205104+0000","last_active":"2024-05-15T18:10:44.997111+0000","last_peered":"2024-05-15T18:10:44.997111+0000","last_clean":"2024-05-15T18:10:44.997111+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:10:44.997111+0000","last_undegraded":"2024-05-15T18:10:44.997111+0000","last_fullsized":"2024-05-15T18:10:44.997111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:18.034720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":397,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.228683+0000","last_change":"2024-05-15T18:08:45.205456+0000","last_active":"2024-05-15T18:11:47.228683+0000","last_peered":"2024-05-15T18:11:47.228683+0000","last_clean":"2024-05-15T18:11:47.228683+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:11:47.228683+0000","last_undegraded":"2024-05-15T18:11:47.228683+0000","last_fullsized":"2024-05-15T18:11:47.228683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400131+0000","last_change":"2024-05-15T18:08:47.218349+0000","last_active":"2024-05-15T18:09:19.400131+0000","last_peered":"2024-05-15T18:09:19.400131+0000","last_clean":"2024-05-15T18:09:19.400131+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:09:19.400131+0000","last_undegraded":"2024-05-15T18:09:19.400131+0000","last_fullsized":"2024-05-15T18:09:19.400131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:22.049537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075674+0000","last_change":"2024-05-15T18:08:39.180538+0000","last_active":"2024-05-15T18:11:47.075674+0000","last_peered":"2024-05-15T18:11:47.075674+0000","last_clean":"2024-05-15T18:11:47.075674+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:11:47.075674+0000","last_undegraded":"2024-05-15T18:11:47.075674+0000","last_fullsized":"2024-05-15T18:11:47.075674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399222+0000","last_change":"2024-05-15T18:08:37.179976+0000","last_active":"2024-05-15T18:09:19.399222+0000","last_peered":"2024-05-15T18:09:19.399222+0000","last_clean":"2024-05-15T18:09:19.399222+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:09:19.399222+0000","last_undegraded":"2024-05-15T18:09:19.399222+0000","last_fullsized":"2024-05-15T18:09:19.399222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:26.717872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399581+0000","last_change":"2024-05-15T18:08:41.193806+0000","last_active":"2024-05-15T18:09:19.399581+0000","last_peered":"2024-05-15T18:09:19.399581+0000","last_clean":"2024-05-15T18:09:19.399581+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:09:19.399581+0000","last_undegraded":"2024-05-15T18:09:19.399581+0000","last_fullsized":"2024-05-15T18:09:19.399581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:03:24.766255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'54","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.998912+0000","last_change":"2024-05-15T18:08:43.201489+0000","last_active":"2024-05-15T18:10:44.998912+0000","last_peered":"2024-05-15T18:10:44.998912+0000","last_clean":"2024-05-15T18:10:44.998912+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:10:44.998912+0000","last_undegraded":"2024-05-15T18:10:44.998912+0000","last_fullsized":"2024-05-15T18:10:44.998912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:29.914900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398840+0000","last_change":"2024-05-15T18:08:45.200667+0000","last_active":"2024-05-15T18:09:19.398840+0000","last_peered":"2024-05-15T18:09:19.398840+0000","last_clean":"2024-05-15T18:09:19.398840+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:09:19.398840+0000","last_undegraded":"2024-05-15T18:09:19.398840+0000","last_fullsized":"2024-05-15T18:09:19.398840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'18","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.205345+0000","last_change":"2024-05-15T18:08:47.219473+0000","last_active":"2024-05-15T18:11:47.205345+0000","last_peered":"2024-05-15T18:11:47.205345+0000","last_clean":"2024-05-15T18:11:47.205345+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:11:47.205345+0000","last_undegraded":"2024-05-15T18:11:47.205345+0000","last_fullsized":"2024-05-15T18:11:47.205345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:54.139301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801094+0000","last_change":"2024-05-15T18:08:39.191385+0000","last_active":"2024-05-15T18:11:46.801094+0000","last_peered":"2024-05-15T18:11:46.801094+0000","last_clean":"2024-05-15T18:11:46.801094+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:11:46.801094+0000","last_undegraded":"2024-05-15T18:11:46.801094+0000","last_fullsized":"2024-05-15T18:11:46.801094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:51.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399685+0000","last_change":"2024-05-15T18:08:37.181014+0000","last_active":"2024-05-15T18:09:19.399685+0000","last_peered":"2024-05-15T18:09:19.399685+0000","last_clean":"2024-05-15T18:09:19.399685+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:09:19.399685+0000","last_undegraded":"2024-05-15T18:09:19.399685+0000","last_fullsized":"2024-05-15T18:09:19.399685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408267+0000","last_change":"2024-05-15T18:08:41.189363+0000","last_active":"2024-05-15T18:09:19.408267+0000","last_peered":"2024-05-15T18:09:19.408267+0000","last_clean":"2024-05-15T18:09:19.408267+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:09:19.408267+0000","last_undegraded":"2024-05-15T18:09:19.408267+0000","last_fullsized":"2024-05-15T18:09:19.408267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:55.939790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.979398+0000","last_change":"2024-05-15T18:08:43.192533+0000","last_active":"2024-05-15T18:10:44.979398+0000","last_peered":"2024-05-15T18:10:44.979398+0000","last_clean":"2024-05-15T18:10:44.979398+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:10:44.979398+0000","last_undegraded":"2024-05-15T18:10:44.979398+0000","last_fullsized":"2024-05-15T18:10:44.979398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:12.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403941+0000","last_change":"2024-05-15T18:08:45.210581+0000","last_active":"2024-05-15T18:09:19.403941+0000","last_peered":"2024-05-15T18:09:19.403941+0000","last_clean":"2024-05-15T18:09:19.403941+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:09:19.403941+0000","last_undegraded":"2024-05-15T18:09:19.403941+0000","last_fullsized":"2024-05-15T18:09:19.403941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:14.840773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393707+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:10:48.393707+0000","last_peered":"2024-05-15T18:10:48.393707+0000","last_clean":"2024-05-15T18:10:48.393707+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:10:48.393707+0000","last_undegraded":"2024-05-15T18:10:48.393707+0000","last_fullsized":"2024-05-15T18:10:48.393707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:06:12.136063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075396+0000","last_change":"2024-05-15T18:08:39.192086+0000","last_active":"2024-05-15T18:11:47.075396+0000","last_peered":"2024-05-15T18:11:47.075396+0000","last_clean":"2024-05-15T18:11:47.075396+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:11:47.075396+0000","last_undegraded":"2024-05-15T18:11:47.075396+0000","last_fullsized":"2024-05-15T18:11:47.075396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:08.553549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399520+0000","last_change":"2024-05-15T18:08:37.182183+0000","last_active":"2024-05-15T18:09:19.399520+0000","last_peered":"2024-05-15T18:09:19.399520+0000","last_clean":"2024-05-15T18:09:19.399520+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:09:19.399520+0000","last_undegraded":"2024-05-15T18:09:19.399520+0000","last_fullsized":"2024-05-15T18:09:19.399520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:19.415597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401501+0000","last_change":"2024-05-15T18:08:41.188718+0000","last_active":"2024-05-15T18:09:19.401501+0000","last_peered":"2024-05-15T18:09:19.401501+0000","last_clean":"2024-05-15T18:09:19.401501+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:09:19.401501+0000","last_undegraded":"2024-05-15T18:09:19.401501+0000","last_fullsized":"2024-05-15T18:09:19.401501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:42.285433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.006001+0000","last_change":"2024-05-15T18:08:43.194313+0000","last_active":"2024-05-15T18:10:45.006001+0000","last_peered":"2024-05-15T18:10:45.006001+0000","last_clean":"2024-05-15T18:10:45.006001+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:10:45.006001+0000","last_undegraded":"2024-05-15T18:10:45.006001+0000","last_fullsized":"2024-05-15T18:10:45.006001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:19.416460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.209358+0000","last_change":"2024-05-15T18:08:45.200646+0000","last_active":"2024-05-15T18:11:47.209358+0000","last_peered":"2024-05-15T18:11:47.209358+0000","last_clean":"2024-05-15T18:11:47.209358+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:11:47.209358+0000","last_undegraded":"2024-05-15T18:11:47.209358+0000","last_fullsized":"2024-05-15T18:11:47.209358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:10:00.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390249+0000","last_change":"2024-05-15T18:08:47.215424+0000","last_active":"2024-05-15T18:10:54.390249+0000","last_peered":"2024-05-15T18:10:54.390249+0000","last_clean":"2024-05-15T18:10:54.390249+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:10:54.390249+0000","last_undegraded":"2024-05-15T18:10:54.390249+0000","last_fullsized":"2024-05-15T18:10:54.390249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.800027+0000","last_change":"2024-05-15T18:08:39.187057+0000","last_active":"2024-05-15T18:11:46.800027+0000","last_peered":"2024-05-15T18:11:46.800027+0000","last_clean":"2024-05-15T18:11:46.800027+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:11:46.800027+0000","last_undegraded":"2024-05-15T18:11:46.800027+0000","last_fullsized":"2024-05-15T18:11:46.800027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.015300+0000","last_change":"2024-05-15T18:08:37.185221+0000","last_active":"2024-05-15T18:11:47.015300+0000","last_peered":"2024-05-15T18:11:47.015300+0000","last_clean":"2024-05-15T18:11:47.015300+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:11:47.015300+0000","last_undegraded":"2024-05-15T18:11:47.015300+0000","last_fullsized":"2024-05-15T18:11:47.015300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:28:54.139077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.048905+0000","last_change":"2024-05-15T18:08:41.190951+0000","last_active":"2024-05-15T18:10:46.048905+0000","last_peered":"2024-05-15T18:10:46.048905+0000","last_clean":"2024-05-15T18:10:46.048905+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:10:46.048905+0000","last_undegraded":"2024-05-15T18:10:46.048905+0000","last_fullsized":"2024-05-15T18:10:46.048905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:49.382359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399598+0000","last_change":"2024-05-15T18:08:43.204683+0000","last_active":"2024-05-15T18:09:19.399598+0000","last_peered":"2024-05-15T18:09:19.399598+0000","last_clean":"2024-05-15T18:09:19.399598+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:09:19.399598+0000","last_undegraded":"2024-05-15T18:09:19.399598+0000","last_fullsized":"2024-05-15T18:09:19.399598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:53.977325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":459,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.165903+0000","last_change":"2024-05-15T18:08:45.199310+0000","last_active":"2024-05-15T18:11:47.165903+0000","last_peered":"2024-05-15T18:11:47.165903+0000","last_clean":"2024-05-15T18:11:47.165903+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:11:47.165903+0000","last_undegraded":"2024-05-15T18:11:47.165903+0000","last_fullsized":"2024-05-15T18:11:47.165903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.189456+0000","last_change":"2024-05-15T18:08:47.215824+0000","last_active":"2024-05-15T18:10:46.189456+0000","last_peered":"2024-05-15T18:10:46.189456+0000","last_clean":"2024-05-15T18:10:46.189456+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:10:46.189456+0000","last_undegraded":"2024-05-15T18:10:46.189456+0000","last_fullsized":"2024-05-15T18:10:46.189456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:24:54.483230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082864+0000","last_change":"2024-05-15T18:08:39.194733+0000","last_active":"2024-05-15T18:09:20.082864+0000","last_peered":"2024-05-15T18:09:20.082864+0000","last_clean":"2024-05-15T18:09:20.082864+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:09:20.082864+0000","last_undegraded":"2024-05-15T18:09:20.082864+0000","last_fullsized":"2024-05-15T18:09:20.082864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:57.618713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398143+0000","last_change":"2024-05-15T18:08:37.183998+0000","last_active":"2024-05-15T18:09:19.398143+0000","last_peered":"2024-05-15T18:09:19.398143+0000","last_clean":"2024-05-15T18:09:19.398143+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:09:19.398143+0000","last_undegraded":"2024-05-15T18:09:19.398143+0000","last_fullsized":"2024-05-15T18:09:19.398143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:37.009803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399709+0000","last_change":"2024-05-15T18:08:41.189678+0000","last_active":"2024-05-15T18:09:19.399709+0000","last_peered":"2024-05-15T18:09:19.399709+0000","last_clean":"2024-05-15T18:09:19.399709+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:09:19.399709+0000","last_undegraded":"2024-05-15T18:09:19.399709+0000","last_fullsized":"2024-05-15T18:09:19.399709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:35.879769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.991934+0000","last_change":"2024-05-15T18:08:43.192247+0000","last_active":"2024-05-15T18:10:44.991934+0000","last_peered":"2024-05-15T18:10:44.991934+0000","last_clean":"2024-05-15T18:10:44.991934+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:10:44.991934+0000","last_undegraded":"2024-05-15T18:10:44.991934+0000","last_fullsized":"2024-05-15T18:10:44.991934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:20:02.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406471+0000","last_change":"2024-05-15T18:08:45.204036+0000","last_active":"2024-05-15T18:09:19.406471+0000","last_peered":"2024-05-15T18:09:19.406471+0000","last_clean":"2024-05-15T18:09:19.406471+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:09:19.406471+0000","last_undegraded":"2024-05-15T18:09:19.406471+0000","last_fullsized":"2024-05-15T18:09:19.406471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:50.743550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.207224+0000","last_change":"2024-05-15T18:08:47.214760+0000","last_active":"2024-05-15T18:11:47.207224+0000","last_peered":"2024-05-15T18:11:47.207224+0000","last_clean":"2024-05-15T18:11:47.207224+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:11:47.207224+0000","last_undegraded":"2024-05-15T18:11:47.207224+0000","last_fullsized":"2024-05-15T18:11:47.207224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:10.382678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401664+0000","last_change":"2024-05-15T18:08:39.189647+0000","last_active":"2024-05-15T18:09:19.401664+0000","last_peered":"2024-05-15T18:09:19.401664+0000","last_clean":"2024-05-15T18:09:19.401664+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:09:19.401664+0000","last_undegraded":"2024-05-15T18:09:19.401664+0000","last_fullsized":"2024-05-15T18:09:19.401664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:38.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399372+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:09:19.399372+0000","last_peered":"2024-05-15T18:09:19.399372+0000","last_clean":"2024-05-15T18:09:19.399372+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:09:19.399372+0000","last_undegraded":"2024-05-15T18:09:19.399372+0000","last_fullsized":"2024-05-15T18:09:19.399372+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:38:29.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399455+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:09:19.399455+0000","last_peered":"2024-05-15T18:09:19.399455+0000","last_clean":"2024-05-15T18:09:19.399455+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:09:19.399455+0000","last_undegraded":"2024-05-15T18:09:19.399455+0000","last_fullsized":"2024-05-15T18:09:19.399455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:51:30.696652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398630+0000","last_change":"2024-05-15T18:08:37.186535+0000","last_active":"2024-05-15T18:09:19.398630+0000","last_peered":"2024-05-15T18:09:19.398630+0000","last_clean":"2024-05-15T18:09:19.398630+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:09:19.398630+0000","last_undegraded":"2024-05-15T18:09:19.398630+0000","last_fullsized":"2024-05-15T18:09:19.398630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:41.333162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403085+0000","last_change":"2024-05-15T18:08:41.191173+0000","last_active":"2024-05-15T18:09:19.403085+0000","last_peered":"2024-05-15T18:09:19.403085+0000","last_clean":"2024-05-15T18:09:19.403085+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:09:19.403085+0000","last_undegraded":"2024-05-15T18:09:19.403085+0000","last_fullsized":"2024-05-15T18:09:19.403085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:33.825447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.003655+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:45.003655+0000","last_peered":"2024-05-15T18:10:45.003655+0000","last_clean":"2024-05-15T18:10:45.003655+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:10:45.003655+0000","last_undegraded":"2024-05-15T18:10:45.003655+0000","last_fullsized":"2024-05-15T18:10:45.003655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:19.100640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401279+0000","last_change":"2024-05-15T18:08:45.208179+0000","last_active":"2024-05-15T18:09:19.401279+0000","last_peered":"2024-05-15T18:09:19.401279+0000","last_clean":"2024-05-15T18:09:19.401279+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:09:19.401279+0000","last_undegraded":"2024-05-15T18:09:19.401279+0000","last_fullsized":"2024-05-15T18:09:19.401279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:39.895143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.117287+0000","last_change":"2024-05-15T18:08:47.212621+0000","last_active":"2024-05-15T18:11:47.117287+0000","last_peered":"2024-05-15T18:11:47.117287+0000","last_clean":"2024-05-15T18:11:47.117287+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:11:47.117287+0000","last_undegraded":"2024-05-15T18:11:47.117287+0000","last_fullsized":"2024-05-15T18:11:47.117287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:45.928963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817460+0000","last_change":"2024-05-15T18:08:39.180830+0000","last_active":"2024-05-15T18:09:20.817460+0000","last_peered":"2024-05-15T18:09:20.817460+0000","last_clean":"2024-05-15T18:09:20.817460+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:09:20.817460+0000","last_undegraded":"2024-05-15T18:09:20.817460+0000","last_fullsized":"2024-05-15T18:09:20.817460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:44.720954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398139+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:09:19.398139+0000","last_peered":"2024-05-15T18:09:19.398139+0000","last_clean":"2024-05-15T18:09:19.398139+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:09:19.398139+0000","last_undegraded":"2024-05-15T18:09:19.398139+0000","last_fullsized":"2024-05-15T18:09:19.398139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:44:53.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399209+0000","last_change":"2024-05-15T18:08:37.179663+0000","last_active":"2024-05-15T18:09:19.399209+0000","last_peered":"2024-05-15T18:09:19.399209+0000","last_clean":"2024-05-15T18:09:19.399209+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:09:19.399209+0000","last_undegraded":"2024-05-15T18:09:19.399209+0000","last_fullsized":"2024-05-15T18:09:19.399209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404825+0000","last_change":"2024-05-15T18:08:41.192861+0000","last_active":"2024-05-15T18:09:19.404825+0000","last_peered":"2024-05-15T18:09:19.404825+0000","last_clean":"2024-05-15T18:09:19.404825+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:09:19.404825+0000","last_undegraded":"2024-05-15T18:09:19.404825+0000","last_fullsized":"2024-05-15T18:09:19.404825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:32.544124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'276","reported_seq":479,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274219+0000","last_change":"2024-05-15T18:08:43.197473+0000","last_active":"2024-05-15T18:11:46.274219+0000","last_peered":"2024-05-15T18:11:46.274219+0000","last_clean":"2024-05-15T18:11:46.274219+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:11:46.274219+0000","last_undegraded":"2024-05-15T18:11:46.274219+0000","last_fullsized":"2024-05-15T18:11:46.274219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:56.013010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":363,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400972+0000","last_change":"2024-05-15T18:08:45.210778+0000","last_active":"2024-05-15T18:09:19.400972+0000","last_peered":"2024-05-15T18:09:19.400972+0000","last_clean":"2024-05-15T18:09:19.400972+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:09:19.400972+0000","last_undegraded":"2024-05-15T18:09:19.400972+0000","last_fullsized":"2024-05-15T18:09:19.400972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:40:44.142402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.643784+0000","last_change":"2024-05-15T18:08:47.217222+0000","last_active":"2024-05-15T18:10:02.643784+0000","last_peered":"2024-05-15T18:10:02.643784+0000","last_clean":"2024-05-15T18:10:02.643784+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:10:02.643784+0000","last_undegraded":"2024-05-15T18:10:02.643784+0000","last_fullsized":"2024-05-15T18:10:02.643784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075441+0000","last_change":"2024-05-15T18:08:39.186998+0000","last_active":"2024-05-15T18:11:47.075441+0000","last_peered":"2024-05-15T18:11:47.075441+0000","last_clean":"2024-05-15T18:11:47.075441+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:11:47.075441+0000","last_undegraded":"2024-05-15T18:11:47.075441+0000","last_fullsized":"2024-05-15T18:11:47.075441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405333+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:09:19.405333+0000","last_peered":"2024-05-15T18:09:19.405333+0000","last_clean":"2024-05-15T18:09:19.405333+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:09:19.405333+0000","last_undegraded":"2024-05-15T18:09:19.405333+0000","last_fullsized":"2024-05-15T18:09:19.405333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398590+0000","last_change":"2024-05-15T18:08:37.173060+0000","last_active":"2024-05-15T18:09:19.398590+0000","last_peered":"2024-05-15T18:09:19.398590+0000","last_clean":"2024-05-15T18:09:19.398590+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:09:19.398590+0000","last_undegraded":"2024-05-15T18:09:19.398590+0000","last_fullsized":"2024-05-15T18:09:19.398590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.417136+0000","last_change":"2024-05-15T18:09:19.416671+0000","last_active":"2024-05-15T18:09:19.417136+0000","last_peered":"2024-05-15T18:09:19.417136+0000","last_clean":"2024-05-15T18:09:19.417136+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:09:19.417136+0000","last_undegraded":"2024-05-15T18:09:19.417136+0000","last_fullsized":"2024-05-15T18:09:19.417136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:46.020343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274261+0000","last_change":"2024-05-15T18:08:43.195546+0000","last_active":"2024-05-15T18:11:46.274261+0000","last_peered":"2024-05-15T18:11:46.274261+0000","last_clean":"2024-05-15T18:11:46.274261+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:11:46.274261+0000","last_undegraded":"2024-05-15T18:11:46.274261+0000","last_fullsized":"2024-05-15T18:11:46.274261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:45:01.029538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400090+0000","last_change":"2024-05-15T18:08:45.204246+0000","last_active":"2024-05-15T18:09:19.400090+0000","last_peered":"2024-05-15T18:09:19.400090+0000","last_clean":"2024-05-15T18:09:19.400090+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:09:19.400090+0000","last_undegraded":"2024-05-15T18:09:19.400090+0000","last_fullsized":"2024-05-15T18:09:19.400090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:36.559499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398480+0000","last_change":"2024-05-15T18:08:47.219388+0000","last_active":"2024-05-15T18:09:19.398480+0000","last_peered":"2024-05-15T18:09:19.398480+0000","last_clean":"2024-05-15T18:09:19.398480+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:09:19.398480+0000","last_undegraded":"2024-05-15T18:09:19.398480+0000","last_fullsized":"2024-05-15T18:09:19.398480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:49.062143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027543+0000","last_change":"2024-05-15T18:08:39.184088+0000","last_active":"2024-05-15T18:11:47.027543+0000","last_peered":"2024-05-15T18:11:47.027543+0000","last_clean":"2024-05-15T18:11:47.027543+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:11:47.027543+0000","last_undegraded":"2024-05-15T18:11:47.027543+0000","last_fullsized":"2024-05-15T18:11:47.027543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398689+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:09:19.398689+0000","last_peered":"2024-05-15T18:09:19.398689+0000","last_clean":"2024-05-15T18:09:19.398689+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:09:19.398689+0000","last_undegraded":"2024-05-15T18:09:19.398689+0000","last_fullsized":"2024-05-15T18:09:19.398689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:36:43.128557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406217+0000","last_change":"2024-05-15T18:08:37.173069+0000","last_active":"2024-05-15T18:09:19.406217+0000","last_peered":"2024-05-15T18:09:19.406217+0000","last_clean":"2024-05-15T18:09:19.406217+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:09:19.406217+0000","last_undegraded":"2024-05-15T18:09:19.406217+0000","last_fullsized":"2024-05-15T18:09:19.406217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401267+0000","last_change":"2024-05-15T18:08:41.191439+0000","last_active":"2024-05-15T18:09:19.401267+0000","last_peered":"2024-05-15T18:09:19.401267+0000","last_clean":"2024-05-15T18:09:19.401267+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:09:19.401267+0000","last_undegraded":"2024-05-15T18:09:19.401267+0000","last_fullsized":"2024-05-15T18:09:19.401267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:23:42.753008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.426994+0000","last_change":"2024-05-15T18:08:43.202158+0000","last_active":"2024-05-15T18:11:46.426994+0000","last_peered":"2024-05-15T18:11:46.426994+0000","last_clean":"2024-05-15T18:11:46.426994+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:11:46.426994+0000","last_undegraded":"2024-05-15T18:11:46.426994+0000","last_fullsized":"2024-05-15T18:11:46.426994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:58:30.776682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404053+0000","last_change":"2024-05-15T18:08:45.211047+0000","last_active":"2024-05-15T18:09:19.404053+0000","last_peered":"2024-05-15T18:09:19.404053+0000","last_clean":"2024-05-15T18:09:19.404053+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:09:19.404053+0000","last_undegraded":"2024-05-15T18:09:19.404053+0000","last_fullsized":"2024-05-15T18:09:19.404053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:32.852658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.169134+0000","last_change":"2024-05-15T18:08:47.221837+0000","last_active":"2024-05-15T18:10:46.169134+0000","last_peered":"2024-05-15T18:10:46.169134+0000","last_clean":"2024-05-15T18:10:46.169134+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:10:46.169134+0000","last_undegraded":"2024-05-15T18:10:46.169134+0000","last_fullsized":"2024-05-15T18:10:46.169134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:52.042498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'7","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413696+0000","last_change":"2024-05-15T18:08:39.194112+0000","last_active":"2024-05-15T18:10:46.413696+0000","last_peered":"2024-05-15T18:10:46.413696+0000","last_clean":"2024-05-15T18:10:46.413696+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:10:46.413696+0000","last_undegraded":"2024-05-15T18:10:46.413696+0000","last_fullsized":"2024-05-15T18:10:46.413696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:34.314353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408561+0000","last_change":"2024-05-15T18:08:37.173933+0000","last_active":"2024-05-15T18:09:19.408561+0000","last_peered":"2024-05-15T18:09:19.408561+0000","last_clean":"2024-05-15T18:09:19.408561+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:09:19.408561+0000","last_undegraded":"2024-05-15T18:09:19.408561+0000","last_fullsized":"2024-05-15T18:09:19.408561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400028+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:09:19.400028+0000","last_peered":"2024-05-15T18:09:19.400028+0000","last_clean":"2024-05-15T18:09:19.400028+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:09:19.400028+0000","last_undegraded":"2024-05-15T18:09:19.400028+0000","last_fullsized":"2024-05-15T18:09:19.400028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:49.389424+0000","last_change":"2024-05-15T18:08:41.195863+0000","last_active":"2024-05-15T18:10:49.389424+0000","last_peered":"2024-05-15T18:10:49.389424+0000","last_clean":"2024-05-15T18:10:49.389424+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:10:49.389424+0000","last_undegraded":"2024-05-15T18:10:49.389424+0000","last_fullsized":"2024-05-15T18:10:49.389424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:40:08.456674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.004628+0000","last_change":"2024-05-15T18:08:43.200791+0000","last_active":"2024-05-15T18:10:45.004628+0000","last_peered":"2024-05-15T18:10:45.004628+0000","last_clean":"2024-05-15T18:10:45.004628+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:10:45.004628+0000","last_undegraded":"2024-05-15T18:10:45.004628+0000","last_fullsized":"2024-05-15T18:10:45.004628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:52.336305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405836+0000","last_change":"2024-05-15T18:08:45.198343+0000","last_active":"2024-05-15T18:09:19.405836+0000","last_peered":"2024-05-15T18:09:19.405836+0000","last_clean":"2024-05-15T18:09:19.405836+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:09:19.405836+0000","last_undegraded":"2024-05-15T18:09:19.405836+0000","last_fullsized":"2024-05-15T18:09:19.405836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:44.763619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.350044+0000","last_change":"2024-05-15T18:08:47.215201+0000","last_active":"2024-05-15T18:10:46.350044+0000","last_peered":"2024-05-15T18:10:46.350044+0000","last_clean":"2024-05-15T18:10:46.350044+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:10:46.350044+0000","last_undegraded":"2024-05-15T18:10:46.350044+0000","last_fullsized":"2024-05-15T18:10:46.350044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:59:36.775916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101867+0000","last_change":"2024-05-15T18:09:19.415333+0000","last_active":"2024-05-15T18:11:47.101867+0000","last_peered":"2024-05-15T18:11:47.101867+0000","last_clean":"2024-05-15T18:11:47.101867+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:11:47.101867+0000","last_undegraded":"2024-05-15T18:11:47.101867+0000","last_fullsized":"2024-05-15T18:11:47.101867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400285+0000","last_change":"2024-05-15T18:08:37.180268+0000","last_active":"2024-05-15T18:09:19.400285+0000","last_peered":"2024-05-15T18:09:19.400285+0000","last_clean":"2024-05-15T18:09:19.400285+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:09:19.400285+0000","last_undegraded":"2024-05-15T18:09:19.400285+0000","last_fullsized":"2024-05-15T18:09:19.400285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401559+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:09:19.401559+0000","last_peered":"2024-05-15T18:09:19.401559+0000","last_clean":"2024-05-15T18:09:19.401559+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:09:19.401559+0000","last_undegraded":"2024-05-15T18:09:19.401559+0000","last_fullsized":"2024-05-15T18:09:19.401559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:13.458538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399025+0000","last_change":"2024-05-15T18:08:41.191700+0000","last_active":"2024-05-15T18:09:19.399025+0000","last_peered":"2024-05-15T18:09:19.399025+0000","last_clean":"2024-05-15T18:09:19.399025+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:09:19.399025+0000","last_undegraded":"2024-05-15T18:09:19.399025+0000","last_fullsized":"2024-05-15T18:09:19.399025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:54.945021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402578+0000","last_change":"2024-05-15T18:08:43.197679+0000","last_active":"2024-05-15T18:09:19.402578+0000","last_peered":"2024-05-15T18:09:19.402578+0000","last_clean":"2024-05-15T18:09:19.402578+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:09:19.402578+0000","last_undegraded":"2024-05-15T18:09:19.402578+0000","last_fullsized":"2024-05-15T18:09:19.402578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:33.125848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":346,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274176+0000","last_change":"2024-05-15T18:08:45.204211+0000","last_active":"2024-05-15T18:11:46.274176+0000","last_peered":"2024-05-15T18:11:46.274176+0000","last_clean":"2024-05-15T18:11:46.274176+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:46.274176+0000","last_undegraded":"2024-05-15T18:11:46.274176+0000","last_fullsized":"2024-05-15T18:11:46.274176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.839010+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:10:02.839010+0000","last_peered":"2024-05-15T18:10:02.839010+0000","last_clean":"2024-05-15T18:10:02.839010+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:10:02.839010+0000","last_undegraded":"2024-05-15T18:10:02.839010+0000","last_fullsized":"2024-05-15T18:10:02.839010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:27.490184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'1","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392336+0000","last_change":"2024-05-15T18:08:39.188916+0000","last_active":"2024-05-15T18:10:38.392336+0000","last_peered":"2024-05-15T18:10:38.392336+0000","last_clean":"2024-05-15T18:10:38.392336+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:10:38.392336+0000","last_undegraded":"2024-05-15T18:10:38.392336+0000","last_fullsized":"2024-05-15T18:10:38.392336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:47.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.831319+0000","last_change":"2024-05-15T18:08:37.184221+0000","last_active":"2024-05-15T18:10:02.831319+0000","last_peered":"2024-05-15T18:10:02.831319+0000","last_clean":"2024-05-15T18:10:02.831319+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:10:02.831319+0000","last_undegraded":"2024-05-15T18:10:02.831319+0000","last_fullsized":"2024-05-15T18:10:02.831319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:08.495247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:14.064562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400602+0000","last_change":"2024-05-15T18:08:41.191409+0000","last_active":"2024-05-15T18:09:19.400602+0000","last_peered":"2024-05-15T18:09:19.400602+0000","last_clean":"2024-05-15T18:09:19.400602+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:09:19.400602+0000","last_undegraded":"2024-05-15T18:09:19.400602+0000","last_fullsized":"2024-05-15T18:09:19.400602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:43.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399422+0000","last_change":"2024-05-15T18:08:43.205538+0000","last_active":"2024-05-15T18:09:19.399422+0000","last_peered":"2024-05-15T18:09:19.399422+0000","last_clean":"2024-05-15T18:09:19.399422+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:09:19.399422+0000","last_undegraded":"2024-05-15T18:09:19.399422+0000","last_fullsized":"2024-05-15T18:09:19.399422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:04.322801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":389,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.206053+0000","last_change":"2024-05-15T18:08:45.198430+0000","last_active":"2024-05-15T18:11:47.206053+0000","last_peered":"2024-05-15T18:11:47.206053+0000","last_clean":"2024-05-15T18:11:47.206053+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:11:47.206053+0000","last_undegraded":"2024-05-15T18:11:47.206053+0000","last_fullsized":"2024-05-15T18:11:47.206053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:20.124986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401547+0000","last_change":"2024-05-15T18:08:47.222589+0000","last_active":"2024-05-15T18:09:19.401547+0000","last_peered":"2024-05-15T18:09:19.401547+0000","last_clean":"2024-05-15T18:09:19.401547+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:09:19.401547+0000","last_undegraded":"2024-05-15T18:09:19.401547+0000","last_fullsized":"2024-05-15T18:09:19.401547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894689+0000","last_change":"2024-05-15T18:08:39.185262+0000","last_active":"2024-05-15T18:11:46.894689+0000","last_peered":"2024-05-15T18:11:46.894689+0000","last_clean":"2024-05-15T18:11:46.894689+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:11:46.894689+0000","last_undegraded":"2024-05-15T18:11:46.894689+0000","last_fullsized":"2024-05-15T18:11:46.894689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:10.502882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.629114+0000","last_change":"2024-05-15T18:08:37.179237+0000","last_active":"2024-05-15T18:10:02.629114+0000","last_peered":"2024-05-15T18:10:02.629114+0000","last_clean":"2024-05-15T18:10:02.629114+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:10:02.629114+0000","last_undegraded":"2024-05-15T18:10:02.629114+0000","last_fullsized":"2024-05-15T18:10:02.629114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404325+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:09:19.404325+0000","last_peered":"2024-05-15T18:09:19.404325+0000","last_clean":"2024-05-15T18:09:19.404325+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:09:19.404325+0000","last_undegraded":"2024-05-15T18:09:19.404325+0000","last_fullsized":"2024-05-15T18:09:19.404325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:33:34.798074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399868+0000","last_change":"2024-05-15T18:08:41.192405+0000","last_active":"2024-05-15T18:09:19.399868+0000","last_peered":"2024-05-15T18:09:19.399868+0000","last_clean":"2024-05-15T18:09:19.399868+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:09:19.399868+0000","last_undegraded":"2024-05-15T18:09:19.399868+0000","last_fullsized":"2024-05-15T18:09:19.399868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:14.835496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393153+0000","last_change":"2024-05-15T18:08:43.199434+0000","last_active":"2024-05-15T18:10:48.393153+0000","last_peered":"2024-05-15T18:10:48.393153+0000","last_clean":"2024-05-15T18:10:48.393153+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:10:48.393153+0000","last_undegraded":"2024-05-15T18:10:48.393153+0000","last_fullsized":"2024-05-15T18:10:48.393153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:57.566833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6026,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399270+0000","last_change":"2024-05-15T18:08:45.201179+0000","last_active":"2024-05-15T18:09:19.399270+0000","last_peered":"2024-05-15T18:09:19.399270+0000","last_clean":"2024-05-15T18:09:19.399270+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:09:19.399270+0000","last_undegraded":"2024-05-15T18:09:19.399270+0000","last_fullsized":"2024-05-15T18:09:19.399270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408019+0000","last_change":"2024-05-15T18:08:47.209997+0000","last_active":"2024-05-15T18:09:19.408019+0000","last_peered":"2024-05-15T18:09:19.408019+0000","last_clean":"2024-05-15T18:09:19.408019+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:09:19.408019+0000","last_undegraded":"2024-05-15T18:09:19.408019+0000","last_fullsized":"2024-05-15T18:09:19.408019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:11.856816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.897494+0000","last_change":"2024-05-15T18:08:47.219593+0000","last_active":"2024-05-15T18:11:46.897494+0000","last_peered":"2024-05-15T18:11:46.897494+0000","last_clean":"2024-05-15T18:11:46.897494+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:11:46.897494+0000","last_undegraded":"2024-05-15T18:11:46.897494+0000","last_fullsized":"2024-05-15T18:11:46.897494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:20.857650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820271+0000","last_change":"2024-05-15T18:08:39.185432+0000","last_active":"2024-05-15T18:09:20.820271+0000","last_peered":"2024-05-15T18:09:20.820271+0000","last_clean":"2024-05-15T18:09:20.820271+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:09:20.820271+0000","last_undegraded":"2024-05-15T18:09:20.820271+0000","last_fullsized":"2024-05-15T18:09:20.820271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399246+0000","last_change":"2024-05-15T18:08:37.185935+0000","last_active":"2024-05-15T18:09:19.399246+0000","last_peered":"2024-05-15T18:09:19.399246+0000","last_clean":"2024-05-15T18:09:19.399246+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:09:19.399246+0000","last_undegraded":"2024-05-15T18:09:19.399246+0000","last_fullsized":"2024-05-15T18:09:19.399246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:44.983084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407349+0000","last_change":"2024-05-15T18:09:19.404553+0000","last_active":"2024-05-15T18:09:19.407349+0000","last_peered":"2024-05-15T18:09:19.407349+0000","last_clean":"2024-05-15T18:09:19.407349+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:09:19.407349+0000","last_undegraded":"2024-05-15T18:09:19.407349+0000","last_fullsized":"2024-05-15T18:09:19.407349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:02.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.996245+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:44.996245+0000","last_peered":"2024-05-15T18:10:44.996245+0000","last_clean":"2024-05-15T18:10:44.996245+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:10:44.996245+0000","last_undegraded":"2024-05-15T18:10:44.996245+0000","last_fullsized":"2024-05-15T18:10:44.996245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:50.124485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399714+0000","last_change":"2024-05-15T18:08:45.208742+0000","last_active":"2024-05-15T18:09:19.399714+0000","last_peered":"2024-05-15T18:09:19.399714+0000","last_clean":"2024-05-15T18:09:19.399714+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:09:19.399714+0000","last_undegraded":"2024-05-15T18:09:19.399714+0000","last_fullsized":"2024-05-15T18:09:19.399714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:53:19.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.822180+0000","last_change":"2024-05-15T18:08:47.216635+0000","last_active":"2024-05-15T18:11:46.822180+0000","last_peered":"2024-05-15T18:11:46.822180+0000","last_clean":"2024-05-15T18:11:46.822180+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:11:46.822180+0000","last_undegraded":"2024-05-15T18:11:46.822180+0000","last_fullsized":"2024-05-15T18:11:46.822180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114135+0000","last_change":"2024-05-15T18:08:39.192773+0000","last_active":"2024-05-15T18:11:47.114135+0000","last_peered":"2024-05-15T18:11:47.114135+0000","last_clean":"2024-05-15T18:11:47.114135+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:11:47.114135+0000","last_undegraded":"2024-05-15T18:11:47.114135+0000","last_fullsized":"2024-05-15T18:11:47.114135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395528+0000","last_change":"2024-05-15T18:08:37.178179+0000","last_active":"2024-05-15T18:11:03.395528+0000","last_peered":"2024-05-15T18:11:03.395528+0000","last_clean":"2024-05-15T18:11:03.395528+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:11:03.395528+0000","last_undegraded":"2024-05-15T18:11:03.395528+0000","last_fullsized":"2024-05-15T18:11:03.395528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400105+0000","last_change":"2024-05-15T18:08:41.192415+0000","last_active":"2024-05-15T18:09:19.400105+0000","last_peered":"2024-05-15T18:09:19.400105+0000","last_clean":"2024-05-15T18:09:19.400105+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:09:19.400105+0000","last_undegraded":"2024-05-15T18:09:19.400105+0000","last_fullsized":"2024-05-15T18:09:19.400105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:26.664611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'5","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.431632+0000","last_change":"2024-05-15T18:08:43.195098+0000","last_active":"2024-05-15T18:11:46.431632+0000","last_peered":"2024-05-15T18:11:46.431632+0000","last_clean":"2024-05-15T18:11:46.431632+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:11:46.431632+0000","last_undegraded":"2024-05-15T18:11:46.431632+0000","last_fullsized":"2024-05-15T18:11:46.431632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:56.349586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405485+0000","last_change":"2024-05-15T18:08:45.208464+0000","last_active":"2024-05-15T18:09:19.405485+0000","last_peered":"2024-05-15T18:09:19.405485+0000","last_clean":"2024-05-15T18:09:19.405485+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:09:19.405485+0000","last_undegraded":"2024-05-15T18:09:19.405485+0000","last_fullsized":"2024-05-15T18:09:19.405485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:55.283378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.083949+0000","last_change":"2024-05-15T18:08:47.209757+0000","last_active":"2024-05-15T18:09:20.083949+0000","last_peered":"2024-05-15T18:09:20.083949+0000","last_clean":"2024-05-15T18:09:20.083949+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:09:20.083949+0000","last_undegraded":"2024-05-15T18:09:20.083949+0000","last_fullsized":"2024-05-15T18:09:20.083949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901409+0000","last_change":"2024-05-15T18:08:39.182386+0000","last_active":"2024-05-15T18:11:46.901409+0000","last_peered":"2024-05-15T18:11:46.901409+0000","last_clean":"2024-05-15T18:11:46.901409+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:11:46.901409+0000","last_undegraded":"2024-05-15T18:11:46.901409+0000","last_fullsized":"2024-05-15T18:11:46.901409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408230+0000","last_change":"2024-05-15T18:08:37.176233+0000","last_active":"2024-05-15T18:09:19.408230+0000","last_peered":"2024-05-15T18:09:19.408230+0000","last_clean":"2024-05-15T18:09:19.408230+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:09:19.408230+0000","last_undegraded":"2024-05-15T18:09:19.408230+0000","last_fullsized":"2024-05-15T18:09:19.408230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405491+0000","last_change":"2024-05-15T18:08:41.196522+0000","last_active":"2024-05-15T18:09:19.405491+0000","last_peered":"2024-05-15T18:09:19.405491+0000","last_clean":"2024-05-15T18:09:19.405491+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:09:19.405491+0000","last_undegraded":"2024-05-15T18:09:19.405491+0000","last_fullsized":"2024-05-15T18:09:19.405491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:21.511313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'41","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.038128+0000","last_change":"2024-05-15T18:08:43.192531+0000","last_active":"2024-05-15T18:11:47.038128+0000","last_peered":"2024-05-15T18:11:47.038128+0000","last_clean":"2024-05-15T18:11:47.038128+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:11:47.038128+0000","last_undegraded":"2024-05-15T18:11:47.038128+0000","last_fullsized":"2024-05-15T18:11:47.038128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:53.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399776+0000","last_change":"2024-05-15T18:08:45.200867+0000","last_active":"2024-05-15T18:09:19.399776+0000","last_peered":"2024-05-15T18:09:19.399776+0000","last_clean":"2024-05-15T18:09:19.399776+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:09:19.399776+0000","last_undegraded":"2024-05-15T18:09:19.399776+0000","last_fullsized":"2024-05-15T18:09:19.399776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398845+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:09:19.398845+0000","last_peered":"2024-05-15T18:09:19.398845+0000","last_clean":"2024-05-15T18:09:19.398845+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:09:19.398845+0000","last_undegraded":"2024-05-15T18:09:19.398845+0000","last_fullsized":"2024-05-15T18:09:19.398845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:58:53.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318729+0000","last_change":"2024-05-15T18:08:39.188917+0000","last_active":"2024-05-15T18:10:43.318729+0000","last_peered":"2024-05-15T18:10:43.318729+0000","last_clean":"2024-05-15T18:10:43.318729+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:10:43.318729+0000","last_undegraded":"2024-05-15T18:10:43.318729+0000","last_fullsized":"2024-05-15T18:10:43.318729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:15.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402731+0000","last_change":"2024-05-15T18:08:37.176555+0000","last_active":"2024-05-15T18:09:19.402731+0000","last_peered":"2024-05-15T18:09:19.402731+0000","last_clean":"2024-05-15T18:09:19.402731+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:09:19.402731+0000","last_undegraded":"2024-05-15T18:09:19.402731+0000","last_fullsized":"2024-05-15T18:09:19.402731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400688+0000","last_change":"2024-05-15T18:08:41.191236+0000","last_active":"2024-05-15T18:09:19.400688+0000","last_peered":"2024-05-15T18:09:19.400688+0000","last_clean":"2024-05-15T18:09:19.400688+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:09:19.400688+0000","last_undegraded":"2024-05-15T18:09:19.400688+0000","last_fullsized":"2024-05-15T18:09:19.400688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:09.434305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395415+0000","last_change":"2024-05-15T18:08:43.194399+0000","last_active":"2024-05-15T18:11:03.395415+0000","last_peered":"2024-05-15T18:11:03.395415+0000","last_clean":"2024-05-15T18:11:03.395415+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:11:03.395415+0000","last_undegraded":"2024-05-15T18:11:03.395415+0000","last_fullsized":"2024-05-15T18:11:03.395415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:44.292771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408147+0000","last_change":"2024-05-15T18:08:45.204060+0000","last_active":"2024-05-15T18:09:19.408147+0000","last_peered":"2024-05-15T18:09:19.408147+0000","last_clean":"2024-05-15T18:09:19.408147+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:09:19.408147+0000","last_undegraded":"2024-05-15T18:09:19.408147+0000","last_fullsized":"2024-05-15T18:09:19.408147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:35.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075577+0000","last_change":"2024-05-15T18:08:39.186233+0000","last_active":"2024-05-15T18:11:47.075577+0000","last_peered":"2024-05-15T18:11:47.075577+0000","last_clean":"2024-05-15T18:11:47.075577+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:11:47.075577+0000","last_undegraded":"2024-05-15T18:11:47.075577+0000","last_fullsized":"2024-05-15T18:11:47.075577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:29.111289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398303+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:09:19.398303+0000","last_peered":"2024-05-15T18:09:19.398303+0000","last_clean":"2024-05-15T18:09:19.398303+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:09:19.398303+0000","last_undegraded":"2024-05-15T18:09:19.398303+0000","last_fullsized":"2024-05-15T18:09:19.398303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:52.211486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401191+0000","last_change":"2024-05-15T18:08:41.191159+0000","last_active":"2024-05-15T18:09:19.401191+0000","last_peered":"2024-05-15T18:09:19.401191+0000","last_clean":"2024-05-15T18:09:19.401191+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:09:19.401191+0000","last_undegraded":"2024-05-15T18:09:19.401191+0000","last_fullsized":"2024-05-15T18:09:19.401191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:59.022200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'54","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.002204+0000","last_change":"2024-05-15T18:08:43.194657+0000","last_active":"2024-05-15T18:10:45.002204+0000","last_peered":"2024-05-15T18:10:45.002204+0000","last_clean":"2024-05-15T18:10:45.002204+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:10:45.002204+0000","last_undegraded":"2024-05-15T18:10:45.002204+0000","last_fullsized":"2024-05-15T18:10:45.002204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:48.735514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407819+0000","last_change":"2024-05-15T18:08:45.205356+0000","last_active":"2024-05-15T18:09:19.407819+0000","last_peered":"2024-05-15T18:09:19.407819+0000","last_clean":"2024-05-15T18:09:19.407819+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:09:19.407819+0000","last_undegraded":"2024-05-15T18:09:19.407819+0000","last_fullsized":"2024-05-15T18:09:19.407819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:39:01.866675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.346448+0000","last_change":"2024-05-15T18:08:47.215443+0000","last_active":"2024-05-15T18:10:46.346448+0000","last_peered":"2024-05-15T18:10:46.346448+0000","last_clean":"2024-05-15T18:10:46.346448+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:10:46.346448+0000","last_undegraded":"2024-05-15T18:10:46.346448+0000","last_fullsized":"2024-05-15T18:10:46.346448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:49:38.789697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353058+0000","last_change":"2024-05-15T18:08:39.186914+0000","last_active":"2024-05-15T18:09:20.353058+0000","last_peered":"2024-05-15T18:09:20.353058+0000","last_clean":"2024-05-15T18:09:20.353058+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:09:20.353058+0000","last_undegraded":"2024-05-15T18:09:20.353058+0000","last_fullsized":"2024-05-15T18:09:20.353058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407422+0000","last_change":"2024-05-15T18:09:19.405624+0000","last_active":"2024-05-15T18:09:19.407422+0000","last_peered":"2024-05-15T18:09:19.407422+0000","last_clean":"2024-05-15T18:09:19.407422+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:09:19.407422+0000","last_undegraded":"2024-05-15T18:09:19.407422+0000","last_fullsized":"2024-05-15T18:09:19.407422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:48.812098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407740+0000","last_change":"2024-05-15T18:08:41.191786+0000","last_active":"2024-05-15T18:09:19.407740+0000","last_peered":"2024-05-15T18:09:19.407740+0000","last_clean":"2024-05-15T18:09:19.407740+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:09:19.407740+0000","last_undegraded":"2024-05-15T18:09:19.407740+0000","last_fullsized":"2024-05-15T18:09:19.407740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:36.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397808+0000","last_change":"2024-05-15T18:08:43.204941+0000","last_active":"2024-05-15T18:11:13.397808+0000","last_peered":"2024-05-15T18:11:13.397808+0000","last_clean":"2024-05-15T18:11:13.397808+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:11:13.397808+0000","last_undegraded":"2024-05-15T18:11:13.397808+0000","last_fullsized":"2024-05-15T18:11:13.397808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:18:25.567210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403966+0000","last_change":"2024-05-15T18:08:45.208563+0000","last_active":"2024-05-15T18:09:19.403966+0000","last_peered":"2024-05-15T18:09:19.403966+0000","last_clean":"2024-05-15T18:09:19.403966+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:09:19.403966+0000","last_undegraded":"2024-05-15T18:09:19.403966+0000","last_fullsized":"2024-05-15T18:09:19.403966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398176+0000","last_change":"2024-05-15T18:08:47.218586+0000","last_active":"2024-05-15T18:09:19.398176+0000","last_peered":"2024-05-15T18:09:19.398176+0000","last_clean":"2024-05-15T18:09:19.398176+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:09:19.398176+0000","last_undegraded":"2024-05-15T18:09:19.398176+0000","last_fullsized":"2024-05-15T18:09:19.398176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:32:15.970197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.320156+0000","last_change":"2024-05-15T18:08:39.191981+0000","last_active":"2024-05-15T18:10:43.320156+0000","last_peered":"2024-05-15T18:10:43.320156+0000","last_clean":"2024-05-15T18:10:43.320156+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:10:43.320156+0000","last_undegraded":"2024-05-15T18:10:43.320156+0000","last_fullsized":"2024-05-15T18:10:43.320156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:58.705649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.020626+0000","last_change":"2024-05-15T18:08:37.175536+0000","last_active":"2024-05-15T18:11:47.020626+0000","last_peered":"2024-05-15T18:11:47.020626+0000","last_clean":"2024-05-15T18:11:47.020626+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:11:47.020626+0000","last_undegraded":"2024-05-15T18:11:47.020626+0000","last_fullsized":"2024-05-15T18:11:47.020626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406884+0000","last_change":"2024-05-15T18:08:41.191062+0000","last_active":"2024-05-15T18:09:19.406884+0000","last_peered":"2024-05-15T18:09:19.406884+0000","last_clean":"2024-05-15T18:09:19.406884+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:09:19.406884+0000","last_undegraded":"2024-05-15T18:09:19.406884+0000","last_fullsized":"2024-05-15T18:09:19.406884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:24.557536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.000210+0000","last_change":"2024-05-15T18:08:43.201223+0000","last_active":"2024-05-15T18:10:45.000210+0000","last_peered":"2024-05-15T18:10:45.000210+0000","last_clean":"2024-05-15T18:10:45.000210+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:10:45.000210+0000","last_undegraded":"2024-05-15T18:10:45.000210+0000","last_fullsized":"2024-05-15T18:10:45.000210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:42.755582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400126+0000","last_change":"2024-05-15T18:08:45.198201+0000","last_active":"2024-05-15T18:09:19.400126+0000","last_peered":"2024-05-15T18:09:19.400126+0000","last_clean":"2024-05-15T18:09:19.400126+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:09:19.400126+0000","last_undegraded":"2024-05-15T18:09:19.400126+0000","last_fullsized":"2024-05-15T18:09:19.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:29.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.407284+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:10:46.407284+0000","last_peered":"2024-05-15T18:10:46.407284+0000","last_clean":"2024-05-15T18:10:46.407284+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:10:46.407284+0000","last_undegraded":"2024-05-15T18:10:46.407284+0000","last_fullsized":"2024-05-15T18:10:46.407284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:05.039222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'5","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111277+0000","last_change":"2024-05-15T18:08:39.184374+0000","last_active":"2024-05-15T18:11:47.111277+0000","last_peered":"2024-05-15T18:11:47.111277+0000","last_clean":"2024-05-15T18:11:47.111277+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:11:47.111277+0000","last_undegraded":"2024-05-15T18:11:47.111277+0000","last_fullsized":"2024-05-15T18:11:47.111277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.023254+0000","last_change":"2024-05-15T18:08:37.183470+0000","last_active":"2024-05-15T18:11:47.023254+0000","last_peered":"2024-05-15T18:11:47.023254+0000","last_clean":"2024-05-15T18:11:47.023254+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:11:47.023254+0000","last_undegraded":"2024-05-15T18:11:47.023254+0000","last_fullsized":"2024-05-15T18:11:47.023254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:28:26.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403818+0000","last_change":"2024-05-15T18:08:41.190070+0000","last_active":"2024-05-15T18:09:19.403818+0000","last_peered":"2024-05-15T18:09:19.403818+0000","last_clean":"2024-05-15T18:09:19.403818+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:09:19.403818+0000","last_undegraded":"2024-05-15T18:09:19.403818+0000","last_fullsized":"2024-05-15T18:09:19.403818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:17.766305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.737811+0000","last_change":"2024-05-15T18:08:43.205310+0000","last_active":"2024-05-15T18:09:19.737811+0000","last_peered":"2024-05-15T18:09:19.737811+0000","last_clean":"2024-05-15T18:09:19.737811+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:09:19.737811+0000","last_undegraded":"2024-05-15T18:09:19.737811+0000","last_fullsized":"2024-05-15T18:09:19.737811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:56.886685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.219182+0000","last_change":"2024-05-15T18:08:45.207348+0000","last_active":"2024-05-15T18:11:47.219182+0000","last_peered":"2024-05-15T18:11:47.219182+0000","last_clean":"2024-05-15T18:11:47.219182+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:11:47.219182+0000","last_undegraded":"2024-05-15T18:11:47.219182+0000","last_fullsized":"2024-05-15T18:11:47.219182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:58.021047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.397876+0000","last_change":"2024-05-15T18:08:47.219182+0000","last_active":"2024-05-15T18:09:19.397876+0000","last_peered":"2024-05-15T18:09:19.397876+0000","last_clean":"2024-05-15T18:09:19.397876+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:09:19.397876+0000","last_undegraded":"2024-05-15T18:09:19.397876+0000","last_fullsized":"2024-05-15T18:09:19.397876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:01.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817578+0000","last_change":"2024-05-15T18:08:39.180759+0000","last_active":"2024-05-15T18:09:20.817578+0000","last_peered":"2024-05-15T18:09:20.817578+0000","last_clean":"2024-05-15T18:09:20.817578+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:09:20.817578+0000","last_undegraded":"2024-05-15T18:09:20.817578+0000","last_fullsized":"2024-05-15T18:09:20.817578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403310+0000","last_change":"2024-05-15T18:08:37.176826+0000","last_active":"2024-05-15T18:09:19.403310+0000","last_peered":"2024-05-15T18:09:19.403310+0000","last_clean":"2024-05-15T18:09:19.403310+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:09:19.403310+0000","last_undegraded":"2024-05-15T18:09:19.403310+0000","last_fullsized":"2024-05-15T18:09:19.403310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401017+0000","last_change":"2024-05-15T18:08:41.192691+0000","last_active":"2024-05-15T18:09:19.401017+0000","last_peered":"2024-05-15T18:09:19.401017+0000","last_clean":"2024-05-15T18:09:19.401017+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:09:19.401017+0000","last_undegraded":"2024-05-15T18:09:19.401017+0000","last_fullsized":"2024-05-15T18:09:19.401017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:17.409123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.973083+0000","last_change":"2024-05-15T18:08:43.191489+0000","last_active":"2024-05-15T18:10:44.973083+0000","last_peered":"2024-05-15T18:10:44.973083+0000","last_clean":"2024-05-15T18:10:44.973083+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:10:44.973083+0000","last_undegraded":"2024-05-15T18:10:44.973083+0000","last_fullsized":"2024-05-15T18:10:44.973083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:58.528171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398467+0000","last_change":"2024-05-15T18:08:45.204577+0000","last_active":"2024-05-15T18:09:19.398467+0000","last_peered":"2024-05-15T18:09:19.398467+0000","last_clean":"2024-05-15T18:09:19.398467+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:09:19.398467+0000","last_undegraded":"2024-05-15T18:09:19.398467+0000","last_fullsized":"2024-05-15T18:09:19.398467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:43.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.511708+0000","last_change":"2024-05-15T18:08:47.217145+0000","last_active":"2024-05-15T18:11:46.511708+0000","last_peered":"2024-05-15T18:11:46.511708+0000","last_clean":"2024-05-15T18:11:46.511708+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:11:46.511708+0000","last_undegraded":"2024-05-15T18:11:46.511708+0000","last_fullsized":"2024-05-15T18:11:46.511708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841386+0000","last_change":"2024-05-15T18:08:39.180684+0000","last_active":"2024-05-15T18:10:02.841386+0000","last_peered":"2024-05-15T18:10:02.841386+0000","last_clean":"2024-05-15T18:10:02.841386+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:10:02.841386+0000","last_undegraded":"2024-05-15T18:10:02.841386+0000","last_fullsized":"2024-05-15T18:10:02.841386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:21.423233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401981+0000","last_change":"2024-05-15T18:08:37.185723+0000","last_active":"2024-05-15T18:09:19.401981+0000","last_peered":"2024-05-15T18:09:19.401981+0000","last_clean":"2024-05-15T18:09:19.401981+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:09:19.401981+0000","last_undegraded":"2024-05-15T18:09:19.401981+0000","last_fullsized":"2024-05-15T18:09:19.401981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:33.641924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408093+0000","last_change":"2024-05-15T18:08:41.194992+0000","last_active":"2024-05-15T18:09:19.408093+0000","last_peered":"2024-05-15T18:09:19.408093+0000","last_clean":"2024-05-15T18:09:19.408093+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:09:19.408093+0000","last_undegraded":"2024-05-15T18:09:19.408093+0000","last_fullsized":"2024-05-15T18:09:19.408093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:46.750498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.973981+0000","last_change":"2024-05-15T18:08:43.200599+0000","last_active":"2024-05-15T18:10:44.973981+0000","last_peered":"2024-05-15T18:10:44.973981+0000","last_clean":"2024-05-15T18:10:44.973981+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:10:44.973981+0000","last_undegraded":"2024-05-15T18:10:44.973981+0000","last_fullsized":"2024-05-15T18:10:44.973981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:22:01.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398116+0000","last_change":"2024-05-15T18:08:45.208564+0000","last_active":"2024-05-15T18:09:19.398116+0000","last_peered":"2024-05-15T18:09:19.398116+0000","last_clean":"2024-05-15T18:09:19.398116+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:09:19.398116+0000","last_undegraded":"2024-05-15T18:09:19.398116+0000","last_fullsized":"2024-05-15T18:09:19.398116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:04.792785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399101+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:09:19.399101+0000","last_peered":"2024-05-15T18:09:19.399101+0000","last_clean":"2024-05-15T18:09:19.399101+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:09:19.399101+0000","last_undegraded":"2024-05-15T18:09:19.399101+0000","last_fullsized":"2024-05-15T18:09:19.399101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:18.365146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.799158+0000","last_change":"2024-05-15T18:08:39.181861+0000","last_active":"2024-05-15T18:11:46.799158+0000","last_peered":"2024-05-15T18:11:46.799158+0000","last_clean":"2024-05-15T18:11:46.799158+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:11:46.799158+0000","last_undegraded":"2024-05-15T18:11:46.799158+0000","last_fullsized":"2024-05-15T18:11:46.799158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:44.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400551+0000","last_change":"2024-05-15T18:08:37.180611+0000","last_active":"2024-05-15T18:09:19.400551+0000","last_peered":"2024-05-15T18:09:19.400551+0000","last_clean":"2024-05-15T18:09:19.400551+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:09:19.400551+0000","last_undegraded":"2024-05-15T18:09:19.400551+0000","last_fullsized":"2024-05-15T18:09:19.400551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:10.580802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400217+0000","last_change":"2024-05-15T18:08:41.195751+0000","last_active":"2024-05-15T18:09:19.400217+0000","last_peered":"2024-05-15T18:09:19.400217+0000","last_clean":"2024-05-15T18:09:19.400217+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:09:19.400217+0000","last_undegraded":"2024-05-15T18:09:19.400217+0000","last_fullsized":"2024-05-15T18:09:19.400217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:46.842509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997990+0000","last_change":"2024-05-15T18:08:43.205423+0000","last_active":"2024-05-15T18:10:44.997990+0000","last_peered":"2024-05-15T18:10:44.997990+0000","last_clean":"2024-05-15T18:10:44.997990+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:10:44.997990+0000","last_undegraded":"2024-05-15T18:10:44.997990+0000","last_fullsized":"2024-05-15T18:10:44.997990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:00:28.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398390+0000","last_change":"2024-05-15T18:08:45.208319+0000","last_active":"2024-05-15T18:09:19.398390+0000","last_peered":"2024-05-15T18:09:19.398390+0000","last_clean":"2024-05-15T18:09:19.398390+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:09:19.398390+0000","last_undegraded":"2024-05-15T18:09:19.398390+0000","last_fullsized":"2024-05-15T18:09:19.398390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:07.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.008319+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:10:45.008319+0000","last_peered":"2024-05-15T18:10:45.008319+0000","last_clean":"2024-05-15T18:10:45.008319+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:10:45.008319+0000","last_undegraded":"2024-05-15T18:10:45.008319+0000","last_fullsized":"2024-05-15T18:10:45.008319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:41:14.101874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318342+0000","last_change":"2024-05-15T18:08:39.182951+0000","last_active":"2024-05-15T18:10:43.318342+0000","last_peered":"2024-05-15T18:10:43.318342+0000","last_clean":"2024-05-15T18:10:43.318342+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:10:43.318342+0000","last_undegraded":"2024-05-15T18:10:43.318342+0000","last_fullsized":"2024-05-15T18:10:43.318342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:28.725507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.361686+0000","last_change":"2024-05-15T18:08:37.173604+0000","last_active":"2024-05-15T18:10:46.361686+0000","last_peered":"2024-05-15T18:10:46.361686+0000","last_clean":"2024-05-15T18:10:46.361686+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:10:46.361686+0000","last_undegraded":"2024-05-15T18:10:46.361686+0000","last_fullsized":"2024-05-15T18:10:46.361686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.690398+0000","last_change":"2024-05-15T18:08:41.194807+0000","last_active":"2024-05-15T18:10:43.690398+0000","last_peered":"2024-05-15T18:10:43.690398+0000","last_clean":"2024-05-15T18:10:43.690398+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:10:43.690398+0000","last_undegraded":"2024-05-15T18:10:43.690398+0000","last_fullsized":"2024-05-15T18:10:43.690398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:20.276747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.432549+0000","last_change":"2024-05-15T18:08:43.204827+0000","last_active":"2024-05-15T18:11:46.432549+0000","last_peered":"2024-05-15T18:11:46.432549+0000","last_clean":"2024-05-15T18:11:46.432549+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:11:46.432549+0000","last_undegraded":"2024-05-15T18:11:46.432549+0000","last_fullsized":"2024-05-15T18:11:46.432549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:25:58.418358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399211+0000","last_change":"2024-05-15T18:08:45.209586+0000","last_active":"2024-05-15T18:09:19.399211+0000","last_peered":"2024-05-15T18:09:19.399211+0000","last_clean":"2024-05-15T18:09:19.399211+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:09:19.399211+0000","last_undegraded":"2024-05-15T18:09:19.399211+0000","last_fullsized":"2024-05-15T18:09:19.399211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.011056+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:10:45.011056+0000","last_peered":"2024-05-15T18:10:45.011056+0000","last_clean":"2024-05-15T18:10:45.011056+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:10:45.011056+0000","last_undegraded":"2024-05-15T18:10:45.011056+0000","last_fullsized":"2024-05-15T18:10:45.011056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:34:17.179772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101917+0000","last_change":"2024-05-15T18:08:39.193212+0000","last_active":"2024-05-15T18:11:47.101917+0000","last_peered":"2024-05-15T18:11:47.101917+0000","last_clean":"2024-05-15T18:11:47.101917+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:11:47.101917+0000","last_undegraded":"2024-05-15T18:11:47.101917+0000","last_fullsized":"2024-05-15T18:11:47.101917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:55:36.876278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392439+0000","last_change":"2024-05-15T18:08:37.175025+0000","last_active":"2024-05-15T18:10:43.392439+0000","last_peered":"2024-05-15T18:10:43.392439+0000","last_clean":"2024-05-15T18:10:43.392439+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:10:43.392439+0000","last_undegraded":"2024-05-15T18:10:43.392439+0000","last_fullsized":"2024-05-15T18:10:43.392439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:37:08.990281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":13,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894085+0000","last_change":"2024-05-15T18:08:39.182556+0000","last_active":"2024-05-15T18:11:46.894085+0000","last_peered":"2024-05-15T18:11:46.894085+0000","last_clean":"2024-05-15T18:11:46.894085+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:11:46.894085+0000","last_undegraded":"2024-05-15T18:11:46.894085+0000","last_fullsized":"2024-05-15T18:11:46.894085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.097398+0000","last_change":"2024-05-15T18:08:37.174455+0000","last_active":"2024-05-15T18:11:47.097398+0000","last_peered":"2024-05-15T18:11:47.097398+0000","last_clean":"2024-05-15T18:11:47.097398+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:11:47.097398+0000","last_undegraded":"2024-05-15T18:11:47.097398+0000","last_fullsized":"2024-05-15T18:11:47.097398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736540+0000","last_change":"2024-05-15T18:08:39.182083+0000","last_active":"2024-05-15T18:09:19.736540+0000","last_peered":"2024-05-15T18:09:19.736540+0000","last_clean":"2024-05-15T18:09:19.736540+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:09:19.736540+0000","last_undegraded":"2024-05-15T18:09:19.736540+0000","last_fullsized":"2024-05-15T18:09:19.736540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:51.998451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399083+0000","last_change":"2024-05-15T18:08:37.180276+0000","last_active":"2024-05-15T18:09:19.399083+0000","last_peered":"2024-05-15T18:09:19.399083+0000","last_clean":"2024-05-15T18:09:19.399083+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:09:19.399083+0000","last_undegraded":"2024-05-15T18:09:19.399083+0000","last_fullsized":"2024-05-15T18:09:19.399083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:42.498474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036744+0000","last_change":"2024-05-15T18:08:39.183629+0000","last_active":"2024-05-15T18:11:47.036744+0000","last_peered":"2024-05-15T18:11:47.036744+0000","last_clean":"2024-05-15T18:11:47.036744+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:11:47.036744+0000","last_undegraded":"2024-05-15T18:11:47.036744+0000","last_fullsized":"2024-05-15T18:11:47.036744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388608+0000","last_change":"2024-05-15T18:08:37.180039+0000","last_active":"2024-05-15T18:10:44.388608+0000","last_peered":"2024-05-15T18:10:44.388608+0000","last_clean":"2024-05-15T18:10:44.388608+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:10:44.388608+0000","last_undegraded":"2024-05-15T18:10:44.388608+0000","last_fullsized":"2024-05-15T18:10:44.388608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081223+0000","last_change":"2024-05-15T18:08:39.183461+0000","last_active":"2024-05-15T18:11:47.081223+0000","last_peered":"2024-05-15T18:11:47.081223+0000","last_clean":"2024-05-15T18:11:47.081223+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:11:47.081223+0000","last_undegraded":"2024-05-15T18:11:47.081223+0000","last_fullsized":"2024-05-15T18:11:47.081223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.017699+0000","last_change":"2024-05-15T18:08:37.173194+0000","last_active":"2024-05-15T18:11:47.017699+0000","last_peered":"2024-05-15T18:11:47.017699+0000","last_clean":"2024-05-15T18:11:47.017699+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:47.017699+0000","last_undegraded":"2024-05-15T18:11:47.017699+0000","last_fullsized":"2024-05-15T18:11:47.017699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392566+0000","last_change":"2024-05-15T18:08:39.193040+0000","last_active":"2024-05-15T18:10:43.392566+0000","last_peered":"2024-05-15T18:10:43.392566+0000","last_clean":"2024-05-15T18:10:43.392566+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:10:43.392566+0000","last_undegraded":"2024-05-15T18:10:43.392566+0000","last_fullsized":"2024-05-15T18:10:43.392566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393392+0000","last_change":"2024-05-15T18:08:37.177086+0000","last_active":"2024-05-15T18:10:48.393392+0000","last_peered":"2024-05-15T18:10:48.393392+0000","last_clean":"2024-05-15T18:10:48.393392+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:10:48.393392+0000","last_undegraded":"2024-05-15T18:10:48.393392+0000","last_fullsized":"2024-05-15T18:10:48.393392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081078+0000","last_change":"2024-05-15T18:08:39.187231+0000","last_active":"2024-05-15T18:11:47.081078+0000","last_peered":"2024-05-15T18:11:47.081078+0000","last_clean":"2024-05-15T18:11:47.081078+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:11:47.081078+0000","last_undegraded":"2024-05-15T18:11:47.081078+0000","last_fullsized":"2024-05-15T18:11:47.081078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408334+0000","last_change":"2024-05-15T18:08:37.185249+0000","last_active":"2024-05-15T18:09:19.408334+0000","last_peered":"2024-05-15T18:09:19.408334+0000","last_clean":"2024-05-15T18:09:19.408334+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:09:19.408334+0000","last_undegraded":"2024-05-15T18:09:19.408334+0000","last_fullsized":"2024-05-15T18:09:19.408334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841468+0000","last_change":"2024-05-15T18:08:39.182188+0000","last_active":"2024-05-15T18:10:02.841468+0000","last_peered":"2024-05-15T18:10:02.841468+0000","last_clean":"2024-05-15T18:10:02.841468+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:10:02.841468+0000","last_undegraded":"2024-05-15T18:10:02.841468+0000","last_fullsized":"2024-05-15T18:10:02.841468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401192+0000","last_change":"2024-05-15T18:08:37.173289+0000","last_active":"2024-05-15T18:09:19.401192+0000","last_peered":"2024-05-15T18:09:19.401192+0000","last_clean":"2024-05-15T18:09:19.401192+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:09:19.401192+0000","last_undegraded":"2024-05-15T18:09:19.401192+0000","last_fullsized":"2024-05-15T18:09:19.401192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:49:25.723441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027663+0000","last_change":"2024-05-15T18:08:39.185677+0000","last_active":"2024-05-15T18:11:47.027663+0000","last_peered":"2024-05-15T18:11:47.027663+0000","last_clean":"2024-05-15T18:11:47.027663+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:11:47.027663+0000","last_undegraded":"2024-05-15T18:11:47.027663+0000","last_fullsized":"2024-05-15T18:11:47.027663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:22:07.754341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393745+0000","last_change":"2024-05-15T18:08:37.174784+0000","last_active":"2024-05-15T18:10:48.393745+0000","last_peered":"2024-05-15T18:10:48.393745+0000","last_clean":"2024-05-15T18:10:48.393745+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:10:48.393745+0000","last_undegraded":"2024-05-15T18:10:48.393745+0000","last_fullsized":"2024-05-15T18:10:48.393745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:01.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.080429+0000","last_change":"2024-05-15T18:08:39.184051+0000","last_active":"2024-05-15T18:09:20.080429+0000","last_peered":"2024-05-15T18:09:20.080429+0000","last_clean":"2024-05-15T18:09:20.080429+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:09:20.080429+0000","last_undegraded":"2024-05-15T18:09:20.080429+0000","last_fullsized":"2024-05-15T18:09:20.080429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:52.335026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399053+0000","last_change":"2024-05-15T18:08:37.179943+0000","last_active":"2024-05-15T18:09:19.399053+0000","last_peered":"2024-05-15T18:09:19.399053+0000","last_clean":"2024-05-15T18:09:19.399053+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:09:19.399053+0000","last_undegraded":"2024-05-15T18:09:19.399053+0000","last_fullsized":"2024-05-15T18:09:19.399053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075510+0000","last_change":"2024-05-15T18:09:19.409291+0000","last_active":"2024-05-15T18:11:47.075510+0000","last_peered":"2024-05-15T18:11:47.075510+0000","last_clean":"2024-05-15T18:11:47.075510+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:11:47.075510+0000","last_undegraded":"2024-05-15T18:11:47.075510+0000","last_fullsized":"2024-05-15T18:11:47.075510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399908+0000","last_change":"2024-05-15T18:08:37.180111+0000","last_active":"2024-05-15T18:09:19.399908+0000","last_peered":"2024-05-15T18:09:19.399908+0000","last_clean":"2024-05-15T18:09:19.399908+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:09:19.399908+0000","last_undegraded":"2024-05-15T18:09:19.399908+0000","last_fullsized":"2024-05-15T18:09:19.399908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075128+0000","last_change":"2024-05-15T18:08:39.180126+0000","last_active":"2024-05-15T18:11:47.075128+0000","last_peered":"2024-05-15T18:11:47.075128+0000","last_clean":"2024-05-15T18:11:47.075128+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:11:47.075128+0000","last_undegraded":"2024-05-15T18:11:47.075128+0000","last_fullsized":"2024-05-15T18:11:47.075128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:53.932569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402839+0000","last_change":"2024-05-15T18:08:37.178460+0000","last_active":"2024-05-15T18:09:19.402839+0000","last_peered":"2024-05-15T18:09:19.402839+0000","last_clean":"2024-05-15T18:09:19.402839+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:09:19.402839+0000","last_undegraded":"2024-05-15T18:09:19.402839+0000","last_fullsized":"2024-05-15T18:09:19.402839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'7","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901964+0000","last_change":"2024-05-15T18:08:39.193285+0000","last_active":"2024-05-15T18:11:46.901964+0000","last_peered":"2024-05-15T18:11:46.901964+0000","last_clean":"2024-05-15T18:11:46.901964+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:11:46.901964+0000","last_undegraded":"2024-05-15T18:11:46.901964+0000","last_fullsized":"2024-05-15T18:11:46.901964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.246822+0000","last_change":"2024-05-15T18:08:37.183430+0000","last_active":"2024-05-15T18:10:46.246822+0000","last_peered":"2024-05-15T18:10:46.246822+0000","last_clean":"2024-05-15T18:10:46.246822+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:10:46.246822+0000","last_undegraded":"2024-05-15T18:10:46.246822+0000","last_fullsized":"2024-05-15T18:10:46.246822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:16:22.035101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318832+0000","last_change":"2024-05-15T18:08:39.187902+0000","last_active":"2024-05-15T18:10:43.318832+0000","last_peered":"2024-05-15T18:10:43.318832+0000","last_clean":"2024-05-15T18:10:43.318832+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:10:43.318832+0000","last_undegraded":"2024-05-15T18:10:43.318832+0000","last_fullsized":"2024-05-15T18:10:43.318832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401767+0000","last_change":"2024-05-15T18:08:37.181882+0000","last_active":"2024-05-15T18:09:19.401767+0000","last_peered":"2024-05-15T18:09:19.401767+0000","last_clean":"2024-05-15T18:09:19.401767+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:09:19.401767+0000","last_undegraded":"2024-05-15T18:09:19.401767+0000","last_fullsized":"2024-05-15T18:09:19.401767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:01.779453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:39.188670+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:47.375138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408417+0000","last_change":"2024-05-15T18:08:37.179459+0000","last_active":"2024-05-15T18:09:19.408417+0000","last_peered":"2024-05-15T18:09:19.408417+0000","last_clean":"2024-05-15T18:09:19.408417+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:09:19.408417+0000","last_undegraded":"2024-05-15T18:09:19.408417+0000","last_fullsized":"2024-05-15T18:09:19.408417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075176+0000","last_change":"2024-05-15T18:08:39.178597+0000","last_active":"2024-05-15T18:11:47.075176+0000","last_peered":"2024-05-15T18:11:47.075176+0000","last_clean":"2024-05-15T18:11:47.075176+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:11:47.075176+0000","last_undegraded":"2024-05-15T18:11:47.075176+0000","last_fullsized":"2024-05-15T18:11:47.075176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.012658+0000","last_change":"2024-05-15T18:09:19.409578+0000","last_active":"2024-05-15T18:11:47.012658+0000","last_peered":"2024-05-15T18:11:47.012658+0000","last_clean":"2024-05-15T18:11:47.012658+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:11:47.012658+0000","last_undegraded":"2024-05-15T18:11:47.012658+0000","last_fullsized":"2024-05-15T18:11:47.012658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:50.864491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398577+0000","last_change":"2024-05-15T18:08:37.182059+0000","last_active":"2024-05-15T18:09:19.398577+0000","last_peered":"2024-05-15T18:09:19.398577+0000","last_clean":"2024-05-15T18:09:19.398577+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:09:19.398577+0000","last_undegraded":"2024-05-15T18:09:19.398577+0000","last_fullsized":"2024-05-15T18:09:19.398577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:38.781325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401588+0000","last_change":"2024-05-15T18:08:39.190238+0000","last_active":"2024-05-15T18:09:19.401588+0000","last_peered":"2024-05-15T18:09:19.401588+0000","last_clean":"2024-05-15T18:09:19.401588+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:09:19.401588+0000","last_undegraded":"2024-05-15T18:09:19.401588+0000","last_fullsized":"2024-05-15T18:09:19.401588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398913+0000","last_change":"2024-05-15T18:08:37.180082+0000","last_active":"2024-05-15T18:09:19.398913+0000","last_peered":"2024-05-15T18:09:19.398913+0000","last_clean":"2024-05-15T18:09:19.398913+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:09:19.398913+0000","last_undegraded":"2024-05-15T18:09:19.398913+0000","last_fullsized":"2024-05-15T18:09:19.398913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082913+0000","last_change":"2024-05-15T18:08:39.192652+0000","last_active":"2024-05-15T18:09:20.082913+0000","last_peered":"2024-05-15T18:09:20.082913+0000","last_clean":"2024-05-15T18:09:20.082913+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:09:20.082913+0000","last_undegraded":"2024-05-15T18:09:20.082913+0000","last_fullsized":"2024-05-15T18:09:20.082913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:22.550315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673007,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56288,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315552,"statfs":{"total":96636764160,"available":96579125248,"internally_reserved":0,"allocated":17195008,"data_stored":16910200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705710,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48692,"kb_used_data":13356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323148,"statfs":{"total":96636764160,"available":96586903552,"internally_reserved":0,"allocated":13676544,"data_stored":13357679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52672,"kb_used_data":17336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319168,"statfs":{"total":96636764160,"available":96582828032,"internally_reserved":0,"allocated":17752064,"data_stored":17499215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41044,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330796,"statfs":{"total":96636764160,"available":96594735104,"internally_reserved":0,"allocated":5844992,"data_stored":5555704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:11:54.182 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:11:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.337+0000 7f3fdc45c640 1 Processor -- start 2024-05-15T18:11:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.337+0000 7f3fdc45c640 1 -- start start 2024-05-15T18:11:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fdc45c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3fd412f580 0x7f3fd4131970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fdc45c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd4113dd0 con 0x7f3fd412c5b0 2024-05-15T18:11:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fdc45c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd4072290 con 0x7f3fd412f580 2024-05-15T18:11:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fda1f8640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f3fd412c5b0 0x7f3fd412c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60892/0 (socket says 172.21.15.3:60892) 2024-05-15T18:11:54.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fda1f8640 1 -- 172.21.15.3:0/3707612535 learned_addr learned my addr 172.21.15.3:0/3707612535 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fd99f7640 1 --2- 172.21.15.3:0/3707612535 >> v2:172.21.15.3:3300/0 conn(0x7f3fd412f580 0x7f3fd4131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fd91f6640 1 -- 172.21.15.3:0/3707612535 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1978656289 0 0) 0x7f3fd4113dd0 con 0x7f3fd412c5b0 2024-05-15T18:11:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fd91f6640 1 -- 172.21.15.3:0/3707612535 --> v1:172.21.15.3:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fc0003520 con 0x7f3fd412c5b0 2024-05-15T18:11:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fd99f7640 1 -- 172.21.15.3:0/3707612535 >> v1:172.21.15.3:6789/0 conn(0x7f3fd412c5b0 legacy=0x7f3fd412c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.338+0000 7f3fd99f7640 1 -- 172.21.15.3:0/3707612535 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd412c390 con 0x7f3fd412f580 2024-05-15T18:11:54.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.339+0000 7f3fd99f7640 1 --2- 172.21.15.3:0/3707612535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412f580 0x7f3fd4131970 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009720 tx=0x7f3fc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7ddb8dcdbc7722 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.339+0000 7f3fd91f6640 1 -- 172.21.15.3:0/3707612535 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc40316d0 con 0x7f3fd412f580 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.339+0000 7f3fd91f6640 1 -- 172.21.15.3:0/3707612535 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc4037070 con 0x7f3fd412f580 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.339+0000 7f3fd91f6640 1 -- 172.21.15.3:0/3707612535 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc40319c0 con 0x7f3fd412f580 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.340+0000 7f3fdc45c640 1 -- 172.21.15.3:0/3707612535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412f580 msgr2=0x7f3fd4131970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.340+0000 7f3fdc45c640 1 --2- 172.21.15.3:0/3707612535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412f580 0x7f3fd4131970 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009720 tx=0x7f3fc402b840 comp rx=0 tx=0).stop 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.340+0000 7f3fdc45c640 1 -- 172.21.15.3:0/3707612535 shutdown_connections 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.340+0000 7f3fdc45c640 1 --2- 172.21.15.3:0/3707612535 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412f580 0x7f3fd4131970 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.340+0000 7f3fdc45c640 1 -- 172.21.15.3:0/3707612535 >> 172.21.15.3:0/3707612535 conn(0x7f3fd4099380 msgr2=0x7f3fd4099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.340+0000 7f3fdc45c640 1 -- 172.21.15.3:0/3707612535 shutdown_connections 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.340+0000 7f3fdc45c640 1 -- 172.21.15.3:0/3707612535 wait complete. 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.341+0000 7f3fdc45c640 1 Processor -- start 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.341+0000 7f3fdc45c640 1 -- start start 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.341+0000 7f3fdc45c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412c5b0 0x7f3fd41227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:54.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.341+0000 7f3fdc45c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd4113990 con 0x7f3fd412c5b0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.341+0000 7f3fda1f8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412c5b0 0x7f3fd41227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.341+0000 7f3fda1f8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412c5b0 0x7f3fd41227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49248/0 (socket says 172.21.15.3:49248) 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.341+0000 7f3fda1f8640 1 -- 172.21.15.3:0/1656483782 learned_addr learned my addr 172.21.15.3:0/1656483782 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.342+0000 7f3fda1f8640 1 -- 172.21.15.3:0/1656483782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd4071d30 con 0x7f3fd412c5b0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.342+0000 7f3fda1f8640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412c5b0 0x7f3fd41227a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c480 tx=0x7f3fd000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.342+0000 7f3fcaffd640 1 -- 172.21.15.3:0/1656483782 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0017070 con 0x7f3fd412c5b0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.342+0000 7f3fcaffd640 1 -- 172.21.15.3:0/1656483782 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd0005c10 con 0x7f3fd412c5b0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.342+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd4129090 con 0x7f3fd412c5b0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.342+0000 7f3fcaffd640 1 -- 172.21.15.3:0/1656483782 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd0007070 con 0x7f3fd412c5b0 2024-05-15T18:11:54.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.342+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd4071050 con 0x7f3fd412c5b0 2024-05-15T18:11:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.343+0000 7f3fcaffd640 1 -- 172.21.15.3:0/1656483782 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3fd001a070 con 0x7f3fd412c5b0 2024-05-15T18:11:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.343+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd41284b0 con 0x7f3fd412c5b0 2024-05-15T18:11:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.343+0000 7f3fcaffd640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3fb8038060 0x7f3fb803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.343+0000 7f3fcaffd640 1 -- 172.21.15.3:0/1656483782 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f3fd004ad10 con 0x7f3fd412c5b0 2024-05-15T18:11:54.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.343+0000 7f3fd99f7640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3fb8038060 0x7f3fb803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:54.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.344+0000 7f3fd99f7640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3fb8038060 0x7f3fb803a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4036000 tx=0x7f3fc4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:54.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.348+0000 7f3fcaffd640 1 -- 172.21.15.3:0/1656483782 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3fd001ac60 con 0x7f3fd412c5b0 2024-05-15T18:11:54.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.531+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3fd406ea60 con 0x7f3fb8038060 2024-05-15T18:11:54.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.546+0000 7f3fcaffd640 1 -- 172.21.15.3:0/1656483782 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665399 (secure 0 0 0) 0x7f3fd406ea60 con 0x7f3fb8038060 2024-05-15T18:11:54.530 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:11:54.535 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3fb8038060 msgr2=0x7f3fb803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3fb8038060 0x7f3fb803a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4036000 tx=0x7f3fc4008030 comp rx=0 tx=0).stop 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412c5b0 msgr2=0x7f3fd41227a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412c5b0 0x7f3fd41227a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c480 tx=0x7f3fd000c940 comp rx=0 tx=0).stop 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 shutdown_connections 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3fb8038060 0x7f3fb803a520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 --2- 172.21.15.3:0/1656483782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3fd412c5b0 0x7f3fd41227a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 >> 172.21.15.3:0/1656483782 conn(0x7f3fd4099380 msgr2=0x7f3fd406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 shutdown_connections 2024-05-15T18:11:54.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.550+0000 7f3fdc45c640 1 -- 172.21.15.3:0/1656483782 wait complete. 2024-05-15T18:11:54.539 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-05-15T18:11:54.376417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4881,"num_read_kb":4462,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198696,"kb_used_data":53192,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288664,"statfs":{"total":386547056640,"available":386343591936,"internally_reserved":0,"allocated":54468608,"data_stored":53322798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":148956946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003654"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.335908+0000","last_change":"2024-05-15T18:08:37.185277+0000","last_active":"2024-05-15T18:09:20.335908+0000","last_peered":"2024-05-15T18:09:20.335908+0000","last_clean":"2024-05-15T18:09:20.335908+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:09:20.335908+0000","last_undegraded":"2024-05-15T18:09:20.335908+0000","last_fullsized":"2024-05-15T18:09:20.335908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101814+0000","last_change":"2024-05-15T18:08:39.181950+0000","last_active":"2024-05-15T18:11:47.101814+0000","last_peered":"2024-05-15T18:11:47.101814+0000","last_clean":"2024-05-15T18:11:47.101814+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:11:47.101814+0000","last_undegraded":"2024-05-15T18:11:47.101814+0000","last_fullsized":"2024-05-15T18:11:47.101814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400383+0000","last_change":"2024-05-15T18:08:37.180815+0000","last_active":"2024-05-15T18:09:19.400383+0000","last_peered":"2024-05-15T18:09:19.400383+0000","last_clean":"2024-05-15T18:09:19.400383+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:09:19.400383+0000","last_undegraded":"2024-05-15T18:09:19.400383+0000","last_fullsized":"2024-05-15T18:09:19.400383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:11:28.156751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801449+0000","last_change":"2024-05-15T18:08:39.183780+0000","last_active":"2024-05-15T18:11:46.801449+0000","last_peered":"2024-05-15T18:11:46.801449+0000","last_clean":"2024-05-15T18:11:46.801449+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:11:46.801449+0000","last_undegraded":"2024-05-15T18:11:46.801449+0000","last_fullsized":"2024-05-15T18:11:46.801449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:15.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403839+0000","last_change":"2024-05-15T18:08:37.186280+0000","last_active":"2024-05-15T18:09:19.403839+0000","last_peered":"2024-05-15T18:09:19.403839+0000","last_clean":"2024-05-15T18:09:19.403839+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:09:19.403839+0000","last_undegraded":"2024-05-15T18:09:19.403839+0000","last_fullsized":"2024-05-15T18:09:19.403839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:41.112234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413763+0000","last_change":"2024-05-15T18:08:39.184797+0000","last_active":"2024-05-15T18:10:46.413763+0000","last_peered":"2024-05-15T18:10:46.413763+0000","last_clean":"2024-05-15T18:10:46.413763+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:10:46.413763+0000","last_undegraded":"2024-05-15T18:10:46.413763+0000","last_fullsized":"2024-05-15T18:10:46.413763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:31.818225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.386408+0000","last_change":"2024-05-15T18:08:37.174049+0000","last_active":"2024-05-15T18:10:46.386408+0000","last_peered":"2024-05-15T18:10:46.386408+0000","last_clean":"2024-05-15T18:10:46.386408+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:10:46.386408+0000","last_undegraded":"2024-05-15T18:10:46.386408+0000","last_fullsized":"2024-05-15T18:10:46.386408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'11","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397038+0000","last_change":"2024-05-15T18:08:39.181113+0000","last_active":"2024-05-15T18:11:08.397038+0000","last_peered":"2024-05-15T18:11:08.397038+0000","last_clean":"2024-05-15T18:11:08.397038+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:11:08.397038+0000","last_undegraded":"2024-05-15T18:11:08.397038+0000","last_fullsized":"2024-05-15T18:11:08.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:57.396932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399830+0000","last_change":"2024-05-15T18:08:37.179942+0000","last_active":"2024-05-15T18:09:19.399830+0000","last_peered":"2024-05-15T18:09:19.399830+0000","last_clean":"2024-05-15T18:09:19.399830+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:09:19.399830+0000","last_undegraded":"2024-05-15T18:09:19.399830+0000","last_fullsized":"2024-05-15T18:09:19.399830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:34.419734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.842198+0000","last_change":"2024-05-15T18:08:39.185769+0000","last_active":"2024-05-15T18:10:02.842198+0000","last_peered":"2024-05-15T18:10:02.842198+0000","last_clean":"2024-05-15T18:10:02.842198+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:10:02.842198+0000","last_undegraded":"2024-05-15T18:10:02.842198+0000","last_fullsized":"2024-05-15T18:10:02.842198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:44.743277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405752+0000","last_change":"2024-05-15T18:08:37.178875+0000","last_active":"2024-05-15T18:09:19.405752+0000","last_peered":"2024-05-15T18:09:19.405752+0000","last_clean":"2024-05-15T18:09:19.405752+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:09:19.405752+0000","last_undegraded":"2024-05-15T18:09:19.405752+0000","last_fullsized":"2024-05-15T18:09:19.405752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027476+0000","last_change":"2024-05-15T18:08:39.189004+0000","last_active":"2024-05-15T18:11:47.027476+0000","last_peered":"2024-05-15T18:11:47.027476+0000","last_clean":"2024-05-15T18:11:47.027476+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:11:47.027476+0000","last_undegraded":"2024-05-15T18:11:47.027476+0000","last_fullsized":"2024-05-15T18:11:47.027476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:55.844079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401251+0000","last_change":"2024-05-15T18:08:37.177010+0000","last_active":"2024-05-15T18:09:19.401251+0000","last_peered":"2024-05-15T18:09:19.401251+0000","last_clean":"2024-05-15T18:09:19.401251+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:09:19.401251+0000","last_undegraded":"2024-05-15T18:09:19.401251+0000","last_fullsized":"2024-05-15T18:09:19.401251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:17:38.714290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'5","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392579+0000","last_change":"2024-05-15T18:08:39.187168+0000","last_active":"2024-05-15T18:10:43.392579+0000","last_peered":"2024-05-15T18:10:43.392579+0000","last_clean":"2024-05-15T18:10:43.392579+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:10:43.392579+0000","last_undegraded":"2024-05-15T18:10:43.392579+0000","last_fullsized":"2024-05-15T18:10:43.392579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398685+0000","last_change":"2024-05-15T18:08:37.180981+0000","last_active":"2024-05-15T18:09:19.398685+0000","last_peered":"2024-05-15T18:09:19.398685+0000","last_clean":"2024-05-15T18:09:19.398685+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:09:19.398685+0000","last_undegraded":"2024-05-15T18:09:19.398685+0000","last_fullsized":"2024-05-15T18:09:19.398685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102117+0000","last_change":"2024-05-15T18:08:39.185117+0000","last_active":"2024-05-15T18:11:47.102117+0000","last_peered":"2024-05-15T18:11:47.102117+0000","last_clean":"2024-05-15T18:11:47.102117+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:11:47.102117+0000","last_undegraded":"2024-05-15T18:11:47.102117+0000","last_fullsized":"2024-05-15T18:11:47.102117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102111+0000","last_change":"2024-05-15T18:08:39.186238+0000","last_active":"2024-05-15T18:11:47.102111+0000","last_peered":"2024-05-15T18:11:47.102111+0000","last_clean":"2024-05-15T18:11:47.102111+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:11:47.102111+0000","last_undegraded":"2024-05-15T18:11:47.102111+0000","last_fullsized":"2024-05-15T18:11:47.102111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:18.269525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401873+0000","last_change":"2024-05-15T18:08:37.177868+0000","last_active":"2024-05-15T18:09:19.401873+0000","last_peered":"2024-05-15T18:09:19.401873+0000","last_clean":"2024-05-15T18:09:19.401873+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:09:19.401873+0000","last_undegraded":"2024-05-15T18:09:19.401873+0000","last_fullsized":"2024-05-15T18:09:19.401873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901911+0000","last_change":"2024-05-15T18:08:39.184998+0000","last_active":"2024-05-15T18:11:46.901911+0000","last_peered":"2024-05-15T18:11:46.901911+0000","last_clean":"2024-05-15T18:11:46.901911+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:11:46.901911+0000","last_undegraded":"2024-05-15T18:11:46.901911+0000","last_fullsized":"2024-05-15T18:11:46.901911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:52.199938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.309110+0000","last_change":"2024-05-15T18:08:37.179232+0000","last_active":"2024-05-15T18:10:43.309110+0000","last_peered":"2024-05-15T18:10:43.309110+0000","last_clean":"2024-05-15T18:10:43.309110+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:10:43.309110+0000","last_undegraded":"2024-05-15T18:10:43.309110+0000","last_fullsized":"2024-05-15T18:10:43.309110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353249+0000","last_change":"2024-05-15T18:08:39.187737+0000","last_active":"2024-05-15T18:09:20.353249+0000","last_peered":"2024-05-15T18:09:20.353249+0000","last_clean":"2024-05-15T18:09:20.353249+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:09:20.353249+0000","last_undegraded":"2024-05-15T18:09:20.353249+0000","last_fullsized":"2024-05-15T18:09:20.353249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403507+0000","last_change":"2024-05-15T18:08:37.176725+0000","last_active":"2024-05-15T18:09:19.403507+0000","last_peered":"2024-05-15T18:09:19.403507+0000","last_clean":"2024-05-15T18:09:19.403507+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:09:19.403507+0000","last_undegraded":"2024-05-15T18:09:19.403507+0000","last_fullsized":"2024-05-15T18:09:19.403507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:14:09.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075342+0000","last_change":"2024-05-15T18:08:39.183706+0000","last_active":"2024-05-15T18:11:47.075342+0000","last_peered":"2024-05-15T18:11:47.075342+0000","last_clean":"2024-05-15T18:11:47.075342+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:11:47.075342+0000","last_undegraded":"2024-05-15T18:11:47.075342+0000","last_fullsized":"2024-05-15T18:11:47.075342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403416+0000","last_change":"2024-05-15T18:08:37.173166+0000","last_active":"2024-05-15T18:09:19.403416+0000","last_peered":"2024-05-15T18:09:19.403416+0000","last_clean":"2024-05-15T18:09:19.403416+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:09:19.403416+0000","last_undegraded":"2024-05-15T18:09:19.403416+0000","last_fullsized":"2024-05-15T18:09:19.403416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820262+0000","last_change":"2024-05-15T18:08:39.183490+0000","last_active":"2024-05-15T18:09:20.820262+0000","last_peered":"2024-05-15T18:09:20.820262+0000","last_clean":"2024-05-15T18:09:20.820262+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:09:20.820262+0000","last_undegraded":"2024-05-15T18:09:20.820262+0000","last_fullsized":"2024-05-15T18:09:20.820262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:04.391798+0000","last_change":"2024-05-15T18:08:37.180056+0000","last_active":"2024-05-15T18:11:04.391798+0000","last_peered":"2024-05-15T18:11:04.391798+0000","last_clean":"2024-05-15T18:11:04.391798+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:11:04.391798+0000","last_undegraded":"2024-05-15T18:11:04.391798+0000","last_fullsized":"2024-05-15T18:11:04.391798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.638104+0000","last_change":"2024-05-15T18:08:39.180165+0000","last_active":"2024-05-15T18:10:02.638104+0000","last_peered":"2024-05-15T18:10:02.638104+0000","last_clean":"2024-05-15T18:10:02.638104+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:10:02.638104+0000","last_undegraded":"2024-05-15T18:10:02.638104+0000","last_fullsized":"2024-05-15T18:10:02.638104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398920+0000","last_change":"2024-05-15T18:08:37.181235+0000","last_active":"2024-05-15T18:09:19.398920+0000","last_peered":"2024-05-15T18:09:19.398920+0000","last_clean":"2024-05-15T18:09:19.398920+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:09:19.398920+0000","last_undegraded":"2024-05-15T18:09:19.398920+0000","last_fullsized":"2024-05-15T18:09:19.398920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:24.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.052271+0000","last_change":"2024-05-15T18:08:47.223064+0000","last_active":"2024-05-15T18:11:47.052271+0000","last_peered":"2024-05-15T18:11:47.052271+0000","last_clean":"2024-05-15T18:11:47.052271+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:11:47.052271+0000","last_undegraded":"2024-05-15T18:11:47.052271+0000","last_fullsized":"2024-05-15T18:11:47.052271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:52.698600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101931+0000","last_change":"2024-05-15T18:09:19.408744+0000","last_active":"2024-05-15T18:11:47.101931+0000","last_peered":"2024-05-15T18:11:47.101931+0000","last_clean":"2024-05-15T18:11:47.101931+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:11:47.101931+0000","last_undegraded":"2024-05-15T18:11:47.101931+0000","last_fullsized":"2024-05-15T18:11:47.101931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:44.669224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398972+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:09:19.398972+0000","last_peered":"2024-05-15T18:09:19.398972+0000","last_clean":"2024-05-15T18:09:19.398972+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:09:19.398972+0000","last_undegraded":"2024-05-15T18:09:19.398972+0000","last_fullsized":"2024-05-15T18:09:19.398972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:34.978659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.039167+0000","last_change":"2024-05-15T18:08:41.191864+0000","last_active":"2024-05-15T18:10:46.039167+0000","last_peered":"2024-05-15T18:10:46.039167+0000","last_clean":"2024-05-15T18:10:46.039167+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:10:46.039167+0000","last_undegraded":"2024-05-15T18:10:46.039167+0000","last_fullsized":"2024-05-15T18:10:46.039167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.990907+0000","last_change":"2024-05-15T18:08:43.205617+0000","last_active":"2024-05-15T18:10:44.990907+0000","last_peered":"2024-05-15T18:10:44.990907+0000","last_clean":"2024-05-15T18:10:44.990907+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:10:44.990907+0000","last_undegraded":"2024-05-15T18:10:44.990907+0000","last_fullsized":"2024-05-15T18:10:44.990907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:54.834292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401260+0000","last_change":"2024-05-15T18:08:45.209245+0000","last_active":"2024-05-15T18:09:19.401260+0000","last_peered":"2024-05-15T18:09:19.401260+0000","last_clean":"2024-05-15T18:09:19.401260+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:09:19.401260+0000","last_undegraded":"2024-05-15T18:09:19.401260+0000","last_fullsized":"2024-05-15T18:09:19.401260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.077076+0000","last_change":"2024-05-15T18:08:47.223088+0000","last_active":"2024-05-15T18:11:47.077076+0000","last_peered":"2024-05-15T18:11:47.077076+0000","last_clean":"2024-05-15T18:11:47.077076+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:11:47.077076+0000","last_undegraded":"2024-05-15T18:11:47.077076+0000","last_fullsized":"2024-05-15T18:11:47.077076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:02.637943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102151+0000","last_change":"2024-05-15T18:08:39.182435+0000","last_active":"2024-05-15T18:11:47.102151+0000","last_peered":"2024-05-15T18:11:47.102151+0000","last_clean":"2024-05-15T18:11:47.102151+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:11:47.102151+0000","last_undegraded":"2024-05-15T18:11:47.102151+0000","last_fullsized":"2024-05-15T18:11:47.102151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:54.513611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406138+0000","last_change":"2024-05-15T18:08:37.176655+0000","last_active":"2024-05-15T18:09:19.406138+0000","last_peered":"2024-05-15T18:09:19.406138+0000","last_clean":"2024-05-15T18:09:19.406138+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:09:19.406138+0000","last_undegraded":"2024-05-15T18:09:19.406138+0000","last_fullsized":"2024-05-15T18:09:19.406138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399967+0000","last_change":"2024-05-15T18:08:41.190513+0000","last_active":"2024-05-15T18:09:19.399967+0000","last_peered":"2024-05-15T18:09:19.399967+0000","last_clean":"2024-05-15T18:09:19.399967+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:09:19.399967+0000","last_undegraded":"2024-05-15T18:09:19.399967+0000","last_fullsized":"2024-05-15T18:09:19.399967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:24:07.182527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.415322+0000","last_change":"2024-05-15T18:08:43.193059+0000","last_active":"2024-05-15T18:10:46.415322+0000","last_peered":"2024-05-15T18:10:46.415322+0000","last_clean":"2024-05-15T18:10:46.415322+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:10:46.415322+0000","last_undegraded":"2024-05-15T18:10:46.415322+0000","last_fullsized":"2024-05-15T18:10:46.415322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:03:54.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401523+0000","last_change":"2024-05-15T18:08:45.200547+0000","last_active":"2024-05-15T18:09:19.401523+0000","last_peered":"2024-05-15T18:09:19.401523+0000","last_clean":"2024-05-15T18:09:19.401523+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:09:19.401523+0000","last_undegraded":"2024-05-15T18:09:19.401523+0000","last_fullsized":"2024-05-15T18:09:19.401523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.731935+0000","last_change":"2024-05-15T18:08:47.215478+0000","last_active":"2024-05-15T18:09:19.731935+0000","last_peered":"2024-05-15T18:09:19.731935+0000","last_clean":"2024-05-15T18:09:19.731935+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:09:19.731935+0000","last_undegraded":"2024-05-15T18:09:19.731935+0000","last_fullsized":"2024-05-15T18:09:19.731935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736547+0000","last_change":"2024-05-15T18:08:39.180798+0000","last_active":"2024-05-15T18:09:19.736547+0000","last_peered":"2024-05-15T18:09:19.736547+0000","last_clean":"2024-05-15T18:09:19.736547+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:09:19.736547+0000","last_undegraded":"2024-05-15T18:09:19.736547+0000","last_fullsized":"2024-05-15T18:09:19.736547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:49.260782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.341191+0000","last_change":"2024-05-15T18:08:37.185177+0000","last_active":"2024-05-15T18:09:20.341191+0000","last_peered":"2024-05-15T18:09:20.341191+0000","last_clean":"2024-05-15T18:09:20.341191+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:09:20.341191+0000","last_undegraded":"2024-05-15T18:09:20.341191+0000","last_fullsized":"2024-05-15T18:09:20.341191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:50.301378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:23.381565+0000","last_change":"2024-05-15T18:09:19.410089+0000","last_active":"2024-05-15T18:09:23.381565+0000","last_peered":"2024-05-15T18:09:23.381565+0000","last_clean":"2024-05-15T18:09:23.381565+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:09:23.381565+0000","last_undegraded":"2024-05-15T18:09:23.381565+0000","last_fullsized":"2024-05-15T18:09:23.381565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:15:56.615789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407814+0000","last_change":"2024-05-15T18:08:43.198970+0000","last_active":"2024-05-15T18:09:19.407814+0000","last_peered":"2024-05-15T18:09:19.407814+0000","last_clean":"2024-05-15T18:09:19.407814+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:09:19.407814+0000","last_undegraded":"2024-05-15T18:09:19.407814+0000","last_fullsized":"2024-05-15T18:09:19.407814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:48.849846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274331+0000","last_change":"2024-05-15T18:08:45.210771+0000","last_active":"2024-05-15T18:11:46.274331+0000","last_peered":"2024-05-15T18:11:46.274331+0000","last_clean":"2024-05-15T18:11:46.274331+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:11:46.274331+0000","last_undegraded":"2024-05-15T18:11:46.274331+0000","last_fullsized":"2024-05-15T18:11:46.274331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:10.645906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.408911+0000","last_change":"2024-05-15T18:08:47.220509+0000","last_active":"2024-05-15T18:10:46.408911+0000","last_peered":"2024-05-15T18:10:46.408911+0000","last_clean":"2024-05-15T18:10:46.408911+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:10:46.408911+0000","last_undegraded":"2024-05-15T18:10:46.408911+0000","last_fullsized":"2024-05-15T18:10:46.408911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:56.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'23","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111340+0000","last_change":"2024-05-15T18:08:39.187144+0000","last_active":"2024-05-15T18:11:47.111340+0000","last_peered":"2024-05-15T18:11:47.111340+0000","last_clean":"2024-05-15T18:11:47.111340+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:11:47.111340+0000","last_undegraded":"2024-05-15T18:11:47.111340+0000","last_fullsized":"2024-05-15T18:11:47.111340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399530+0000","last_change":"2024-05-15T18:08:37.176800+0000","last_active":"2024-05-15T18:09:19.399530+0000","last_peered":"2024-05-15T18:09:19.399530+0000","last_clean":"2024-05-15T18:09:19.399530+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:09:19.399530+0000","last_undegraded":"2024-05-15T18:09:19.399530+0000","last_fullsized":"2024-05-15T18:09:19.399530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400987+0000","last_change":"2024-05-15T18:08:41.191184+0000","last_active":"2024-05-15T18:09:19.400987+0000","last_peered":"2024-05-15T18:09:19.400987+0000","last_clean":"2024-05-15T18:09:19.400987+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:09:19.400987+0000","last_undegraded":"2024-05-15T18:09:19.400987+0000","last_fullsized":"2024-05-15T18:09:19.400987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:25.413878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.985510+0000","last_change":"2024-05-15T18:08:43.199596+0000","last_active":"2024-05-15T18:10:44.985510+0000","last_peered":"2024-05-15T18:10:44.985510+0000","last_clean":"2024-05-15T18:10:44.985510+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:10:44.985510+0000","last_undegraded":"2024-05-15T18:10:44.985510+0000","last_fullsized":"2024-05-15T18:10:44.985510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:22.284084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":435,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.107028+0000","last_change":"2024-05-15T18:08:45.198740+0000","last_active":"2024-05-15T18:11:47.107028+0000","last_peered":"2024-05-15T18:11:47.107028+0000","last_clean":"2024-05-15T18:11:47.107028+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:47.107028+0000","last_undegraded":"2024-05-15T18:11:47.107028+0000","last_fullsized":"2024-05-15T18:11:47.107028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:30.679986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.798859+0000","last_change":"2024-05-15T18:08:39.194038+0000","last_active":"2024-05-15T18:11:46.798859+0000","last_peered":"2024-05-15T18:11:46.798859+0000","last_clean":"2024-05-15T18:11:46.798859+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:11:46.798859+0000","last_undegraded":"2024-05-15T18:11:46.798859+0000","last_fullsized":"2024-05-15T18:11:46.798859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:23:21.748030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408742+0000","last_change":"2024-05-15T18:08:37.173486+0000","last_active":"2024-05-15T18:09:19.408742+0000","last_peered":"2024-05-15T18:09:19.408742+0000","last_clean":"2024-05-15T18:09:19.408742+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:09:19.408742+0000","last_undegraded":"2024-05-15T18:09:19.408742+0000","last_fullsized":"2024-05-15T18:09:19.408742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402302+0000","last_change":"2024-05-15T18:08:41.193621+0000","last_active":"2024-05-15T18:09:19.402302+0000","last_peered":"2024-05-15T18:09:19.402302+0000","last_clean":"2024-05-15T18:09:19.402302+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:09:19.402302+0000","last_undegraded":"2024-05-15T18:09:19.402302+0000","last_fullsized":"2024-05-15T18:09:19.402302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:49.471489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'41","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.995296+0000","last_change":"2024-05-15T18:08:43.190370+0000","last_active":"2024-05-15T18:10:44.995296+0000","last_peered":"2024-05-15T18:10:44.995296+0000","last_clean":"2024-05-15T18:10:44.995296+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:10:44.995296+0000","last_undegraded":"2024-05-15T18:10:44.995296+0000","last_fullsized":"2024-05-15T18:10:44.995296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:30:17.103247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399470+0000","last_change":"2024-05-15T18:08:45.198524+0000","last_active":"2024-05-15T18:09:19.399470+0000","last_peered":"2024-05-15T18:09:19.399470+0000","last_clean":"2024-05-15T18:09:19.399470+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:09:19.399470+0000","last_undegraded":"2024-05-15T18:09:19.399470+0000","last_fullsized":"2024-05-15T18:09:19.399470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.647715+0000","last_change":"2024-05-15T18:08:47.221822+0000","last_active":"2024-05-15T18:10:02.647715+0000","last_peered":"2024-05-15T18:10:02.647715+0000","last_clean":"2024-05-15T18:10:02.647715+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:10:02.647715+0000","last_undegraded":"2024-05-15T18:10:02.647715+0000","last_fullsized":"2024-05-15T18:10:02.647715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:13.338228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.411141+0000","last_change":"2024-05-15T18:08:39.186448+0000","last_active":"2024-05-15T18:10:46.411141+0000","last_peered":"2024-05-15T18:10:46.411141+0000","last_clean":"2024-05-15T18:10:46.411141+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:10:46.411141+0000","last_undegraded":"2024-05-15T18:10:46.411141+0000","last_fullsized":"2024-05-15T18:10:46.411141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:19.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.409682+0000","last_change":"2024-05-15T18:08:37.179060+0000","last_active":"2024-05-15T18:09:19.409682+0000","last_peered":"2024-05-15T18:09:19.409682+0000","last_clean":"2024-05-15T18:09:19.409682+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:09:19.409682+0000","last_undegraded":"2024-05-15T18:09:19.409682+0000","last_fullsized":"2024-05-15T18:09:19.409682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"22'1","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.049391+0000","last_change":"2024-05-15T18:08:41.193828+0000","last_active":"2024-05-15T18:10:46.049391+0000","last_peered":"2024-05-15T18:10:46.049391+0000","last_clean":"2024-05-15T18:10:46.049391+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:10:46.049391+0000","last_undegraded":"2024-05-15T18:10:46.049391+0000","last_fullsized":"2024-05-15T18:10:46.049391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:53.033474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.975080+0000","last_change":"2024-05-15T18:08:43.205152+0000","last_active":"2024-05-15T18:10:44.975080+0000","last_peered":"2024-05-15T18:10:44.975080+0000","last_clean":"2024-05-15T18:10:44.975080+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:10:44.975080+0000","last_undegraded":"2024-05-15T18:10:44.975080+0000","last_fullsized":"2024-05-15T18:10:44.975080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:54:29.654507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399047+0000","last_change":"2024-05-15T18:08:45.207980+0000","last_active":"2024-05-15T18:09:19.399047+0000","last_peered":"2024-05-15T18:09:19.399047+0000","last_clean":"2024-05-15T18:09:19.399047+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:09:19.399047+0000","last_undegraded":"2024-05-15T18:09:19.399047+0000","last_fullsized":"2024-05-15T18:09:19.399047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:57.088948+0000","last_change":"2024-05-15T18:08:47.217227+0000","last_active":"2024-05-15T18:09:57.088948+0000","last_peered":"2024-05-15T18:09:57.088948+0000","last_clean":"2024-05-15T18:09:57.088948+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:09:57.088948+0000","last_undegraded":"2024-05-15T18:09:57.088948+0000","last_fullsized":"2024-05-15T18:09:57.088948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102085+0000","last_change":"2024-05-15T18:08:39.185744+0000","last_active":"2024-05-15T18:11:47.102085+0000","last_peered":"2024-05-15T18:11:47.102085+0000","last_clean":"2024-05-15T18:11:47.102085+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:11:47.102085+0000","last_undegraded":"2024-05-15T18:11:47.102085+0000","last_fullsized":"2024-05-15T18:11:47.102085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:26.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.761148+0000","last_change":"2024-05-15T18:08:37.181644+0000","last_active":"2024-05-15T18:11:46.761148+0000","last_peered":"2024-05-15T18:11:46.761148+0000","last_clean":"2024-05-15T18:11:46.761148+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:11:46.761148+0000","last_undegraded":"2024-05-15T18:11:46.761148+0000","last_fullsized":"2024-05-15T18:11:46.761148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:40.709421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400858+0000","last_change":"2024-05-15T18:08:41.191195+0000","last_active":"2024-05-15T18:09:19.400858+0000","last_peered":"2024-05-15T18:09:19.400858+0000","last_clean":"2024-05-15T18:09:19.400858+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:09:19.400858+0000","last_undegraded":"2024-05-15T18:09:19.400858+0000","last_fullsized":"2024-05-15T18:09:19.400858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:55.559496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997111+0000","last_change":"2024-05-15T18:08:43.205104+0000","last_active":"2024-05-15T18:10:44.997111+0000","last_peered":"2024-05-15T18:10:44.997111+0000","last_clean":"2024-05-15T18:10:44.997111+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:10:44.997111+0000","last_undegraded":"2024-05-15T18:10:44.997111+0000","last_fullsized":"2024-05-15T18:10:44.997111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:18.034720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":397,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.228683+0000","last_change":"2024-05-15T18:08:45.205456+0000","last_active":"2024-05-15T18:11:47.228683+0000","last_peered":"2024-05-15T18:11:47.228683+0000","last_clean":"2024-05-15T18:11:47.228683+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:11:47.228683+0000","last_undegraded":"2024-05-15T18:11:47.228683+0000","last_fullsized":"2024-05-15T18:11:47.228683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400131+0000","last_change":"2024-05-15T18:08:47.218349+0000","last_active":"2024-05-15T18:09:19.400131+0000","last_peered":"2024-05-15T18:09:19.400131+0000","last_clean":"2024-05-15T18:09:19.400131+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:09:19.400131+0000","last_undegraded":"2024-05-15T18:09:19.400131+0000","last_fullsized":"2024-05-15T18:09:19.400131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:22.049537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075674+0000","last_change":"2024-05-15T18:08:39.180538+0000","last_active":"2024-05-15T18:11:47.075674+0000","last_peered":"2024-05-15T18:11:47.075674+0000","last_clean":"2024-05-15T18:11:47.075674+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:11:47.075674+0000","last_undegraded":"2024-05-15T18:11:47.075674+0000","last_fullsized":"2024-05-15T18:11:47.075674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399222+0000","last_change":"2024-05-15T18:08:37.179976+0000","last_active":"2024-05-15T18:09:19.399222+0000","last_peered":"2024-05-15T18:09:19.399222+0000","last_clean":"2024-05-15T18:09:19.399222+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:09:19.399222+0000","last_undegraded":"2024-05-15T18:09:19.399222+0000","last_fullsized":"2024-05-15T18:09:19.399222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:26.717872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399581+0000","last_change":"2024-05-15T18:08:41.193806+0000","last_active":"2024-05-15T18:09:19.399581+0000","last_peered":"2024-05-15T18:09:19.399581+0000","last_clean":"2024-05-15T18:09:19.399581+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:09:19.399581+0000","last_undegraded":"2024-05-15T18:09:19.399581+0000","last_fullsized":"2024-05-15T18:09:19.399581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:03:24.766255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'54","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.998912+0000","last_change":"2024-05-15T18:08:43.201489+0000","last_active":"2024-05-15T18:10:44.998912+0000","last_peered":"2024-05-15T18:10:44.998912+0000","last_clean":"2024-05-15T18:10:44.998912+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:10:44.998912+0000","last_undegraded":"2024-05-15T18:10:44.998912+0000","last_fullsized":"2024-05-15T18:10:44.998912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:29.914900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398840+0000","last_change":"2024-05-15T18:08:45.200667+0000","last_active":"2024-05-15T18:09:19.398840+0000","last_peered":"2024-05-15T18:09:19.398840+0000","last_clean":"2024-05-15T18:09:19.398840+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:09:19.398840+0000","last_undegraded":"2024-05-15T18:09:19.398840+0000","last_fullsized":"2024-05-15T18:09:19.398840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'18","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.205345+0000","last_change":"2024-05-15T18:08:47.219473+0000","last_active":"2024-05-15T18:11:47.205345+0000","last_peered":"2024-05-15T18:11:47.205345+0000","last_clean":"2024-05-15T18:11:47.205345+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:11:47.205345+0000","last_undegraded":"2024-05-15T18:11:47.205345+0000","last_fullsized":"2024-05-15T18:11:47.205345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:54.139301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801094+0000","last_change":"2024-05-15T18:08:39.191385+0000","last_active":"2024-05-15T18:11:46.801094+0000","last_peered":"2024-05-15T18:11:46.801094+0000","last_clean":"2024-05-15T18:11:46.801094+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:11:46.801094+0000","last_undegraded":"2024-05-15T18:11:46.801094+0000","last_fullsized":"2024-05-15T18:11:46.801094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:51.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399685+0000","last_change":"2024-05-15T18:08:37.181014+0000","last_active":"2024-05-15T18:09:19.399685+0000","last_peered":"2024-05-15T18:09:19.399685+0000","last_clean":"2024-05-15T18:09:19.399685+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:09:19.399685+0000","last_undegraded":"2024-05-15T18:09:19.399685+0000","last_fullsized":"2024-05-15T18:09:19.399685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408267+0000","last_change":"2024-05-15T18:08:41.189363+0000","last_active":"2024-05-15T18:09:19.408267+0000","last_peered":"2024-05-15T18:09:19.408267+0000","last_clean":"2024-05-15T18:09:19.408267+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:09:19.408267+0000","last_undegraded":"2024-05-15T18:09:19.408267+0000","last_fullsized":"2024-05-15T18:09:19.408267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:55.939790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.979398+0000","last_change":"2024-05-15T18:08:43.192533+0000","last_active":"2024-05-15T18:10:44.979398+0000","last_peered":"2024-05-15T18:10:44.979398+0000","last_clean":"2024-05-15T18:10:44.979398+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:10:44.979398+0000","last_undegraded":"2024-05-15T18:10:44.979398+0000","last_fullsized":"2024-05-15T18:10:44.979398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:12.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403941+0000","last_change":"2024-05-15T18:08:45.210581+0000","last_active":"2024-05-15T18:09:19.403941+0000","last_peered":"2024-05-15T18:09:19.403941+0000","last_clean":"2024-05-15T18:09:19.403941+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:09:19.403941+0000","last_undegraded":"2024-05-15T18:09:19.403941+0000","last_fullsized":"2024-05-15T18:09:19.403941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:14.840773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393707+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:10:48.393707+0000","last_peered":"2024-05-15T18:10:48.393707+0000","last_clean":"2024-05-15T18:10:48.393707+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:10:48.393707+0000","last_undegraded":"2024-05-15T18:10:48.393707+0000","last_fullsized":"2024-05-15T18:10:48.393707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:06:12.136063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075396+0000","last_change":"2024-05-15T18:08:39.192086+0000","last_active":"2024-05-15T18:11:47.075396+0000","last_peered":"2024-05-15T18:11:47.075396+0000","last_clean":"2024-05-15T18:11:47.075396+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:11:47.075396+0000","last_undegraded":"2024-05-15T18:11:47.075396+0000","last_fullsized":"2024-05-15T18:11:47.075396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:08.553549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399520+0000","last_change":"2024-05-15T18:08:37.182183+0000","last_active":"2024-05-15T18:09:19.399520+0000","last_peered":"2024-05-15T18:09:19.399520+0000","last_clean":"2024-05-15T18:09:19.399520+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:09:19.399520+0000","last_undegraded":"2024-05-15T18:09:19.399520+0000","last_fullsized":"2024-05-15T18:09:19.399520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:19.415597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401501+0000","last_change":"2024-05-15T18:08:41.188718+0000","last_active":"2024-05-15T18:09:19.401501+0000","last_peered":"2024-05-15T18:09:19.401501+0000","last_clean":"2024-05-15T18:09:19.401501+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:09:19.401501+0000","last_undegraded":"2024-05-15T18:09:19.401501+0000","last_fullsized":"2024-05-15T18:09:19.401501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:42.285433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.006001+0000","last_change":"2024-05-15T18:08:43.194313+0000","last_active":"2024-05-15T18:10:45.006001+0000","last_peered":"2024-05-15T18:10:45.006001+0000","last_clean":"2024-05-15T18:10:45.006001+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:10:45.006001+0000","last_undegraded":"2024-05-15T18:10:45.006001+0000","last_fullsized":"2024-05-15T18:10:45.006001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:19.416460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.209358+0000","last_change":"2024-05-15T18:08:45.200646+0000","last_active":"2024-05-15T18:11:47.209358+0000","last_peered":"2024-05-15T18:11:47.209358+0000","last_clean":"2024-05-15T18:11:47.209358+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:11:47.209358+0000","last_undegraded":"2024-05-15T18:11:47.209358+0000","last_fullsized":"2024-05-15T18:11:47.209358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:10:00.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390249+0000","last_change":"2024-05-15T18:08:47.215424+0000","last_active":"2024-05-15T18:10:54.390249+0000","last_peered":"2024-05-15T18:10:54.390249+0000","last_clean":"2024-05-15T18:10:54.390249+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:10:54.390249+0000","last_undegraded":"2024-05-15T18:10:54.390249+0000","last_fullsized":"2024-05-15T18:10:54.390249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.800027+0000","last_change":"2024-05-15T18:08:39.187057+0000","last_active":"2024-05-15T18:11:46.800027+0000","last_peered":"2024-05-15T18:11:46.800027+0000","last_clean":"2024-05-15T18:11:46.800027+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:11:46.800027+0000","last_undegraded":"2024-05-15T18:11:46.800027+0000","last_fullsized":"2024-05-15T18:11:46.800027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.015300+0000","last_change":"2024-05-15T18:08:37.185221+0000","last_active":"2024-05-15T18:11:47.015300+0000","last_peered":"2024-05-15T18:11:47.015300+0000","last_clean":"2024-05-15T18:11:47.015300+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:11:47.015300+0000","last_undegraded":"2024-05-15T18:11:47.015300+0000","last_fullsized":"2024-05-15T18:11:47.015300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:28:54.139077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.048905+0000","last_change":"2024-05-15T18:08:41.190951+0000","last_active":"2024-05-15T18:10:46.048905+0000","last_peered":"2024-05-15T18:10:46.048905+0000","last_clean":"2024-05-15T18:10:46.048905+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:10:46.048905+0000","last_undegraded":"2024-05-15T18:10:46.048905+0000","last_fullsized":"2024-05-15T18:10:46.048905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:49.382359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399598+0000","last_change":"2024-05-15T18:08:43.204683+0000","last_active":"2024-05-15T18:09:19.399598+0000","last_peered":"2024-05-15T18:09:19.399598+0000","last_clean":"2024-05-15T18:09:19.399598+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:09:19.399598+0000","last_undegraded":"2024-05-15T18:09:19.399598+0000","last_fullsized":"2024-05-15T18:09:19.399598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:53.977325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":459,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.165903+0000","last_change":"2024-05-15T18:08:45.199310+0000","last_active":"2024-05-15T18:11:47.165903+0000","last_peered":"2024-05-15T18:11:47.165903+0000","last_clean":"2024-05-15T18:11:47.165903+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:11:47.165903+0000","last_undegraded":"2024-05-15T18:11:47.165903+0000","last_fullsized":"2024-05-15T18:11:47.165903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.189456+0000","last_change":"2024-05-15T18:08:47.215824+0000","last_active":"2024-05-15T18:10:46.189456+0000","last_peered":"2024-05-15T18:10:46.189456+0000","last_clean":"2024-05-15T18:10:46.189456+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:10:46.189456+0000","last_undegraded":"2024-05-15T18:10:46.189456+0000","last_fullsized":"2024-05-15T18:10:46.189456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:24:54.483230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082864+0000","last_change":"2024-05-15T18:08:39.194733+0000","last_active":"2024-05-15T18:09:20.082864+0000","last_peered":"2024-05-15T18:09:20.082864+0000","last_clean":"2024-05-15T18:09:20.082864+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:09:20.082864+0000","last_undegraded":"2024-05-15T18:09:20.082864+0000","last_fullsized":"2024-05-15T18:09:20.082864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:57.618713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398143+0000","last_change":"2024-05-15T18:08:37.183998+0000","last_active":"2024-05-15T18:09:19.398143+0000","last_peered":"2024-05-15T18:09:19.398143+0000","last_clean":"2024-05-15T18:09:19.398143+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:09:19.398143+0000","last_undegraded":"2024-05-15T18:09:19.398143+0000","last_fullsized":"2024-05-15T18:09:19.398143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:37.009803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399709+0000","last_change":"2024-05-15T18:08:41.189678+0000","last_active":"2024-05-15T18:09:19.399709+0000","last_peered":"2024-05-15T18:09:19.399709+0000","last_clean":"2024-05-15T18:09:19.399709+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:09:19.399709+0000","last_undegraded":"2024-05-15T18:09:19.399709+0000","last_fullsized":"2024-05-15T18:09:19.399709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:35.879769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.991934+0000","last_change":"2024-05-15T18:08:43.192247+0000","last_active":"2024-05-15T18:10:44.991934+0000","last_peered":"2024-05-15T18:10:44.991934+0000","last_clean":"2024-05-15T18:10:44.991934+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:10:44.991934+0000","last_undegraded":"2024-05-15T18:10:44.991934+0000","last_fullsized":"2024-05-15T18:10:44.991934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:20:02.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406471+0000","last_change":"2024-05-15T18:08:45.204036+0000","last_active":"2024-05-15T18:09:19.406471+0000","last_peered":"2024-05-15T18:09:19.406471+0000","last_clean":"2024-05-15T18:09:19.406471+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:09:19.406471+0000","last_undegraded":"2024-05-15T18:09:19.406471+0000","last_fullsized":"2024-05-15T18:09:19.406471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:50.743550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.207224+0000","last_change":"2024-05-15T18:08:47.214760+0000","last_active":"2024-05-15T18:11:47.207224+0000","last_peered":"2024-05-15T18:11:47.207224+0000","last_clean":"2024-05-15T18:11:47.207224+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:11:47.207224+0000","last_undegraded":"2024-05-15T18:11:47.207224+0000","last_fullsized":"2024-05-15T18:11:47.207224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:10.382678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401664+0000","last_change":"2024-05-15T18:08:39.189647+0000","last_active":"2024-05-15T18:09:19.401664+0000","last_peered":"2024-05-15T18:09:19.401664+0000","last_clean":"2024-05-15T18:09:19.401664+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:09:19.401664+0000","last_undegraded":"2024-05-15T18:09:19.401664+0000","last_fullsized":"2024-05-15T18:09:19.401664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:38.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399372+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:09:19.399372+0000","last_peered":"2024-05-15T18:09:19.399372+0000","last_clean":"2024-05-15T18:09:19.399372+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:09:19.399372+0000","last_undegraded":"2024-05-15T18:09:19.399372+0000","last_fullsized":"2024-05-15T18:09:19.399372+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:38:29.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399455+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:09:19.399455+0000","last_peered":"2024-05-15T18:09:19.399455+0000","last_clean":"2024-05-15T18:09:19.399455+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:09:19.399455+0000","last_undegraded":"2024-05-15T18:09:19.399455+0000","last_fullsized":"2024-05-15T18:09:19.399455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:51:30.696652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398630+0000","last_change":"2024-05-15T18:08:37.186535+0000","last_active":"2024-05-15T18:09:19.398630+0000","last_peered":"2024-05-15T18:09:19.398630+0000","last_clean":"2024-05-15T18:09:19.398630+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:09:19.398630+0000","last_undegraded":"2024-05-15T18:09:19.398630+0000","last_fullsized":"2024-05-15T18:09:19.398630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:41.333162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403085+0000","last_change":"2024-05-15T18:08:41.191173+0000","last_active":"2024-05-15T18:09:19.403085+0000","last_peered":"2024-05-15T18:09:19.403085+0000","last_clean":"2024-05-15T18:09:19.403085+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:09:19.403085+0000","last_undegraded":"2024-05-15T18:09:19.403085+0000","last_fullsized":"2024-05-15T18:09:19.403085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:33.825447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.003655+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:45.003655+0000","last_peered":"2024-05-15T18:10:45.003655+0000","last_clean":"2024-05-15T18:10:45.003655+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:10:45.003655+0000","last_undegraded":"2024-05-15T18:10:45.003655+0000","last_fullsized":"2024-05-15T18:10:45.003655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:19.100640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401279+0000","last_change":"2024-05-15T18:08:45.208179+0000","last_active":"2024-05-15T18:09:19.401279+0000","last_peered":"2024-05-15T18:09:19.401279+0000","last_clean":"2024-05-15T18:09:19.401279+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:09:19.401279+0000","last_undegraded":"2024-05-15T18:09:19.401279+0000","last_fullsized":"2024-05-15T18:09:19.401279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:39.895143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.117287+0000","last_change":"2024-05-15T18:08:47.212621+0000","last_active":"2024-05-15T18:11:47.117287+0000","last_peered":"2024-05-15T18:11:47.117287+0000","last_clean":"2024-05-15T18:11:47.117287+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:11:47.117287+0000","last_undegraded":"2024-05-15T18:11:47.117287+0000","last_fullsized":"2024-05-15T18:11:47.117287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:45.928963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817460+0000","last_change":"2024-05-15T18:08:39.180830+0000","last_active":"2024-05-15T18:09:20.817460+0000","last_peered":"2024-05-15T18:09:20.817460+0000","last_clean":"2024-05-15T18:09:20.817460+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:09:20.817460+0000","last_undegraded":"2024-05-15T18:09:20.817460+0000","last_fullsized":"2024-05-15T18:09:20.817460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:44.720954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398139+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:09:19.398139+0000","last_peered":"2024-05-15T18:09:19.398139+0000","last_clean":"2024-05-15T18:09:19.398139+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:09:19.398139+0000","last_undegraded":"2024-05-15T18:09:19.398139+0000","last_fullsized":"2024-05-15T18:09:19.398139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:44:53.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399209+0000","last_change":"2024-05-15T18:08:37.179663+0000","last_active":"2024-05-15T18:09:19.399209+0000","last_peered":"2024-05-15T18:09:19.399209+0000","last_clean":"2024-05-15T18:09:19.399209+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:09:19.399209+0000","last_undegraded":"2024-05-15T18:09:19.399209+0000","last_fullsized":"2024-05-15T18:09:19.399209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404825+0000","last_change":"2024-05-15T18:08:41.192861+0000","last_active":"2024-05-15T18:09:19.404825+0000","last_peered":"2024-05-15T18:09:19.404825+0000","last_clean":"2024-05-15T18:09:19.404825+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:09:19.404825+0000","last_undegraded":"2024-05-15T18:09:19.404825+0000","last_fullsized":"2024-05-15T18:09:19.404825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:32.544124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'276","reported_seq":479,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274219+0000","last_change":"2024-05-15T18:08:43.197473+0000","last_active":"2024-05-15T18:11:46.274219+0000","last_peered":"2024-05-15T18:11:46.274219+0000","last_clean":"2024-05-15T18:11:46.274219+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:11:46.274219+0000","last_undegraded":"2024-05-15T18:11:46.274219+0000","last_fullsized":"2024-05-15T18:11:46.274219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:56.013010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":363,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400972+0000","last_change":"2024-05-15T18:08:45.210778+0000","last_active":"2024-05-15T18:09:19.400972+0000","last_peered":"2024-05-15T18:09:19.400972+0000","last_clean":"2024-05-15T18:09:19.400972+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:09:19.400972+0000","last_undegraded":"2024-05-15T18:09:19.400972+0000","last_fullsized":"2024-05-15T18:09:19.400972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:40:44.142402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.643784+0000","last_change":"2024-05-15T18:08:47.217222+0000","last_active":"2024-05-15T18:10:02.643784+0000","last_peered":"2024-05-15T18:10:02.643784+0000","last_clean":"2024-05-15T18:10:02.643784+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:10:02.643784+0000","last_undegraded":"2024-05-15T18:10:02.643784+0000","last_fullsized":"2024-05-15T18:10:02.643784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075441+0000","last_change":"2024-05-15T18:08:39.186998+0000","last_active":"2024-05-15T18:11:47.075441+0000","last_peered":"2024-05-15T18:11:47.075441+0000","last_clean":"2024-05-15T18:11:47.075441+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:11:47.075441+0000","last_undegraded":"2024-05-15T18:11:47.075441+0000","last_fullsized":"2024-05-15T18:11:47.075441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405333+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:09:19.405333+0000","last_peered":"2024-05-15T18:09:19.405333+0000","last_clean":"2024-05-15T18:09:19.405333+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:09:19.405333+0000","last_undegraded":"2024-05-15T18:09:19.405333+0000","last_fullsized":"2024-05-15T18:09:19.405333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398590+0000","last_change":"2024-05-15T18:08:37.173060+0000","last_active":"2024-05-15T18:09:19.398590+0000","last_peered":"2024-05-15T18:09:19.398590+0000","last_clean":"2024-05-15T18:09:19.398590+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:09:19.398590+0000","last_undegraded":"2024-05-15T18:09:19.398590+0000","last_fullsized":"2024-05-15T18:09:19.398590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.417136+0000","last_change":"2024-05-15T18:09:19.416671+0000","last_active":"2024-05-15T18:09:19.417136+0000","last_peered":"2024-05-15T18:09:19.417136+0000","last_clean":"2024-05-15T18:09:19.417136+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:09:19.417136+0000","last_undegraded":"2024-05-15T18:09:19.417136+0000","last_fullsized":"2024-05-15T18:09:19.417136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:46.020343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274261+0000","last_change":"2024-05-15T18:08:43.195546+0000","last_active":"2024-05-15T18:11:46.274261+0000","last_peered":"2024-05-15T18:11:46.274261+0000","last_clean":"2024-05-15T18:11:46.274261+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:11:46.274261+0000","last_undegraded":"2024-05-15T18:11:46.274261+0000","last_fullsized":"2024-05-15T18:11:46.274261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:45:01.029538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400090+0000","last_change":"2024-05-15T18:08:45.204246+0000","last_active":"2024-05-15T18:09:19.400090+0000","last_peered":"2024-05-15T18:09:19.400090+0000","last_clean":"2024-05-15T18:09:19.400090+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:09:19.400090+0000","last_undegraded":"2024-05-15T18:09:19.400090+0000","last_fullsized":"2024-05-15T18:09:19.400090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:36.559499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398480+0000","last_change":"2024-05-15T18:08:47.219388+0000","last_active":"2024-05-15T18:09:19.398480+0000","last_peered":"2024-05-15T18:09:19.398480+0000","last_clean":"2024-05-15T18:09:19.398480+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:09:19.398480+0000","last_undegraded":"2024-05-15T18:09:19.398480+0000","last_fullsized":"2024-05-15T18:09:19.398480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:49.062143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027543+0000","last_change":"2024-05-15T18:08:39.184088+0000","last_active":"2024-05-15T18:11:47.027543+0000","last_peered":"2024-05-15T18:11:47.027543+0000","last_clean":"2024-05-15T18:11:47.027543+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:11:47.027543+0000","last_undegraded":"2024-05-15T18:11:47.027543+0000","last_fullsized":"2024-05-15T18:11:47.027543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398689+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:09:19.398689+0000","last_peered":"2024-05-15T18:09:19.398689+0000","last_clean":"2024-05-15T18:09:19.398689+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:09:19.398689+0000","last_undegraded":"2024-05-15T18:09:19.398689+0000","last_fullsized":"2024-05-15T18:09:19.398689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:36:43.128557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406217+0000","last_change":"2024-05-15T18:08:37.173069+0000","last_active":"2024-05-15T18:09:19.406217+0000","last_peered":"2024-05-15T18:09:19.406217+0000","last_clean":"2024-05-15T18:09:19.406217+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:09:19.406217+0000","last_undegraded":"2024-05-15T18:09:19.406217+0000","last_fullsized":"2024-05-15T18:09:19.406217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401267+0000","last_change":"2024-05-15T18:08:41.191439+0000","last_active":"2024-05-15T18:09:19.401267+0000","last_peered":"2024-05-15T18:09:19.401267+0000","last_clean":"2024-05-15T18:09:19.401267+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:09:19.401267+0000","last_undegraded":"2024-05-15T18:09:19.401267+0000","last_fullsized":"2024-05-15T18:09:19.401267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:23:42.753008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.426994+0000","last_change":"2024-05-15T18:08:43.202158+0000","last_active":"2024-05-15T18:11:46.426994+0000","last_peered":"2024-05-15T18:11:46.426994+0000","last_clean":"2024-05-15T18:11:46.426994+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:11:46.426994+0000","last_undegraded":"2024-05-15T18:11:46.426994+0000","last_fullsized":"2024-05-15T18:11:46.426994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:58:30.776682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404053+0000","last_change":"2024-05-15T18:08:45.211047+0000","last_active":"2024-05-15T18:09:19.404053+0000","last_peered":"2024-05-15T18:09:19.404053+0000","last_clean":"2024-05-15T18:09:19.404053+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:09:19.404053+0000","last_undegraded":"2024-05-15T18:09:19.404053+0000","last_fullsized":"2024-05-15T18:09:19.404053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:32.852658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.169134+0000","last_change":"2024-05-15T18:08:47.221837+0000","last_active":"2024-05-15T18:10:46.169134+0000","last_peered":"2024-05-15T18:10:46.169134+0000","last_clean":"2024-05-15T18:10:46.169134+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:10:46.169134+0000","last_undegraded":"2024-05-15T18:10:46.169134+0000","last_fullsized":"2024-05-15T18:10:46.169134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:52.042498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'7","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413696+0000","last_change":"2024-05-15T18:08:39.194112+0000","last_active":"2024-05-15T18:10:46.413696+0000","last_peered":"2024-05-15T18:10:46.413696+0000","last_clean":"2024-05-15T18:10:46.413696+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:10:46.413696+0000","last_undegraded":"2024-05-15T18:10:46.413696+0000","last_fullsized":"2024-05-15T18:10:46.413696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:34.314353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408561+0000","last_change":"2024-05-15T18:08:37.173933+0000","last_active":"2024-05-15T18:09:19.408561+0000","last_peered":"2024-05-15T18:09:19.408561+0000","last_clean":"2024-05-15T18:09:19.408561+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:09:19.408561+0000","last_undegraded":"2024-05-15T18:09:19.408561+0000","last_fullsized":"2024-05-15T18:09:19.408561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400028+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:09:19.400028+0000","last_peered":"2024-05-15T18:09:19.400028+0000","last_clean":"2024-05-15T18:09:19.400028+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:09:19.400028+0000","last_undegraded":"2024-05-15T18:09:19.400028+0000","last_fullsized":"2024-05-15T18:09:19.400028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:49.389424+0000","last_change":"2024-05-15T18:08:41.195863+0000","last_active":"2024-05-15T18:10:49.389424+0000","last_peered":"2024-05-15T18:10:49.389424+0000","last_clean":"2024-05-15T18:10:49.389424+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:10:49.389424+0000","last_undegraded":"2024-05-15T18:10:49.389424+0000","last_fullsized":"2024-05-15T18:10:49.389424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:40:08.456674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.004628+0000","last_change":"2024-05-15T18:08:43.200791+0000","last_active":"2024-05-15T18:10:45.004628+0000","last_peered":"2024-05-15T18:10:45.004628+0000","last_clean":"2024-05-15T18:10:45.004628+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:10:45.004628+0000","last_undegraded":"2024-05-15T18:10:45.004628+0000","last_fullsized":"2024-05-15T18:10:45.004628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:52.336305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405836+0000","last_change":"2024-05-15T18:08:45.198343+0000","last_active":"2024-05-15T18:09:19.405836+0000","last_peered":"2024-05-15T18:09:19.405836+0000","last_clean":"2024-05-15T18:09:19.405836+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:09:19.405836+0000","last_undegraded":"2024-05-15T18:09:19.405836+0000","last_fullsized":"2024-05-15T18:09:19.405836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:44.763619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.350044+0000","last_change":"2024-05-15T18:08:47.215201+0000","last_active":"2024-05-15T18:10:46.350044+0000","last_peered":"2024-05-15T18:10:46.350044+0000","last_clean":"2024-05-15T18:10:46.350044+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:10:46.350044+0000","last_undegraded":"2024-05-15T18:10:46.350044+0000","last_fullsized":"2024-05-15T18:10:46.350044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:59:36.775916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101867+0000","last_change":"2024-05-15T18:09:19.415333+0000","last_active":"2024-05-15T18:11:47.101867+0000","last_peered":"2024-05-15T18:11:47.101867+0000","last_clean":"2024-05-15T18:11:47.101867+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:11:47.101867+0000","last_undegraded":"2024-05-15T18:11:47.101867+0000","last_fullsized":"2024-05-15T18:11:47.101867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400285+0000","last_change":"2024-05-15T18:08:37.180268+0000","last_active":"2024-05-15T18:09:19.400285+0000","last_peered":"2024-05-15T18:09:19.400285+0000","last_clean":"2024-05-15T18:09:19.400285+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:09:19.400285+0000","last_undegraded":"2024-05-15T18:09:19.400285+0000","last_fullsized":"2024-05-15T18:09:19.400285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401559+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:09:19.401559+0000","last_peered":"2024-05-15T18:09:19.401559+0000","last_clean":"2024-05-15T18:09:19.401559+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:09:19.401559+0000","last_undegraded":"2024-05-15T18:09:19.401559+0000","last_fullsized":"2024-05-15T18:09:19.401559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:13.458538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399025+0000","last_change":"2024-05-15T18:08:41.191700+0000","last_active":"2024-05-15T18:09:19.399025+0000","last_peered":"2024-05-15T18:09:19.399025+0000","last_clean":"2024-05-15T18:09:19.399025+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:09:19.399025+0000","last_undegraded":"2024-05-15T18:09:19.399025+0000","last_fullsized":"2024-05-15T18:09:19.399025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:54.945021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402578+0000","last_change":"2024-05-15T18:08:43.197679+0000","last_active":"2024-05-15T18:09:19.402578+0000","last_peered":"2024-05-15T18:09:19.402578+0000","last_clean":"2024-05-15T18:09:19.402578+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:09:19.402578+0000","last_undegraded":"2024-05-15T18:09:19.402578+0000","last_fullsized":"2024-05-15T18:09:19.402578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:33.125848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":346,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274176+0000","last_change":"2024-05-15T18:08:45.204211+0000","last_active":"2024-05-15T18:11:46.274176+0000","last_peered":"2024-05-15T18:11:46.274176+0000","last_clean":"2024-05-15T18:11:46.274176+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:46.274176+0000","last_undegraded":"2024-05-15T18:11:46.274176+0000","last_fullsized":"2024-05-15T18:11:46.274176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.839010+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:10:02.839010+0000","last_peered":"2024-05-15T18:10:02.839010+0000","last_clean":"2024-05-15T18:10:02.839010+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:10:02.839010+0000","last_undegraded":"2024-05-15T18:10:02.839010+0000","last_fullsized":"2024-05-15T18:10:02.839010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:27.490184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'1","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392336+0000","last_change":"2024-05-15T18:08:39.188916+0000","last_active":"2024-05-15T18:10:38.392336+0000","last_peered":"2024-05-15T18:10:38.392336+0000","last_clean":"2024-05-15T18:10:38.392336+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:10:38.392336+0000","last_undegraded":"2024-05-15T18:10:38.392336+0000","last_fullsized":"2024-05-15T18:10:38.392336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:47.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.831319+0000","last_change":"2024-05-15T18:08:37.184221+0000","last_active":"2024-05-15T18:10:02.831319+0000","last_peered":"2024-05-15T18:10:02.831319+0000","last_clean":"2024-05-15T18:10:02.831319+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:10:02.831319+0000","last_undegraded":"2024-05-15T18:10:02.831319+0000","last_fullsized":"2024-05-15T18:10:02.831319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:08.495247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:14.064562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400602+0000","last_change":"2024-05-15T18:08:41.191409+0000","last_active":"2024-05-15T18:09:19.400602+0000","last_peered":"2024-05-15T18:09:19.400602+0000","last_clean":"2024-05-15T18:09:19.400602+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:09:19.400602+0000","last_undegraded":"2024-05-15T18:09:19.400602+0000","last_fullsized":"2024-05-15T18:09:19.400602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:43.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399422+0000","last_change":"2024-05-15T18:08:43.205538+0000","last_active":"2024-05-15T18:09:19.399422+0000","last_peered":"2024-05-15T18:09:19.399422+0000","last_clean":"2024-05-15T18:09:19.399422+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:09:19.399422+0000","last_undegraded":"2024-05-15T18:09:19.399422+0000","last_fullsized":"2024-05-15T18:09:19.399422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:04.322801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":389,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.206053+0000","last_change":"2024-05-15T18:08:45.198430+0000","last_active":"2024-05-15T18:11:47.206053+0000","last_peered":"2024-05-15T18:11:47.206053+0000","last_clean":"2024-05-15T18:11:47.206053+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:11:47.206053+0000","last_undegraded":"2024-05-15T18:11:47.206053+0000","last_fullsized":"2024-05-15T18:11:47.206053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:20.124986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401547+0000","last_change":"2024-05-15T18:08:47.222589+0000","last_active":"2024-05-15T18:09:19.401547+0000","last_peered":"2024-05-15T18:09:19.401547+0000","last_clean":"2024-05-15T18:09:19.401547+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:09:19.401547+0000","last_undegraded":"2024-05-15T18:09:19.401547+0000","last_fullsized":"2024-05-15T18:09:19.401547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894689+0000","last_change":"2024-05-15T18:08:39.185262+0000","last_active":"2024-05-15T18:11:46.894689+0000","last_peered":"2024-05-15T18:11:46.894689+0000","last_clean":"2024-05-15T18:11:46.894689+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:11:46.894689+0000","last_undegraded":"2024-05-15T18:11:46.894689+0000","last_fullsized":"2024-05-15T18:11:46.894689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:10.502882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.629114+0000","last_change":"2024-05-15T18:08:37.179237+0000","last_active":"2024-05-15T18:10:02.629114+0000","last_peered":"2024-05-15T18:10:02.629114+0000","last_clean":"2024-05-15T18:10:02.629114+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:10:02.629114+0000","last_undegraded":"2024-05-15T18:10:02.629114+0000","last_fullsized":"2024-05-15T18:10:02.629114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404325+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:09:19.404325+0000","last_peered":"2024-05-15T18:09:19.404325+0000","last_clean":"2024-05-15T18:09:19.404325+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:09:19.404325+0000","last_undegraded":"2024-05-15T18:09:19.404325+0000","last_fullsized":"2024-05-15T18:09:19.404325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:33:34.798074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399868+0000","last_change":"2024-05-15T18:08:41.192405+0000","last_active":"2024-05-15T18:09:19.399868+0000","last_peered":"2024-05-15T18:09:19.399868+0000","last_clean":"2024-05-15T18:09:19.399868+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:09:19.399868+0000","last_undegraded":"2024-05-15T18:09:19.399868+0000","last_fullsized":"2024-05-15T18:09:19.399868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:14.835496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393153+0000","last_change":"2024-05-15T18:08:43.199434+0000","last_active":"2024-05-15T18:10:48.393153+0000","last_peered":"2024-05-15T18:10:48.393153+0000","last_clean":"2024-05-15T18:10:48.393153+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:10:48.393153+0000","last_undegraded":"2024-05-15T18:10:48.393153+0000","last_fullsized":"2024-05-15T18:10:48.393153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:57.566833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6026,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399270+0000","last_change":"2024-05-15T18:08:45.201179+0000","last_active":"2024-05-15T18:09:19.399270+0000","last_peered":"2024-05-15T18:09:19.399270+0000","last_clean":"2024-05-15T18:09:19.399270+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:09:19.399270+0000","last_undegraded":"2024-05-15T18:09:19.399270+0000","last_fullsized":"2024-05-15T18:09:19.399270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408019+0000","last_change":"2024-05-15T18:08:47.209997+0000","last_active":"2024-05-15T18:09:19.408019+0000","last_peered":"2024-05-15T18:09:19.408019+0000","last_clean":"2024-05-15T18:09:19.408019+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:09:19.408019+0000","last_undegraded":"2024-05-15T18:09:19.408019+0000","last_fullsized":"2024-05-15T18:09:19.408019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:11.856816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.897494+0000","last_change":"2024-05-15T18:08:47.219593+0000","last_active":"2024-05-15T18:11:46.897494+0000","last_peered":"2024-05-15T18:11:46.897494+0000","last_clean":"2024-05-15T18:11:46.897494+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:11:46.897494+0000","last_undegraded":"2024-05-15T18:11:46.897494+0000","last_fullsized":"2024-05-15T18:11:46.897494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:20.857650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820271+0000","last_change":"2024-05-15T18:08:39.185432+0000","last_active":"2024-05-15T18:09:20.820271+0000","last_peered":"2024-05-15T18:09:20.820271+0000","last_clean":"2024-05-15T18:09:20.820271+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:09:20.820271+0000","last_undegraded":"2024-05-15T18:09:20.820271+0000","last_fullsized":"2024-05-15T18:09:20.820271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399246+0000","last_change":"2024-05-15T18:08:37.185935+0000","last_active":"2024-05-15T18:09:19.399246+0000","last_peered":"2024-05-15T18:09:19.399246+0000","last_clean":"2024-05-15T18:09:19.399246+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:09:19.399246+0000","last_undegraded":"2024-05-15T18:09:19.399246+0000","last_fullsized":"2024-05-15T18:09:19.399246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:44.983084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407349+0000","last_change":"2024-05-15T18:09:19.404553+0000","last_active":"2024-05-15T18:09:19.407349+0000","last_peered":"2024-05-15T18:09:19.407349+0000","last_clean":"2024-05-15T18:09:19.407349+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:09:19.407349+0000","last_undegraded":"2024-05-15T18:09:19.407349+0000","last_fullsized":"2024-05-15T18:09:19.407349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:02.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.996245+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:44.996245+0000","last_peered":"2024-05-15T18:10:44.996245+0000","last_clean":"2024-05-15T18:10:44.996245+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:10:44.996245+0000","last_undegraded":"2024-05-15T18:10:44.996245+0000","last_fullsized":"2024-05-15T18:10:44.996245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:50.124485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399714+0000","last_change":"2024-05-15T18:08:45.208742+0000","last_active":"2024-05-15T18:09:19.399714+0000","last_peered":"2024-05-15T18:09:19.399714+0000","last_clean":"2024-05-15T18:09:19.399714+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:09:19.399714+0000","last_undegraded":"2024-05-15T18:09:19.399714+0000","last_fullsized":"2024-05-15T18:09:19.399714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:53:19.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.822180+0000","last_change":"2024-05-15T18:08:47.216635+0000","last_active":"2024-05-15T18:11:46.822180+0000","last_peered":"2024-05-15T18:11:46.822180+0000","last_clean":"2024-05-15T18:11:46.822180+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:11:46.822180+0000","last_undegraded":"2024-05-15T18:11:46.822180+0000","last_fullsized":"2024-05-15T18:11:46.822180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114135+0000","last_change":"2024-05-15T18:08:39.192773+0000","last_active":"2024-05-15T18:11:47.114135+0000","last_peered":"2024-05-15T18:11:47.114135+0000","last_clean":"2024-05-15T18:11:47.114135+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:11:47.114135+0000","last_undegraded":"2024-05-15T18:11:47.114135+0000","last_fullsized":"2024-05-15T18:11:47.114135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395528+0000","last_change":"2024-05-15T18:08:37.178179+0000","last_active":"2024-05-15T18:11:03.395528+0000","last_peered":"2024-05-15T18:11:03.395528+0000","last_clean":"2024-05-15T18:11:03.395528+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:11:03.395528+0000","last_undegraded":"2024-05-15T18:11:03.395528+0000","last_fullsized":"2024-05-15T18:11:03.395528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400105+0000","last_change":"2024-05-15T18:08:41.192415+0000","last_active":"2024-05-15T18:09:19.400105+0000","last_peered":"2024-05-15T18:09:19.400105+0000","last_clean":"2024-05-15T18:09:19.400105+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:09:19.400105+0000","last_undegraded":"2024-05-15T18:09:19.400105+0000","last_fullsized":"2024-05-15T18:09:19.400105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:26.664611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'5","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.431632+0000","last_change":"2024-05-15T18:08:43.195098+0000","last_active":"2024-05-15T18:11:46.431632+0000","last_peered":"2024-05-15T18:11:46.431632+0000","last_clean":"2024-05-15T18:11:46.431632+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:11:46.431632+0000","last_undegraded":"2024-05-15T18:11:46.431632+0000","last_fullsized":"2024-05-15T18:11:46.431632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:56.349586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405485+0000","last_change":"2024-05-15T18:08:45.208464+0000","last_active":"2024-05-15T18:09:19.405485+0000","last_peered":"2024-05-15T18:09:19.405485+0000","last_clean":"2024-05-15T18:09:19.405485+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:09:19.405485+0000","last_undegraded":"2024-05-15T18:09:19.405485+0000","last_fullsized":"2024-05-15T18:09:19.405485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:55.283378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.083949+0000","last_change":"2024-05-15T18:08:47.209757+0000","last_active":"2024-05-15T18:09:20.083949+0000","last_peered":"2024-05-15T18:09:20.083949+0000","last_clean":"2024-05-15T18:09:20.083949+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:09:20.083949+0000","last_undegraded":"2024-05-15T18:09:20.083949+0000","last_fullsized":"2024-05-15T18:09:20.083949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901409+0000","last_change":"2024-05-15T18:08:39.182386+0000","last_active":"2024-05-15T18:11:46.901409+0000","last_peered":"2024-05-15T18:11:46.901409+0000","last_clean":"2024-05-15T18:11:46.901409+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:11:46.901409+0000","last_undegraded":"2024-05-15T18:11:46.901409+0000","last_fullsized":"2024-05-15T18:11:46.901409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408230+0000","last_change":"2024-05-15T18:08:37.176233+0000","last_active":"2024-05-15T18:09:19.408230+0000","last_peered":"2024-05-15T18:09:19.408230+0000","last_clean":"2024-05-15T18:09:19.408230+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:09:19.408230+0000","last_undegraded":"2024-05-15T18:09:19.408230+0000","last_fullsized":"2024-05-15T18:09:19.408230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405491+0000","last_change":"2024-05-15T18:08:41.196522+0000","last_active":"2024-05-15T18:09:19.405491+0000","last_peered":"2024-05-15T18:09:19.405491+0000","last_clean":"2024-05-15T18:09:19.405491+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:09:19.405491+0000","last_undegraded":"2024-05-15T18:09:19.405491+0000","last_fullsized":"2024-05-15T18:09:19.405491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:21.511313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'41","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.038128+0000","last_change":"2024-05-15T18:08:43.192531+0000","last_active":"2024-05-15T18:11:47.038128+0000","last_peered":"2024-05-15T18:11:47.038128+0000","last_clean":"2024-05-15T18:11:47.038128+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:11:47.038128+0000","last_undegraded":"2024-05-15T18:11:47.038128+0000","last_fullsized":"2024-05-15T18:11:47.038128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:53.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399776+0000","last_change":"2024-05-15T18:08:45.200867+0000","last_active":"2024-05-15T18:09:19.399776+0000","last_peered":"2024-05-15T18:09:19.399776+0000","last_clean":"2024-05-15T18:09:19.399776+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:09:19.399776+0000","last_undegraded":"2024-05-15T18:09:19.399776+0000","last_fullsized":"2024-05-15T18:09:19.399776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398845+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:09:19.398845+0000","last_peered":"2024-05-15T18:09:19.398845+0000","last_clean":"2024-05-15T18:09:19.398845+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:09:19.398845+0000","last_undegraded":"2024-05-15T18:09:19.398845+0000","last_fullsized":"2024-05-15T18:09:19.398845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:58:53.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318729+0000","last_change":"2024-05-15T18:08:39.188917+0000","last_active":"2024-05-15T18:10:43.318729+0000","last_peered":"2024-05-15T18:10:43.318729+0000","last_clean":"2024-05-15T18:10:43.318729+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:10:43.318729+0000","last_undegraded":"2024-05-15T18:10:43.318729+0000","last_fullsized":"2024-05-15T18:10:43.318729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:15.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402731+0000","last_change":"2024-05-15T18:08:37.176555+0000","last_active":"2024-05-15T18:09:19.402731+0000","last_peered":"2024-05-15T18:09:19.402731+0000","last_clean":"2024-05-15T18:09:19.402731+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:09:19.402731+0000","last_undegraded":"2024-05-15T18:09:19.402731+0000","last_fullsized":"2024-05-15T18:09:19.402731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400688+0000","last_change":"2024-05-15T18:08:41.191236+0000","last_active":"2024-05-15T18:09:19.400688+0000","last_peered":"2024-05-15T18:09:19.400688+0000","last_clean":"2024-05-15T18:09:19.400688+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:09:19.400688+0000","last_undegraded":"2024-05-15T18:09:19.400688+0000","last_fullsized":"2024-05-15T18:09:19.400688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:09.434305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395415+0000","last_change":"2024-05-15T18:08:43.194399+0000","last_active":"2024-05-15T18:11:03.395415+0000","last_peered":"2024-05-15T18:11:03.395415+0000","last_clean":"2024-05-15T18:11:03.395415+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:11:03.395415+0000","last_undegraded":"2024-05-15T18:11:03.395415+0000","last_fullsized":"2024-05-15T18:11:03.395415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:44.292771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408147+0000","last_change":"2024-05-15T18:08:45.204060+0000","last_active":"2024-05-15T18:09:19.408147+0000","last_peered":"2024-05-15T18:09:19.408147+0000","last_clean":"2024-05-15T18:09:19.408147+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:09:19.408147+0000","last_undegraded":"2024-05-15T18:09:19.408147+0000","last_fullsized":"2024-05-15T18:09:19.408147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:35.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075577+0000","last_change":"2024-05-15T18:08:39.186233+0000","last_active":"2024-05-15T18:11:47.075577+0000","last_peered":"2024-05-15T18:11:47.075577+0000","last_clean":"2024-05-15T18:11:47.075577+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:11:47.075577+0000","last_undegraded":"2024-05-15T18:11:47.075577+0000","last_fullsized":"2024-05-15T18:11:47.075577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:29.111289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398303+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:09:19.398303+0000","last_peered":"2024-05-15T18:09:19.398303+0000","last_clean":"2024-05-15T18:09:19.398303+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:09:19.398303+0000","last_undegraded":"2024-05-15T18:09:19.398303+0000","last_fullsized":"2024-05-15T18:09:19.398303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:52.211486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401191+0000","last_change":"2024-05-15T18:08:41.191159+0000","last_active":"2024-05-15T18:09:19.401191+0000","last_peered":"2024-05-15T18:09:19.401191+0000","last_clean":"2024-05-15T18:09:19.401191+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:09:19.401191+0000","last_undegraded":"2024-05-15T18:09:19.401191+0000","last_fullsized":"2024-05-15T18:09:19.401191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:59.022200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'54","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.002204+0000","last_change":"2024-05-15T18:08:43.194657+0000","last_active":"2024-05-15T18:10:45.002204+0000","last_peered":"2024-05-15T18:10:45.002204+0000","last_clean":"2024-05-15T18:10:45.002204+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:10:45.002204+0000","last_undegraded":"2024-05-15T18:10:45.002204+0000","last_fullsized":"2024-05-15T18:10:45.002204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:48.735514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407819+0000","last_change":"2024-05-15T18:08:45.205356+0000","last_active":"2024-05-15T18:09:19.407819+0000","last_peered":"2024-05-15T18:09:19.407819+0000","last_clean":"2024-05-15T18:09:19.407819+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:09:19.407819+0000","last_undegraded":"2024-05-15T18:09:19.407819+0000","last_fullsized":"2024-05-15T18:09:19.407819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:39:01.866675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.346448+0000","last_change":"2024-05-15T18:08:47.215443+0000","last_active":"2024-05-15T18:10:46.346448+0000","last_peered":"2024-05-15T18:10:46.346448+0000","last_clean":"2024-05-15T18:10:46.346448+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:10:46.346448+0000","last_undegraded":"2024-05-15T18:10:46.346448+0000","last_fullsized":"2024-05-15T18:10:46.346448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:49:38.789697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353058+0000","last_change":"2024-05-15T18:08:39.186914+0000","last_active":"2024-05-15T18:09:20.353058+0000","last_peered":"2024-05-15T18:09:20.353058+0000","last_clean":"2024-05-15T18:09:20.353058+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:09:20.353058+0000","last_undegraded":"2024-05-15T18:09:20.353058+0000","last_fullsized":"2024-05-15T18:09:20.353058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407422+0000","last_change":"2024-05-15T18:09:19.405624+0000","last_active":"2024-05-15T18:09:19.407422+0000","last_peered":"2024-05-15T18:09:19.407422+0000","last_clean":"2024-05-15T18:09:19.407422+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:09:19.407422+0000","last_undegraded":"2024-05-15T18:09:19.407422+0000","last_fullsized":"2024-05-15T18:09:19.407422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:48.812098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407740+0000","last_change":"2024-05-15T18:08:41.191786+0000","last_active":"2024-05-15T18:09:19.407740+0000","last_peered":"2024-05-15T18:09:19.407740+0000","last_clean":"2024-05-15T18:09:19.407740+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:09:19.407740+0000","last_undegraded":"2024-05-15T18:09:19.407740+0000","last_fullsized":"2024-05-15T18:09:19.407740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:36.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397808+0000","last_change":"2024-05-15T18:08:43.204941+0000","last_active":"2024-05-15T18:11:13.397808+0000","last_peered":"2024-05-15T18:11:13.397808+0000","last_clean":"2024-05-15T18:11:13.397808+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:11:13.397808+0000","last_undegraded":"2024-05-15T18:11:13.397808+0000","last_fullsized":"2024-05-15T18:11:13.397808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:18:25.567210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403966+0000","last_change":"2024-05-15T18:08:45.208563+0000","last_active":"2024-05-15T18:09:19.403966+0000","last_peered":"2024-05-15T18:09:19.403966+0000","last_clean":"2024-05-15T18:09:19.403966+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:09:19.403966+0000","last_undegraded":"2024-05-15T18:09:19.403966+0000","last_fullsized":"2024-05-15T18:09:19.403966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398176+0000","last_change":"2024-05-15T18:08:47.218586+0000","last_active":"2024-05-15T18:09:19.398176+0000","last_peered":"2024-05-15T18:09:19.398176+0000","last_clean":"2024-05-15T18:09:19.398176+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:09:19.398176+0000","last_undegraded":"2024-05-15T18:09:19.398176+0000","last_fullsized":"2024-05-15T18:09:19.398176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:32:15.970197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.320156+0000","last_change":"2024-05-15T18:08:39.191981+0000","last_active":"2024-05-15T18:10:43.320156+0000","last_peered":"2024-05-15T18:10:43.320156+0000","last_clean":"2024-05-15T18:10:43.320156+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:10:43.320156+0000","last_undegraded":"2024-05-15T18:10:43.320156+0000","last_fullsized":"2024-05-15T18:10:43.320156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:58.705649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.020626+0000","last_change":"2024-05-15T18:08:37.175536+0000","last_active":"2024-05-15T18:11:47.020626+0000","last_peered":"2024-05-15T18:11:47.020626+0000","last_clean":"2024-05-15T18:11:47.020626+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:11:47.020626+0000","last_undegraded":"2024-05-15T18:11:47.020626+0000","last_fullsized":"2024-05-15T18:11:47.020626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406884+0000","last_change":"2024-05-15T18:08:41.191062+0000","last_active":"2024-05-15T18:09:19.406884+0000","last_peered":"2024-05-15T18:09:19.406884+0000","last_clean":"2024-05-15T18:09:19.406884+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:09:19.406884+0000","last_undegraded":"2024-05-15T18:09:19.406884+0000","last_fullsized":"2024-05-15T18:09:19.406884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:24.557536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.000210+0000","last_change":"2024-05-15T18:08:43.201223+0000","last_active":"2024-05-15T18:10:45.000210+0000","last_peered":"2024-05-15T18:10:45.000210+0000","last_clean":"2024-05-15T18:10:45.000210+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:10:45.000210+0000","last_undegraded":"2024-05-15T18:10:45.000210+0000","last_fullsized":"2024-05-15T18:10:45.000210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:42.755582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400126+0000","last_change":"2024-05-15T18:08:45.198201+0000","last_active":"2024-05-15T18:09:19.400126+0000","last_peered":"2024-05-15T18:09:19.400126+0000","last_clean":"2024-05-15T18:09:19.400126+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:09:19.400126+0000","last_undegraded":"2024-05-15T18:09:19.400126+0000","last_fullsized":"2024-05-15T18:09:19.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:29.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.407284+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:10:46.407284+0000","last_peered":"2024-05-15T18:10:46.407284+0000","last_clean":"2024-05-15T18:10:46.407284+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:10:46.407284+0000","last_undegraded":"2024-05-15T18:10:46.407284+0000","last_fullsized":"2024-05-15T18:10:46.407284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:05.039222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'5","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111277+0000","last_change":"2024-05-15T18:08:39.184374+0000","last_active":"2024-05-15T18:11:47.111277+0000","last_peered":"2024-05-15T18:11:47.111277+0000","last_clean":"2024-05-15T18:11:47.111277+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:11:47.111277+0000","last_undegraded":"2024-05-15T18:11:47.111277+0000","last_fullsized":"2024-05-15T18:11:47.111277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.023254+0000","last_change":"2024-05-15T18:08:37.183470+0000","last_active":"2024-05-15T18:11:47.023254+0000","last_peered":"2024-05-15T18:11:47.023254+0000","last_clean":"2024-05-15T18:11:47.023254+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:11:47.023254+0000","last_undegraded":"2024-05-15T18:11:47.023254+0000","last_fullsized":"2024-05-15T18:11:47.023254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:28:26.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403818+0000","last_change":"2024-05-15T18:08:41.190070+0000","last_active":"2024-05-15T18:09:19.403818+0000","last_peered":"2024-05-15T18:09:19.403818+0000","last_clean":"2024-05-15T18:09:19.403818+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:09:19.403818+0000","last_undegraded":"2024-05-15T18:09:19.403818+0000","last_fullsized":"2024-05-15T18:09:19.403818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:17.766305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.737811+0000","last_change":"2024-05-15T18:08:43.205310+0000","last_active":"2024-05-15T18:09:19.737811+0000","last_peered":"2024-05-15T18:09:19.737811+0000","last_clean":"2024-05-15T18:09:19.737811+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:09:19.737811+0000","last_undegraded":"2024-05-15T18:09:19.737811+0000","last_fullsized":"2024-05-15T18:09:19.737811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:56.886685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.219182+0000","last_change":"2024-05-15T18:08:45.207348+0000","last_active":"2024-05-15T18:11:47.219182+0000","last_peered":"2024-05-15T18:11:47.219182+0000","last_clean":"2024-05-15T18:11:47.219182+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:11:47.219182+0000","last_undegraded":"2024-05-15T18:11:47.219182+0000","last_fullsized":"2024-05-15T18:11:47.219182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:58.021047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.397876+0000","last_change":"2024-05-15T18:08:47.219182+0000","last_active":"2024-05-15T18:09:19.397876+0000","last_peered":"2024-05-15T18:09:19.397876+0000","last_clean":"2024-05-15T18:09:19.397876+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:09:19.397876+0000","last_undegraded":"2024-05-15T18:09:19.397876+0000","last_fullsized":"2024-05-15T18:09:19.397876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:01.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817578+0000","last_change":"2024-05-15T18:08:39.180759+0000","last_active":"2024-05-15T18:09:20.817578+0000","last_peered":"2024-05-15T18:09:20.817578+0000","last_clean":"2024-05-15T18:09:20.817578+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:09:20.817578+0000","last_undegraded":"2024-05-15T18:09:20.817578+0000","last_fullsized":"2024-05-15T18:09:20.817578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403310+0000","last_change":"2024-05-15T18:08:37.176826+0000","last_active":"2024-05-15T18:09:19.403310+0000","last_peered":"2024-05-15T18:09:19.403310+0000","last_clean":"2024-05-15T18:09:19.403310+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:09:19.403310+0000","last_undegraded":"2024-05-15T18:09:19.403310+0000","last_fullsized":"2024-05-15T18:09:19.403310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401017+0000","last_change":"2024-05-15T18:08:41.192691+0000","last_active":"2024-05-15T18:09:19.401017+0000","last_peered":"2024-05-15T18:09:19.401017+0000","last_clean":"2024-05-15T18:09:19.401017+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:09:19.401017+0000","last_undegraded":"2024-05-15T18:09:19.401017+0000","last_fullsized":"2024-05-15T18:09:19.401017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:17.409123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.973083+0000","last_change":"2024-05-15T18:08:43.191489+0000","last_active":"2024-05-15T18:10:44.973083+0000","last_peered":"2024-05-15T18:10:44.973083+0000","last_clean":"2024-05-15T18:10:44.973083+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:10:44.973083+0000","last_undegraded":"2024-05-15T18:10:44.973083+0000","last_fullsized":"2024-05-15T18:10:44.973083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:58.528171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398467+0000","last_change":"2024-05-15T18:08:45.204577+0000","last_active":"2024-05-15T18:09:19.398467+0000","last_peered":"2024-05-15T18:09:19.398467+0000","last_clean":"2024-05-15T18:09:19.398467+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:09:19.398467+0000","last_undegraded":"2024-05-15T18:09:19.398467+0000","last_fullsized":"2024-05-15T18:09:19.398467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:43.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.511708+0000","last_change":"2024-05-15T18:08:47.217145+0000","last_active":"2024-05-15T18:11:46.511708+0000","last_peered":"2024-05-15T18:11:46.511708+0000","last_clean":"2024-05-15T18:11:46.511708+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:11:46.511708+0000","last_undegraded":"2024-05-15T18:11:46.511708+0000","last_fullsized":"2024-05-15T18:11:46.511708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841386+0000","last_change":"2024-05-15T18:08:39.180684+0000","last_active":"2024-05-15T18:10:02.841386+0000","last_peered":"2024-05-15T18:10:02.841386+0000","last_clean":"2024-05-15T18:10:02.841386+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:10:02.841386+0000","last_undegraded":"2024-05-15T18:10:02.841386+0000","last_fullsized":"2024-05-15T18:10:02.841386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:21.423233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401981+0000","last_change":"2024-05-15T18:08:37.185723+0000","last_active":"2024-05-15T18:09:19.401981+0000","last_peered":"2024-05-15T18:09:19.401981+0000","last_clean":"2024-05-15T18:09:19.401981+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:09:19.401981+0000","last_undegraded":"2024-05-15T18:09:19.401981+0000","last_fullsized":"2024-05-15T18:09:19.401981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:33.641924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408093+0000","last_change":"2024-05-15T18:08:41.194992+0000","last_active":"2024-05-15T18:09:19.408093+0000","last_peered":"2024-05-15T18:09:19.408093+0000","last_clean":"2024-05-15T18:09:19.408093+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:09:19.408093+0000","last_undegraded":"2024-05-15T18:09:19.408093+0000","last_fullsized":"2024-05-15T18:09:19.408093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:46.750498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.973981+0000","last_change":"2024-05-15T18:08:43.200599+0000","last_active":"2024-05-15T18:10:44.973981+0000","last_peered":"2024-05-15T18:10:44.973981+0000","last_clean":"2024-05-15T18:10:44.973981+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:10:44.973981+0000","last_undegraded":"2024-05-15T18:10:44.973981+0000","last_fullsized":"2024-05-15T18:10:44.973981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:22:01.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398116+0000","last_change":"2024-05-15T18:08:45.208564+0000","last_active":"2024-05-15T18:09:19.398116+0000","last_peered":"2024-05-15T18:09:19.398116+0000","last_clean":"2024-05-15T18:09:19.398116+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:09:19.398116+0000","last_undegraded":"2024-05-15T18:09:19.398116+0000","last_fullsized":"2024-05-15T18:09:19.398116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:04.792785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399101+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:09:19.399101+0000","last_peered":"2024-05-15T18:09:19.399101+0000","last_clean":"2024-05-15T18:09:19.399101+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:09:19.399101+0000","last_undegraded":"2024-05-15T18:09:19.399101+0000","last_fullsized":"2024-05-15T18:09:19.399101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:18.365146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.799158+0000","last_change":"2024-05-15T18:08:39.181861+0000","last_active":"2024-05-15T18:11:46.799158+0000","last_peered":"2024-05-15T18:11:46.799158+0000","last_clean":"2024-05-15T18:11:46.799158+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:11:46.799158+0000","last_undegraded":"2024-05-15T18:11:46.799158+0000","last_fullsized":"2024-05-15T18:11:46.799158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:44.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400551+0000","last_change":"2024-05-15T18:08:37.180611+0000","last_active":"2024-05-15T18:09:19.400551+0000","last_peered":"2024-05-15T18:09:19.400551+0000","last_clean":"2024-05-15T18:09:19.400551+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:09:19.400551+0000","last_undegraded":"2024-05-15T18:09:19.400551+0000","last_fullsized":"2024-05-15T18:09:19.400551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:10.580802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400217+0000","last_change":"2024-05-15T18:08:41.195751+0000","last_active":"2024-05-15T18:09:19.400217+0000","last_peered":"2024-05-15T18:09:19.400217+0000","last_clean":"2024-05-15T18:09:19.400217+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:09:19.400217+0000","last_undegraded":"2024-05-15T18:09:19.400217+0000","last_fullsized":"2024-05-15T18:09:19.400217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:46.842509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997990+0000","last_change":"2024-05-15T18:08:43.205423+0000","last_active":"2024-05-15T18:10:44.997990+0000","last_peered":"2024-05-15T18:10:44.997990+0000","last_clean":"2024-05-15T18:10:44.997990+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:10:44.997990+0000","last_undegraded":"2024-05-15T18:10:44.997990+0000","last_fullsized":"2024-05-15T18:10:44.997990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:00:28.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398390+0000","last_change":"2024-05-15T18:08:45.208319+0000","last_active":"2024-05-15T18:09:19.398390+0000","last_peered":"2024-05-15T18:09:19.398390+0000","last_clean":"2024-05-15T18:09:19.398390+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:09:19.398390+0000","last_undegraded":"2024-05-15T18:09:19.398390+0000","last_fullsized":"2024-05-15T18:09:19.398390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:07.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.008319+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:10:45.008319+0000","last_peered":"2024-05-15T18:10:45.008319+0000","last_clean":"2024-05-15T18:10:45.008319+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:10:45.008319+0000","last_undegraded":"2024-05-15T18:10:45.008319+0000","last_fullsized":"2024-05-15T18:10:45.008319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:41:14.101874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318342+0000","last_change":"2024-05-15T18:08:39.182951+0000","last_active":"2024-05-15T18:10:43.318342+0000","last_peered":"2024-05-15T18:10:43.318342+0000","last_clean":"2024-05-15T18:10:43.318342+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:10:43.318342+0000","last_undegraded":"2024-05-15T18:10:43.318342+0000","last_fullsized":"2024-05-15T18:10:43.318342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:28.725507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.361686+0000","last_change":"2024-05-15T18:08:37.173604+0000","last_active":"2024-05-15T18:10:46.361686+0000","last_peered":"2024-05-15T18:10:46.361686+0000","last_clean":"2024-05-15T18:10:46.361686+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:10:46.361686+0000","last_undegraded":"2024-05-15T18:10:46.361686+0000","last_fullsized":"2024-05-15T18:10:46.361686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.690398+0000","last_change":"2024-05-15T18:08:41.194807+0000","last_active":"2024-05-15T18:10:43.690398+0000","last_peered":"2024-05-15T18:10:43.690398+0000","last_clean":"2024-05-15T18:10:43.690398+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:10:43.690398+0000","last_undegraded":"2024-05-15T18:10:43.690398+0000","last_fullsized":"2024-05-15T18:10:43.690398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:20.276747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.432549+0000","last_change":"2024-05-15T18:08:43.204827+0000","last_active":"2024-05-15T18:11:46.432549+0000","last_peered":"2024-05-15T18:11:46.432549+0000","last_clean":"2024-05-15T18:11:46.432549+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:11:46.432549+0000","last_undegraded":"2024-05-15T18:11:46.432549+0000","last_fullsized":"2024-05-15T18:11:46.432549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:25:58.418358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399211+0000","last_change":"2024-05-15T18:08:45.209586+0000","last_active":"2024-05-15T18:09:19.399211+0000","last_peered":"2024-05-15T18:09:19.399211+0000","last_clean":"2024-05-15T18:09:19.399211+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:09:19.399211+0000","last_undegraded":"2024-05-15T18:09:19.399211+0000","last_fullsized":"2024-05-15T18:09:19.399211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.011056+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:10:45.011056+0000","last_peered":"2024-05-15T18:10:45.011056+0000","last_clean":"2024-05-15T18:10:45.011056+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:10:45.011056+0000","last_undegraded":"2024-05-15T18:10:45.011056+0000","last_fullsized":"2024-05-15T18:10:45.011056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:34:17.179772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101917+0000","last_change":"2024-05-15T18:08:39.193212+0000","last_active":"2024-05-15T18:11:47.101917+0000","last_peered":"2024-05-15T18:11:47.101917+0000","last_clean":"2024-05-15T18:11:47.101917+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:11:47.101917+0000","last_undegraded":"2024-05-15T18:11:47.101917+0000","last_fullsized":"2024-05-15T18:11:47.101917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:55:36.876278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392439+0000","last_change":"2024-05-15T18:08:37.175025+0000","last_active":"2024-05-15T18:10:43.392439+0000","last_peered":"2024-05-15T18:10:43.392439+0000","last_clean":"2024-05-15T18:10:43.392439+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:10:43.392439+0000","last_undegraded":"2024-05-15T18:10:43.392439+0000","last_fullsized":"2024-05-15T18:10:43.392439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:37:08.990281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":13,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894085+0000","last_change":"2024-05-15T18:08:39.182556+0000","last_active":"2024-05-15T18:11:46.894085+0000","last_peered":"2024-05-15T18:11:46.894085+0000","last_clean":"2024-05-15T18:11:46.894085+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:11:46.894085+0000","last_undegraded":"2024-05-15T18:11:46.894085+0000","last_fullsized":"2024-05-15T18:11:46.894085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.097398+0000","last_change":"2024-05-15T18:08:37.174455+0000","last_active":"2024-05-15T18:11:47.097398+0000","last_peered":"2024-05-15T18:11:47.097398+0000","last_clean":"2024-05-15T18:11:47.097398+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:11:47.097398+0000","last_undegraded":"2024-05-15T18:11:47.097398+0000","last_fullsized":"2024-05-15T18:11:47.097398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736540+0000","last_change":"2024-05-15T18:08:39.182083+0000","last_active":"2024-05-15T18:09:19.736540+0000","last_peered":"2024-05-15T18:09:19.736540+0000","last_clean":"2024-05-15T18:09:19.736540+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:09:19.736540+0000","last_undegraded":"2024-05-15T18:09:19.736540+0000","last_fullsized":"2024-05-15T18:09:19.736540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:51.998451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399083+0000","last_change":"2024-05-15T18:08:37.180276+0000","last_active":"2024-05-15T18:09:19.399083+0000","last_peered":"2024-05-15T18:09:19.399083+0000","last_clean":"2024-05-15T18:09:19.399083+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:09:19.399083+0000","last_undegraded":"2024-05-15T18:09:19.399083+0000","last_fullsized":"2024-05-15T18:09:19.399083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:42.498474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036744+0000","last_change":"2024-05-15T18:08:39.183629+0000","last_active":"2024-05-15T18:11:47.036744+0000","last_peered":"2024-05-15T18:11:47.036744+0000","last_clean":"2024-05-15T18:11:47.036744+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:11:47.036744+0000","last_undegraded":"2024-05-15T18:11:47.036744+0000","last_fullsized":"2024-05-15T18:11:47.036744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388608+0000","last_change":"2024-05-15T18:08:37.180039+0000","last_active":"2024-05-15T18:10:44.388608+0000","last_peered":"2024-05-15T18:10:44.388608+0000","last_clean":"2024-05-15T18:10:44.388608+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:10:44.388608+0000","last_undegraded":"2024-05-15T18:10:44.388608+0000","last_fullsized":"2024-05-15T18:10:44.388608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081223+0000","last_change":"2024-05-15T18:08:39.183461+0000","last_active":"2024-05-15T18:11:47.081223+0000","last_peered":"2024-05-15T18:11:47.081223+0000","last_clean":"2024-05-15T18:11:47.081223+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:11:47.081223+0000","last_undegraded":"2024-05-15T18:11:47.081223+0000","last_fullsized":"2024-05-15T18:11:47.081223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.017699+0000","last_change":"2024-05-15T18:08:37.173194+0000","last_active":"2024-05-15T18:11:47.017699+0000","last_peered":"2024-05-15T18:11:47.017699+0000","last_clean":"2024-05-15T18:11:47.017699+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:47.017699+0000","last_undegraded":"2024-05-15T18:11:47.017699+0000","last_fullsized":"2024-05-15T18:11:47.017699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392566+0000","last_change":"2024-05-15T18:08:39.193040+0000","last_active":"2024-05-15T18:10:43.392566+0000","last_peered":"2024-05-15T18:10:43.392566+0000","last_clean":"2024-05-15T18:10:43.392566+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:10:43.392566+0000","last_undegraded":"2024-05-15T18:10:43.392566+0000","last_fullsized":"2024-05-15T18:10:43.392566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393392+0000","last_change":"2024-05-15T18:08:37.177086+0000","last_active":"2024-05-15T18:10:48.393392+0000","last_peered":"2024-05-15T18:10:48.393392+0000","last_clean":"2024-05-15T18:10:48.393392+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:10:48.393392+0000","last_undegraded":"2024-05-15T18:10:48.393392+0000","last_fullsized":"2024-05-15T18:10:48.393392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081078+0000","last_change":"2024-05-15T18:08:39.187231+0000","last_active":"2024-05-15T18:11:47.081078+0000","last_peered":"2024-05-15T18:11:47.081078+0000","last_clean":"2024-05-15T18:11:47.081078+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:11:47.081078+0000","last_undegraded":"2024-05-15T18:11:47.081078+0000","last_fullsized":"2024-05-15T18:11:47.081078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408334+0000","last_change":"2024-05-15T18:08:37.185249+0000","last_active":"2024-05-15T18:09:19.408334+0000","last_peered":"2024-05-15T18:09:19.408334+0000","last_clean":"2024-05-15T18:09:19.408334+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:09:19.408334+0000","last_undegraded":"2024-05-15T18:09:19.408334+0000","last_fullsized":"2024-05-15T18:09:19.408334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841468+0000","last_change":"2024-05-15T18:08:39.182188+0000","last_active":"2024-05-15T18:10:02.841468+0000","last_peered":"2024-05-15T18:10:02.841468+0000","last_clean":"2024-05-15T18:10:02.841468+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:10:02.841468+0000","last_undegraded":"2024-05-15T18:10:02.841468+0000","last_fullsized":"2024-05-15T18:10:02.841468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401192+0000","last_change":"2024-05-15T18:08:37.173289+0000","last_active":"2024-05-15T18:09:19.401192+0000","last_peered":"2024-05-15T18:09:19.401192+0000","last_clean":"2024-05-15T18:09:19.401192+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:09:19.401192+0000","last_undegraded":"2024-05-15T18:09:19.401192+0000","last_fullsized":"2024-05-15T18:09:19.401192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:49:25.723441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027663+0000","last_change":"2024-05-15T18:08:39.185677+0000","last_active":"2024-05-15T18:11:47.027663+0000","last_peered":"2024-05-15T18:11:47.027663+0000","last_clean":"2024-05-15T18:11:47.027663+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:11:47.027663+0000","last_undegraded":"2024-05-15T18:11:47.027663+0000","last_fullsized":"2024-05-15T18:11:47.027663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:22:07.754341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393745+0000","last_change":"2024-05-15T18:08:37.174784+0000","last_active":"2024-05-15T18:10:48.393745+0000","last_peered":"2024-05-15T18:10:48.393745+0000","last_clean":"2024-05-15T18:10:48.393745+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:10:48.393745+0000","last_undegraded":"2024-05-15T18:10:48.393745+0000","last_fullsized":"2024-05-15T18:10:48.393745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:01.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.080429+0000","last_change":"2024-05-15T18:08:39.184051+0000","last_active":"2024-05-15T18:09:20.080429+0000","last_peered":"2024-05-15T18:09:20.080429+0000","last_clean":"2024-05-15T18:09:20.080429+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:09:20.080429+0000","last_undegraded":"2024-05-15T18:09:20.080429+0000","last_fullsized":"2024-05-15T18:09:20.080429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:52.335026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399053+0000","last_change":"2024-05-15T18:08:37.179943+0000","last_active":"2024-05-15T18:09:19.399053+0000","last_peered":"2024-05-15T18:09:19.399053+0000","last_clean":"2024-05-15T18:09:19.399053+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:09:19.399053+0000","last_undegraded":"2024-05-15T18:09:19.399053+0000","last_fullsized":"2024-05-15T18:09:19.399053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075510+0000","last_change":"2024-05-15T18:09:19.409291+0000","last_active":"2024-05-15T18:11:47.075510+0000","last_peered":"2024-05-15T18:11:47.075510+0000","last_clean":"2024-05-15T18:11:47.075510+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:11:47.075510+0000","last_undegraded":"2024-05-15T18:11:47.075510+0000","last_fullsized":"2024-05-15T18:11:47.075510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399908+0000","last_change":"2024-05-15T18:08:37.180111+0000","last_active":"2024-05-15T18:09:19.399908+0000","last_peered":"2024-05-15T18:09:19.399908+0000","last_clean":"2024-05-15T18:09:19.399908+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:09:19.399908+0000","last_undegraded":"2024-05-15T18:09:19.399908+0000","last_fullsized":"2024-05-15T18:09:19.399908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075128+0000","last_change":"2024-05-15T18:08:39.180126+0000","last_active":"2024-05-15T18:11:47.075128+0000","last_peered":"2024-05-15T18:11:47.075128+0000","last_clean":"2024-05-15T18:11:47.075128+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:11:47.075128+0000","last_undegraded":"2024-05-15T18:11:47.075128+0000","last_fullsized":"2024-05-15T18:11:47.075128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:53.932569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402839+0000","last_change":"2024-05-15T18:08:37.178460+0000","last_active":"2024-05-15T18:09:19.402839+0000","last_peered":"2024-05-15T18:09:19.402839+0000","last_clean":"2024-05-15T18:09:19.402839+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:09:19.402839+0000","last_undegraded":"2024-05-15T18:09:19.402839+0000","last_fullsized":"2024-05-15T18:09:19.402839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'7","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901964+0000","last_change":"2024-05-15T18:08:39.193285+0000","last_active":"2024-05-15T18:11:46.901964+0000","last_peered":"2024-05-15T18:11:46.901964+0000","last_clean":"2024-05-15T18:11:46.901964+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:11:46.901964+0000","last_undegraded":"2024-05-15T18:11:46.901964+0000","last_fullsized":"2024-05-15T18:11:46.901964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.246822+0000","last_change":"2024-05-15T18:08:37.183430+0000","last_active":"2024-05-15T18:10:46.246822+0000","last_peered":"2024-05-15T18:10:46.246822+0000","last_clean":"2024-05-15T18:10:46.246822+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:10:46.246822+0000","last_undegraded":"2024-05-15T18:10:46.246822+0000","last_fullsized":"2024-05-15T18:10:46.246822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:16:22.035101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318832+0000","last_change":"2024-05-15T18:08:39.187902+0000","last_active":"2024-05-15T18:10:43.318832+0000","last_peered":"2024-05-15T18:10:43.318832+0000","last_clean":"2024-05-15T18:10:43.318832+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:10:43.318832+0000","last_undegraded":"2024-05-15T18:10:43.318832+0000","last_fullsized":"2024-05-15T18:10:43.318832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401767+0000","last_change":"2024-05-15T18:08:37.181882+0000","last_active":"2024-05-15T18:09:19.401767+0000","last_peered":"2024-05-15T18:09:19.401767+0000","last_clean":"2024-05-15T18:09:19.401767+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:09:19.401767+0000","last_undegraded":"2024-05-15T18:09:19.401767+0000","last_fullsized":"2024-05-15T18:09:19.401767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:01.779453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:39.188670+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:47.375138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408417+0000","last_change":"2024-05-15T18:08:37.179459+0000","last_active":"2024-05-15T18:09:19.408417+0000","last_peered":"2024-05-15T18:09:19.408417+0000","last_clean":"2024-05-15T18:09:19.408417+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:09:19.408417+0000","last_undegraded":"2024-05-15T18:09:19.408417+0000","last_fullsized":"2024-05-15T18:09:19.408417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075176+0000","last_change":"2024-05-15T18:08:39.178597+0000","last_active":"2024-05-15T18:11:47.075176+0000","last_peered":"2024-05-15T18:11:47.075176+0000","last_clean":"2024-05-15T18:11:47.075176+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:11:47.075176+0000","last_undegraded":"2024-05-15T18:11:47.075176+0000","last_fullsized":"2024-05-15T18:11:47.075176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.012658+0000","last_change":"2024-05-15T18:09:19.409578+0000","last_active":"2024-05-15T18:11:47.012658+0000","last_peered":"2024-05-15T18:11:47.012658+0000","last_clean":"2024-05-15T18:11:47.012658+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:11:47.012658+0000","last_undegraded":"2024-05-15T18:11:47.012658+0000","last_fullsized":"2024-05-15T18:11:47.012658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:50.864491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398577+0000","last_change":"2024-05-15T18:08:37.182059+0000","last_active":"2024-05-15T18:09:19.398577+0000","last_peered":"2024-05-15T18:09:19.398577+0000","last_clean":"2024-05-15T18:09:19.398577+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:09:19.398577+0000","last_undegraded":"2024-05-15T18:09:19.398577+0000","last_fullsized":"2024-05-15T18:09:19.398577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:38.781325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401588+0000","last_change":"2024-05-15T18:08:39.190238+0000","last_active":"2024-05-15T18:09:19.401588+0000","last_peered":"2024-05-15T18:09:19.401588+0000","last_clean":"2024-05-15T18:09:19.401588+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:09:19.401588+0000","last_undegraded":"2024-05-15T18:09:19.401588+0000","last_fullsized":"2024-05-15T18:09:19.401588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398913+0000","last_change":"2024-05-15T18:08:37.180082+0000","last_active":"2024-05-15T18:09:19.398913+0000","last_peered":"2024-05-15T18:09:19.398913+0000","last_clean":"2024-05-15T18:09:19.398913+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:09:19.398913+0000","last_undegraded":"2024-05-15T18:09:19.398913+0000","last_fullsized":"2024-05-15T18:09:19.398913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082913+0000","last_change":"2024-05-15T18:08:39.192652+0000","last_active":"2024-05-15T18:09:20.082913+0000","last_peered":"2024-05-15T18:09:20.082913+0000","last_clean":"2024-05-15T18:09:20.082913+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:09:20.082913+0000","last_undegraded":"2024-05-15T18:09:20.082913+0000","last_fullsized":"2024-05-15T18:09:20.082913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:22.550315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673007,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56288,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315552,"statfs":{"total":96636764160,"available":96579125248,"internally_reserved":0,"allocated":17195008,"data_stored":16910200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48692,"kb_used_data":13356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323148,"statfs":{"total":96636764160,"available":96586903552,"internally_reserved":0,"allocated":13676544,"data_stored":13357679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52672,"kb_used_data":17336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319168,"statfs":{"total":96636764160,"available":96582828032,"internally_reserved":0,"allocated":17752064,"data_stored":17499215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41044,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330796,"statfs":{"total":96636764160,"available":96594735104,"internally_reserved":0,"allocated":5844992,"data_stored":5555704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:11:54.548 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T18:11:54.548 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.704+0000 7fb60dbbd640 1 Processor -- start 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.704+0000 7fb60dbbd640 1 -- start start 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb60dbbd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb608127ea0 0x7fb608128280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb60dbbd640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb608071020 con 0x7fb6081287c0 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb60dbbd640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fb608071780 con 0x7fb608127ea0 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb6077fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb608127ea0 0x7fb608128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb606ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb6081287c0 0x7fb60812b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60894/0 (socket says 172.21.15.3:60894) 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb606ffd640 1 -- 172.21.15.3:0/180211523 learned_addr learned my addr 172.21.15.3:0/180211523 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb6077fe640 1 -- 172.21.15.3:0/180211523 >> v1:172.21.15.3:6789/0 conn(0x7fb6081287c0 legacy=0x7fb60812b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb6077fe640 1 -- 172.21.15.3:0/180211523 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60806e6e0 con 0x7fb608127ea0 2024-05-15T18:11:54.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.705+0000 7fb6067fc640 1 -- 172.21.15.3:0/180211523 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013778402 0 0) 0x7fb608071020 con 0x7fb6081287c0 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.706+0000 7fb6077fe640 1 --2- 172.21.15.3:0/180211523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608128280 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009720 tx=0x7fb5f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7494b3174aa28b1f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.706+0000 7fb6067fc640 1 -- 172.21.15.3:0/180211523 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f8035020 con 0x7fb608127ea0 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.706+0000 7fb6067fc640 1 -- 172.21.15.3:0/180211523 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8031760 con 0x7fb608127ea0 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.706+0000 7fb6067fc640 1 -- 172.21.15.3:0/180211523 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f8031a60 con 0x7fb608127ea0 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 -- 172.21.15.3:0/180211523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 msgr2=0x7fb608128280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 --2- 172.21.15.3:0/180211523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608128280 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009720 tx=0x7fb5f802b8d0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 -- 172.21.15.3:0/180211523 shutdown_connections 2024-05-15T18:11:54.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 --2- 172.21.15.3:0/180211523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608128280 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 -- 172.21.15.3:0/180211523 >> 172.21.15.3:0/180211523 conn(0x7fb608099380 msgr2=0x7fb608099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:54.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 -- 172.21.15.3:0/180211523 shutdown_connections 2024-05-15T18:11:54.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 -- 172.21.15.3:0/180211523 wait complete. 2024-05-15T18:11:54.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.707+0000 7fb60dbbd640 1 Processor -- start 2024-05-15T18:11:54.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.708+0000 7fb60dbbd640 1 -- start start 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.708+0000 7fb60dbbd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.708+0000 7fb60dbbd640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb60812b800 con 0x7fb608127ea0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.708+0000 7fb6077fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.708+0000 7fb6077fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49274/0 (socket says 172.21.15.3:49274) 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.708+0000 7fb6077fe640 1 -- 172.21.15.3:0/689767741 learned_addr learned my addr 172.21.15.3:0/689767741 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.708+0000 7fb6077fe640 1 -- 172.21.15.3:0/689767741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb608114670 con 0x7fb608127ea0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.709+0000 7fb6077fe640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608113060 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009720 tx=0x7fb5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.709+0000 7fb5effff640 1 -- 172.21.15.3:0/689767741 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f803cc30 con 0x7fb608127ea0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.709+0000 7fb5effff640 1 -- 172.21.15.3:0/689767741 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f803cdd0 con 0x7fb608127ea0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.709+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60809b9b0 con 0x7fb608127ea0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.709+0000 7fb5effff640 1 -- 172.21.15.3:0/689767741 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f8004160 con 0x7fb608127ea0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.709+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb608115310 con 0x7fb608127ea0 2024-05-15T18:11:54.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.710+0000 7fb5effff640 1 -- 172.21.15.3:0/689767741 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb5f8038020 con 0x7fb608127ea0 2024-05-15T18:11:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.710+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60809b6d0 con 0x7fb608127ea0 2024-05-15T18:11:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.710+0000 7fb5effff640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4038060 0x7fb5f403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.710+0000 7fb5effff640 1 -- 172.21.15.3:0/689767741 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb5f806e070 con 0x7fb608127ea0 2024-05-15T18:11:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.710+0000 7fb606ffd640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4038060 0x7fb5f403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:54.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.711+0000 7fb606ffd640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4038060 0x7fb5f403a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc000c00 tx=0x7fb5fc007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:54.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.715+0000 7fb5effff640 1 -- 172.21.15.3:0/689767741 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb60809b6d0 con 0x7fb608127ea0 2024-05-15T18:11:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.894+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb608062e90 con 0x7fb5f4038060 2024-05-15T18:11:54.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.909+0000 7fb5effff640 1 -- 172.21.15.3:0/689767741 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665399 (secure 0 0 0) 0x7fb608062e90 con 0x7fb5f4038060 2024-05-15T18:11:54.894 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:11:54.899 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:11:54.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4038060 msgr2=0x7fb5f403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4038060 0x7fb5f403a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc000c00 tx=0x7fb5fc007970 comp rx=0 tx=0).stop 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 msgr2=0x7fb608113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608113060 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009720 tx=0x7fb5f80046c0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 shutdown_connections 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb5f4038060 0x7fb5f403a520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 --2- 172.21.15.3:0/689767741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb608127ea0 0x7fb608113060 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 >> 172.21.15.3:0/689767741 conn(0x7fb608099380 msgr2=0x7fb60806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 shutdown_connections 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:54.914+0000 7fb60dbbd640 1 -- 172.21.15.3:0/689767741 wait complete. 2024-05-15T18:11:54.902 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-05-15T18:11:54.376417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412789,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4881,"num_read_kb":4462,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":198696,"kb_used_data":53192,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377288664,"statfs":{"total":386547056640,"available":386343591936,"internally_reserved":0,"allocated":54468608,"data_stored":53322798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":148956946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003654"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.335908+0000","last_change":"2024-05-15T18:08:37.185277+0000","last_active":"2024-05-15T18:09:20.335908+0000","last_peered":"2024-05-15T18:09:20.335908+0000","last_clean":"2024-05-15T18:09:20.335908+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:09:20.335908+0000","last_undegraded":"2024-05-15T18:09:20.335908+0000","last_fullsized":"2024-05-15T18:09:20.335908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101814+0000","last_change":"2024-05-15T18:08:39.181950+0000","last_active":"2024-05-15T18:11:47.101814+0000","last_peered":"2024-05-15T18:11:47.101814+0000","last_clean":"2024-05-15T18:11:47.101814+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:11:47.101814+0000","last_undegraded":"2024-05-15T18:11:47.101814+0000","last_fullsized":"2024-05-15T18:11:47.101814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400383+0000","last_change":"2024-05-15T18:08:37.180815+0000","last_active":"2024-05-15T18:09:19.400383+0000","last_peered":"2024-05-15T18:09:19.400383+0000","last_clean":"2024-05-15T18:09:19.400383+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:09:19.400383+0000","last_undegraded":"2024-05-15T18:09:19.400383+0000","last_fullsized":"2024-05-15T18:09:19.400383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:11:28.156751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801449+0000","last_change":"2024-05-15T18:08:39.183780+0000","last_active":"2024-05-15T18:11:46.801449+0000","last_peered":"2024-05-15T18:11:46.801449+0000","last_clean":"2024-05-15T18:11:46.801449+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:11:46.801449+0000","last_undegraded":"2024-05-15T18:11:46.801449+0000","last_fullsized":"2024-05-15T18:11:46.801449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:15.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403839+0000","last_change":"2024-05-15T18:08:37.186280+0000","last_active":"2024-05-15T18:09:19.403839+0000","last_peered":"2024-05-15T18:09:19.403839+0000","last_clean":"2024-05-15T18:09:19.403839+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:09:19.403839+0000","last_undegraded":"2024-05-15T18:09:19.403839+0000","last_fullsized":"2024-05-15T18:09:19.403839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:41.112234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413763+0000","last_change":"2024-05-15T18:08:39.184797+0000","last_active":"2024-05-15T18:10:46.413763+0000","last_peered":"2024-05-15T18:10:46.413763+0000","last_clean":"2024-05-15T18:10:46.413763+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:10:46.413763+0000","last_undegraded":"2024-05-15T18:10:46.413763+0000","last_fullsized":"2024-05-15T18:10:46.413763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:31.818225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.386408+0000","last_change":"2024-05-15T18:08:37.174049+0000","last_active":"2024-05-15T18:10:46.386408+0000","last_peered":"2024-05-15T18:10:46.386408+0000","last_clean":"2024-05-15T18:10:46.386408+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:10:46.386408+0000","last_undegraded":"2024-05-15T18:10:46.386408+0000","last_fullsized":"2024-05-15T18:10:46.386408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'11","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397038+0000","last_change":"2024-05-15T18:08:39.181113+0000","last_active":"2024-05-15T18:11:08.397038+0000","last_peered":"2024-05-15T18:11:08.397038+0000","last_clean":"2024-05-15T18:11:08.397038+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:11:08.397038+0000","last_undegraded":"2024-05-15T18:11:08.397038+0000","last_fullsized":"2024-05-15T18:11:08.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:57.396932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399830+0000","last_change":"2024-05-15T18:08:37.179942+0000","last_active":"2024-05-15T18:09:19.399830+0000","last_peered":"2024-05-15T18:09:19.399830+0000","last_clean":"2024-05-15T18:09:19.399830+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:09:19.399830+0000","last_undegraded":"2024-05-15T18:09:19.399830+0000","last_fullsized":"2024-05-15T18:09:19.399830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:34.419734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.842198+0000","last_change":"2024-05-15T18:08:39.185769+0000","last_active":"2024-05-15T18:10:02.842198+0000","last_peered":"2024-05-15T18:10:02.842198+0000","last_clean":"2024-05-15T18:10:02.842198+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:10:02.842198+0000","last_undegraded":"2024-05-15T18:10:02.842198+0000","last_fullsized":"2024-05-15T18:10:02.842198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:44.743277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405752+0000","last_change":"2024-05-15T18:08:37.178875+0000","last_active":"2024-05-15T18:09:19.405752+0000","last_peered":"2024-05-15T18:09:19.405752+0000","last_clean":"2024-05-15T18:09:19.405752+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:09:19.405752+0000","last_undegraded":"2024-05-15T18:09:19.405752+0000","last_fullsized":"2024-05-15T18:09:19.405752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027476+0000","last_change":"2024-05-15T18:08:39.189004+0000","last_active":"2024-05-15T18:11:47.027476+0000","last_peered":"2024-05-15T18:11:47.027476+0000","last_clean":"2024-05-15T18:11:47.027476+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:11:47.027476+0000","last_undegraded":"2024-05-15T18:11:47.027476+0000","last_fullsized":"2024-05-15T18:11:47.027476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:55.844079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401251+0000","last_change":"2024-05-15T18:08:37.177010+0000","last_active":"2024-05-15T18:09:19.401251+0000","last_peered":"2024-05-15T18:09:19.401251+0000","last_clean":"2024-05-15T18:09:19.401251+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:09:19.401251+0000","last_undegraded":"2024-05-15T18:09:19.401251+0000","last_fullsized":"2024-05-15T18:09:19.401251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:17:38.714290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'5","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392579+0000","last_change":"2024-05-15T18:08:39.187168+0000","last_active":"2024-05-15T18:10:43.392579+0000","last_peered":"2024-05-15T18:10:43.392579+0000","last_clean":"2024-05-15T18:10:43.392579+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:10:43.392579+0000","last_undegraded":"2024-05-15T18:10:43.392579+0000","last_fullsized":"2024-05-15T18:10:43.392579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398685+0000","last_change":"2024-05-15T18:08:37.180981+0000","last_active":"2024-05-15T18:09:19.398685+0000","last_peered":"2024-05-15T18:09:19.398685+0000","last_clean":"2024-05-15T18:09:19.398685+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:09:19.398685+0000","last_undegraded":"2024-05-15T18:09:19.398685+0000","last_fullsized":"2024-05-15T18:09:19.398685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102117+0000","last_change":"2024-05-15T18:08:39.185117+0000","last_active":"2024-05-15T18:11:47.102117+0000","last_peered":"2024-05-15T18:11:47.102117+0000","last_clean":"2024-05-15T18:11:47.102117+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:11:47.102117+0000","last_undegraded":"2024-05-15T18:11:47.102117+0000","last_fullsized":"2024-05-15T18:11:47.102117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102111+0000","last_change":"2024-05-15T18:08:39.186238+0000","last_active":"2024-05-15T18:11:47.102111+0000","last_peered":"2024-05-15T18:11:47.102111+0000","last_clean":"2024-05-15T18:11:47.102111+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:11:47.102111+0000","last_undegraded":"2024-05-15T18:11:47.102111+0000","last_fullsized":"2024-05-15T18:11:47.102111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:18.269525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401873+0000","last_change":"2024-05-15T18:08:37.177868+0000","last_active":"2024-05-15T18:09:19.401873+0000","last_peered":"2024-05-15T18:09:19.401873+0000","last_clean":"2024-05-15T18:09:19.401873+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:09:19.401873+0000","last_undegraded":"2024-05-15T18:09:19.401873+0000","last_fullsized":"2024-05-15T18:09:19.401873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901911+0000","last_change":"2024-05-15T18:08:39.184998+0000","last_active":"2024-05-15T18:11:46.901911+0000","last_peered":"2024-05-15T18:11:46.901911+0000","last_clean":"2024-05-15T18:11:46.901911+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:11:46.901911+0000","last_undegraded":"2024-05-15T18:11:46.901911+0000","last_fullsized":"2024-05-15T18:11:46.901911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:52.199938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.309110+0000","last_change":"2024-05-15T18:08:37.179232+0000","last_active":"2024-05-15T18:10:43.309110+0000","last_peered":"2024-05-15T18:10:43.309110+0000","last_clean":"2024-05-15T18:10:43.309110+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:10:43.309110+0000","last_undegraded":"2024-05-15T18:10:43.309110+0000","last_fullsized":"2024-05-15T18:10:43.309110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353249+0000","last_change":"2024-05-15T18:08:39.187737+0000","last_active":"2024-05-15T18:09:20.353249+0000","last_peered":"2024-05-15T18:09:20.353249+0000","last_clean":"2024-05-15T18:09:20.353249+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:09:20.353249+0000","last_undegraded":"2024-05-15T18:09:20.353249+0000","last_fullsized":"2024-05-15T18:09:20.353249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403507+0000","last_change":"2024-05-15T18:08:37.176725+0000","last_active":"2024-05-15T18:09:19.403507+0000","last_peered":"2024-05-15T18:09:19.403507+0000","last_clean":"2024-05-15T18:09:19.403507+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:09:19.403507+0000","last_undegraded":"2024-05-15T18:09:19.403507+0000","last_fullsized":"2024-05-15T18:09:19.403507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:14:09.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075342+0000","last_change":"2024-05-15T18:08:39.183706+0000","last_active":"2024-05-15T18:11:47.075342+0000","last_peered":"2024-05-15T18:11:47.075342+0000","last_clean":"2024-05-15T18:11:47.075342+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:11:47.075342+0000","last_undegraded":"2024-05-15T18:11:47.075342+0000","last_fullsized":"2024-05-15T18:11:47.075342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403416+0000","last_change":"2024-05-15T18:08:37.173166+0000","last_active":"2024-05-15T18:09:19.403416+0000","last_peered":"2024-05-15T18:09:19.403416+0000","last_clean":"2024-05-15T18:09:19.403416+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:09:19.403416+0000","last_undegraded":"2024-05-15T18:09:19.403416+0000","last_fullsized":"2024-05-15T18:09:19.403416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820262+0000","last_change":"2024-05-15T18:08:39.183490+0000","last_active":"2024-05-15T18:09:20.820262+0000","last_peered":"2024-05-15T18:09:20.820262+0000","last_clean":"2024-05-15T18:09:20.820262+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:09:20.820262+0000","last_undegraded":"2024-05-15T18:09:20.820262+0000","last_fullsized":"2024-05-15T18:09:20.820262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:04.391798+0000","last_change":"2024-05-15T18:08:37.180056+0000","last_active":"2024-05-15T18:11:04.391798+0000","last_peered":"2024-05-15T18:11:04.391798+0000","last_clean":"2024-05-15T18:11:04.391798+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:11:04.391798+0000","last_undegraded":"2024-05-15T18:11:04.391798+0000","last_fullsized":"2024-05-15T18:11:04.391798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.638104+0000","last_change":"2024-05-15T18:08:39.180165+0000","last_active":"2024-05-15T18:10:02.638104+0000","last_peered":"2024-05-15T18:10:02.638104+0000","last_clean":"2024-05-15T18:10:02.638104+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:10:02.638104+0000","last_undegraded":"2024-05-15T18:10:02.638104+0000","last_fullsized":"2024-05-15T18:10:02.638104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398920+0000","last_change":"2024-05-15T18:08:37.181235+0000","last_active":"2024-05-15T18:09:19.398920+0000","last_peered":"2024-05-15T18:09:19.398920+0000","last_clean":"2024-05-15T18:09:19.398920+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:09:19.398920+0000","last_undegraded":"2024-05-15T18:09:19.398920+0000","last_fullsized":"2024-05-15T18:09:19.398920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:24.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.052271+0000","last_change":"2024-05-15T18:08:47.223064+0000","last_active":"2024-05-15T18:11:47.052271+0000","last_peered":"2024-05-15T18:11:47.052271+0000","last_clean":"2024-05-15T18:11:47.052271+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:11:47.052271+0000","last_undegraded":"2024-05-15T18:11:47.052271+0000","last_fullsized":"2024-05-15T18:11:47.052271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:52.698600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101931+0000","last_change":"2024-05-15T18:09:19.408744+0000","last_active":"2024-05-15T18:11:47.101931+0000","last_peered":"2024-05-15T18:11:47.101931+0000","last_clean":"2024-05-15T18:11:47.101931+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:11:47.101931+0000","last_undegraded":"2024-05-15T18:11:47.101931+0000","last_fullsized":"2024-05-15T18:11:47.101931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:44.669224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398972+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:09:19.398972+0000","last_peered":"2024-05-15T18:09:19.398972+0000","last_clean":"2024-05-15T18:09:19.398972+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:09:19.398972+0000","last_undegraded":"2024-05-15T18:09:19.398972+0000","last_fullsized":"2024-05-15T18:09:19.398972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:34.978659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.039167+0000","last_change":"2024-05-15T18:08:41.191864+0000","last_active":"2024-05-15T18:10:46.039167+0000","last_peered":"2024-05-15T18:10:46.039167+0000","last_clean":"2024-05-15T18:10:46.039167+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:10:46.039167+0000","last_undegraded":"2024-05-15T18:10:46.039167+0000","last_fullsized":"2024-05-15T18:10:46.039167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.990907+0000","last_change":"2024-05-15T18:08:43.205617+0000","last_active":"2024-05-15T18:10:44.990907+0000","last_peered":"2024-05-15T18:10:44.990907+0000","last_clean":"2024-05-15T18:10:44.990907+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:10:44.990907+0000","last_undegraded":"2024-05-15T18:10:44.990907+0000","last_fullsized":"2024-05-15T18:10:44.990907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:54.834292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401260+0000","last_change":"2024-05-15T18:08:45.209245+0000","last_active":"2024-05-15T18:09:19.401260+0000","last_peered":"2024-05-15T18:09:19.401260+0000","last_clean":"2024-05-15T18:09:19.401260+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:09:19.401260+0000","last_undegraded":"2024-05-15T18:09:19.401260+0000","last_fullsized":"2024-05-15T18:09:19.401260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.077076+0000","last_change":"2024-05-15T18:08:47.223088+0000","last_active":"2024-05-15T18:11:47.077076+0000","last_peered":"2024-05-15T18:11:47.077076+0000","last_clean":"2024-05-15T18:11:47.077076+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:11:47.077076+0000","last_undegraded":"2024-05-15T18:11:47.077076+0000","last_fullsized":"2024-05-15T18:11:47.077076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:02.637943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102151+0000","last_change":"2024-05-15T18:08:39.182435+0000","last_active":"2024-05-15T18:11:47.102151+0000","last_peered":"2024-05-15T18:11:47.102151+0000","last_clean":"2024-05-15T18:11:47.102151+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:11:47.102151+0000","last_undegraded":"2024-05-15T18:11:47.102151+0000","last_fullsized":"2024-05-15T18:11:47.102151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:54.513611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406138+0000","last_change":"2024-05-15T18:08:37.176655+0000","last_active":"2024-05-15T18:09:19.406138+0000","last_peered":"2024-05-15T18:09:19.406138+0000","last_clean":"2024-05-15T18:09:19.406138+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:09:19.406138+0000","last_undegraded":"2024-05-15T18:09:19.406138+0000","last_fullsized":"2024-05-15T18:09:19.406138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399967+0000","last_change":"2024-05-15T18:08:41.190513+0000","last_active":"2024-05-15T18:09:19.399967+0000","last_peered":"2024-05-15T18:09:19.399967+0000","last_clean":"2024-05-15T18:09:19.399967+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:09:19.399967+0000","last_undegraded":"2024-05-15T18:09:19.399967+0000","last_fullsized":"2024-05-15T18:09:19.399967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:24:07.182527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.415322+0000","last_change":"2024-05-15T18:08:43.193059+0000","last_active":"2024-05-15T18:10:46.415322+0000","last_peered":"2024-05-15T18:10:46.415322+0000","last_clean":"2024-05-15T18:10:46.415322+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:10:46.415322+0000","last_undegraded":"2024-05-15T18:10:46.415322+0000","last_fullsized":"2024-05-15T18:10:46.415322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:03:54.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401523+0000","last_change":"2024-05-15T18:08:45.200547+0000","last_active":"2024-05-15T18:09:19.401523+0000","last_peered":"2024-05-15T18:09:19.401523+0000","last_clean":"2024-05-15T18:09:19.401523+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:09:19.401523+0000","last_undegraded":"2024-05-15T18:09:19.401523+0000","last_fullsized":"2024-05-15T18:09:19.401523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.731935+0000","last_change":"2024-05-15T18:08:47.215478+0000","last_active":"2024-05-15T18:09:19.731935+0000","last_peered":"2024-05-15T18:09:19.731935+0000","last_clean":"2024-05-15T18:09:19.731935+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:09:19.731935+0000","last_undegraded":"2024-05-15T18:09:19.731935+0000","last_fullsized":"2024-05-15T18:09:19.731935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736547+0000","last_change":"2024-05-15T18:08:39.180798+0000","last_active":"2024-05-15T18:09:19.736547+0000","last_peered":"2024-05-15T18:09:19.736547+0000","last_clean":"2024-05-15T18:09:19.736547+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:09:19.736547+0000","last_undegraded":"2024-05-15T18:09:19.736547+0000","last_fullsized":"2024-05-15T18:09:19.736547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:49.260782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.341191+0000","last_change":"2024-05-15T18:08:37.185177+0000","last_active":"2024-05-15T18:09:20.341191+0000","last_peered":"2024-05-15T18:09:20.341191+0000","last_clean":"2024-05-15T18:09:20.341191+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:09:20.341191+0000","last_undegraded":"2024-05-15T18:09:20.341191+0000","last_fullsized":"2024-05-15T18:09:20.341191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:50.301378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:23.381565+0000","last_change":"2024-05-15T18:09:19.410089+0000","last_active":"2024-05-15T18:09:23.381565+0000","last_peered":"2024-05-15T18:09:23.381565+0000","last_clean":"2024-05-15T18:09:23.381565+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:09:23.381565+0000","last_undegraded":"2024-05-15T18:09:23.381565+0000","last_fullsized":"2024-05-15T18:09:23.381565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:15:56.615789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407814+0000","last_change":"2024-05-15T18:08:43.198970+0000","last_active":"2024-05-15T18:09:19.407814+0000","last_peered":"2024-05-15T18:09:19.407814+0000","last_clean":"2024-05-15T18:09:19.407814+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:09:19.407814+0000","last_undegraded":"2024-05-15T18:09:19.407814+0000","last_fullsized":"2024-05-15T18:09:19.407814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:48.849846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274331+0000","last_change":"2024-05-15T18:08:45.210771+0000","last_active":"2024-05-15T18:11:46.274331+0000","last_peered":"2024-05-15T18:11:46.274331+0000","last_clean":"2024-05-15T18:11:46.274331+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:11:46.274331+0000","last_undegraded":"2024-05-15T18:11:46.274331+0000","last_fullsized":"2024-05-15T18:11:46.274331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:10.645906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.408911+0000","last_change":"2024-05-15T18:08:47.220509+0000","last_active":"2024-05-15T18:10:46.408911+0000","last_peered":"2024-05-15T18:10:46.408911+0000","last_clean":"2024-05-15T18:10:46.408911+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:10:46.408911+0000","last_undegraded":"2024-05-15T18:10:46.408911+0000","last_fullsized":"2024-05-15T18:10:46.408911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:56.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'23","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111340+0000","last_change":"2024-05-15T18:08:39.187144+0000","last_active":"2024-05-15T18:11:47.111340+0000","last_peered":"2024-05-15T18:11:47.111340+0000","last_clean":"2024-05-15T18:11:47.111340+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:11:47.111340+0000","last_undegraded":"2024-05-15T18:11:47.111340+0000","last_fullsized":"2024-05-15T18:11:47.111340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399530+0000","last_change":"2024-05-15T18:08:37.176800+0000","last_active":"2024-05-15T18:09:19.399530+0000","last_peered":"2024-05-15T18:09:19.399530+0000","last_clean":"2024-05-15T18:09:19.399530+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:09:19.399530+0000","last_undegraded":"2024-05-15T18:09:19.399530+0000","last_fullsized":"2024-05-15T18:09:19.399530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400987+0000","last_change":"2024-05-15T18:08:41.191184+0000","last_active":"2024-05-15T18:09:19.400987+0000","last_peered":"2024-05-15T18:09:19.400987+0000","last_clean":"2024-05-15T18:09:19.400987+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:09:19.400987+0000","last_undegraded":"2024-05-15T18:09:19.400987+0000","last_fullsized":"2024-05-15T18:09:19.400987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:25.413878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.985510+0000","last_change":"2024-05-15T18:08:43.199596+0000","last_active":"2024-05-15T18:10:44.985510+0000","last_peered":"2024-05-15T18:10:44.985510+0000","last_clean":"2024-05-15T18:10:44.985510+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:10:44.985510+0000","last_undegraded":"2024-05-15T18:10:44.985510+0000","last_fullsized":"2024-05-15T18:10:44.985510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:22.284084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'282","reported_seq":435,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.107028+0000","last_change":"2024-05-15T18:08:45.198740+0000","last_active":"2024-05-15T18:11:47.107028+0000","last_peered":"2024-05-15T18:11:47.107028+0000","last_clean":"2024-05-15T18:11:47.107028+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:47.107028+0000","last_undegraded":"2024-05-15T18:11:47.107028+0000","last_fullsized":"2024-05-15T18:11:47.107028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:30.679986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.798859+0000","last_change":"2024-05-15T18:08:39.194038+0000","last_active":"2024-05-15T18:11:46.798859+0000","last_peered":"2024-05-15T18:11:46.798859+0000","last_clean":"2024-05-15T18:11:46.798859+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:11:46.798859+0000","last_undegraded":"2024-05-15T18:11:46.798859+0000","last_fullsized":"2024-05-15T18:11:46.798859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:23:21.748030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408742+0000","last_change":"2024-05-15T18:08:37.173486+0000","last_active":"2024-05-15T18:09:19.408742+0000","last_peered":"2024-05-15T18:09:19.408742+0000","last_clean":"2024-05-15T18:09:19.408742+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:09:19.408742+0000","last_undegraded":"2024-05-15T18:09:19.408742+0000","last_fullsized":"2024-05-15T18:09:19.408742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402302+0000","last_change":"2024-05-15T18:08:41.193621+0000","last_active":"2024-05-15T18:09:19.402302+0000","last_peered":"2024-05-15T18:09:19.402302+0000","last_clean":"2024-05-15T18:09:19.402302+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:09:19.402302+0000","last_undegraded":"2024-05-15T18:09:19.402302+0000","last_fullsized":"2024-05-15T18:09:19.402302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:49.471489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'41","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.995296+0000","last_change":"2024-05-15T18:08:43.190370+0000","last_active":"2024-05-15T18:10:44.995296+0000","last_peered":"2024-05-15T18:10:44.995296+0000","last_clean":"2024-05-15T18:10:44.995296+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:10:44.995296+0000","last_undegraded":"2024-05-15T18:10:44.995296+0000","last_fullsized":"2024-05-15T18:10:44.995296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:30:17.103247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399470+0000","last_change":"2024-05-15T18:08:45.198524+0000","last_active":"2024-05-15T18:09:19.399470+0000","last_peered":"2024-05-15T18:09:19.399470+0000","last_clean":"2024-05-15T18:09:19.399470+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:09:19.399470+0000","last_undegraded":"2024-05-15T18:09:19.399470+0000","last_fullsized":"2024-05-15T18:09:19.399470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.647715+0000","last_change":"2024-05-15T18:08:47.221822+0000","last_active":"2024-05-15T18:10:02.647715+0000","last_peered":"2024-05-15T18:10:02.647715+0000","last_clean":"2024-05-15T18:10:02.647715+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:10:02.647715+0000","last_undegraded":"2024-05-15T18:10:02.647715+0000","last_fullsized":"2024-05-15T18:10:02.647715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:13.338228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.411141+0000","last_change":"2024-05-15T18:08:39.186448+0000","last_active":"2024-05-15T18:10:46.411141+0000","last_peered":"2024-05-15T18:10:46.411141+0000","last_clean":"2024-05-15T18:10:46.411141+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:10:46.411141+0000","last_undegraded":"2024-05-15T18:10:46.411141+0000","last_fullsized":"2024-05-15T18:10:46.411141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:19.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.409682+0000","last_change":"2024-05-15T18:08:37.179060+0000","last_active":"2024-05-15T18:09:19.409682+0000","last_peered":"2024-05-15T18:09:19.409682+0000","last_clean":"2024-05-15T18:09:19.409682+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:09:19.409682+0000","last_undegraded":"2024-05-15T18:09:19.409682+0000","last_fullsized":"2024-05-15T18:09:19.409682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"22'1","reported_seq":218,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.049391+0000","last_change":"2024-05-15T18:08:41.193828+0000","last_active":"2024-05-15T18:10:46.049391+0000","last_peered":"2024-05-15T18:10:46.049391+0000","last_clean":"2024-05-15T18:10:46.049391+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:10:46.049391+0000","last_undegraded":"2024-05-15T18:10:46.049391+0000","last_fullsized":"2024-05-15T18:10:46.049391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:53.033474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.975080+0000","last_change":"2024-05-15T18:08:43.205152+0000","last_active":"2024-05-15T18:10:44.975080+0000","last_peered":"2024-05-15T18:10:44.975080+0000","last_clean":"2024-05-15T18:10:44.975080+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:10:44.975080+0000","last_undegraded":"2024-05-15T18:10:44.975080+0000","last_fullsized":"2024-05-15T18:10:44.975080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:54:29.654507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399047+0000","last_change":"2024-05-15T18:08:45.207980+0000","last_active":"2024-05-15T18:09:19.399047+0000","last_peered":"2024-05-15T18:09:19.399047+0000","last_clean":"2024-05-15T18:09:19.399047+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:09:19.399047+0000","last_undegraded":"2024-05-15T18:09:19.399047+0000","last_fullsized":"2024-05-15T18:09:19.399047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:57.088948+0000","last_change":"2024-05-15T18:08:47.217227+0000","last_active":"2024-05-15T18:09:57.088948+0000","last_peered":"2024-05-15T18:09:57.088948+0000","last_clean":"2024-05-15T18:09:57.088948+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:09:57.088948+0000","last_undegraded":"2024-05-15T18:09:57.088948+0000","last_fullsized":"2024-05-15T18:09:57.088948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102085+0000","last_change":"2024-05-15T18:08:39.185744+0000","last_active":"2024-05-15T18:11:47.102085+0000","last_peered":"2024-05-15T18:11:47.102085+0000","last_clean":"2024-05-15T18:11:47.102085+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:11:47.102085+0000","last_undegraded":"2024-05-15T18:11:47.102085+0000","last_fullsized":"2024-05-15T18:11:47.102085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:26.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.761148+0000","last_change":"2024-05-15T18:08:37.181644+0000","last_active":"2024-05-15T18:11:46.761148+0000","last_peered":"2024-05-15T18:11:46.761148+0000","last_clean":"2024-05-15T18:11:46.761148+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:11:46.761148+0000","last_undegraded":"2024-05-15T18:11:46.761148+0000","last_fullsized":"2024-05-15T18:11:46.761148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:40.709421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400858+0000","last_change":"2024-05-15T18:08:41.191195+0000","last_active":"2024-05-15T18:09:19.400858+0000","last_peered":"2024-05-15T18:09:19.400858+0000","last_clean":"2024-05-15T18:09:19.400858+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:09:19.400858+0000","last_undegraded":"2024-05-15T18:09:19.400858+0000","last_fullsized":"2024-05-15T18:09:19.400858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:55.559496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997111+0000","last_change":"2024-05-15T18:08:43.205104+0000","last_active":"2024-05-15T18:10:44.997111+0000","last_peered":"2024-05-15T18:10:44.997111+0000","last_clean":"2024-05-15T18:10:44.997111+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:10:44.997111+0000","last_undegraded":"2024-05-15T18:10:44.997111+0000","last_fullsized":"2024-05-15T18:10:44.997111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:18.034720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'282","reported_seq":397,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.228683+0000","last_change":"2024-05-15T18:08:45.205456+0000","last_active":"2024-05-15T18:11:47.228683+0000","last_peered":"2024-05-15T18:11:47.228683+0000","last_clean":"2024-05-15T18:11:47.228683+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:11:47.228683+0000","last_undegraded":"2024-05-15T18:11:47.228683+0000","last_fullsized":"2024-05-15T18:11:47.228683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400131+0000","last_change":"2024-05-15T18:08:47.218349+0000","last_active":"2024-05-15T18:09:19.400131+0000","last_peered":"2024-05-15T18:09:19.400131+0000","last_clean":"2024-05-15T18:09:19.400131+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:09:19.400131+0000","last_undegraded":"2024-05-15T18:09:19.400131+0000","last_fullsized":"2024-05-15T18:09:19.400131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:22.049537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075674+0000","last_change":"2024-05-15T18:08:39.180538+0000","last_active":"2024-05-15T18:11:47.075674+0000","last_peered":"2024-05-15T18:11:47.075674+0000","last_clean":"2024-05-15T18:11:47.075674+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:11:47.075674+0000","last_undegraded":"2024-05-15T18:11:47.075674+0000","last_fullsized":"2024-05-15T18:11:47.075674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399222+0000","last_change":"2024-05-15T18:08:37.179976+0000","last_active":"2024-05-15T18:09:19.399222+0000","last_peered":"2024-05-15T18:09:19.399222+0000","last_clean":"2024-05-15T18:09:19.399222+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:09:19.399222+0000","last_undegraded":"2024-05-15T18:09:19.399222+0000","last_fullsized":"2024-05-15T18:09:19.399222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:26.717872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399581+0000","last_change":"2024-05-15T18:08:41.193806+0000","last_active":"2024-05-15T18:09:19.399581+0000","last_peered":"2024-05-15T18:09:19.399581+0000","last_clean":"2024-05-15T18:09:19.399581+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:09:19.399581+0000","last_undegraded":"2024-05-15T18:09:19.399581+0000","last_fullsized":"2024-05-15T18:09:19.399581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:03:24.766255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'54","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.998912+0000","last_change":"2024-05-15T18:08:43.201489+0000","last_active":"2024-05-15T18:10:44.998912+0000","last_peered":"2024-05-15T18:10:44.998912+0000","last_clean":"2024-05-15T18:10:44.998912+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:10:44.998912+0000","last_undegraded":"2024-05-15T18:10:44.998912+0000","last_fullsized":"2024-05-15T18:10:44.998912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:29.914900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398840+0000","last_change":"2024-05-15T18:08:45.200667+0000","last_active":"2024-05-15T18:09:19.398840+0000","last_peered":"2024-05-15T18:09:19.398840+0000","last_clean":"2024-05-15T18:09:19.398840+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:09:19.398840+0000","last_undegraded":"2024-05-15T18:09:19.398840+0000","last_fullsized":"2024-05-15T18:09:19.398840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'18","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.205345+0000","last_change":"2024-05-15T18:08:47.219473+0000","last_active":"2024-05-15T18:11:47.205345+0000","last_peered":"2024-05-15T18:11:47.205345+0000","last_clean":"2024-05-15T18:11:47.205345+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:11:47.205345+0000","last_undegraded":"2024-05-15T18:11:47.205345+0000","last_fullsized":"2024-05-15T18:11:47.205345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:54.139301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801094+0000","last_change":"2024-05-15T18:08:39.191385+0000","last_active":"2024-05-15T18:11:46.801094+0000","last_peered":"2024-05-15T18:11:46.801094+0000","last_clean":"2024-05-15T18:11:46.801094+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:11:46.801094+0000","last_undegraded":"2024-05-15T18:11:46.801094+0000","last_fullsized":"2024-05-15T18:11:46.801094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:51.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399685+0000","last_change":"2024-05-15T18:08:37.181014+0000","last_active":"2024-05-15T18:09:19.399685+0000","last_peered":"2024-05-15T18:09:19.399685+0000","last_clean":"2024-05-15T18:09:19.399685+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:09:19.399685+0000","last_undegraded":"2024-05-15T18:09:19.399685+0000","last_fullsized":"2024-05-15T18:09:19.399685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408267+0000","last_change":"2024-05-15T18:08:41.189363+0000","last_active":"2024-05-15T18:09:19.408267+0000","last_peered":"2024-05-15T18:09:19.408267+0000","last_clean":"2024-05-15T18:09:19.408267+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:09:19.408267+0000","last_undegraded":"2024-05-15T18:09:19.408267+0000","last_fullsized":"2024-05-15T18:09:19.408267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:55.939790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.979398+0000","last_change":"2024-05-15T18:08:43.192533+0000","last_active":"2024-05-15T18:10:44.979398+0000","last_peered":"2024-05-15T18:10:44.979398+0000","last_clean":"2024-05-15T18:10:44.979398+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:10:44.979398+0000","last_undegraded":"2024-05-15T18:10:44.979398+0000","last_fullsized":"2024-05-15T18:10:44.979398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:12.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403941+0000","last_change":"2024-05-15T18:08:45.210581+0000","last_active":"2024-05-15T18:09:19.403941+0000","last_peered":"2024-05-15T18:09:19.403941+0000","last_clean":"2024-05-15T18:09:19.403941+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:09:19.403941+0000","last_undegraded":"2024-05-15T18:09:19.403941+0000","last_fullsized":"2024-05-15T18:09:19.403941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:14.840773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393707+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:10:48.393707+0000","last_peered":"2024-05-15T18:10:48.393707+0000","last_clean":"2024-05-15T18:10:48.393707+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:10:48.393707+0000","last_undegraded":"2024-05-15T18:10:48.393707+0000","last_fullsized":"2024-05-15T18:10:48.393707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:06:12.136063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075396+0000","last_change":"2024-05-15T18:08:39.192086+0000","last_active":"2024-05-15T18:11:47.075396+0000","last_peered":"2024-05-15T18:11:47.075396+0000","last_clean":"2024-05-15T18:11:47.075396+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:11:47.075396+0000","last_undegraded":"2024-05-15T18:11:47.075396+0000","last_fullsized":"2024-05-15T18:11:47.075396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:08.553549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399520+0000","last_change":"2024-05-15T18:08:37.182183+0000","last_active":"2024-05-15T18:09:19.399520+0000","last_peered":"2024-05-15T18:09:19.399520+0000","last_clean":"2024-05-15T18:09:19.399520+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:09:19.399520+0000","last_undegraded":"2024-05-15T18:09:19.399520+0000","last_fullsized":"2024-05-15T18:09:19.399520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:19.415597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401501+0000","last_change":"2024-05-15T18:08:41.188718+0000","last_active":"2024-05-15T18:09:19.401501+0000","last_peered":"2024-05-15T18:09:19.401501+0000","last_clean":"2024-05-15T18:09:19.401501+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:09:19.401501+0000","last_undegraded":"2024-05-15T18:09:19.401501+0000","last_fullsized":"2024-05-15T18:09:19.401501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:42.285433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.006001+0000","last_change":"2024-05-15T18:08:43.194313+0000","last_active":"2024-05-15T18:10:45.006001+0000","last_peered":"2024-05-15T18:10:45.006001+0000","last_clean":"2024-05-15T18:10:45.006001+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:10:45.006001+0000","last_undegraded":"2024-05-15T18:10:45.006001+0000","last_fullsized":"2024-05-15T18:10:45.006001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:19.416460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.209358+0000","last_change":"2024-05-15T18:08:45.200646+0000","last_active":"2024-05-15T18:11:47.209358+0000","last_peered":"2024-05-15T18:11:47.209358+0000","last_clean":"2024-05-15T18:11:47.209358+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:11:47.209358+0000","last_undegraded":"2024-05-15T18:11:47.209358+0000","last_fullsized":"2024-05-15T18:11:47.209358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:10:00.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390249+0000","last_change":"2024-05-15T18:08:47.215424+0000","last_active":"2024-05-15T18:10:54.390249+0000","last_peered":"2024-05-15T18:10:54.390249+0000","last_clean":"2024-05-15T18:10:54.390249+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:10:54.390249+0000","last_undegraded":"2024-05-15T18:10:54.390249+0000","last_fullsized":"2024-05-15T18:10:54.390249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.800027+0000","last_change":"2024-05-15T18:08:39.187057+0000","last_active":"2024-05-15T18:11:46.800027+0000","last_peered":"2024-05-15T18:11:46.800027+0000","last_clean":"2024-05-15T18:11:46.800027+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:11:46.800027+0000","last_undegraded":"2024-05-15T18:11:46.800027+0000","last_fullsized":"2024-05-15T18:11:46.800027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.015300+0000","last_change":"2024-05-15T18:08:37.185221+0000","last_active":"2024-05-15T18:11:47.015300+0000","last_peered":"2024-05-15T18:11:47.015300+0000","last_clean":"2024-05-15T18:11:47.015300+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:11:47.015300+0000","last_undegraded":"2024-05-15T18:11:47.015300+0000","last_fullsized":"2024-05-15T18:11:47.015300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:28:54.139077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.048905+0000","last_change":"2024-05-15T18:08:41.190951+0000","last_active":"2024-05-15T18:10:46.048905+0000","last_peered":"2024-05-15T18:10:46.048905+0000","last_clean":"2024-05-15T18:10:46.048905+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:10:46.048905+0000","last_undegraded":"2024-05-15T18:10:46.048905+0000","last_fullsized":"2024-05-15T18:10:46.048905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:49.382359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399598+0000","last_change":"2024-05-15T18:08:43.204683+0000","last_active":"2024-05-15T18:09:19.399598+0000","last_peered":"2024-05-15T18:09:19.399598+0000","last_clean":"2024-05-15T18:09:19.399598+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:09:19.399598+0000","last_undegraded":"2024-05-15T18:09:19.399598+0000","last_fullsized":"2024-05-15T18:09:19.399598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:53.977325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":459,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.165903+0000","last_change":"2024-05-15T18:08:45.199310+0000","last_active":"2024-05-15T18:11:47.165903+0000","last_peered":"2024-05-15T18:11:47.165903+0000","last_clean":"2024-05-15T18:11:47.165903+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:11:47.165903+0000","last_undegraded":"2024-05-15T18:11:47.165903+0000","last_fullsized":"2024-05-15T18:11:47.165903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.189456+0000","last_change":"2024-05-15T18:08:47.215824+0000","last_active":"2024-05-15T18:10:46.189456+0000","last_peered":"2024-05-15T18:10:46.189456+0000","last_clean":"2024-05-15T18:10:46.189456+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:10:46.189456+0000","last_undegraded":"2024-05-15T18:10:46.189456+0000","last_fullsized":"2024-05-15T18:10:46.189456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:24:54.483230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082864+0000","last_change":"2024-05-15T18:08:39.194733+0000","last_active":"2024-05-15T18:09:20.082864+0000","last_peered":"2024-05-15T18:09:20.082864+0000","last_clean":"2024-05-15T18:09:20.082864+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:09:20.082864+0000","last_undegraded":"2024-05-15T18:09:20.082864+0000","last_fullsized":"2024-05-15T18:09:20.082864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:57.618713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398143+0000","last_change":"2024-05-15T18:08:37.183998+0000","last_active":"2024-05-15T18:09:19.398143+0000","last_peered":"2024-05-15T18:09:19.398143+0000","last_clean":"2024-05-15T18:09:19.398143+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:09:19.398143+0000","last_undegraded":"2024-05-15T18:09:19.398143+0000","last_fullsized":"2024-05-15T18:09:19.398143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:37.009803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399709+0000","last_change":"2024-05-15T18:08:41.189678+0000","last_active":"2024-05-15T18:09:19.399709+0000","last_peered":"2024-05-15T18:09:19.399709+0000","last_clean":"2024-05-15T18:09:19.399709+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:09:19.399709+0000","last_undegraded":"2024-05-15T18:09:19.399709+0000","last_fullsized":"2024-05-15T18:09:19.399709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:35.879769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.991934+0000","last_change":"2024-05-15T18:08:43.192247+0000","last_active":"2024-05-15T18:10:44.991934+0000","last_peered":"2024-05-15T18:10:44.991934+0000","last_clean":"2024-05-15T18:10:44.991934+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:10:44.991934+0000","last_undegraded":"2024-05-15T18:10:44.991934+0000","last_fullsized":"2024-05-15T18:10:44.991934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:20:02.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406471+0000","last_change":"2024-05-15T18:08:45.204036+0000","last_active":"2024-05-15T18:09:19.406471+0000","last_peered":"2024-05-15T18:09:19.406471+0000","last_clean":"2024-05-15T18:09:19.406471+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:09:19.406471+0000","last_undegraded":"2024-05-15T18:09:19.406471+0000","last_fullsized":"2024-05-15T18:09:19.406471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:50.743550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.207224+0000","last_change":"2024-05-15T18:08:47.214760+0000","last_active":"2024-05-15T18:11:47.207224+0000","last_peered":"2024-05-15T18:11:47.207224+0000","last_clean":"2024-05-15T18:11:47.207224+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:11:47.207224+0000","last_undegraded":"2024-05-15T18:11:47.207224+0000","last_fullsized":"2024-05-15T18:11:47.207224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:10.382678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401664+0000","last_change":"2024-05-15T18:08:39.189647+0000","last_active":"2024-05-15T18:09:19.401664+0000","last_peered":"2024-05-15T18:09:19.401664+0000","last_clean":"2024-05-15T18:09:19.401664+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:09:19.401664+0000","last_undegraded":"2024-05-15T18:09:19.401664+0000","last_fullsized":"2024-05-15T18:09:19.401664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:38.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399372+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:09:19.399372+0000","last_peered":"2024-05-15T18:09:19.399372+0000","last_clean":"2024-05-15T18:09:19.399372+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:09:19.399372+0000","last_undegraded":"2024-05-15T18:09:19.399372+0000","last_fullsized":"2024-05-15T18:09:19.399372+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:38:29.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399455+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:09:19.399455+0000","last_peered":"2024-05-15T18:09:19.399455+0000","last_clean":"2024-05-15T18:09:19.399455+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:09:19.399455+0000","last_undegraded":"2024-05-15T18:09:19.399455+0000","last_fullsized":"2024-05-15T18:09:19.399455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:51:30.696652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398630+0000","last_change":"2024-05-15T18:08:37.186535+0000","last_active":"2024-05-15T18:09:19.398630+0000","last_peered":"2024-05-15T18:09:19.398630+0000","last_clean":"2024-05-15T18:09:19.398630+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:09:19.398630+0000","last_undegraded":"2024-05-15T18:09:19.398630+0000","last_fullsized":"2024-05-15T18:09:19.398630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:41.333162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403085+0000","last_change":"2024-05-15T18:08:41.191173+0000","last_active":"2024-05-15T18:09:19.403085+0000","last_peered":"2024-05-15T18:09:19.403085+0000","last_clean":"2024-05-15T18:09:19.403085+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:09:19.403085+0000","last_undegraded":"2024-05-15T18:09:19.403085+0000","last_fullsized":"2024-05-15T18:09:19.403085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:33.825447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.003655+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:45.003655+0000","last_peered":"2024-05-15T18:10:45.003655+0000","last_clean":"2024-05-15T18:10:45.003655+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:10:45.003655+0000","last_undegraded":"2024-05-15T18:10:45.003655+0000","last_fullsized":"2024-05-15T18:10:45.003655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:19.100640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401279+0000","last_change":"2024-05-15T18:08:45.208179+0000","last_active":"2024-05-15T18:09:19.401279+0000","last_peered":"2024-05-15T18:09:19.401279+0000","last_clean":"2024-05-15T18:09:19.401279+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:09:19.401279+0000","last_undegraded":"2024-05-15T18:09:19.401279+0000","last_fullsized":"2024-05-15T18:09:19.401279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:39.895143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.117287+0000","last_change":"2024-05-15T18:08:47.212621+0000","last_active":"2024-05-15T18:11:47.117287+0000","last_peered":"2024-05-15T18:11:47.117287+0000","last_clean":"2024-05-15T18:11:47.117287+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:11:47.117287+0000","last_undegraded":"2024-05-15T18:11:47.117287+0000","last_fullsized":"2024-05-15T18:11:47.117287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:45.928963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817460+0000","last_change":"2024-05-15T18:08:39.180830+0000","last_active":"2024-05-15T18:09:20.817460+0000","last_peered":"2024-05-15T18:09:20.817460+0000","last_clean":"2024-05-15T18:09:20.817460+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:09:20.817460+0000","last_undegraded":"2024-05-15T18:09:20.817460+0000","last_fullsized":"2024-05-15T18:09:20.817460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:44.720954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398139+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:09:19.398139+0000","last_peered":"2024-05-15T18:09:19.398139+0000","last_clean":"2024-05-15T18:09:19.398139+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:09:19.398139+0000","last_undegraded":"2024-05-15T18:09:19.398139+0000","last_fullsized":"2024-05-15T18:09:19.398139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:44:53.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399209+0000","last_change":"2024-05-15T18:08:37.179663+0000","last_active":"2024-05-15T18:09:19.399209+0000","last_peered":"2024-05-15T18:09:19.399209+0000","last_clean":"2024-05-15T18:09:19.399209+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:09:19.399209+0000","last_undegraded":"2024-05-15T18:09:19.399209+0000","last_fullsized":"2024-05-15T18:09:19.399209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404825+0000","last_change":"2024-05-15T18:08:41.192861+0000","last_active":"2024-05-15T18:09:19.404825+0000","last_peered":"2024-05-15T18:09:19.404825+0000","last_clean":"2024-05-15T18:09:19.404825+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:09:19.404825+0000","last_undegraded":"2024-05-15T18:09:19.404825+0000","last_fullsized":"2024-05-15T18:09:19.404825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:32.544124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'276","reported_seq":479,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274219+0000","last_change":"2024-05-15T18:08:43.197473+0000","last_active":"2024-05-15T18:11:46.274219+0000","last_peered":"2024-05-15T18:11:46.274219+0000","last_clean":"2024-05-15T18:11:46.274219+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:11:46.274219+0000","last_undegraded":"2024-05-15T18:11:46.274219+0000","last_fullsized":"2024-05-15T18:11:46.274219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:56.013010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":363,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400972+0000","last_change":"2024-05-15T18:08:45.210778+0000","last_active":"2024-05-15T18:09:19.400972+0000","last_peered":"2024-05-15T18:09:19.400972+0000","last_clean":"2024-05-15T18:09:19.400972+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:09:19.400972+0000","last_undegraded":"2024-05-15T18:09:19.400972+0000","last_fullsized":"2024-05-15T18:09:19.400972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:40:44.142402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.643784+0000","last_change":"2024-05-15T18:08:47.217222+0000","last_active":"2024-05-15T18:10:02.643784+0000","last_peered":"2024-05-15T18:10:02.643784+0000","last_clean":"2024-05-15T18:10:02.643784+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:10:02.643784+0000","last_undegraded":"2024-05-15T18:10:02.643784+0000","last_fullsized":"2024-05-15T18:10:02.643784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075441+0000","last_change":"2024-05-15T18:08:39.186998+0000","last_active":"2024-05-15T18:11:47.075441+0000","last_peered":"2024-05-15T18:11:47.075441+0000","last_clean":"2024-05-15T18:11:47.075441+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:11:47.075441+0000","last_undegraded":"2024-05-15T18:11:47.075441+0000","last_fullsized":"2024-05-15T18:11:47.075441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405333+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:09:19.405333+0000","last_peered":"2024-05-15T18:09:19.405333+0000","last_clean":"2024-05-15T18:09:19.405333+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:09:19.405333+0000","last_undegraded":"2024-05-15T18:09:19.405333+0000","last_fullsized":"2024-05-15T18:09:19.405333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398590+0000","last_change":"2024-05-15T18:08:37.173060+0000","last_active":"2024-05-15T18:09:19.398590+0000","last_peered":"2024-05-15T18:09:19.398590+0000","last_clean":"2024-05-15T18:09:19.398590+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:09:19.398590+0000","last_undegraded":"2024-05-15T18:09:19.398590+0000","last_fullsized":"2024-05-15T18:09:19.398590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.417136+0000","last_change":"2024-05-15T18:09:19.416671+0000","last_active":"2024-05-15T18:09:19.417136+0000","last_peered":"2024-05-15T18:09:19.417136+0000","last_clean":"2024-05-15T18:09:19.417136+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:09:19.417136+0000","last_undegraded":"2024-05-15T18:09:19.417136+0000","last_fullsized":"2024-05-15T18:09:19.417136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:46.020343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274261+0000","last_change":"2024-05-15T18:08:43.195546+0000","last_active":"2024-05-15T18:11:46.274261+0000","last_peered":"2024-05-15T18:11:46.274261+0000","last_clean":"2024-05-15T18:11:46.274261+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:11:46.274261+0000","last_undegraded":"2024-05-15T18:11:46.274261+0000","last_fullsized":"2024-05-15T18:11:46.274261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:45:01.029538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400090+0000","last_change":"2024-05-15T18:08:45.204246+0000","last_active":"2024-05-15T18:09:19.400090+0000","last_peered":"2024-05-15T18:09:19.400090+0000","last_clean":"2024-05-15T18:09:19.400090+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:09:19.400090+0000","last_undegraded":"2024-05-15T18:09:19.400090+0000","last_fullsized":"2024-05-15T18:09:19.400090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:36.559499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398480+0000","last_change":"2024-05-15T18:08:47.219388+0000","last_active":"2024-05-15T18:09:19.398480+0000","last_peered":"2024-05-15T18:09:19.398480+0000","last_clean":"2024-05-15T18:09:19.398480+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:09:19.398480+0000","last_undegraded":"2024-05-15T18:09:19.398480+0000","last_fullsized":"2024-05-15T18:09:19.398480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:49.062143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027543+0000","last_change":"2024-05-15T18:08:39.184088+0000","last_active":"2024-05-15T18:11:47.027543+0000","last_peered":"2024-05-15T18:11:47.027543+0000","last_clean":"2024-05-15T18:11:47.027543+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:11:47.027543+0000","last_undegraded":"2024-05-15T18:11:47.027543+0000","last_fullsized":"2024-05-15T18:11:47.027543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398689+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:09:19.398689+0000","last_peered":"2024-05-15T18:09:19.398689+0000","last_clean":"2024-05-15T18:09:19.398689+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:09:19.398689+0000","last_undegraded":"2024-05-15T18:09:19.398689+0000","last_fullsized":"2024-05-15T18:09:19.398689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:36:43.128557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406217+0000","last_change":"2024-05-15T18:08:37.173069+0000","last_active":"2024-05-15T18:09:19.406217+0000","last_peered":"2024-05-15T18:09:19.406217+0000","last_clean":"2024-05-15T18:09:19.406217+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:09:19.406217+0000","last_undegraded":"2024-05-15T18:09:19.406217+0000","last_fullsized":"2024-05-15T18:09:19.406217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401267+0000","last_change":"2024-05-15T18:08:41.191439+0000","last_active":"2024-05-15T18:09:19.401267+0000","last_peered":"2024-05-15T18:09:19.401267+0000","last_clean":"2024-05-15T18:09:19.401267+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:09:19.401267+0000","last_undegraded":"2024-05-15T18:09:19.401267+0000","last_fullsized":"2024-05-15T18:09:19.401267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:23:42.753008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.426994+0000","last_change":"2024-05-15T18:08:43.202158+0000","last_active":"2024-05-15T18:11:46.426994+0000","last_peered":"2024-05-15T18:11:46.426994+0000","last_clean":"2024-05-15T18:11:46.426994+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:11:46.426994+0000","last_undegraded":"2024-05-15T18:11:46.426994+0000","last_fullsized":"2024-05-15T18:11:46.426994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:58:30.776682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404053+0000","last_change":"2024-05-15T18:08:45.211047+0000","last_active":"2024-05-15T18:09:19.404053+0000","last_peered":"2024-05-15T18:09:19.404053+0000","last_clean":"2024-05-15T18:09:19.404053+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:09:19.404053+0000","last_undegraded":"2024-05-15T18:09:19.404053+0000","last_fullsized":"2024-05-15T18:09:19.404053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:32.852658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.169134+0000","last_change":"2024-05-15T18:08:47.221837+0000","last_active":"2024-05-15T18:10:46.169134+0000","last_peered":"2024-05-15T18:10:46.169134+0000","last_clean":"2024-05-15T18:10:46.169134+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:10:46.169134+0000","last_undegraded":"2024-05-15T18:10:46.169134+0000","last_fullsized":"2024-05-15T18:10:46.169134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:52.042498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'7","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413696+0000","last_change":"2024-05-15T18:08:39.194112+0000","last_active":"2024-05-15T18:10:46.413696+0000","last_peered":"2024-05-15T18:10:46.413696+0000","last_clean":"2024-05-15T18:10:46.413696+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:10:46.413696+0000","last_undegraded":"2024-05-15T18:10:46.413696+0000","last_fullsized":"2024-05-15T18:10:46.413696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:34.314353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408561+0000","last_change":"2024-05-15T18:08:37.173933+0000","last_active":"2024-05-15T18:09:19.408561+0000","last_peered":"2024-05-15T18:09:19.408561+0000","last_clean":"2024-05-15T18:09:19.408561+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:09:19.408561+0000","last_undegraded":"2024-05-15T18:09:19.408561+0000","last_fullsized":"2024-05-15T18:09:19.408561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400028+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:09:19.400028+0000","last_peered":"2024-05-15T18:09:19.400028+0000","last_clean":"2024-05-15T18:09:19.400028+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:09:19.400028+0000","last_undegraded":"2024-05-15T18:09:19.400028+0000","last_fullsized":"2024-05-15T18:09:19.400028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:49.389424+0000","last_change":"2024-05-15T18:08:41.195863+0000","last_active":"2024-05-15T18:10:49.389424+0000","last_peered":"2024-05-15T18:10:49.389424+0000","last_clean":"2024-05-15T18:10:49.389424+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:10:49.389424+0000","last_undegraded":"2024-05-15T18:10:49.389424+0000","last_fullsized":"2024-05-15T18:10:49.389424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:40:08.456674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'61","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.004628+0000","last_change":"2024-05-15T18:08:43.200791+0000","last_active":"2024-05-15T18:10:45.004628+0000","last_peered":"2024-05-15T18:10:45.004628+0000","last_clean":"2024-05-15T18:10:45.004628+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:10:45.004628+0000","last_undegraded":"2024-05-15T18:10:45.004628+0000","last_fullsized":"2024-05-15T18:10:45.004628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:52.336305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405836+0000","last_change":"2024-05-15T18:08:45.198343+0000","last_active":"2024-05-15T18:09:19.405836+0000","last_peered":"2024-05-15T18:09:19.405836+0000","last_clean":"2024-05-15T18:09:19.405836+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:09:19.405836+0000","last_undegraded":"2024-05-15T18:09:19.405836+0000","last_fullsized":"2024-05-15T18:09:19.405836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:44.763619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.350044+0000","last_change":"2024-05-15T18:08:47.215201+0000","last_active":"2024-05-15T18:10:46.350044+0000","last_peered":"2024-05-15T18:10:46.350044+0000","last_clean":"2024-05-15T18:10:46.350044+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:10:46.350044+0000","last_undegraded":"2024-05-15T18:10:46.350044+0000","last_fullsized":"2024-05-15T18:10:46.350044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:59:36.775916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101867+0000","last_change":"2024-05-15T18:09:19.415333+0000","last_active":"2024-05-15T18:11:47.101867+0000","last_peered":"2024-05-15T18:11:47.101867+0000","last_clean":"2024-05-15T18:11:47.101867+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:11:47.101867+0000","last_undegraded":"2024-05-15T18:11:47.101867+0000","last_fullsized":"2024-05-15T18:11:47.101867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400285+0000","last_change":"2024-05-15T18:08:37.180268+0000","last_active":"2024-05-15T18:09:19.400285+0000","last_peered":"2024-05-15T18:09:19.400285+0000","last_clean":"2024-05-15T18:09:19.400285+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:09:19.400285+0000","last_undegraded":"2024-05-15T18:09:19.400285+0000","last_fullsized":"2024-05-15T18:09:19.400285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401559+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:09:19.401559+0000","last_peered":"2024-05-15T18:09:19.401559+0000","last_clean":"2024-05-15T18:09:19.401559+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:09:19.401559+0000","last_undegraded":"2024-05-15T18:09:19.401559+0000","last_fullsized":"2024-05-15T18:09:19.401559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:13.458538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399025+0000","last_change":"2024-05-15T18:08:41.191700+0000","last_active":"2024-05-15T18:09:19.399025+0000","last_peered":"2024-05-15T18:09:19.399025+0000","last_clean":"2024-05-15T18:09:19.399025+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:09:19.399025+0000","last_undegraded":"2024-05-15T18:09:19.399025+0000","last_fullsized":"2024-05-15T18:09:19.399025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:54.945021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402578+0000","last_change":"2024-05-15T18:08:43.197679+0000","last_active":"2024-05-15T18:09:19.402578+0000","last_peered":"2024-05-15T18:09:19.402578+0000","last_clean":"2024-05-15T18:09:19.402578+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:09:19.402578+0000","last_undegraded":"2024-05-15T18:09:19.402578+0000","last_fullsized":"2024-05-15T18:09:19.402578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:33.125848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":346,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274176+0000","last_change":"2024-05-15T18:08:45.204211+0000","last_active":"2024-05-15T18:11:46.274176+0000","last_peered":"2024-05-15T18:11:46.274176+0000","last_clean":"2024-05-15T18:11:46.274176+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:46.274176+0000","last_undegraded":"2024-05-15T18:11:46.274176+0000","last_fullsized":"2024-05-15T18:11:46.274176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.839010+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:10:02.839010+0000","last_peered":"2024-05-15T18:10:02.839010+0000","last_clean":"2024-05-15T18:10:02.839010+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:10:02.839010+0000","last_undegraded":"2024-05-15T18:10:02.839010+0000","last_fullsized":"2024-05-15T18:10:02.839010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:27.490184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'1","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392336+0000","last_change":"2024-05-15T18:08:39.188916+0000","last_active":"2024-05-15T18:10:38.392336+0000","last_peered":"2024-05-15T18:10:38.392336+0000","last_clean":"2024-05-15T18:10:38.392336+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:10:38.392336+0000","last_undegraded":"2024-05-15T18:10:38.392336+0000","last_fullsized":"2024-05-15T18:10:38.392336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:47.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.831319+0000","last_change":"2024-05-15T18:08:37.184221+0000","last_active":"2024-05-15T18:10:02.831319+0000","last_peered":"2024-05-15T18:10:02.831319+0000","last_clean":"2024-05-15T18:10:02.831319+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:10:02.831319+0000","last_undegraded":"2024-05-15T18:10:02.831319+0000","last_fullsized":"2024-05-15T18:10:02.831319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:08.495247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:14.064562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400602+0000","last_change":"2024-05-15T18:08:41.191409+0000","last_active":"2024-05-15T18:09:19.400602+0000","last_peered":"2024-05-15T18:09:19.400602+0000","last_clean":"2024-05-15T18:09:19.400602+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:09:19.400602+0000","last_undegraded":"2024-05-15T18:09:19.400602+0000","last_fullsized":"2024-05-15T18:09:19.400602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:43.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399422+0000","last_change":"2024-05-15T18:08:43.205538+0000","last_active":"2024-05-15T18:09:19.399422+0000","last_peered":"2024-05-15T18:09:19.399422+0000","last_clean":"2024-05-15T18:09:19.399422+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:09:19.399422+0000","last_undegraded":"2024-05-15T18:09:19.399422+0000","last_fullsized":"2024-05-15T18:09:19.399422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:04.322801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'282","reported_seq":389,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.206053+0000","last_change":"2024-05-15T18:08:45.198430+0000","last_active":"2024-05-15T18:11:47.206053+0000","last_peered":"2024-05-15T18:11:47.206053+0000","last_clean":"2024-05-15T18:11:47.206053+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:11:47.206053+0000","last_undegraded":"2024-05-15T18:11:47.206053+0000","last_fullsized":"2024-05-15T18:11:47.206053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:20.124986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401547+0000","last_change":"2024-05-15T18:08:47.222589+0000","last_active":"2024-05-15T18:09:19.401547+0000","last_peered":"2024-05-15T18:09:19.401547+0000","last_clean":"2024-05-15T18:09:19.401547+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:09:19.401547+0000","last_undegraded":"2024-05-15T18:09:19.401547+0000","last_fullsized":"2024-05-15T18:09:19.401547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894689+0000","last_change":"2024-05-15T18:08:39.185262+0000","last_active":"2024-05-15T18:11:46.894689+0000","last_peered":"2024-05-15T18:11:46.894689+0000","last_clean":"2024-05-15T18:11:46.894689+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:11:46.894689+0000","last_undegraded":"2024-05-15T18:11:46.894689+0000","last_fullsized":"2024-05-15T18:11:46.894689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:10.502882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.629114+0000","last_change":"2024-05-15T18:08:37.179237+0000","last_active":"2024-05-15T18:10:02.629114+0000","last_peered":"2024-05-15T18:10:02.629114+0000","last_clean":"2024-05-15T18:10:02.629114+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:10:02.629114+0000","last_undegraded":"2024-05-15T18:10:02.629114+0000","last_fullsized":"2024-05-15T18:10:02.629114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404325+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:09:19.404325+0000","last_peered":"2024-05-15T18:09:19.404325+0000","last_clean":"2024-05-15T18:09:19.404325+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:09:19.404325+0000","last_undegraded":"2024-05-15T18:09:19.404325+0000","last_fullsized":"2024-05-15T18:09:19.404325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:33:34.798074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399868+0000","last_change":"2024-05-15T18:08:41.192405+0000","last_active":"2024-05-15T18:09:19.399868+0000","last_peered":"2024-05-15T18:09:19.399868+0000","last_clean":"2024-05-15T18:09:19.399868+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:09:19.399868+0000","last_undegraded":"2024-05-15T18:09:19.399868+0000","last_fullsized":"2024-05-15T18:09:19.399868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:14.835496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393153+0000","last_change":"2024-05-15T18:08:43.199434+0000","last_active":"2024-05-15T18:10:48.393153+0000","last_peered":"2024-05-15T18:10:48.393153+0000","last_clean":"2024-05-15T18:10:48.393153+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:10:48.393153+0000","last_undegraded":"2024-05-15T18:10:48.393153+0000","last_fullsized":"2024-05-15T18:10:48.393153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:57.566833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6026,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399270+0000","last_change":"2024-05-15T18:08:45.201179+0000","last_active":"2024-05-15T18:09:19.399270+0000","last_peered":"2024-05-15T18:09:19.399270+0000","last_clean":"2024-05-15T18:09:19.399270+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:09:19.399270+0000","last_undegraded":"2024-05-15T18:09:19.399270+0000","last_fullsized":"2024-05-15T18:09:19.399270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408019+0000","last_change":"2024-05-15T18:08:47.209997+0000","last_active":"2024-05-15T18:09:19.408019+0000","last_peered":"2024-05-15T18:09:19.408019+0000","last_clean":"2024-05-15T18:09:19.408019+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:09:19.408019+0000","last_undegraded":"2024-05-15T18:09:19.408019+0000","last_fullsized":"2024-05-15T18:09:19.408019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:11.856816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.897494+0000","last_change":"2024-05-15T18:08:47.219593+0000","last_active":"2024-05-15T18:11:46.897494+0000","last_peered":"2024-05-15T18:11:46.897494+0000","last_clean":"2024-05-15T18:11:46.897494+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:11:46.897494+0000","last_undegraded":"2024-05-15T18:11:46.897494+0000","last_fullsized":"2024-05-15T18:11:46.897494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:20.857650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820271+0000","last_change":"2024-05-15T18:08:39.185432+0000","last_active":"2024-05-15T18:09:20.820271+0000","last_peered":"2024-05-15T18:09:20.820271+0000","last_clean":"2024-05-15T18:09:20.820271+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:09:20.820271+0000","last_undegraded":"2024-05-15T18:09:20.820271+0000","last_fullsized":"2024-05-15T18:09:20.820271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399246+0000","last_change":"2024-05-15T18:08:37.185935+0000","last_active":"2024-05-15T18:09:19.399246+0000","last_peered":"2024-05-15T18:09:19.399246+0000","last_clean":"2024-05-15T18:09:19.399246+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:09:19.399246+0000","last_undegraded":"2024-05-15T18:09:19.399246+0000","last_fullsized":"2024-05-15T18:09:19.399246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:44.983084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407349+0000","last_change":"2024-05-15T18:09:19.404553+0000","last_active":"2024-05-15T18:09:19.407349+0000","last_peered":"2024-05-15T18:09:19.407349+0000","last_clean":"2024-05-15T18:09:19.407349+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:09:19.407349+0000","last_undegraded":"2024-05-15T18:09:19.407349+0000","last_fullsized":"2024-05-15T18:09:19.407349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:02.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.996245+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:44.996245+0000","last_peered":"2024-05-15T18:10:44.996245+0000","last_clean":"2024-05-15T18:10:44.996245+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:10:44.996245+0000","last_undegraded":"2024-05-15T18:10:44.996245+0000","last_fullsized":"2024-05-15T18:10:44.996245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:50.124485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399714+0000","last_change":"2024-05-15T18:08:45.208742+0000","last_active":"2024-05-15T18:09:19.399714+0000","last_peered":"2024-05-15T18:09:19.399714+0000","last_clean":"2024-05-15T18:09:19.399714+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:09:19.399714+0000","last_undegraded":"2024-05-15T18:09:19.399714+0000","last_fullsized":"2024-05-15T18:09:19.399714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:53:19.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.822180+0000","last_change":"2024-05-15T18:08:47.216635+0000","last_active":"2024-05-15T18:11:46.822180+0000","last_peered":"2024-05-15T18:11:46.822180+0000","last_clean":"2024-05-15T18:11:46.822180+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:11:46.822180+0000","last_undegraded":"2024-05-15T18:11:46.822180+0000","last_fullsized":"2024-05-15T18:11:46.822180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114135+0000","last_change":"2024-05-15T18:08:39.192773+0000","last_active":"2024-05-15T18:11:47.114135+0000","last_peered":"2024-05-15T18:11:47.114135+0000","last_clean":"2024-05-15T18:11:47.114135+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:11:47.114135+0000","last_undegraded":"2024-05-15T18:11:47.114135+0000","last_fullsized":"2024-05-15T18:11:47.114135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395528+0000","last_change":"2024-05-15T18:08:37.178179+0000","last_active":"2024-05-15T18:11:03.395528+0000","last_peered":"2024-05-15T18:11:03.395528+0000","last_clean":"2024-05-15T18:11:03.395528+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:11:03.395528+0000","last_undegraded":"2024-05-15T18:11:03.395528+0000","last_fullsized":"2024-05-15T18:11:03.395528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400105+0000","last_change":"2024-05-15T18:08:41.192415+0000","last_active":"2024-05-15T18:09:19.400105+0000","last_peered":"2024-05-15T18:09:19.400105+0000","last_clean":"2024-05-15T18:09:19.400105+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:09:19.400105+0000","last_undegraded":"2024-05-15T18:09:19.400105+0000","last_fullsized":"2024-05-15T18:09:19.400105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:26.664611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'5","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.431632+0000","last_change":"2024-05-15T18:08:43.195098+0000","last_active":"2024-05-15T18:11:46.431632+0000","last_peered":"2024-05-15T18:11:46.431632+0000","last_clean":"2024-05-15T18:11:46.431632+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:11:46.431632+0000","last_undegraded":"2024-05-15T18:11:46.431632+0000","last_fullsized":"2024-05-15T18:11:46.431632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:56.349586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405485+0000","last_change":"2024-05-15T18:08:45.208464+0000","last_active":"2024-05-15T18:09:19.405485+0000","last_peered":"2024-05-15T18:09:19.405485+0000","last_clean":"2024-05-15T18:09:19.405485+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:09:19.405485+0000","last_undegraded":"2024-05-15T18:09:19.405485+0000","last_fullsized":"2024-05-15T18:09:19.405485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:55.283378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.083949+0000","last_change":"2024-05-15T18:08:47.209757+0000","last_active":"2024-05-15T18:09:20.083949+0000","last_peered":"2024-05-15T18:09:20.083949+0000","last_clean":"2024-05-15T18:09:20.083949+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:09:20.083949+0000","last_undegraded":"2024-05-15T18:09:20.083949+0000","last_fullsized":"2024-05-15T18:09:20.083949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901409+0000","last_change":"2024-05-15T18:08:39.182386+0000","last_active":"2024-05-15T18:11:46.901409+0000","last_peered":"2024-05-15T18:11:46.901409+0000","last_clean":"2024-05-15T18:11:46.901409+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:11:46.901409+0000","last_undegraded":"2024-05-15T18:11:46.901409+0000","last_fullsized":"2024-05-15T18:11:46.901409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408230+0000","last_change":"2024-05-15T18:08:37.176233+0000","last_active":"2024-05-15T18:09:19.408230+0000","last_peered":"2024-05-15T18:09:19.408230+0000","last_clean":"2024-05-15T18:09:19.408230+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:09:19.408230+0000","last_undegraded":"2024-05-15T18:09:19.408230+0000","last_fullsized":"2024-05-15T18:09:19.408230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405491+0000","last_change":"2024-05-15T18:08:41.196522+0000","last_active":"2024-05-15T18:09:19.405491+0000","last_peered":"2024-05-15T18:09:19.405491+0000","last_clean":"2024-05-15T18:09:19.405491+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:09:19.405491+0000","last_undegraded":"2024-05-15T18:09:19.405491+0000","last_fullsized":"2024-05-15T18:09:19.405491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:21.511313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'41","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.038128+0000","last_change":"2024-05-15T18:08:43.192531+0000","last_active":"2024-05-15T18:11:47.038128+0000","last_peered":"2024-05-15T18:11:47.038128+0000","last_clean":"2024-05-15T18:11:47.038128+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:11:47.038128+0000","last_undegraded":"2024-05-15T18:11:47.038128+0000","last_fullsized":"2024-05-15T18:11:47.038128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:53.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399776+0000","last_change":"2024-05-15T18:08:45.200867+0000","last_active":"2024-05-15T18:09:19.399776+0000","last_peered":"2024-05-15T18:09:19.399776+0000","last_clean":"2024-05-15T18:09:19.399776+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:09:19.399776+0000","last_undegraded":"2024-05-15T18:09:19.399776+0000","last_fullsized":"2024-05-15T18:09:19.399776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398845+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:09:19.398845+0000","last_peered":"2024-05-15T18:09:19.398845+0000","last_clean":"2024-05-15T18:09:19.398845+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:09:19.398845+0000","last_undegraded":"2024-05-15T18:09:19.398845+0000","last_fullsized":"2024-05-15T18:09:19.398845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:58:53.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318729+0000","last_change":"2024-05-15T18:08:39.188917+0000","last_active":"2024-05-15T18:10:43.318729+0000","last_peered":"2024-05-15T18:10:43.318729+0000","last_clean":"2024-05-15T18:10:43.318729+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:10:43.318729+0000","last_undegraded":"2024-05-15T18:10:43.318729+0000","last_fullsized":"2024-05-15T18:10:43.318729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:15.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402731+0000","last_change":"2024-05-15T18:08:37.176555+0000","last_active":"2024-05-15T18:09:19.402731+0000","last_peered":"2024-05-15T18:09:19.402731+0000","last_clean":"2024-05-15T18:09:19.402731+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:09:19.402731+0000","last_undegraded":"2024-05-15T18:09:19.402731+0000","last_fullsized":"2024-05-15T18:09:19.402731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400688+0000","last_change":"2024-05-15T18:08:41.191236+0000","last_active":"2024-05-15T18:09:19.400688+0000","last_peered":"2024-05-15T18:09:19.400688+0000","last_clean":"2024-05-15T18:09:19.400688+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:09:19.400688+0000","last_undegraded":"2024-05-15T18:09:19.400688+0000","last_fullsized":"2024-05-15T18:09:19.400688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:09.434305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395415+0000","last_change":"2024-05-15T18:08:43.194399+0000","last_active":"2024-05-15T18:11:03.395415+0000","last_peered":"2024-05-15T18:11:03.395415+0000","last_clean":"2024-05-15T18:11:03.395415+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:11:03.395415+0000","last_undegraded":"2024-05-15T18:11:03.395415+0000","last_fullsized":"2024-05-15T18:11:03.395415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:44.292771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408147+0000","last_change":"2024-05-15T18:08:45.204060+0000","last_active":"2024-05-15T18:09:19.408147+0000","last_peered":"2024-05-15T18:09:19.408147+0000","last_clean":"2024-05-15T18:09:19.408147+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:09:19.408147+0000","last_undegraded":"2024-05-15T18:09:19.408147+0000","last_fullsized":"2024-05-15T18:09:19.408147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:35.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075577+0000","last_change":"2024-05-15T18:08:39.186233+0000","last_active":"2024-05-15T18:11:47.075577+0000","last_peered":"2024-05-15T18:11:47.075577+0000","last_clean":"2024-05-15T18:11:47.075577+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:11:47.075577+0000","last_undegraded":"2024-05-15T18:11:47.075577+0000","last_fullsized":"2024-05-15T18:11:47.075577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:29.111289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398303+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:09:19.398303+0000","last_peered":"2024-05-15T18:09:19.398303+0000","last_clean":"2024-05-15T18:09:19.398303+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:09:19.398303+0000","last_undegraded":"2024-05-15T18:09:19.398303+0000","last_fullsized":"2024-05-15T18:09:19.398303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:52.211486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401191+0000","last_change":"2024-05-15T18:08:41.191159+0000","last_active":"2024-05-15T18:09:19.401191+0000","last_peered":"2024-05-15T18:09:19.401191+0000","last_clean":"2024-05-15T18:09:19.401191+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:09:19.401191+0000","last_undegraded":"2024-05-15T18:09:19.401191+0000","last_fullsized":"2024-05-15T18:09:19.401191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:59.022200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'54","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.002204+0000","last_change":"2024-05-15T18:08:43.194657+0000","last_active":"2024-05-15T18:10:45.002204+0000","last_peered":"2024-05-15T18:10:45.002204+0000","last_clean":"2024-05-15T18:10:45.002204+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:10:45.002204+0000","last_undegraded":"2024-05-15T18:10:45.002204+0000","last_fullsized":"2024-05-15T18:10:45.002204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:48.735514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407819+0000","last_change":"2024-05-15T18:08:45.205356+0000","last_active":"2024-05-15T18:09:19.407819+0000","last_peered":"2024-05-15T18:09:19.407819+0000","last_clean":"2024-05-15T18:09:19.407819+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:09:19.407819+0000","last_undegraded":"2024-05-15T18:09:19.407819+0000","last_fullsized":"2024-05-15T18:09:19.407819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:39:01.866675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.346448+0000","last_change":"2024-05-15T18:08:47.215443+0000","last_active":"2024-05-15T18:10:46.346448+0000","last_peered":"2024-05-15T18:10:46.346448+0000","last_clean":"2024-05-15T18:10:46.346448+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:10:46.346448+0000","last_undegraded":"2024-05-15T18:10:46.346448+0000","last_fullsized":"2024-05-15T18:10:46.346448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:49:38.789697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353058+0000","last_change":"2024-05-15T18:08:39.186914+0000","last_active":"2024-05-15T18:09:20.353058+0000","last_peered":"2024-05-15T18:09:20.353058+0000","last_clean":"2024-05-15T18:09:20.353058+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:09:20.353058+0000","last_undegraded":"2024-05-15T18:09:20.353058+0000","last_fullsized":"2024-05-15T18:09:20.353058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407422+0000","last_change":"2024-05-15T18:09:19.405624+0000","last_active":"2024-05-15T18:09:19.407422+0000","last_peered":"2024-05-15T18:09:19.407422+0000","last_clean":"2024-05-15T18:09:19.407422+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:09:19.407422+0000","last_undegraded":"2024-05-15T18:09:19.407422+0000","last_fullsized":"2024-05-15T18:09:19.407422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:48.812098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407740+0000","last_change":"2024-05-15T18:08:41.191786+0000","last_active":"2024-05-15T18:09:19.407740+0000","last_peered":"2024-05-15T18:09:19.407740+0000","last_clean":"2024-05-15T18:09:19.407740+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:09:19.407740+0000","last_undegraded":"2024-05-15T18:09:19.407740+0000","last_fullsized":"2024-05-15T18:09:19.407740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:36.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397808+0000","last_change":"2024-05-15T18:08:43.204941+0000","last_active":"2024-05-15T18:11:13.397808+0000","last_peered":"2024-05-15T18:11:13.397808+0000","last_clean":"2024-05-15T18:11:13.397808+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:11:13.397808+0000","last_undegraded":"2024-05-15T18:11:13.397808+0000","last_fullsized":"2024-05-15T18:11:13.397808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:18:25.567210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403966+0000","last_change":"2024-05-15T18:08:45.208563+0000","last_active":"2024-05-15T18:09:19.403966+0000","last_peered":"2024-05-15T18:09:19.403966+0000","last_clean":"2024-05-15T18:09:19.403966+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:09:19.403966+0000","last_undegraded":"2024-05-15T18:09:19.403966+0000","last_fullsized":"2024-05-15T18:09:19.403966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398176+0000","last_change":"2024-05-15T18:08:47.218586+0000","last_active":"2024-05-15T18:09:19.398176+0000","last_peered":"2024-05-15T18:09:19.398176+0000","last_clean":"2024-05-15T18:09:19.398176+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:09:19.398176+0000","last_undegraded":"2024-05-15T18:09:19.398176+0000","last_fullsized":"2024-05-15T18:09:19.398176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:32:15.970197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.320156+0000","last_change":"2024-05-15T18:08:39.191981+0000","last_active":"2024-05-15T18:10:43.320156+0000","last_peered":"2024-05-15T18:10:43.320156+0000","last_clean":"2024-05-15T18:10:43.320156+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:10:43.320156+0000","last_undegraded":"2024-05-15T18:10:43.320156+0000","last_fullsized":"2024-05-15T18:10:43.320156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:58.705649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.020626+0000","last_change":"2024-05-15T18:08:37.175536+0000","last_active":"2024-05-15T18:11:47.020626+0000","last_peered":"2024-05-15T18:11:47.020626+0000","last_clean":"2024-05-15T18:11:47.020626+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:11:47.020626+0000","last_undegraded":"2024-05-15T18:11:47.020626+0000","last_fullsized":"2024-05-15T18:11:47.020626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406884+0000","last_change":"2024-05-15T18:08:41.191062+0000","last_active":"2024-05-15T18:09:19.406884+0000","last_peered":"2024-05-15T18:09:19.406884+0000","last_clean":"2024-05-15T18:09:19.406884+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:09:19.406884+0000","last_undegraded":"2024-05-15T18:09:19.406884+0000","last_fullsized":"2024-05-15T18:09:19.406884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:24.557536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.000210+0000","last_change":"2024-05-15T18:08:43.201223+0000","last_active":"2024-05-15T18:10:45.000210+0000","last_peered":"2024-05-15T18:10:45.000210+0000","last_clean":"2024-05-15T18:10:45.000210+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:10:45.000210+0000","last_undegraded":"2024-05-15T18:10:45.000210+0000","last_fullsized":"2024-05-15T18:10:45.000210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:42.755582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400126+0000","last_change":"2024-05-15T18:08:45.198201+0000","last_active":"2024-05-15T18:09:19.400126+0000","last_peered":"2024-05-15T18:09:19.400126+0000","last_clean":"2024-05-15T18:09:19.400126+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:09:19.400126+0000","last_undegraded":"2024-05-15T18:09:19.400126+0000","last_fullsized":"2024-05-15T18:09:19.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:29.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.407284+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:10:46.407284+0000","last_peered":"2024-05-15T18:10:46.407284+0000","last_clean":"2024-05-15T18:10:46.407284+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:10:46.407284+0000","last_undegraded":"2024-05-15T18:10:46.407284+0000","last_fullsized":"2024-05-15T18:10:46.407284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:05.039222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'5","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111277+0000","last_change":"2024-05-15T18:08:39.184374+0000","last_active":"2024-05-15T18:11:47.111277+0000","last_peered":"2024-05-15T18:11:47.111277+0000","last_clean":"2024-05-15T18:11:47.111277+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:11:47.111277+0000","last_undegraded":"2024-05-15T18:11:47.111277+0000","last_fullsized":"2024-05-15T18:11:47.111277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.023254+0000","last_change":"2024-05-15T18:08:37.183470+0000","last_active":"2024-05-15T18:11:47.023254+0000","last_peered":"2024-05-15T18:11:47.023254+0000","last_clean":"2024-05-15T18:11:47.023254+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:11:47.023254+0000","last_undegraded":"2024-05-15T18:11:47.023254+0000","last_fullsized":"2024-05-15T18:11:47.023254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:28:26.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403818+0000","last_change":"2024-05-15T18:08:41.190070+0000","last_active":"2024-05-15T18:09:19.403818+0000","last_peered":"2024-05-15T18:09:19.403818+0000","last_clean":"2024-05-15T18:09:19.403818+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:09:19.403818+0000","last_undegraded":"2024-05-15T18:09:19.403818+0000","last_fullsized":"2024-05-15T18:09:19.403818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:17.766305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.737811+0000","last_change":"2024-05-15T18:08:43.205310+0000","last_active":"2024-05-15T18:09:19.737811+0000","last_peered":"2024-05-15T18:09:19.737811+0000","last_clean":"2024-05-15T18:09:19.737811+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:09:19.737811+0000","last_undegraded":"2024-05-15T18:09:19.737811+0000","last_fullsized":"2024-05-15T18:09:19.737811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:56.886685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.219182+0000","last_change":"2024-05-15T18:08:45.207348+0000","last_active":"2024-05-15T18:11:47.219182+0000","last_peered":"2024-05-15T18:11:47.219182+0000","last_clean":"2024-05-15T18:11:47.219182+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:11:47.219182+0000","last_undegraded":"2024-05-15T18:11:47.219182+0000","last_fullsized":"2024-05-15T18:11:47.219182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:58.021047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.397876+0000","last_change":"2024-05-15T18:08:47.219182+0000","last_active":"2024-05-15T18:09:19.397876+0000","last_peered":"2024-05-15T18:09:19.397876+0000","last_clean":"2024-05-15T18:09:19.397876+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:09:19.397876+0000","last_undegraded":"2024-05-15T18:09:19.397876+0000","last_fullsized":"2024-05-15T18:09:19.397876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:01.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817578+0000","last_change":"2024-05-15T18:08:39.180759+0000","last_active":"2024-05-15T18:09:20.817578+0000","last_peered":"2024-05-15T18:09:20.817578+0000","last_clean":"2024-05-15T18:09:20.817578+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:09:20.817578+0000","last_undegraded":"2024-05-15T18:09:20.817578+0000","last_fullsized":"2024-05-15T18:09:20.817578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403310+0000","last_change":"2024-05-15T18:08:37.176826+0000","last_active":"2024-05-15T18:09:19.403310+0000","last_peered":"2024-05-15T18:09:19.403310+0000","last_clean":"2024-05-15T18:09:19.403310+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:09:19.403310+0000","last_undegraded":"2024-05-15T18:09:19.403310+0000","last_fullsized":"2024-05-15T18:09:19.403310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401017+0000","last_change":"2024-05-15T18:08:41.192691+0000","last_active":"2024-05-15T18:09:19.401017+0000","last_peered":"2024-05-15T18:09:19.401017+0000","last_clean":"2024-05-15T18:09:19.401017+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:09:19.401017+0000","last_undegraded":"2024-05-15T18:09:19.401017+0000","last_fullsized":"2024-05-15T18:09:19.401017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:17.409123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.973083+0000","last_change":"2024-05-15T18:08:43.191489+0000","last_active":"2024-05-15T18:10:44.973083+0000","last_peered":"2024-05-15T18:10:44.973083+0000","last_clean":"2024-05-15T18:10:44.973083+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:10:44.973083+0000","last_undegraded":"2024-05-15T18:10:44.973083+0000","last_fullsized":"2024-05-15T18:10:44.973083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:58.528171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398467+0000","last_change":"2024-05-15T18:08:45.204577+0000","last_active":"2024-05-15T18:09:19.398467+0000","last_peered":"2024-05-15T18:09:19.398467+0000","last_clean":"2024-05-15T18:09:19.398467+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:09:19.398467+0000","last_undegraded":"2024-05-15T18:09:19.398467+0000","last_fullsized":"2024-05-15T18:09:19.398467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:43.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.511708+0000","last_change":"2024-05-15T18:08:47.217145+0000","last_active":"2024-05-15T18:11:46.511708+0000","last_peered":"2024-05-15T18:11:46.511708+0000","last_clean":"2024-05-15T18:11:46.511708+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:11:46.511708+0000","last_undegraded":"2024-05-15T18:11:46.511708+0000","last_fullsized":"2024-05-15T18:11:46.511708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841386+0000","last_change":"2024-05-15T18:08:39.180684+0000","last_active":"2024-05-15T18:10:02.841386+0000","last_peered":"2024-05-15T18:10:02.841386+0000","last_clean":"2024-05-15T18:10:02.841386+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:10:02.841386+0000","last_undegraded":"2024-05-15T18:10:02.841386+0000","last_fullsized":"2024-05-15T18:10:02.841386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:21.423233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401981+0000","last_change":"2024-05-15T18:08:37.185723+0000","last_active":"2024-05-15T18:09:19.401981+0000","last_peered":"2024-05-15T18:09:19.401981+0000","last_clean":"2024-05-15T18:09:19.401981+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:09:19.401981+0000","last_undegraded":"2024-05-15T18:09:19.401981+0000","last_fullsized":"2024-05-15T18:09:19.401981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:33.641924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408093+0000","last_change":"2024-05-15T18:08:41.194992+0000","last_active":"2024-05-15T18:09:19.408093+0000","last_peered":"2024-05-15T18:09:19.408093+0000","last_clean":"2024-05-15T18:09:19.408093+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:09:19.408093+0000","last_undegraded":"2024-05-15T18:09:19.408093+0000","last_fullsized":"2024-05-15T18:09:19.408093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:46.750498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.973981+0000","last_change":"2024-05-15T18:08:43.200599+0000","last_active":"2024-05-15T18:10:44.973981+0000","last_peered":"2024-05-15T18:10:44.973981+0000","last_clean":"2024-05-15T18:10:44.973981+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:10:44.973981+0000","last_undegraded":"2024-05-15T18:10:44.973981+0000","last_fullsized":"2024-05-15T18:10:44.973981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:22:01.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398116+0000","last_change":"2024-05-15T18:08:45.208564+0000","last_active":"2024-05-15T18:09:19.398116+0000","last_peered":"2024-05-15T18:09:19.398116+0000","last_clean":"2024-05-15T18:09:19.398116+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:09:19.398116+0000","last_undegraded":"2024-05-15T18:09:19.398116+0000","last_fullsized":"2024-05-15T18:09:19.398116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:04.792785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399101+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:09:19.399101+0000","last_peered":"2024-05-15T18:09:19.399101+0000","last_clean":"2024-05-15T18:09:19.399101+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:09:19.399101+0000","last_undegraded":"2024-05-15T18:09:19.399101+0000","last_fullsized":"2024-05-15T18:09:19.399101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:18.365146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.799158+0000","last_change":"2024-05-15T18:08:39.181861+0000","last_active":"2024-05-15T18:11:46.799158+0000","last_peered":"2024-05-15T18:11:46.799158+0000","last_clean":"2024-05-15T18:11:46.799158+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:11:46.799158+0000","last_undegraded":"2024-05-15T18:11:46.799158+0000","last_fullsized":"2024-05-15T18:11:46.799158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:44.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400551+0000","last_change":"2024-05-15T18:08:37.180611+0000","last_active":"2024-05-15T18:09:19.400551+0000","last_peered":"2024-05-15T18:09:19.400551+0000","last_clean":"2024-05-15T18:09:19.400551+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:09:19.400551+0000","last_undegraded":"2024-05-15T18:09:19.400551+0000","last_fullsized":"2024-05-15T18:09:19.400551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:10.580802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400217+0000","last_change":"2024-05-15T18:08:41.195751+0000","last_active":"2024-05-15T18:09:19.400217+0000","last_peered":"2024-05-15T18:09:19.400217+0000","last_clean":"2024-05-15T18:09:19.400217+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:09:19.400217+0000","last_undegraded":"2024-05-15T18:09:19.400217+0000","last_fullsized":"2024-05-15T18:09:19.400217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:46.842509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997990+0000","last_change":"2024-05-15T18:08:43.205423+0000","last_active":"2024-05-15T18:10:44.997990+0000","last_peered":"2024-05-15T18:10:44.997990+0000","last_clean":"2024-05-15T18:10:44.997990+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:10:44.997990+0000","last_undegraded":"2024-05-15T18:10:44.997990+0000","last_fullsized":"2024-05-15T18:10:44.997990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:00:28.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398390+0000","last_change":"2024-05-15T18:08:45.208319+0000","last_active":"2024-05-15T18:09:19.398390+0000","last_peered":"2024-05-15T18:09:19.398390+0000","last_clean":"2024-05-15T18:09:19.398390+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:09:19.398390+0000","last_undegraded":"2024-05-15T18:09:19.398390+0000","last_fullsized":"2024-05-15T18:09:19.398390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:07.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.008319+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:10:45.008319+0000","last_peered":"2024-05-15T18:10:45.008319+0000","last_clean":"2024-05-15T18:10:45.008319+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:10:45.008319+0000","last_undegraded":"2024-05-15T18:10:45.008319+0000","last_fullsized":"2024-05-15T18:10:45.008319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:41:14.101874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318342+0000","last_change":"2024-05-15T18:08:39.182951+0000","last_active":"2024-05-15T18:10:43.318342+0000","last_peered":"2024-05-15T18:10:43.318342+0000","last_clean":"2024-05-15T18:10:43.318342+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:10:43.318342+0000","last_undegraded":"2024-05-15T18:10:43.318342+0000","last_fullsized":"2024-05-15T18:10:43.318342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:28.725507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.361686+0000","last_change":"2024-05-15T18:08:37.173604+0000","last_active":"2024-05-15T18:10:46.361686+0000","last_peered":"2024-05-15T18:10:46.361686+0000","last_clean":"2024-05-15T18:10:46.361686+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:10:46.361686+0000","last_undegraded":"2024-05-15T18:10:46.361686+0000","last_fullsized":"2024-05-15T18:10:46.361686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.690398+0000","last_change":"2024-05-15T18:08:41.194807+0000","last_active":"2024-05-15T18:10:43.690398+0000","last_peered":"2024-05-15T18:10:43.690398+0000","last_clean":"2024-05-15T18:10:43.690398+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:10:43.690398+0000","last_undegraded":"2024-05-15T18:10:43.690398+0000","last_fullsized":"2024-05-15T18:10:43.690398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:20.276747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.432549+0000","last_change":"2024-05-15T18:08:43.204827+0000","last_active":"2024-05-15T18:11:46.432549+0000","last_peered":"2024-05-15T18:11:46.432549+0000","last_clean":"2024-05-15T18:11:46.432549+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:11:46.432549+0000","last_undegraded":"2024-05-15T18:11:46.432549+0000","last_fullsized":"2024-05-15T18:11:46.432549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:25:58.418358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399211+0000","last_change":"2024-05-15T18:08:45.209586+0000","last_active":"2024-05-15T18:09:19.399211+0000","last_peered":"2024-05-15T18:09:19.399211+0000","last_clean":"2024-05-15T18:09:19.399211+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:09:19.399211+0000","last_undegraded":"2024-05-15T18:09:19.399211+0000","last_fullsized":"2024-05-15T18:09:19.399211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.011056+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:10:45.011056+0000","last_peered":"2024-05-15T18:10:45.011056+0000","last_clean":"2024-05-15T18:10:45.011056+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:10:45.011056+0000","last_undegraded":"2024-05-15T18:10:45.011056+0000","last_fullsized":"2024-05-15T18:10:45.011056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:34:17.179772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101917+0000","last_change":"2024-05-15T18:08:39.193212+0000","last_active":"2024-05-15T18:11:47.101917+0000","last_peered":"2024-05-15T18:11:47.101917+0000","last_clean":"2024-05-15T18:11:47.101917+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:11:47.101917+0000","last_undegraded":"2024-05-15T18:11:47.101917+0000","last_fullsized":"2024-05-15T18:11:47.101917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:55:36.876278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392439+0000","last_change":"2024-05-15T18:08:37.175025+0000","last_active":"2024-05-15T18:10:43.392439+0000","last_peered":"2024-05-15T18:10:43.392439+0000","last_clean":"2024-05-15T18:10:43.392439+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:10:43.392439+0000","last_undegraded":"2024-05-15T18:10:43.392439+0000","last_fullsized":"2024-05-15T18:10:43.392439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:37:08.990281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":13,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894085+0000","last_change":"2024-05-15T18:08:39.182556+0000","last_active":"2024-05-15T18:11:46.894085+0000","last_peered":"2024-05-15T18:11:46.894085+0000","last_clean":"2024-05-15T18:11:46.894085+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:11:46.894085+0000","last_undegraded":"2024-05-15T18:11:46.894085+0000","last_fullsized":"2024-05-15T18:11:46.894085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.097398+0000","last_change":"2024-05-15T18:08:37.174455+0000","last_active":"2024-05-15T18:11:47.097398+0000","last_peered":"2024-05-15T18:11:47.097398+0000","last_clean":"2024-05-15T18:11:47.097398+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:11:47.097398+0000","last_undegraded":"2024-05-15T18:11:47.097398+0000","last_fullsized":"2024-05-15T18:11:47.097398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736540+0000","last_change":"2024-05-15T18:08:39.182083+0000","last_active":"2024-05-15T18:09:19.736540+0000","last_peered":"2024-05-15T18:09:19.736540+0000","last_clean":"2024-05-15T18:09:19.736540+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:09:19.736540+0000","last_undegraded":"2024-05-15T18:09:19.736540+0000","last_fullsized":"2024-05-15T18:09:19.736540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:51.998451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399083+0000","last_change":"2024-05-15T18:08:37.180276+0000","last_active":"2024-05-15T18:09:19.399083+0000","last_peered":"2024-05-15T18:09:19.399083+0000","last_clean":"2024-05-15T18:09:19.399083+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:09:19.399083+0000","last_undegraded":"2024-05-15T18:09:19.399083+0000","last_fullsized":"2024-05-15T18:09:19.399083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:42.498474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036744+0000","last_change":"2024-05-15T18:08:39.183629+0000","last_active":"2024-05-15T18:11:47.036744+0000","last_peered":"2024-05-15T18:11:47.036744+0000","last_clean":"2024-05-15T18:11:47.036744+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:11:47.036744+0000","last_undegraded":"2024-05-15T18:11:47.036744+0000","last_fullsized":"2024-05-15T18:11:47.036744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388608+0000","last_change":"2024-05-15T18:08:37.180039+0000","last_active":"2024-05-15T18:10:44.388608+0000","last_peered":"2024-05-15T18:10:44.388608+0000","last_clean":"2024-05-15T18:10:44.388608+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:10:44.388608+0000","last_undegraded":"2024-05-15T18:10:44.388608+0000","last_fullsized":"2024-05-15T18:10:44.388608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081223+0000","last_change":"2024-05-15T18:08:39.183461+0000","last_active":"2024-05-15T18:11:47.081223+0000","last_peered":"2024-05-15T18:11:47.081223+0000","last_clean":"2024-05-15T18:11:47.081223+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:11:47.081223+0000","last_undegraded":"2024-05-15T18:11:47.081223+0000","last_fullsized":"2024-05-15T18:11:47.081223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.017699+0000","last_change":"2024-05-15T18:08:37.173194+0000","last_active":"2024-05-15T18:11:47.017699+0000","last_peered":"2024-05-15T18:11:47.017699+0000","last_clean":"2024-05-15T18:11:47.017699+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:47.017699+0000","last_undegraded":"2024-05-15T18:11:47.017699+0000","last_fullsized":"2024-05-15T18:11:47.017699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392566+0000","last_change":"2024-05-15T18:08:39.193040+0000","last_active":"2024-05-15T18:10:43.392566+0000","last_peered":"2024-05-15T18:10:43.392566+0000","last_clean":"2024-05-15T18:10:43.392566+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:10:43.392566+0000","last_undegraded":"2024-05-15T18:10:43.392566+0000","last_fullsized":"2024-05-15T18:10:43.392566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393392+0000","last_change":"2024-05-15T18:08:37.177086+0000","last_active":"2024-05-15T18:10:48.393392+0000","last_peered":"2024-05-15T18:10:48.393392+0000","last_clean":"2024-05-15T18:10:48.393392+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:10:48.393392+0000","last_undegraded":"2024-05-15T18:10:48.393392+0000","last_fullsized":"2024-05-15T18:10:48.393392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081078+0000","last_change":"2024-05-15T18:08:39.187231+0000","last_active":"2024-05-15T18:11:47.081078+0000","last_peered":"2024-05-15T18:11:47.081078+0000","last_clean":"2024-05-15T18:11:47.081078+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:11:47.081078+0000","last_undegraded":"2024-05-15T18:11:47.081078+0000","last_fullsized":"2024-05-15T18:11:47.081078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408334+0000","last_change":"2024-05-15T18:08:37.185249+0000","last_active":"2024-05-15T18:09:19.408334+0000","last_peered":"2024-05-15T18:09:19.408334+0000","last_clean":"2024-05-15T18:09:19.408334+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:09:19.408334+0000","last_undegraded":"2024-05-15T18:09:19.408334+0000","last_fullsized":"2024-05-15T18:09:19.408334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841468+0000","last_change":"2024-05-15T18:08:39.182188+0000","last_active":"2024-05-15T18:10:02.841468+0000","last_peered":"2024-05-15T18:10:02.841468+0000","last_clean":"2024-05-15T18:10:02.841468+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:10:02.841468+0000","last_undegraded":"2024-05-15T18:10:02.841468+0000","last_fullsized":"2024-05-15T18:10:02.841468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401192+0000","last_change":"2024-05-15T18:08:37.173289+0000","last_active":"2024-05-15T18:09:19.401192+0000","last_peered":"2024-05-15T18:09:19.401192+0000","last_clean":"2024-05-15T18:09:19.401192+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:09:19.401192+0000","last_undegraded":"2024-05-15T18:09:19.401192+0000","last_fullsized":"2024-05-15T18:09:19.401192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:49:25.723441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027663+0000","last_change":"2024-05-15T18:08:39.185677+0000","last_active":"2024-05-15T18:11:47.027663+0000","last_peered":"2024-05-15T18:11:47.027663+0000","last_clean":"2024-05-15T18:11:47.027663+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:11:47.027663+0000","last_undegraded":"2024-05-15T18:11:47.027663+0000","last_fullsized":"2024-05-15T18:11:47.027663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:22:07.754341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393745+0000","last_change":"2024-05-15T18:08:37.174784+0000","last_active":"2024-05-15T18:10:48.393745+0000","last_peered":"2024-05-15T18:10:48.393745+0000","last_clean":"2024-05-15T18:10:48.393745+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:10:48.393745+0000","last_undegraded":"2024-05-15T18:10:48.393745+0000","last_fullsized":"2024-05-15T18:10:48.393745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:01.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.080429+0000","last_change":"2024-05-15T18:08:39.184051+0000","last_active":"2024-05-15T18:09:20.080429+0000","last_peered":"2024-05-15T18:09:20.080429+0000","last_clean":"2024-05-15T18:09:20.080429+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:09:20.080429+0000","last_undegraded":"2024-05-15T18:09:20.080429+0000","last_fullsized":"2024-05-15T18:09:20.080429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:52.335026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399053+0000","last_change":"2024-05-15T18:08:37.179943+0000","last_active":"2024-05-15T18:09:19.399053+0000","last_peered":"2024-05-15T18:09:19.399053+0000","last_clean":"2024-05-15T18:09:19.399053+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:09:19.399053+0000","last_undegraded":"2024-05-15T18:09:19.399053+0000","last_fullsized":"2024-05-15T18:09:19.399053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075510+0000","last_change":"2024-05-15T18:09:19.409291+0000","last_active":"2024-05-15T18:11:47.075510+0000","last_peered":"2024-05-15T18:11:47.075510+0000","last_clean":"2024-05-15T18:11:47.075510+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:11:47.075510+0000","last_undegraded":"2024-05-15T18:11:47.075510+0000","last_fullsized":"2024-05-15T18:11:47.075510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399908+0000","last_change":"2024-05-15T18:08:37.180111+0000","last_active":"2024-05-15T18:09:19.399908+0000","last_peered":"2024-05-15T18:09:19.399908+0000","last_clean":"2024-05-15T18:09:19.399908+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:09:19.399908+0000","last_undegraded":"2024-05-15T18:09:19.399908+0000","last_fullsized":"2024-05-15T18:09:19.399908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075128+0000","last_change":"2024-05-15T18:08:39.180126+0000","last_active":"2024-05-15T18:11:47.075128+0000","last_peered":"2024-05-15T18:11:47.075128+0000","last_clean":"2024-05-15T18:11:47.075128+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:11:47.075128+0000","last_undegraded":"2024-05-15T18:11:47.075128+0000","last_fullsized":"2024-05-15T18:11:47.075128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:53.932569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402839+0000","last_change":"2024-05-15T18:08:37.178460+0000","last_active":"2024-05-15T18:09:19.402839+0000","last_peered":"2024-05-15T18:09:19.402839+0000","last_clean":"2024-05-15T18:09:19.402839+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:09:19.402839+0000","last_undegraded":"2024-05-15T18:09:19.402839+0000","last_fullsized":"2024-05-15T18:09:19.402839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'7","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901964+0000","last_change":"2024-05-15T18:08:39.193285+0000","last_active":"2024-05-15T18:11:46.901964+0000","last_peered":"2024-05-15T18:11:46.901964+0000","last_clean":"2024-05-15T18:11:46.901964+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:11:46.901964+0000","last_undegraded":"2024-05-15T18:11:46.901964+0000","last_fullsized":"2024-05-15T18:11:46.901964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.246822+0000","last_change":"2024-05-15T18:08:37.183430+0000","last_active":"2024-05-15T18:10:46.246822+0000","last_peered":"2024-05-15T18:10:46.246822+0000","last_clean":"2024-05-15T18:10:46.246822+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:10:46.246822+0000","last_undegraded":"2024-05-15T18:10:46.246822+0000","last_fullsized":"2024-05-15T18:10:46.246822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:16:22.035101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318832+0000","last_change":"2024-05-15T18:08:39.187902+0000","last_active":"2024-05-15T18:10:43.318832+0000","last_peered":"2024-05-15T18:10:43.318832+0000","last_clean":"2024-05-15T18:10:43.318832+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:10:43.318832+0000","last_undegraded":"2024-05-15T18:10:43.318832+0000","last_fullsized":"2024-05-15T18:10:43.318832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401767+0000","last_change":"2024-05-15T18:08:37.181882+0000","last_active":"2024-05-15T18:09:19.401767+0000","last_peered":"2024-05-15T18:09:19.401767+0000","last_clean":"2024-05-15T18:09:19.401767+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:09:19.401767+0000","last_undegraded":"2024-05-15T18:09:19.401767+0000","last_fullsized":"2024-05-15T18:09:19.401767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:01.779453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:39.188670+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:47.375138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408417+0000","last_change":"2024-05-15T18:08:37.179459+0000","last_active":"2024-05-15T18:09:19.408417+0000","last_peered":"2024-05-15T18:09:19.408417+0000","last_clean":"2024-05-15T18:09:19.408417+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:09:19.408417+0000","last_undegraded":"2024-05-15T18:09:19.408417+0000","last_fullsized":"2024-05-15T18:09:19.408417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075176+0000","last_change":"2024-05-15T18:08:39.178597+0000","last_active":"2024-05-15T18:11:47.075176+0000","last_peered":"2024-05-15T18:11:47.075176+0000","last_clean":"2024-05-15T18:11:47.075176+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:11:47.075176+0000","last_undegraded":"2024-05-15T18:11:47.075176+0000","last_fullsized":"2024-05-15T18:11:47.075176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.012658+0000","last_change":"2024-05-15T18:09:19.409578+0000","last_active":"2024-05-15T18:11:47.012658+0000","last_peered":"2024-05-15T18:11:47.012658+0000","last_clean":"2024-05-15T18:11:47.012658+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:11:47.012658+0000","last_undegraded":"2024-05-15T18:11:47.012658+0000","last_fullsized":"2024-05-15T18:11:47.012658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:50.864491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398577+0000","last_change":"2024-05-15T18:08:37.182059+0000","last_active":"2024-05-15T18:09:19.398577+0000","last_peered":"2024-05-15T18:09:19.398577+0000","last_clean":"2024-05-15T18:09:19.398577+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:09:19.398577+0000","last_undegraded":"2024-05-15T18:09:19.398577+0000","last_fullsized":"2024-05-15T18:09:19.398577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:38.781325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401588+0000","last_change":"2024-05-15T18:08:39.190238+0000","last_active":"2024-05-15T18:09:19.401588+0000","last_peered":"2024-05-15T18:09:19.401588+0000","last_clean":"2024-05-15T18:09:19.401588+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:09:19.401588+0000","last_undegraded":"2024-05-15T18:09:19.401588+0000","last_fullsized":"2024-05-15T18:09:19.401588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398913+0000","last_change":"2024-05-15T18:08:37.180082+0000","last_active":"2024-05-15T18:09:19.398913+0000","last_peered":"2024-05-15T18:09:19.398913+0000","last_clean":"2024-05-15T18:09:19.398913+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:09:19.398913+0000","last_undegraded":"2024-05-15T18:09:19.398913+0000","last_fullsized":"2024-05-15T18:09:19.398913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082913+0000","last_change":"2024-05-15T18:08:39.192652+0000","last_active":"2024-05-15T18:09:20.082913+0000","last_peered":"2024-05-15T18:09:20.082913+0000","last_clean":"2024-05-15T18:09:20.082913+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:09:20.082913+0000","last_undegraded":"2024-05-15T18:09:20.082913+0000","last_fullsized":"2024-05-15T18:09:20.082913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:22.550315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673007,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56288,"kb_used_data":16792,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315552,"statfs":{"total":96636764160,"available":96579125248,"internally_reserved":0,"allocated":17195008,"data_stored":16910200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48692,"kb_used_data":13356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323148,"statfs":{"total":96636764160,"available":96586903552,"internally_reserved":0,"allocated":13676544,"data_stored":13357679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52672,"kb_used_data":17336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319168,"statfs":{"total":96636764160,"available":96582828032,"internally_reserved":0,"allocated":17752064,"data_stored":17499215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41044,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330796,"statfs":{"total":96636764160,"available":96594735104,"internally_reserved":0,"allocated":5844992,"data_stored":5555704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:11:54.912 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T18:11:55.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.068+0000 7f1d271bd640 1 Processor -- start 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.068+0000 7f1d271bd640 1 -- start start 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d271bd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1d2012e460 0x7f1d20130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d271bd640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d20071020 con 0x7f1d20127ea0 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d271bd640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f1d20071780 con 0x7f1d2012e460 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d1ffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f1d2012e460 0x7f1d20130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d24f59640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f1d20127ea0 0x7f1d20128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60906/0 (socket says 172.21.15.3:60906) 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d24f59640 1 -- 172.21.15.3:0/1644530958 learned_addr learned my addr 172.21.15.3:0/1644530958 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d1ffff640 1 -- 172.21.15.3:0/1644530958 >> v1:172.21.15.3:6789/0 conn(0x7f1d20127ea0 legacy=0x7f1d20128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:55.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.069+0000 7f1d1ffff640 1 -- 172.21.15.3:0/1644530958 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2006e6e0 con 0x7f1d2012e460 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d1ffff640 1 --2- 172.21.15.3:0/1644530958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d2012e460 0x7f1d20130850 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009720 tx=0x7f1d1402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9544df5e64385179 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d1f7fe640 1 -- 172.21.15.3:0/1644530958 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d14035020 con 0x7f1d2012e460 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d1f7fe640 1 -- 172.21.15.3:0/1644530958 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14031760 con 0x7f1d2012e460 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d1f7fe640 1 -- 172.21.15.3:0/1644530958 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d14031a60 con 0x7f1d2012e460 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d271bd640 1 -- 172.21.15.3:0/1644530958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d2012e460 msgr2=0x7f1d20130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d271bd640 1 --2- 172.21.15.3:0/1644530958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d2012e460 0x7f1d20130850 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009720 tx=0x7f1d1402b8d0 comp rx=0 tx=0).stop 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d271bd640 1 -- 172.21.15.3:0/1644530958 shutdown_connections 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d271bd640 1 --2- 172.21.15.3:0/1644530958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d2012e460 0x7f1d20130850 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d271bd640 1 -- 172.21.15.3:0/1644530958 >> 172.21.15.3:0/1644530958 conn(0x7f1d20099380 msgr2=0x7f1d20099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:55.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.070+0000 7f1d271bd640 1 -- 172.21.15.3:0/1644530958 shutdown_connections 2024-05-15T18:11:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.071+0000 7f1d271bd640 1 -- 172.21.15.3:0/1644530958 wait complete. 2024-05-15T18:11:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.071+0000 7f1d271bd640 1 Processor -- start 2024-05-15T18:11:55.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.071+0000 7f1d271bd640 1 -- start start 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d271bd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d20127ea0 0x7f1d20113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d271bd640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1d200725d0 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d24f59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d20127ea0 0x7f1d20113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d24f59640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d20127ea0 0x7f1d20113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49288/0 (socket says 172.21.15.3:49288) 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d24f59640 1 -- 172.21.15.3:0/3867236115 learned_addr learned my addr 172.21.15.3:0/3867236115 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d24f59640 1 -- 172.21.15.3:0/3867236115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d20114640 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d24f59640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d20127ea0 0x7f1d20113060 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c4a0 tx=0x7f1d1000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d1d7fa640 1 -- 172.21.15.3:0/3867236115 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d10017070 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.072+0000 7f1d1d7fa640 1 -- 172.21.15.3:0/3867236115 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10005c10 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.073+0000 7f1d1d7fa640 1 -- 172.21.15.3:0/3867236115 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d10007070 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.073+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d20125110 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.073+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d20124960 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.073+0000 7f1d1d7fa640 1 -- 172.21.15.3:0/3867236115 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d1001a070 con 0x7f1d20127ea0 2024-05-15T18:11:55.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.074+0000 7f1d1d7fa640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1d0c038060 0x7f1d0c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.074+0000 7f1d1d7fa640 1 -- 172.21.15.3:0/3867236115 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f1d1004ab40 con 0x7f1d20127ea0 2024-05-15T18:11:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.074+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d20062e90 con 0x7f1d20127ea0 2024-05-15T18:11:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.074+0000 7f1d1ffff640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1d0c038060 0x7f1d0c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:55.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.074+0000 7f1d1ffff640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1d0c038060 0x7f1d0c03a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1d14036000 tx=0x7f1d14008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:55.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.078+0000 7f1d1d7fa640 1 -- 172.21.15.3:0/3867236115 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1d1001b3b0 con 0x7f1d20127ea0 2024-05-15T18:11:55.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.268+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d2006eae0 con 0x7f1d20127ea0 2024-05-15T18:11:55.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.270+0000 7f1d1d7fa640 1 -- 172.21.15.3:0/3867236115 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+21027 (secure 0 0 0) 0x7f1d10010300 con 0x7f1d20127ea0 2024-05-15T18:11:55.247 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:11:55.247 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":31,"fsid":"b091c162-becd-4424-b394-ddcc165a450a","created":"2024-05-15T18:08:14.002961+0000","modified":"2024-05-15T18:09:19.392401+0000","last_up_change":"2024-05-15T18:08:24.124486+0000","last_in_change":"2024-05-15T18:08:15.093157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T18:08:24.359980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-15T18:08:29.685679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-15T18:08:35.434061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-15T18:08:37.515786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-15T18:08:39.509121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-15T18:08:41.288744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-15T18:08:43.238530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-15T18:08:45.300485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5f954d51-bfea-4d84-8489-befad33377e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6801","nonce":774076599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6803","nonce":774076599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6807","nonce":774076599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":774076599},{"type":"v1","addr":"172.21.15.3:6805","nonce":774076599}]},"public_addr":"172.21.15.3:6801/774076599","cluster_addr":"172.21.15.3:6803/774076599","heartbeat_back_addr":"172.21.15.3:6807/774076599","heartbeat_front_addr":"172.21.15.3:6805/774076599","state":["exists","up"]},{"osd":1,"uuid":"1d016dab-93aa-42f0-a59a-63c894431afe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6801","nonce":3225970667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6803","nonce":3225970667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6807","nonce":3225970667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3225970667},{"type":"v1","addr":"172.21.15.173:6805","nonce":3225970667}]},"public_addr":"172.21.15.173:6801/3225970667","cluster_addr":"172.21.15.173:6803/3225970667","heartbeat_back_addr":"172.21.15.173:6807/3225970667","heartbeat_front_addr":"172.21.15.173:6805/3225970667","state":["exists","up"]},{"osd":2,"uuid":"81eea92a-95c4-47aa-b7fd-60c53281e661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6809","nonce":3098545592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6811","nonce":3098545592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6817","nonce":3098545592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3098545592},{"type":"v1","addr":"172.21.15.173:6813","nonce":3098545592}]},"public_addr":"172.21.15.173:6809/3098545592","cluster_addr":"172.21.15.173:6811/3098545592","heartbeat_back_addr":"172.21.15.173:6817/3098545592","heartbeat_front_addr":"172.21.15.173:6813/3098545592","state":["exists","up"]},{"osd":3,"uuid":"4499dec7-c48d-42fb-95a6-9f5e346fb4da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6816","nonce":3793320597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6819","nonce":3793320597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6823","nonce":3793320597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":3793320597},{"type":"v1","addr":"172.21.15.173:6821","nonce":3793320597}]},"public_addr":"172.21.15.173:6816/3793320597","cluster_addr":"172.21.15.173:6819/3793320597","heartbeat_back_addr":"172.21.15.173:6823/3793320597","heartbeat_front_addr":"172.21.15.173:6821/3793320597","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.180046+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.270013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.222912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T18:08:20.265860+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":0}]},{"pgid":"3.2f","mappings":[{"from":3,"to":1}]},{"pgid":"4.3","mappings":[{"from":3,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.2d","mappings":[{"from":3,"to":2}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.12","mappings":[{"from":0,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1d0c038060 msgr2=0x7f1d0c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1d0c038060 0x7f1d0c03a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1d14036000 tx=0x7f1d14008030 comp rx=0 tx=0).stop 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d20127ea0 msgr2=0x7f1d20113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d20127ea0 0x7f1d20113060 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c4a0 tx=0x7f1d1000c960 comp rx=0 tx=0).stop 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 shutdown_connections 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f1d0c038060 0x7f1d0c03a520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 --2- 172.21.15.3:0/3867236115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d20127ea0 0x7f1d20113060 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 >> 172.21.15.3:0/3867236115 conn(0x7f1d20099380 msgr2=0x7f1d2009a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 shutdown_connections 2024-05-15T18:11:55.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:55.272+0000 7f1d271bd640 1 -- 172.21.15.3:0/3867236115 wait complete. 2024-05-15T18:11:56.260 INFO:tasks.ceph:Scrubbing osd.0 2024-05-15T18:11:56.261 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-15T18:11:56.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.404+0000 7fed611be640 1 Processor -- start 2024-05-15T18:11:56.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.404+0000 7fed611be640 1 -- start start 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.404+0000 7fed611be640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fed5c12e2e0 0x7fed5c1306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.404+0000 7fed611be640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed5c06e6e0 con 0x7fed5c127ee0 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.404+0000 7fed611be640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fed5c127a90 con 0x7fed5c12e2e0 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.405+0000 7fed5259c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fed5c12e2e0 0x7fed5c1306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.405+0000 7fed5ad9d640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fed5c127ee0 0x7fed5c1282c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60908/0 (socket says 172.21.15.3:60908) 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.405+0000 7fed5ad9d640 1 -- 172.21.15.3:0/2371578663 learned_addr learned my addr 172.21.15.3:0/2371578663 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.405+0000 7fed5259c640 1 -- 172.21.15.3:0/2371578663 >> v1:172.21.15.3:6789/0 conn(0x7fed5c127ee0 legacy=0x7fed5c1282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.405+0000 7fed5259c640 1 -- 172.21.15.3:0/2371578663 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c0716a0 con 0x7fed5c12e2e0 2024-05-15T18:11:56.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed5259c640 1 --2- 172.21.15.3:0/2371578663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c12e2e0 0x7fed5c1306d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fed44009720 tx=0x7fed4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42404dc60e8b126 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed5a59c640 1 -- 172.21.15.3:0/2371578663 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed440316d0 con 0x7fed5c12e2e0 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed5a59c640 1 -- 172.21.15.3:0/2371578663 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed44037070 con 0x7fed5c12e2e0 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed5a59c640 1 -- 172.21.15.3:0/2371578663 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed440319c0 con 0x7fed5c12e2e0 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed611be640 1 -- 172.21.15.3:0/2371578663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c12e2e0 msgr2=0x7fed5c1306d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed611be640 1 --2- 172.21.15.3:0/2371578663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c12e2e0 0x7fed5c1306d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fed44009720 tx=0x7fed4402b840 comp rx=0 tx=0).stop 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed611be640 1 -- 172.21.15.3:0/2371578663 shutdown_connections 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed611be640 1 --2- 172.21.15.3:0/2371578663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c12e2e0 0x7fed5c1306d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed611be640 1 -- 172.21.15.3:0/2371578663 >> 172.21.15.3:0/2371578663 conn(0x7fed5c0991a0 msgr2=0x7fed5c0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed611be640 1 -- 172.21.15.3:0/2371578663 shutdown_connections 2024-05-15T18:11:56.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.406+0000 7fed611be640 1 -- 172.21.15.3:0/2371578663 wait complete. 2024-05-15T18:11:56.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.407+0000 7fed611be640 1 Processor -- start 2024-05-15T18:11:56.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.408+0000 7fed611be640 1 -- start start 2024-05-15T18:11:56.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.408+0000 7fed611be640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c127ee0 0x7fed5c1c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.408+0000 7fed611be640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c130c10 con 0x7fed5c127ee0 2024-05-15T18:11:56.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.408+0000 7fed5ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c127ee0 0x7fed5c1c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.408+0000 7fed5ad9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c127ee0 0x7fed5c1c0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49300/0 (socket says 172.21.15.3:49300) 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.408+0000 7fed5ad9d640 1 -- 172.21.15.3:0/404814888 learned_addr learned my addr 172.21.15.3:0/404814888 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.408+0000 7fed5ad9d640 1 -- 172.21.15.3:0/404814888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c12b6a0 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.409+0000 7fed5ad9d640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c127ee0 0x7fed5c1c0ca0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c4a0 tx=0x7fed4c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.409+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed4c017070 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.409+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4c005c10 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.409+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c12ade0 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.409+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed4c007070 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.409+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c124090 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed5c1270c0 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fed4c01a070 con 0x7fed5c127ee0 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed53fff640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed3c038060 0x7fed3c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fed4c04aba0 con 0x7fed5c127ee0 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed53fff640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fed3c043de0 0x7fed3c046280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed4c013e50 con 0x7fed3c043de0 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fed4c04f2a0 con 0x7fed5c127ee0 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed5b59e640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fed3c043de0 0x7fed3c046280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.410+0000 7fed5259c640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed3c038060 0x7fed3c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.411+0000 7fed5b59e640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fed3c043de0 0x7fed3c046280 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.411+0000 7fed5259c640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed3c038060 0x7fed3c03a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fed44036000 tx=0x7fed44008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.411+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== osd.0 v2:172.21.15.3:6800/774076599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed4c013e50 con 0x7fed3c043de0 2024-05-15T18:11:56.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 --> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fed5c1249c0 con 0x7fed3c043de0 2024-05-15T18:11:56.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed53fff640 1 -- 172.21.15.3:0/404814888 <== osd.0 v2:172.21.15.3:6800/774076599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fed5c1249c0 con 0x7fed3c043de0 2024-05-15T18:11:56.401 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-05-15T18:11:56.402 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T18:11:56.402 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-05-15T18:11:56.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fed3c043de0 msgr2=0x7fed3c046280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fed3c043de0 0x7fed3c046280 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed3c038060 msgr2=0x7fed3c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed3c038060 0x7fed3c03a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fed44036000 tx=0x7fed44008030 comp rx=0 tx=0).stop 2024-05-15T18:11:56.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c127ee0 msgr2=0x7fed5c1c0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c127ee0 0x7fed5c1c0ca0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c4a0 tx=0x7fed4c00c960 comp rx=0 tx=0).stop 2024-05-15T18:11:56.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 shutdown_connections 2024-05-15T18:11:56.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:6800/774076599,v1:172.21.15.3:6801/774076599] conn(0x7fed3c043de0 0x7fed3c046280 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fed3c038060 0x7fed3c03a520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 --2- 172.21.15.3:0/404814888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed5c127ee0 0x7fed5c1c0ca0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 >> 172.21.15.3:0/404814888 conn(0x7fed5c0991a0 msgr2=0x7fed5c09b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:56.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 shutdown_connections 2024-05-15T18:11:56.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.425+0000 7fed611be640 1 -- 172.21.15.3:0/404814888 wait complete. 2024-05-15T18:11:56.412 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-15T18:11:56.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.540+0000 7f765d03e640 1 Processor -- start 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.540+0000 7f765d03e640 1 -- start start 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.540+0000 7f765d03e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f765812b2e0 0x7f765812b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.540+0000 7f765d03e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7658098840 con 0x7f765812bc00 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.540+0000 7f765d03e640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f765806f9a0 con 0x7f765812b2e0 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.541+0000 7f7656d9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f765812b2e0 0x7f765812b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.541+0000 7f764ffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f765812bc00 0x7f765806e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60910/0 (socket says 172.21.15.3:60910) 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.541+0000 7f764ffff640 1 -- 172.21.15.3:0/2237758549 learned_addr learned my addr 172.21.15.3:0/2237758549 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:56.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.541+0000 7f7656d9d640 1 -- 172.21.15.3:0/2237758549 >> v1:172.21.15.3:6789/0 conn(0x7f765812bc00 legacy=0x7f765806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.541+0000 7f7656d9d640 1 -- 172.21.15.3:0/2237758549 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76580707f0 con 0x7f765812b2e0 2024-05-15T18:11:56.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.541+0000 7f765659c640 1 -- 172.21.15.3:0/2237758549 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915735403 0 0) 0x7f7658098840 con 0x7f765812bc00 2024-05-15T18:11:56.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f7656d9d640 1 --2- 172.21.15.3:0/2237758549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f765812b6c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7648009720 tx=0x7f764802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15273601adf8f9ee server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765659c640 1 -- 172.21.15.3:0/2237758549 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76480316d0 con 0x7f765812b2e0 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765659c640 1 -- 172.21.15.3:0/2237758549 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7648037070 con 0x7f765812b2e0 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765659c640 1 -- 172.21.15.3:0/2237758549 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76480319c0 con 0x7f765812b2e0 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765d03e640 1 -- 172.21.15.3:0/2237758549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 msgr2=0x7f765812b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765d03e640 1 --2- 172.21.15.3:0/2237758549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f765812b6c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f7648009720 tx=0x7f764802b840 comp rx=0 tx=0).stop 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765d03e640 1 -- 172.21.15.3:0/2237758549 shutdown_connections 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765d03e640 1 --2- 172.21.15.3:0/2237758549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f765812b6c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765d03e640 1 -- 172.21.15.3:0/2237758549 >> 172.21.15.3:0/2237758549 conn(0x7f76580996c0 msgr2=0x7f7658099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765d03e640 1 -- 172.21.15.3:0/2237758549 shutdown_connections 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.542+0000 7f765d03e640 1 -- 172.21.15.3:0/2237758549 wait complete. 2024-05-15T18:11:56.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.543+0000 7f765d03e640 1 Processor -- start 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.543+0000 7f765d03e640 1 -- start start 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.544+0000 7f765d03e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f76581c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.544+0000 7f765d03e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f765806ee20 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.544+0000 7f7656d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f76581c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.544+0000 7f7656d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f76581c10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49310/0 (socket says 172.21.15.3:49310) 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.544+0000 7f7656d9d640 1 -- 172.21.15.3:0/2314461705 learned_addr learned my addr 172.21.15.3:0/2314461705 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.544+0000 7f7656d9d640 1 -- 172.21.15.3:0/2314461705 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765808d8e0 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.544+0000 7f7656d9d640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f76581c10f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7648009840 tx=0x7f76480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.545+0000 7f764f7fe640 1 -- 172.21.15.3:0/2314461705 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7648004030 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.545+0000 7f764f7fe640 1 -- 172.21.15.3:0/2314461705 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76480041d0 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.545+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765809ba40 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.545+0000 7f764f7fe640 1 -- 172.21.15.3:0/2314461705 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76480044b0 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.545+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f765808e570 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.546+0000 7f764f7fe640 1 -- 172.21.15.3:0/2314461705 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7648003610 con 0x7f765812b2e0 2024-05-15T18:11:56.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.546+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7658062e90 con 0x7f765812b2e0 2024-05-15T18:11:56.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.546+0000 7f764f7fe640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7638038060 0x7f763803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.546+0000 7f764f7fe640 1 -- 172.21.15.3:0/2314461705 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f764802f050 con 0x7f765812b2e0 2024-05-15T18:11:56.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.546+0000 7f764ffff640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7638038060 0x7f763803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.547+0000 7f764ffff640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7638038060 0x7f763803a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7640000c00 tx=0x7f7640007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.550+0000 7f764f7fe640 1 -- 172.21.15.3:0/2314461705 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7648040070 con 0x7f765812b2e0 2024-05-15T18:11:56.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.732+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f765808e800 con 0x7f7638038060 2024-05-15T18:11:56.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.733+0000 7f764f7fe640 1 -- 172.21.15.3:0/2314461705 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f765808e800 con 0x7f7638038060 2024-05-15T18:11:56.709 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 0 to deep-scrub 2024-05-15T18:11:56.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7638038060 msgr2=0x7f763803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7638038060 0x7f763803a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7640000c00 tx=0x7f7640007970 comp rx=0 tx=0).stop 2024-05-15T18:11:56.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 msgr2=0x7f76581c10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f76581c10f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f7648009840 tx=0x7f76480046c0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 shutdown_connections 2024-05-15T18:11:56.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7638038060 0x7f763803a520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 --2- 172.21.15.3:0/2314461705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f765812b2e0 0x7f76581c10f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 >> 172.21.15.3:0/2314461705 conn(0x7f76580996c0 msgr2=0x7f765806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:56.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 shutdown_connections 2024-05-15T18:11:56.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.735+0000 7f765d03e640 1 -- 172.21.15.3:0/2314461705 wait complete. 2024-05-15T18:11:56.723 INFO:tasks.ceph:Scrubbing osd.1 2024-05-15T18:11:56.723 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-15T18:11:56.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.853+0000 7f63441c7640 1 Processor -- start 2024-05-15T18:11:56.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.853+0000 7f63441c7640 1 -- start start 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.853+0000 7f63441c7640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f633c12f340 0x7f633c131730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.854+0000 7f63441c7640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f633c1230b0 con 0x7f633c128f40 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.854+0000 7f63441c7640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f633c0722f0 con 0x7f633c12f340 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.854+0000 7f6341762640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f633c12f340 0x7f633c131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.854+0000 7f6341f63640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f633c128f40 0x7f633c129320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60926/0 (socket says 172.21.15.3:60926) 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.854+0000 7f6341f63640 1 -- 172.21.15.3:0/2640755502 learned_addr learned my addr 172.21.15.3:0/2640755502 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.854+0000 7f6341762640 1 -- 172.21.15.3:0/2640755502 >> v1:172.21.15.3:6789/0 conn(0x7f633c128f40 legacy=0x7f633c129320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.854+0000 7f6341762640 1 -- 172.21.15.3:0/2640755502 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c06f970 con 0x7f633c12f340 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f6341762640 1 --2- 172.21.15.3:0/2640755502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c12f340 0x7f633c131730 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f632c009750 tx=0x7f632c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c86d30d1d37063 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f6340f61640 1 -- 172.21.15.3:0/2640755502 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c0316d0 con 0x7f633c12f340 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f6340f61640 1 -- 172.21.15.3:0/2640755502 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c037070 con 0x7f633c12f340 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f6340f61640 1 -- 172.21.15.3:0/2640755502 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c0319c0 con 0x7f633c12f340 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f63441c7640 1 -- 172.21.15.3:0/2640755502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c12f340 msgr2=0x7f633c131730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f63441c7640 1 --2- 172.21.15.3:0/2640755502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c12f340 0x7f633c131730 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f632c009750 tx=0x7f632c02b840 comp rx=0 tx=0).stop 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f63441c7640 1 -- 172.21.15.3:0/2640755502 shutdown_connections 2024-05-15T18:11:56.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f63441c7640 1 --2- 172.21.15.3:0/2640755502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c12f340 0x7f633c131730 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f63441c7640 1 -- 172.21.15.3:0/2640755502 >> 172.21.15.3:0/2640755502 conn(0x7f633c0991a0 msgr2=0x7f633c0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f63441c7640 1 -- 172.21.15.3:0/2640755502 shutdown_connections 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.855+0000 7f63441c7640 1 -- 172.21.15.3:0/2640755502 wait complete. 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.856+0000 7f63441c7640 1 Processor -- start 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.856+0000 7f63441c7640 1 -- start start 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f63441c7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c128f40 0x7f633c1226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f63441c7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f633c113160 con 0x7f633c128f40 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f6341f63640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c128f40 0x7f633c1226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f6341f63640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c128f40 0x7f633c1226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49340/0 (socket says 172.21.15.3:49340) 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f6341f63640 1 -- 172.21.15.3:0/3420805909 learned_addr learned my addr 172.21.15.3:0/3420805909 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f6341f63640 1 -- 172.21.15.3:0/3420805909 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c0718e0 con 0x7f633c128f40 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f6341f63640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c128f40 0x7f633c1226a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f633800c4a0 tx=0x7f633800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6338017070 con 0x7f633c128f40 2024-05-15T18:11:56.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6338005c10 con 0x7f633c128f40 2024-05-15T18:11:56.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c12b0c0 con 0x7f633c128f40 2024-05-15T18:11:56.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6338007070 con 0x7f633c128f40 2024-05-15T18:11:56.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.857+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c12b740 con 0x7f633c128f40 2024-05-15T18:11:56.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.858+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f633c062e90 con 0x7f633c128f40 2024-05-15T18:11:56.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.858+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f633801a070 con 0x7f633c128f40 2024-05-15T18:11:56.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f63327fc640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6320038060 0x7f632003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f633804aba0 con 0x7f633c128f40 2024-05-15T18:11:56.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f63327fc640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7f6320043e40 0x7f63200462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6338013e50 con 0x7f6320043e40 2024-05-15T18:11:56.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f633804f2a0 con 0x7f633c128f40 2024-05-15T18:11:56.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f6341762640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6320038060 0x7f632003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f6342764640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7f6320043e40 0x7f63200462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f6341762640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6320038060 0x7f632003a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f632c036000 tx=0x7f632c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.859+0000 7f6342764640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7f6320043e40 0x7f63200462e0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.860+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== osd.1 v2:172.21.15.173:6800/3225970667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6338013e50 con 0x7f6320043e40 2024-05-15T18:11:56.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.873+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 --> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f633c12bef0 con 0x7f6320043e40 2024-05-15T18:11:56.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63327fc640 1 -- 172.21.15.3:0/3420805909 <== osd.1 v2:172.21.15.173:6800/3225970667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f633c12bef0 con 0x7f6320043e40 2024-05-15T18:11:56.851 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-05-15T18:11:56.851 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T18:11:56.851 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-05-15T18:11:56.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7f6320043e40 msgr2=0x7f63200462e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7f6320043e40 0x7f63200462e0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6320038060 msgr2=0x7f632003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6320038060 0x7f632003a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f632c036000 tx=0x7f632c008030 comp rx=0 tx=0).stop 2024-05-15T18:11:56.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c128f40 msgr2=0x7f633c1226a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c128f40 0x7f633c1226a0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f633800c4a0 tx=0x7f633800c960 comp rx=0 tx=0).stop 2024-05-15T18:11:56.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 shutdown_connections 2024-05-15T18:11:56.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6800/3225970667,v1:172.21.15.173:6801/3225970667] conn(0x7f6320043e40 0x7f63200462e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f6320038060 0x7f632003a520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 --2- 172.21.15.3:0/3420805909 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f633c128f40 0x7f633c1226a0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 >> 172.21.15.3:0/3420805909 conn(0x7f633c0991a0 msgr2=0x7f633c127700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:56.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 shutdown_connections 2024-05-15T18:11:56.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.874+0000 7f63441c7640 1 -- 172.21.15.3:0/3420805909 wait complete. 2024-05-15T18:11:56.861 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-15T18:11:56.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.988+0000 7f9cc8638640 1 Processor -- start 2024-05-15T18:11:56.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.988+0000 7f9cc8638640 1 -- start start 2024-05-15T18:11:56.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc8638640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9cc006df70 0x7f9cc01316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc8638640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc0098840 con 0x7f9cc006d480 2024-05-15T18:11:56.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc8638640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc0072040 con 0x7f9cc006df70 2024-05-15T18:11:56.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc5bd3640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f9cc006df70 0x7f9cc01316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc63d4640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f9cc006d480 0x7f9cc006d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60934/0 (socket says 172.21.15.3:60934) 2024-05-15T18:11:56.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc63d4640 1 -- 172.21.15.3:0/1313182086 learned_addr learned my addr 172.21.15.3:0/1313182086 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:56.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc5bd3640 1 -- 172.21.15.3:0/1313182086 >> v1:172.21.15.3:6789/0 conn(0x7f9cc006d480 legacy=0x7f9cc006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.989+0000 7f9cc5bd3640 1 -- 172.21.15.3:0/1313182086 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc0070b20 con 0x7f9cc006df70 2024-05-15T18:11:56.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.990+0000 7f9cc5bd3640 1 --2- 172.21.15.3:0/1313182086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006df70 0x7f9cc01316a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009720 tx=0x7f9cb002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51643da8d288a7f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.990+0000 7f9cc53d2640 1 -- 172.21.15.3:0/1313182086 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb00316d0 con 0x7f9cc006df70 2024-05-15T18:11:56.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.990+0000 7f9cc53d2640 1 -- 172.21.15.3:0/1313182086 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb0037070 con 0x7f9cc006df70 2024-05-15T18:11:56.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.990+0000 7f9cc53d2640 1 -- 172.21.15.3:0/1313182086 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cb00319c0 con 0x7f9cc006df70 2024-05-15T18:11:56.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.990+0000 7f9cc8638640 1 -- 172.21.15.3:0/1313182086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006df70 msgr2=0x7f9cc01316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:56.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.990+0000 7f9cc8638640 1 --2- 172.21.15.3:0/1313182086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006df70 0x7f9cc01316a0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009720 tx=0x7f9cb002b840 comp rx=0 tx=0).stop 2024-05-15T18:11:56.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.991+0000 7f9cc8638640 1 -- 172.21.15.3:0/1313182086 shutdown_connections 2024-05-15T18:11:56.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.991+0000 7f9cc8638640 1 --2- 172.21.15.3:0/1313182086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006df70 0x7f9cc01316a0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:56.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.991+0000 7f9cc8638640 1 -- 172.21.15.3:0/1313182086 >> 172.21.15.3:0/1313182086 conn(0x7f9cc00996c0 msgr2=0x7f9cc0099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:56.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.991+0000 7f9cc8638640 1 -- 172.21.15.3:0/1313182086 shutdown_connections 2024-05-15T18:11:56.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.991+0000 7f9cc8638640 1 -- 172.21.15.3:0/1313182086 wait complete. 2024-05-15T18:11:56.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.991+0000 7f9cc8638640 1 Processor -- start 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.991+0000 7f9cc8638640 1 -- start start 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cc8638640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006d480 0x7f9cc006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cc8638640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0071270 con 0x7f9cc006d480 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cc63d4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006d480 0x7f9cc006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cc63d4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006d480 0x7f9cc006e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49364/0 (socket says 172.21.15.3:49364) 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cc63d4640 1 -- 172.21.15.3:0/3514835055 learned_addr learned my addr 172.21.15.3:0/3514835055 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cc63d4640 1 -- 172.21.15.3:0/3514835055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc008b520 con 0x7f9cc006d480 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cc63d4640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006d480 0x7f9cc006e770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c4a0 tx=0x7f9cbc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.992+0000 7f9cb6ffd640 1 -- 172.21.15.3:0/3514835055 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cbc017070 con 0x7f9cc006d480 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.993+0000 7f9cb6ffd640 1 -- 172.21.15.3:0/3514835055 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc005c10 con 0x7f9cc006d480 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.993+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc006ecb0 con 0x7f9cc006d480 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.993+0000 7f9cb6ffd640 1 -- 172.21.15.3:0/3514835055 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cbc007070 con 0x7f9cc006d480 2024-05-15T18:11:56.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.993+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc006f180 con 0x7f9cc006d480 2024-05-15T18:11:56.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.993+0000 7f9cb6ffd640 1 -- 172.21.15.3:0/3514835055 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9cbc01a070 con 0x7f9cc006d480 2024-05-15T18:11:56.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.993+0000 7f9cb6ffd640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ca4038060 0x7f9ca403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:56.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.994+0000 7f9cb6ffd640 1 -- 172.21.15.3:0/3514835055 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f9cbc04ab40 con 0x7f9cc006d480 2024-05-15T18:11:56.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.994+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc008acc0 con 0x7f9cc006d480 2024-05-15T18:11:56.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.994+0000 7f9cc5bd3640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ca4038060 0x7f9ca403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:56.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.994+0000 7f9cc5bd3640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ca4038060 0x7f9ca403a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0036000 tx=0x7f9cb0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:56.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:56.998+0000 7f9cb6ffd640 1 -- 172.21.15.3:0/3514835055 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9cbc01b3b0 con 0x7f9cc006d480 2024-05-15T18:11:56.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-15T18:11:57.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.180+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9cc008aa90 con 0x7f9ca4038060 2024-05-15T18:11:57.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.181+0000 7f9cb6ffd640 1 -- 172.21.15.3:0/3514835055 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9cb0037040 con 0x7f9ca4038060 2024-05-15T18:11:57.158 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 1 to deep-scrub 2024-05-15T18:11:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ca4038060 msgr2=0x7f9ca403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ca4038060 0x7f9ca403a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0036000 tx=0x7f9cb0008030 comp rx=0 tx=0).stop 2024-05-15T18:11:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006d480 msgr2=0x7f9cc006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006d480 0x7f9cc006e770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00c4a0 tx=0x7f9cbc00c960 comp rx=0 tx=0).stop 2024-05-15T18:11:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 shutdown_connections 2024-05-15T18:11:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f9ca4038060 0x7f9ca403a520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 --2- 172.21.15.3:0/3514835055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9cc006d480 0x7f9cc006e770 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 >> 172.21.15.3:0/3514835055 conn(0x7f9cc00996c0 msgr2=0x7f9cc01289d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 shutdown_connections 2024-05-15T18:11:57.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.183+0000 7f9cc8638640 1 -- 172.21.15.3:0/3514835055 wait complete. 2024-05-15T18:11:57.171 INFO:tasks.ceph:Scrubbing osd.2 2024-05-15T18:11:57.171 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-15T18:11:57.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.302+0000 7f333c496640 1 Processor -- start 2024-05-15T18:11:57.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.302+0000 7f333c496640 1 -- start start 2024-05-15T18:11:57.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f333c496640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3334128f40 0x7f3334129320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f333c496640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33341230b0 con 0x7f333412bfd0 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f333c496640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f33340722f0 con 0x7f3334128f40 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f333a232640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f3334128f40 0x7f3334129320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f3339a31640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f333412bfd0 0x7f333412c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60948/0 (socket says 172.21.15.3:60948) 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f3339a31640 1 -- 172.21.15.3:0/4013119462 learned_addr learned my addr 172.21.15.3:0/4013119462 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f333a232640 1 -- 172.21.15.3:0/4013119462 >> v1:172.21.15.3:6789/0 conn(0x7f333412bfd0 legacy=0x7f333412c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.303+0000 7f333a232640 1 -- 172.21.15.3:0/4013119462 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333406f970 con 0x7f3334128f40 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.304+0000 7f333a232640 1 --2- 172.21.15.3:0/4013119462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f3334129320 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3330009720 tx=0x7f333002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c43c215d81f60c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.304+0000 7f3339230640 1 -- 172.21.15.3:0/4013119462 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33300316d0 con 0x7f3334128f40 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.304+0000 7f3339230640 1 -- 172.21.15.3:0/4013119462 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3330037070 con 0x7f3334128f40 2024-05-15T18:11:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.304+0000 7f3339230640 1 -- 172.21.15.3:0/4013119462 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33300319c0 con 0x7f3334128f40 2024-05-15T18:11:57.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.305+0000 7f333c496640 1 -- 172.21.15.3:0/4013119462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 msgr2=0x7f3334129320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.305+0000 7f333c496640 1 --2- 172.21.15.3:0/4013119462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f3334129320 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3330009720 tx=0x7f333002b840 comp rx=0 tx=0).stop 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.305+0000 7f333c496640 1 -- 172.21.15.3:0/4013119462 shutdown_connections 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.305+0000 7f333c496640 1 --2- 172.21.15.3:0/4013119462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f3334129320 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.305+0000 7f333c496640 1 -- 172.21.15.3:0/4013119462 >> 172.21.15.3:0/4013119462 conn(0x7f33340991a0 msgr2=0x7f33340995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.305+0000 7f333c496640 1 -- 172.21.15.3:0/4013119462 shutdown_connections 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.305+0000 7f333c496640 1 -- 172.21.15.3:0/4013119462 wait complete. 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333c496640 1 Processor -- start 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333c496640 1 -- start start 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333c496640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f33341c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333c496640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3334113980 con 0x7f3334128f40 2024-05-15T18:11:57.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333a232640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f33341c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333a232640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f33341c31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49388/0 (socket says 172.21.15.3:49388) 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333a232640 1 -- 172.21.15.3:0/3918840778 learned_addr learned my addr 172.21.15.3:0/3918840778 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.306+0000 7f333a232640 1 -- 172.21.15.3:0/3918840778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333409ba80 con 0x7f3334128f40 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.307+0000 7f333a232640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f33341c31b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3330000c00 tx=0x7f33300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.307+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3330032640 con 0x7f3334128f40 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.307+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3330032800 con 0x7f3334128f40 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.307+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33340718e0 con 0x7f3334128f40 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.307+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3330032b20 con 0x7f3334128f40 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.307+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33341c36f0 con 0x7f3334128f40 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.307+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f333004c060 con 0x7f3334128f40 2024-05-15T18:11:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3334062e90 con 0x7f3334128f40 2024-05-15T18:11:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f332affd640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3318038060 0x7f331803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f333002f050 con 0x7f3334128f40 2024-05-15T18:11:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f332affd640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3318043dc0 0x7f3318046260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f333004ee50 con 0x7f3318043dc0 2024-05-15T18:11:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3330032cc0 con 0x7f3334128f40 2024-05-15T18:11:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f3339a31640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3318038060 0x7f331803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.308+0000 7f333aa33640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3318043dc0 0x7f3318046260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.309+0000 7f3339a31640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3318038060 0x7f331803a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3324007fd0 tx=0x7f3324007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.309+0000 7f333aa33640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3318043dc0 0x7f3318046260 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.309+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== osd.2 v2:172.21.15.173:6808/3098545592 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f333004ee50 con 0x7f3318043dc0 2024-05-15T18:11:57.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.323+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 --> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f333411bd70 con 0x7f3318043dc0 2024-05-15T18:11:57.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.323+0000 7f332affd640 1 -- 172.21.15.3:0/3918840778 <== osd.2 v2:172.21.15.173:6808/3098545592 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f333411bd70 con 0x7f3318043dc0 2024-05-15T18:11:57.300 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-05-15T18:11:57.301 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T18:11:57.301 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.323+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3318043dc0 msgr2=0x7f3318046260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.323+0000 7f333c496640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3318043dc0 0x7f3318046260 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3318038060 msgr2=0x7f331803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3318038060 0x7f331803a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3324007fd0 tx=0x7f3324007ac0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 msgr2=0x7f33341c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f33341c31b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3330000c00 tx=0x7f33300046c0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 shutdown_connections 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6808/3098545592,v1:172.21.15.173:6809/3098545592] conn(0x7f3318043dc0 0x7f3318046260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f3318038060 0x7f331803a520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 --2- 172.21.15.3:0/3918840778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3334128f40 0x7f33341c31b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 >> 172.21.15.3:0/3918840778 conn(0x7f33340991a0 msgr2=0x7f3334127330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 shutdown_connections 2024-05-15T18:11:57.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.324+0000 7f333c496640 1 -- 172.21.15.3:0/3918840778 wait complete. 2024-05-15T18:11:57.310 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-15T18:11:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64c0e8c640 1 Processor -- start 2024-05-15T18:11:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64c0e8c640 1 -- start start 2024-05-15T18:11:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64c0e8c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f64bc06d6f0 0x7f64bc06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64c0e8c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64bc06f120 con 0x7f64bc06e010 2024-05-15T18:11:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64c0e8c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f64bc06e800 con 0x7f64bc06d6f0 2024-05-15T18:11:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64ba59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f64bc06d6f0 0x7f64bc06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64b9d9b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f64bc06e010 0x7f64bc070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:60960/0 (socket says 172.21.15.3:60960) 2024-05-15T18:11:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64ba59c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f64bc06d6f0 0x7f64bc06dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49394/0 (socket says 172.21.15.3:49394) 2024-05-15T18:11:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.438+0000 7f64b9d9b640 1 -- 172.21.15.3:0/2121774010 learned_addr learned my addr 172.21.15.3:0/2121774010 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.439+0000 7f64ba59c640 1 -- 172.21.15.3:0/2121774010 >> v1:172.21.15.3:6789/0 conn(0x7f64bc06e010 legacy=0x7f64bc070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.439+0000 7f64ba59c640 1 -- 172.21.15.3:0/2121774010 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc071b20 con 0x7f64bc06d6f0 2024-05-15T18:11:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.439+0000 7f64ba59c640 1 --2- 172.21.15.3:0/2121774010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc06dad0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00a8c0 tx=0x7f64ac02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3326459f60350 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64b959a640 1 -- 172.21.15.3:0/2121774010 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac03a070 con 0x7f64bc06d6f0 2024-05-15T18:11:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64b959a640 1 -- 172.21.15.3:0/2121774010 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac02da00 con 0x7f64bc06d6f0 2024-05-15T18:11:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64b959a640 1 -- 172.21.15.3:0/2121774010 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac00b040 con 0x7f64bc06d6f0 2024-05-15T18:11:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2121774010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 msgr2=0x7f64bc06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64c0e8c640 1 --2- 172.21.15.3:0/2121774010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc06dad0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f64ac00a8c0 tx=0x7f64ac02cd20 comp rx=0 tx=0).stop 2024-05-15T18:11:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2121774010 shutdown_connections 2024-05-15T18:11:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64c0e8c640 1 --2- 172.21.15.3:0/2121774010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc06dad0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2121774010 >> 172.21.15.3:0/2121774010 conn(0x7f64bc0996c0 msgr2=0x7f64bc099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2121774010 shutdown_connections 2024-05-15T18:11:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.440+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2121774010 wait complete. 2024-05-15T18:11:57.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.441+0000 7f64c0e8c640 1 Processor -- start 2024-05-15T18:11:57.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.441+0000 7f64c0e8c640 1 -- start start 2024-05-15T18:11:57.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64c0e8c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc093430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64c0e8c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc0985d0 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64ba59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc093430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64ba59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc093430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49396/0 (socket says 172.21.15.3:49396) 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64ba59c640 1 -- 172.21.15.3:0/2018391982 learned_addr learned my addr 172.21.15.3:0/2018391982 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64ba59c640 1 -- 172.21.15.3:0/2018391982 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc096cc0 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64ba59c640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc093430 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f64ac038040 tx=0x7f64ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64aaffd640 1 -- 172.21.15.3:0/2018391982 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac042020 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64bc094e10 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64aaffd640 1 -- 172.21.15.3:0/2018391982 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac035bd0 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64aaffd640 1 -- 172.21.15.3:0/2018391982 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac03a040 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.442+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64bc1a6690 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.443+0000 7f64aaffd640 1 -- 172.21.15.3:0/2018391982 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f64ac045020 con 0x7f64bc06d6f0 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.443+0000 7f64aaffd640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f649c038010 0x7f649c03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.443+0000 7f64aaffd640 1 -- 172.21.15.3:0/2018391982 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f64ac06d550 con 0x7f64bc06d6f0 2024-05-15T18:11:57.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.443+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64bc062e90 con 0x7f64bc06d6f0 2024-05-15T18:11:57.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.444+0000 7f64b9d9b640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f649c038010 0x7f649c03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.444+0000 7f64b9d9b640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f649c038010 0x7f649c03a4d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007fd0 tx=0x7f64b0007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.448+0000 7f64aaffd640 1 -- 172.21.15.3:0/2018391982 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f64ac04c030 con 0x7f64bc06d6f0 2024-05-15T18:11:57.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.631+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f64bc0703a0 con 0x7f649c038010 2024-05-15T18:11:57.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.632+0000 7f64aaffd640 1 -- 172.21.15.3:0/2018391982 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f64bc0703a0 con 0x7f649c038010 2024-05-15T18:11:57.610 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 2 to deep-scrub 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f649c038010 msgr2=0x7f649c03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f649c038010 0x7f649c03a4d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007fd0 tx=0x7f64b0007ac0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 msgr2=0x7f64bc093430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc093430 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f64ac038040 tx=0x7f64ac0046c0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 shutdown_connections 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f649c038010 0x7f649c03a4d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 --2- 172.21.15.3:0/2018391982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64bc06d6f0 0x7f64bc093430 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 >> 172.21.15.3:0/2018391982 conn(0x7f64bc0996c0 msgr2=0x7f64bc08c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 shutdown_connections 2024-05-15T18:11:57.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.634+0000 7f64c0e8c640 1 -- 172.21.15.3:0/2018391982 wait complete. 2024-05-15T18:11:57.622 INFO:tasks.ceph:Scrubbing osd.3 2024-05-15T18:11:57.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-15T18:11:57.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.751+0000 7fcec884a640 1 Processor -- start 2024-05-15T18:11:57.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.751+0000 7fcec884a640 1 -- start start 2024-05-15T18:11:57.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec884a640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcec412f340 0x7fcec4131730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec884a640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec41230b0 con 0x7fcec4128f40 2024-05-15T18:11:57.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec884a640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fcec40722f0 con 0x7fcec412f340 2024-05-15T18:11:57.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec1d9b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fcec412f340 0x7fcec4131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec259c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fcec4128f40 0x7fcec4129320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37296/0 (socket says 172.21.15.3:37296) 2024-05-15T18:11:57.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec259c640 1 -- 172.21.15.3:0/2259590984 learned_addr learned my addr 172.21.15.3:0/2259590984 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:57.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec1d9b640 1 -- 172.21.15.3:0/2259590984 >> v1:172.21.15.3:6789/0 conn(0x7fcec4128f40 legacy=0x7fcec4129320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.752+0000 7fcec1d9b640 1 -- 172.21.15.3:0/2259590984 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec406f970 con 0x7fcec412f340 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.753+0000 7fcec1d9b640 1 --2- 172.21.15.3:0/2259590984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec412f340 0x7fcec4131730 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009750 tx=0x7fceb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b584e8297b625c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.753+0000 7fcec159a640 1 -- 172.21.15.3:0/2259590984 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb80316d0 con 0x7fcec412f340 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.753+0000 7fcec159a640 1 -- 172.21.15.3:0/2259590984 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb8037070 con 0x7fcec412f340 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.753+0000 7fcec159a640 1 -- 172.21.15.3:0/2259590984 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb80319c0 con 0x7fcec412f340 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.754+0000 7fcec884a640 1 -- 172.21.15.3:0/2259590984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec412f340 msgr2=0x7fcec4131730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.754+0000 7fcec884a640 1 --2- 172.21.15.3:0/2259590984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec412f340 0x7fcec4131730 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009750 tx=0x7fceb802b840 comp rx=0 tx=0).stop 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.754+0000 7fcec884a640 1 -- 172.21.15.3:0/2259590984 shutdown_connections 2024-05-15T18:11:57.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.754+0000 7fcec884a640 1 --2- 172.21.15.3:0/2259590984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec412f340 0x7fcec4131730 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.754+0000 7fcec884a640 1 -- 172.21.15.3:0/2259590984 >> 172.21.15.3:0/2259590984 conn(0x7fcec40991a0 msgr2=0x7fcec40995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.754+0000 7fcec884a640 1 -- 172.21.15.3:0/2259590984 shutdown_connections 2024-05-15T18:11:57.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.754+0000 7fcec884a640 1 -- 172.21.15.3:0/2259590984 wait complete. 2024-05-15T18:11:57.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.755+0000 7fcec884a640 1 Processor -- start 2024-05-15T18:11:57.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.755+0000 7fcec884a640 1 -- start start 2024-05-15T18:11:57.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.755+0000 7fcec884a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec4128f40 0x7fcec41226a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.755+0000 7fcec884a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4113160 con 0x7fcec4128f40 2024-05-15T18:11:57.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.755+0000 7fcec259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec4128f40 0x7fcec41226a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fcec259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec4128f40 0x7fcec41226a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42410/0 (socket says 172.21.15.3:42410) 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fcec259c640 1 -- 172.21.15.3:0/2539729324 learned_addr learned my addr 172.21.15.3:0/2539729324 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fcec259c640 1 -- 172.21.15.3:0/2539729324 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40718e0 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fcec259c640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec4128f40 0x7fcec41226a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fceb400cb20 tx=0x7fceb400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb4017070 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb400abf0 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb4012400 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec412b0c0 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.756+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec412b740 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.757+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcec4062e90 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.757+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fceb401a070 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.757+0000 7fceb2ffd640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcea4038060 0x7fcea403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.757+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fceb404b660 con 0x7fcec4128f40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.757+0000 7fceb2ffd640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7fcea4043e40 0x7fcea40462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.757+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcea40469b0 con 0x7fcea4043e40 2024-05-15T18:11:57.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.757+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fceb4052050 con 0x7fcec4128f40 2024-05-15T18:11:57.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.758+0000 7fcec1d9b640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcea4038060 0x7fcea403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.758+0000 7fcec2d9d640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7fcea4043e40 0x7fcea40462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.758+0000 7fcec2d9d640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7fcea4043e40 0x7fcea40462e0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.758+0000 7fcec1d9b640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcea4038060 0x7fcea403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fceb8036000 tx=0x7fceb8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.759+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== osd.3 v2:172.21.15.173:6814/3793320597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcea40469b0 con 0x7fcea4043e40 2024-05-15T18:11:57.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.772+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 --> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcec412bef0 con 0x7fcea4043e40 2024-05-15T18:11:57.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fceb2ffd640 1 -- 172.21.15.3:0/2539729324 <== osd.3 v2:172.21.15.173:6814/3793320597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcec412bef0 con 0x7fcea4043e40 2024-05-15T18:11:57.750 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-05-15T18:11:57.751 INFO:teuthology.orchestra.run.smithi003.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T18:11:57.751 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7fcea4043e40 msgr2=0x7fcea40462e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7fcea4043e40 0x7fcea40462e0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcea4038060 msgr2=0x7fcea403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcea4038060 0x7fcea403a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fceb8036000 tx=0x7fceb8008030 comp rx=0 tx=0).stop 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec4128f40 msgr2=0x7fcec41226a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec4128f40 0x7fcec41226a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fceb400cb20 tx=0x7fceb400a060 comp rx=0 tx=0).stop 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 shutdown_connections 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6814/3793320597,v1:172.21.15.173:6816/3793320597] conn(0x7fcea4043e40 0x7fcea40462e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fcea4038060 0x7fcea403a520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 --2- 172.21.15.3:0/2539729324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcec4128f40 0x7fcec41226a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 >> 172.21.15.3:0/2539729324 conn(0x7fcec40991a0 msgr2=0x7fcec4127700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 shutdown_connections 2024-05-15T18:11:57.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.774+0000 7fcec884a640 1 -- 172.21.15.3:0/2539729324 wait complete. 2024-05-15T18:11:57.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.887+0000 7f0326750640 1 Processor -- start 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.887+0000 7f0326750640 1 -- start start 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f0326750640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0320131790 0x7f0320133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f0326750640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032012c060 con 0x7f032012b570 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f0326750640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f0320071a80 con 0x7f0320131790 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f031f7fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f0320131790 0x7f0320133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f031ffff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f032012b570 0x7f032012b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37298/0 (socket says 172.21.15.3:37298) 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f031ffff640 1 -- 172.21.15.3:0/2211438461 learned_addr learned my addr 172.21.15.3:0/2211438461 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f031f7fe640 1 -- 172.21.15.3:0/2211438461 >> v1:172.21.15.3:6789/0 conn(0x7f032012b570 legacy=0x7f032012b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.888+0000 7f031f7fe640 1 -- 172.21.15.3:0/2211438461 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0320072060 con 0x7f0320131790 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.889+0000 7f031f7fe640 1 --2- 172.21.15.3:0/2211438461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0320131790 0x7f0320133b80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0314009720 tx=0x7f031402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866ce52794bfc959 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.889+0000 7f031effd640 1 -- 172.21.15.3:0/2211438461 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03140316d0 con 0x7f0320131790 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.889+0000 7f031effd640 1 -- 172.21.15.3:0/2211438461 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0314037070 con 0x7f0320131790 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.889+0000 7f031effd640 1 -- 172.21.15.3:0/2211438461 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03140319c0 con 0x7f0320131790 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.890+0000 7f0326750640 1 -- 172.21.15.3:0/2211438461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0320131790 msgr2=0x7f0320133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.890+0000 7f0326750640 1 --2- 172.21.15.3:0/2211438461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0320131790 0x7f0320133b80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0314009720 tx=0x7f031402b840 comp rx=0 tx=0).stop 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.890+0000 7f0326750640 1 -- 172.21.15.3:0/2211438461 shutdown_connections 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.890+0000 7f0326750640 1 --2- 172.21.15.3:0/2211438461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0320131790 0x7f0320133b80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:57.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.890+0000 7f0326750640 1 -- 172.21.15.3:0/2211438461 >> 172.21.15.3:0/2211438461 conn(0x7f032009eb90 msgr2=0x7f032009efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:57.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.890+0000 7f0326750640 1 -- 172.21.15.3:0/2211438461 shutdown_connections 2024-05-15T18:11:57.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.890+0000 7f0326750640 1 -- 172.21.15.3:0/2211438461 wait complete. 2024-05-15T18:11:57.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.891+0000 7f0326750640 1 Processor -- start 2024-05-15T18:11:57.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.891+0000 7f0326750640 1 -- start start 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.891+0000 7f0326750640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f032012b570 0x7f0320119f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.891+0000 7f0326750640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0320070bc0 con 0x7f032012b570 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.891+0000 7f031ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f032012b570 0x7f0320119f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.891+0000 7f031ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f032012b570 0x7f0320119f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42428/0 (socket says 172.21.15.3:42428) 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.891+0000 7f031ffff640 1 -- 172.21.15.3:0/3230488847 learned_addr learned my addr 172.21.15.3:0/3230488847 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.892+0000 7f031ffff640 1 -- 172.21.15.3:0/3230488847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032011bd50 con 0x7f032012b570 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.892+0000 7f031ffff640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f032012b570 0x7f0320119f10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f031000c4a0 tx=0x7f031000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.892+0000 7f031cff9640 1 -- 172.21.15.3:0/3230488847 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0310017070 con 0x7f032012b570 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.892+0000 7f031cff9640 1 -- 172.21.15.3:0/3230488847 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0310005c10 con 0x7f032012b570 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.892+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032006ff50 con 0x7f032012b570 2024-05-15T18:11:57.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.892+0000 7f031cff9640 1 -- 172.21.15.3:0/3230488847 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0310007070 con 0x7f032012b570 2024-05-15T18:11:57.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.892+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032011c9e0 con 0x7f032012b570 2024-05-15T18:11:57.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.893+0000 7f031cff9640 1 -- 172.21.15.3:0/3230488847 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f031001a070 con 0x7f032012b570 2024-05-15T18:11:57.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.893+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0320062e90 con 0x7f032012b570 2024-05-15T18:11:57.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.893+0000 7f031cff9640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f030c038060 0x7f030c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:57.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.893+0000 7f031cff9640 1 -- 172.21.15.3:0/3230488847 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f031004abd0 con 0x7f032012b570 2024-05-15T18:11:57.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.893+0000 7f031f7fe640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f030c038060 0x7f030c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:57.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.894+0000 7f031f7fe640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f030c038060 0x7f030c03a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0314009720 tx=0x7f0314008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:57.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:57.898+0000 7f031cff9640 1 -- 172.21.15.3:0/3230488847 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0310012400 con 0x7f032012b570 2024-05-15T18:11:58.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.082+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f032011b100 con 0x7f030c038060 2024-05-15T18:11:58.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.083+0000 7f031cff9640 1 -- 172.21.15.3:0/3230488847 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f032011b100 con 0x7f030c038060 2024-05-15T18:11:58.061 INFO:teuthology.orchestra.run.smithi003.stderr:instructed osd(s) 3 to deep-scrub 2024-05-15T18:11:58.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f030c038060 msgr2=0x7f030c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:58.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f030c038060 0x7f030c03a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0314009720 tx=0x7f0314008030 comp rx=0 tx=0).stop 2024-05-15T18:11:58.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f032012b570 msgr2=0x7f0320119f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:58.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f032012b570 0x7f0320119f10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f031000c4a0 tx=0x7f031000c960 comp rx=0 tx=0).stop 2024-05-15T18:11:58.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 shutdown_connections 2024-05-15T18:11:58.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f030c038060 0x7f030c03a520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:58.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 --2- 172.21.15.3:0/3230488847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f032012b570 0x7f0320119f10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:58.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 >> 172.21.15.3:0/3230488847 conn(0x7f032009eb90 msgr2=0x7f0320132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:58.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 shutdown_connections 2024-05-15T18:11:58.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.085+0000 7f0326750640 1 -- 172.21.15.3:0/3230488847 wait complete. 2024-05-15T18:11:58.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:11:58.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.198+0000 7f885984e640 1 Processor -- start 2024-05-15T18:11:58.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.198+0000 7f885984e640 1 -- start start 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f885984e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8854127ea0 0x7f8854128280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f885984e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8854071020 con 0x7f88541287c0 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f885984e640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f8854071780 con 0x7f8854127ea0 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f8852ffd640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f8854127ea0 0x7f8854128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f88527fc640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f88541287c0 0x7f885412b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37300/0 (socket says 172.21.15.3:37300) 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f88527fc640 1 -- 172.21.15.3:0/60425707 learned_addr learned my addr 172.21.15.3:0/60425707 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f8852ffd640 1 -- 172.21.15.3:0/60425707 >> v1:172.21.15.3:6789/0 conn(0x7f88541287c0 legacy=0x7f885412b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:58.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.199+0000 7f8851ffb640 1 -- 172.21.15.3:0/60425707 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872956221 0 0) 0x7f8854071020 con 0x7f88541287c0 2024-05-15T18:11:58.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.200+0000 7f8852ffd640 1 -- 172.21.15.3:0/60425707 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885406e6e0 con 0x7f8854127ea0 2024-05-15T18:11:58.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.200+0000 7f8852ffd640 1 --2- 172.21.15.3:0/60425707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854128280 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8844009720 tx=0x7f884402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430c7acfc474f9da server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:58.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.200+0000 7f8851ffb640 1 -- 172.21.15.3:0/60425707 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8844035020 con 0x7f8854127ea0 2024-05-15T18:11:58.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.200+0000 7f8851ffb640 1 -- 172.21.15.3:0/60425707 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8844031760 con 0x7f8854127ea0 2024-05-15T18:11:58.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.200+0000 7f8851ffb640 1 -- 172.21.15.3:0/60425707 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8844031a60 con 0x7f8854127ea0 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.201+0000 7f885984e640 1 -- 172.21.15.3:0/60425707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 msgr2=0x7f8854128280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.201+0000 7f885984e640 1 --2- 172.21.15.3:0/60425707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854128280 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8844009720 tx=0x7f884402b8d0 comp rx=0 tx=0).stop 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.201+0000 7f885984e640 1 -- 172.21.15.3:0/60425707 shutdown_connections 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.201+0000 7f885984e640 1 --2- 172.21.15.3:0/60425707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854128280 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.201+0000 7f885984e640 1 -- 172.21.15.3:0/60425707 >> 172.21.15.3:0/60425707 conn(0x7f8854099380 msgr2=0x7f8854099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.201+0000 7f885984e640 1 -- 172.21.15.3:0/60425707 shutdown_connections 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.201+0000 7f885984e640 1 -- 172.21.15.3:0/60425707 wait complete. 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.202+0000 7f885984e640 1 Processor -- start 2024-05-15T18:11:58.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.202+0000 7f885984e640 1 -- start start 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.202+0000 7f885984e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.202+0000 7f885984e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f885412b800 con 0x7f8854127ea0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f8852ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f8852ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42444/0 (socket says 172.21.15.3:42444) 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f8852ffd640 1 -- 172.21.15.3:0/61355906 learned_addr learned my addr 172.21.15.3:0/61355906 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f8852ffd640 1 -- 172.21.15.3:0/61355906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8854114670 con 0x7f8854127ea0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f8852ffd640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854113060 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8844009720 tx=0x7f88440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f883bfff640 1 -- 172.21.15.3:0/61355906 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f884403cc30 con 0x7f8854127ea0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f883bfff640 1 -- 172.21.15.3:0/61355906 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884403cdd0 con 0x7f8854127ea0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885409b9b0 con 0x7f8854127ea0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f883bfff640 1 -- 172.21.15.3:0/61355906 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8844004160 con 0x7f8854127ea0 2024-05-15T18:11:58.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.203+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8854115310 con 0x7f8854127ea0 2024-05-15T18:11:58.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.204+0000 7f883bfff640 1 -- 172.21.15.3:0/61355906 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8844038020 con 0x7f8854127ea0 2024-05-15T18:11:58.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.204+0000 7f883bfff640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8840038060 0x7f884003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:11:58.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.204+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885409b6d0 con 0x7f8854127ea0 2024-05-15T18:11:58.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.204+0000 7f883bfff640 1 -- 172.21.15.3:0/61355906 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f884406e070 con 0x7f8854127ea0 2024-05-15T18:11:58.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.205+0000 7f88527fc640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8840038060 0x7f884003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:11:58.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.205+0000 7f88527fc640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8840038060 0x7f884003a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8848000c00 tx=0x7f8848007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:11:58.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.209+0000 7f883bfff640 1 -- 172.21.15.3:0/61355906 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f885409b6d0 con 0x7f8854127ea0 2024-05-15T18:11:58.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.388+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8854062e90 con 0x7f8840038060 2024-05-15T18:11:58.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.403+0000 7f883bfff640 1 -- 172.21.15.3:0/61355906 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665367 (secure 0 0 0) 0x7f8854062e90 con 0x7f8840038060 2024-05-15T18:11:58.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:11:58.394 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8840038060 msgr2=0x7f884003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8840038060 0x7f884003a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8848000c00 tx=0x7f8848007970 comp rx=0 tx=0).stop 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 msgr2=0x7f8854113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854113060 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8844009720 tx=0x7f88440046c0 comp rx=0 tx=0).stop 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 shutdown_connections 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f8840038060 0x7f884003a520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 --2- 172.21.15.3:0/61355906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8854127ea0 0x7f8854113060 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 >> 172.21.15.3:0/61355906 conn(0x7f8854099380 msgr2=0x7f885406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:11:58.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 shutdown_connections 2024-05-15T18:11:58.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:11:58.408+0000 7f885984e640 1 -- 172.21.15.3:0/61355906 wait complete. 2024-05-15T18:11:58.398 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-05-15T18:11:58.377680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18024181,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":4929,"num_read_kb":4508,"num_write":2120,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4508,"ondisk_log_size":4508,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182312,"kb_used_data":36808,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305048,"statfs":{"total":386547056640,"available":386360369152,"internally_reserved":0,"allocated":37691392,"data_stored":36545582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":148956946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17423079,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":545,"num_read_kb":498,"num_write":400,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003796"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.335908+0000","last_change":"2024-05-15T18:08:37.185277+0000","last_active":"2024-05-15T18:09:20.335908+0000","last_peered":"2024-05-15T18:09:20.335908+0000","last_clean":"2024-05-15T18:09:20.335908+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:09:20.335908+0000","last_undegraded":"2024-05-15T18:09:20.335908+0000","last_fullsized":"2024-05-15T18:09:20.335908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101814+0000","last_change":"2024-05-15T18:08:39.181950+0000","last_active":"2024-05-15T18:11:47.101814+0000","last_peered":"2024-05-15T18:11:47.101814+0000","last_clean":"2024-05-15T18:11:47.101814+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:11:47.101814+0000","last_undegraded":"2024-05-15T18:11:47.101814+0000","last_fullsized":"2024-05-15T18:11:47.101814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400383+0000","last_change":"2024-05-15T18:08:37.180815+0000","last_active":"2024-05-15T18:09:19.400383+0000","last_peered":"2024-05-15T18:09:19.400383+0000","last_clean":"2024-05-15T18:09:19.400383+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:09:19.400383+0000","last_undegraded":"2024-05-15T18:09:19.400383+0000","last_fullsized":"2024-05-15T18:09:19.400383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:11:28.156751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801449+0000","last_change":"2024-05-15T18:08:39.183780+0000","last_active":"2024-05-15T18:11:46.801449+0000","last_peered":"2024-05-15T18:11:46.801449+0000","last_clean":"2024-05-15T18:11:46.801449+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:11:46.801449+0000","last_undegraded":"2024-05-15T18:11:46.801449+0000","last_fullsized":"2024-05-15T18:11:46.801449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:15.759084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403839+0000","last_change":"2024-05-15T18:08:37.186280+0000","last_active":"2024-05-15T18:09:19.403839+0000","last_peered":"2024-05-15T18:09:19.403839+0000","last_clean":"2024-05-15T18:09:19.403839+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:09:19.403839+0000","last_undegraded":"2024-05-15T18:09:19.403839+0000","last_fullsized":"2024-05-15T18:09:19.403839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:41.112234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413763+0000","last_change":"2024-05-15T18:08:39.184797+0000","last_active":"2024-05-15T18:10:46.413763+0000","last_peered":"2024-05-15T18:10:46.413763+0000","last_clean":"2024-05-15T18:10:46.413763+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:10:46.413763+0000","last_undegraded":"2024-05-15T18:10:46.413763+0000","last_fullsized":"2024-05-15T18:10:46.413763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:31.818225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.386408+0000","last_change":"2024-05-15T18:08:37.174049+0000","last_active":"2024-05-15T18:10:46.386408+0000","last_peered":"2024-05-15T18:10:46.386408+0000","last_clean":"2024-05-15T18:10:46.386408+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:10:46.386408+0000","last_undegraded":"2024-05-15T18:10:46.386408+0000","last_fullsized":"2024-05-15T18:10:46.386408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'11","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397038+0000","last_change":"2024-05-15T18:08:39.181113+0000","last_active":"2024-05-15T18:11:08.397038+0000","last_peered":"2024-05-15T18:11:08.397038+0000","last_clean":"2024-05-15T18:11:08.397038+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:11:08.397038+0000","last_undegraded":"2024-05-15T18:11:08.397038+0000","last_fullsized":"2024-05-15T18:11:08.397038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:21:57.396932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399830+0000","last_change":"2024-05-15T18:08:37.179942+0000","last_active":"2024-05-15T18:09:19.399830+0000","last_peered":"2024-05-15T18:09:19.399830+0000","last_clean":"2024-05-15T18:09:19.399830+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:09:19.399830+0000","last_undegraded":"2024-05-15T18:09:19.399830+0000","last_fullsized":"2024-05-15T18:09:19.399830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:31:34.419734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.842198+0000","last_change":"2024-05-15T18:08:39.185769+0000","last_active":"2024-05-15T18:10:02.842198+0000","last_peered":"2024-05-15T18:10:02.842198+0000","last_clean":"2024-05-15T18:10:02.842198+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:10:02.842198+0000","last_undegraded":"2024-05-15T18:10:02.842198+0000","last_fullsized":"2024-05-15T18:10:02.842198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:44.743277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405752+0000","last_change":"2024-05-15T18:08:37.178875+0000","last_active":"2024-05-15T18:09:19.405752+0000","last_peered":"2024-05-15T18:09:19.405752+0000","last_clean":"2024-05-15T18:09:19.405752+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:09:19.405752+0000","last_undegraded":"2024-05-15T18:09:19.405752+0000","last_fullsized":"2024-05-15T18:09:19.405752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027476+0000","last_change":"2024-05-15T18:08:39.189004+0000","last_active":"2024-05-15T18:11:47.027476+0000","last_peered":"2024-05-15T18:11:47.027476+0000","last_clean":"2024-05-15T18:11:47.027476+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:11:47.027476+0000","last_undegraded":"2024-05-15T18:11:47.027476+0000","last_fullsized":"2024-05-15T18:11:47.027476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:55.844079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401251+0000","last_change":"2024-05-15T18:08:37.177010+0000","last_active":"2024-05-15T18:09:19.401251+0000","last_peered":"2024-05-15T18:09:19.401251+0000","last_clean":"2024-05-15T18:09:19.401251+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:09:19.401251+0000","last_undegraded":"2024-05-15T18:09:19.401251+0000","last_fullsized":"2024-05-15T18:09:19.401251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:17:38.714290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'5","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392579+0000","last_change":"2024-05-15T18:08:39.187168+0000","last_active":"2024-05-15T18:10:43.392579+0000","last_peered":"2024-05-15T18:10:43.392579+0000","last_clean":"2024-05-15T18:10:43.392579+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:10:43.392579+0000","last_undegraded":"2024-05-15T18:10:43.392579+0000","last_fullsized":"2024-05-15T18:10:43.392579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398685+0000","last_change":"2024-05-15T18:08:37.180981+0000","last_active":"2024-05-15T18:09:19.398685+0000","last_peered":"2024-05-15T18:09:19.398685+0000","last_clean":"2024-05-15T18:09:19.398685+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:09:19.398685+0000","last_undegraded":"2024-05-15T18:09:19.398685+0000","last_fullsized":"2024-05-15T18:09:19.398685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102117+0000","last_change":"2024-05-15T18:08:39.185117+0000","last_active":"2024-05-15T18:11:47.102117+0000","last_peered":"2024-05-15T18:11:47.102117+0000","last_clean":"2024-05-15T18:11:47.102117+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:11:47.102117+0000","last_undegraded":"2024-05-15T18:11:47.102117+0000","last_fullsized":"2024-05-15T18:11:47.102117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102111+0000","last_change":"2024-05-15T18:08:39.186238+0000","last_active":"2024-05-15T18:11:47.102111+0000","last_peered":"2024-05-15T18:11:47.102111+0000","last_clean":"2024-05-15T18:11:47.102111+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:11:47.102111+0000","last_undegraded":"2024-05-15T18:11:47.102111+0000","last_fullsized":"2024-05-15T18:11:47.102111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:18.269525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401873+0000","last_change":"2024-05-15T18:08:37.177868+0000","last_active":"2024-05-15T18:09:19.401873+0000","last_peered":"2024-05-15T18:09:19.401873+0000","last_clean":"2024-05-15T18:09:19.401873+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:09:19.401873+0000","last_undegraded":"2024-05-15T18:09:19.401873+0000","last_fullsized":"2024-05-15T18:09:19.401873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'5","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901911+0000","last_change":"2024-05-15T18:08:39.184998+0000","last_active":"2024-05-15T18:11:46.901911+0000","last_peered":"2024-05-15T18:11:46.901911+0000","last_clean":"2024-05-15T18:11:46.901911+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:11:46.901911+0000","last_undegraded":"2024-05-15T18:11:46.901911+0000","last_fullsized":"2024-05-15T18:11:46.901911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:52.199938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.309110+0000","last_change":"2024-05-15T18:08:37.179232+0000","last_active":"2024-05-15T18:10:43.309110+0000","last_peered":"2024-05-15T18:10:43.309110+0000","last_clean":"2024-05-15T18:10:43.309110+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:10:43.309110+0000","last_undegraded":"2024-05-15T18:10:43.309110+0000","last_fullsized":"2024-05-15T18:10:43.309110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353249+0000","last_change":"2024-05-15T18:08:39.187737+0000","last_active":"2024-05-15T18:09:20.353249+0000","last_peered":"2024-05-15T18:09:20.353249+0000","last_clean":"2024-05-15T18:09:20.353249+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:09:20.353249+0000","last_undegraded":"2024-05-15T18:09:20.353249+0000","last_fullsized":"2024-05-15T18:09:20.353249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403507+0000","last_change":"2024-05-15T18:08:37.176725+0000","last_active":"2024-05-15T18:09:19.403507+0000","last_peered":"2024-05-15T18:09:19.403507+0000","last_clean":"2024-05-15T18:09:19.403507+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:09:19.403507+0000","last_undegraded":"2024-05-15T18:09:19.403507+0000","last_fullsized":"2024-05-15T18:09:19.403507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:14:09.625003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075342+0000","last_change":"2024-05-15T18:08:39.183706+0000","last_active":"2024-05-15T18:11:47.075342+0000","last_peered":"2024-05-15T18:11:47.075342+0000","last_clean":"2024-05-15T18:11:47.075342+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:11:47.075342+0000","last_undegraded":"2024-05-15T18:11:47.075342+0000","last_fullsized":"2024-05-15T18:11:47.075342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403416+0000","last_change":"2024-05-15T18:08:37.173166+0000","last_active":"2024-05-15T18:09:19.403416+0000","last_peered":"2024-05-15T18:09:19.403416+0000","last_clean":"2024-05-15T18:09:19.403416+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:09:19.403416+0000","last_undegraded":"2024-05-15T18:09:19.403416+0000","last_fullsized":"2024-05-15T18:09:19.403416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820262+0000","last_change":"2024-05-15T18:08:39.183490+0000","last_active":"2024-05-15T18:09:20.820262+0000","last_peered":"2024-05-15T18:09:20.820262+0000","last_clean":"2024-05-15T18:09:20.820262+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:09:20.820262+0000","last_undegraded":"2024-05-15T18:09:20.820262+0000","last_fullsized":"2024-05-15T18:09:20.820262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.696652+0000","last_change":"2024-05-15T18:08:37.180056+0000","last_active":"2024-05-15T18:11:46.696652+0000","last_peered":"2024-05-15T18:11:46.696652+0000","last_clean":"2024-05-15T18:11:46.696652+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:11:46.696652+0000","last_undegraded":"2024-05-15T18:11:46.696652+0000","last_fullsized":"2024-05-15T18:11:46.696652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.638104+0000","last_change":"2024-05-15T18:08:39.180165+0000","last_active":"2024-05-15T18:10:02.638104+0000","last_peered":"2024-05-15T18:10:02.638104+0000","last_clean":"2024-05-15T18:10:02.638104+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:10:02.638104+0000","last_undegraded":"2024-05-15T18:10:02.638104+0000","last_fullsized":"2024-05-15T18:10:02.638104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398920+0000","last_change":"2024-05-15T18:08:37.181235+0000","last_active":"2024-05-15T18:09:19.398920+0000","last_peered":"2024-05-15T18:09:19.398920+0000","last_clean":"2024-05-15T18:09:19.398920+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:09:19.398920+0000","last_undegraded":"2024-05-15T18:09:19.398920+0000","last_fullsized":"2024-05-15T18:09:19.398920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:24.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.052271+0000","last_change":"2024-05-15T18:08:47.223064+0000","last_active":"2024-05-15T18:11:47.052271+0000","last_peered":"2024-05-15T18:11:47.052271+0000","last_clean":"2024-05-15T18:11:47.052271+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:11:47.052271+0000","last_undegraded":"2024-05-15T18:11:47.052271+0000","last_fullsized":"2024-05-15T18:11:47.052271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:52.698600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101931+0000","last_change":"2024-05-15T18:09:19.408744+0000","last_active":"2024-05-15T18:11:47.101931+0000","last_peered":"2024-05-15T18:11:47.101931+0000","last_clean":"2024-05-15T18:11:47.101931+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:11:47.101931+0000","last_undegraded":"2024-05-15T18:11:47.101931+0000","last_fullsized":"2024-05-15T18:11:47.101931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:25:44.669224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398972+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:09:19.398972+0000","last_peered":"2024-05-15T18:09:19.398972+0000","last_clean":"2024-05-15T18:09:19.398972+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:09:19.398972+0000","last_undegraded":"2024-05-15T18:09:19.398972+0000","last_fullsized":"2024-05-15T18:09:19.398972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:14:34.978659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'4","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.039167+0000","last_change":"2024-05-15T18:08:41.191864+0000","last_active":"2024-05-15T18:10:46.039167+0000","last_peered":"2024-05-15T18:10:46.039167+0000","last_clean":"2024-05-15T18:10:46.039167+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:10:46.039167+0000","last_undegraded":"2024-05-15T18:10:46.039167+0000","last_fullsized":"2024-05-15T18:10:46.039167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:16.109612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.990907+0000","last_change":"2024-05-15T18:08:43.205617+0000","last_active":"2024-05-15T18:10:44.990907+0000","last_peered":"2024-05-15T18:10:44.990907+0000","last_clean":"2024-05-15T18:10:44.990907+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:10:44.990907+0000","last_undegraded":"2024-05-15T18:10:44.990907+0000","last_fullsized":"2024-05-15T18:10:44.990907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:54.834292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401260+0000","last_change":"2024-05-15T18:08:45.209245+0000","last_active":"2024-05-15T18:09:19.401260+0000","last_peered":"2024-05-15T18:09:19.401260+0000","last_clean":"2024-05-15T18:09:19.401260+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:09:19.401260+0000","last_undegraded":"2024-05-15T18:09:19.401260+0000","last_fullsized":"2024-05-15T18:09:19.401260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.077076+0000","last_change":"2024-05-15T18:08:47.223088+0000","last_active":"2024-05-15T18:11:47.077076+0000","last_peered":"2024-05-15T18:11:47.077076+0000","last_clean":"2024-05-15T18:11:47.077076+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:11:47.077076+0000","last_undegraded":"2024-05-15T18:11:47.077076+0000","last_fullsized":"2024-05-15T18:11:47.077076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:02.637943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102151+0000","last_change":"2024-05-15T18:08:39.182435+0000","last_active":"2024-05-15T18:11:47.102151+0000","last_peered":"2024-05-15T18:11:47.102151+0000","last_clean":"2024-05-15T18:11:47.102151+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:11:47.102151+0000","last_undegraded":"2024-05-15T18:11:47.102151+0000","last_fullsized":"2024-05-15T18:11:47.102151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:54.513611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406138+0000","last_change":"2024-05-15T18:08:37.176655+0000","last_active":"2024-05-15T18:09:19.406138+0000","last_peered":"2024-05-15T18:09:19.406138+0000","last_clean":"2024-05-15T18:09:19.406138+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:09:19.406138+0000","last_undegraded":"2024-05-15T18:09:19.406138+0000","last_fullsized":"2024-05-15T18:09:19.406138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399967+0000","last_change":"2024-05-15T18:08:41.190513+0000","last_active":"2024-05-15T18:09:19.399967+0000","last_peered":"2024-05-15T18:09:19.399967+0000","last_clean":"2024-05-15T18:09:19.399967+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:09:19.399967+0000","last_undegraded":"2024-05-15T18:09:19.399967+0000","last_fullsized":"2024-05-15T18:09:19.399967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:24:07.182527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'7","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.415322+0000","last_change":"2024-05-15T18:08:43.193059+0000","last_active":"2024-05-15T18:10:46.415322+0000","last_peered":"2024-05-15T18:10:46.415322+0000","last_clean":"2024-05-15T18:10:46.415322+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:10:46.415322+0000","last_undegraded":"2024-05-15T18:10:46.415322+0000","last_fullsized":"2024-05-15T18:10:46.415322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:03:54.729307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401523+0000","last_change":"2024-05-15T18:08:45.200547+0000","last_active":"2024-05-15T18:09:19.401523+0000","last_peered":"2024-05-15T18:09:19.401523+0000","last_clean":"2024-05-15T18:09:19.401523+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:09:19.401523+0000","last_undegraded":"2024-05-15T18:09:19.401523+0000","last_fullsized":"2024-05-15T18:09:19.401523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.731935+0000","last_change":"2024-05-15T18:08:47.215478+0000","last_active":"2024-05-15T18:09:19.731935+0000","last_peered":"2024-05-15T18:09:19.731935+0000","last_clean":"2024-05-15T18:09:19.731935+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:09:19.731935+0000","last_undegraded":"2024-05-15T18:09:19.731935+0000","last_fullsized":"2024-05-15T18:09:19.731935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736547+0000","last_change":"2024-05-15T18:08:39.180798+0000","last_active":"2024-05-15T18:09:19.736547+0000","last_peered":"2024-05-15T18:09:19.736547+0000","last_clean":"2024-05-15T18:09:19.736547+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:09:19.736547+0000","last_undegraded":"2024-05-15T18:09:19.736547+0000","last_fullsized":"2024-05-15T18:09:19.736547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:49.260782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.341191+0000","last_change":"2024-05-15T18:08:37.185177+0000","last_active":"2024-05-15T18:09:20.341191+0000","last_peered":"2024-05-15T18:09:20.341191+0000","last_clean":"2024-05-15T18:09:20.341191+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:09:20.341191+0000","last_undegraded":"2024-05-15T18:09:20.341191+0000","last_fullsized":"2024-05-15T18:09:20.341191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:50.301378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:23.381565+0000","last_change":"2024-05-15T18:09:19.410089+0000","last_active":"2024-05-15T18:09:23.381565+0000","last_peered":"2024-05-15T18:09:23.381565+0000","last_clean":"2024-05-15T18:09:23.381565+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:09:23.381565+0000","last_undegraded":"2024-05-15T18:09:23.381565+0000","last_fullsized":"2024-05-15T18:09:23.381565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:15:56.615789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407814+0000","last_change":"2024-05-15T18:08:43.198970+0000","last_active":"2024-05-15T18:09:19.407814+0000","last_peered":"2024-05-15T18:09:19.407814+0000","last_clean":"2024-05-15T18:09:19.407814+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:09:19.407814+0000","last_undegraded":"2024-05-15T18:09:19.407814+0000","last_fullsized":"2024-05-15T18:09:19.407814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:48.849846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'282","reported_seq":404,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274331+0000","last_change":"2024-05-15T18:08:45.210771+0000","last_active":"2024-05-15T18:11:46.274331+0000","last_peered":"2024-05-15T18:11:46.274331+0000","last_clean":"2024-05-15T18:11:46.274331+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:11:46.274331+0000","last_undegraded":"2024-05-15T18:11:46.274331+0000","last_fullsized":"2024-05-15T18:11:46.274331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:10.645906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.408911+0000","last_change":"2024-05-15T18:08:47.220509+0000","last_active":"2024-05-15T18:10:46.408911+0000","last_peered":"2024-05-15T18:10:46.408911+0000","last_clean":"2024-05-15T18:10:46.408911+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:10:46.408911+0000","last_undegraded":"2024-05-15T18:10:46.408911+0000","last_fullsized":"2024-05-15T18:10:46.408911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:56.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'23","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111340+0000","last_change":"2024-05-15T18:08:39.187144+0000","last_active":"2024-05-15T18:11:47.111340+0000","last_peered":"2024-05-15T18:11:47.111340+0000","last_clean":"2024-05-15T18:11:47.111340+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:11:47.111340+0000","last_undegraded":"2024-05-15T18:11:47.111340+0000","last_fullsized":"2024-05-15T18:11:47.111340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:51:43.119869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399530+0000","last_change":"2024-05-15T18:08:37.176800+0000","last_active":"2024-05-15T18:09:19.399530+0000","last_peered":"2024-05-15T18:09:19.399530+0000","last_clean":"2024-05-15T18:09:19.399530+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:09:19.399530+0000","last_undegraded":"2024-05-15T18:09:19.399530+0000","last_fullsized":"2024-05-15T18:09:19.399530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400987+0000","last_change":"2024-05-15T18:08:41.191184+0000","last_active":"2024-05-15T18:09:19.400987+0000","last_peered":"2024-05-15T18:09:19.400987+0000","last_clean":"2024-05-15T18:09:19.400987+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:09:19.400987+0000","last_undegraded":"2024-05-15T18:09:19.400987+0000","last_fullsized":"2024-05-15T18:09:19.400987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:25.413878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.985510+0000","last_change":"2024-05-15T18:08:43.199596+0000","last_active":"2024-05-15T18:10:44.985510+0000","last_peered":"2024-05-15T18:10:44.985510+0000","last_clean":"2024-05-15T18:10:44.985510+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:10:44.985510+0000","last_undegraded":"2024-05-15T18:10:44.985510+0000","last_fullsized":"2024-05-15T18:10:44.985510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:22.284084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":438,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.660086+0000","last_change":"2024-05-15T18:08:45.198740+0000","last_active":"2024-05-15T18:11:53.660086+0000","last_peered":"2024-05-15T18:11:53.660086+0000","last_clean":"2024-05-15T18:11:53.660086+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:53.660086+0000","last_undegraded":"2024-05-15T18:11:53.660086+0000","last_fullsized":"2024-05-15T18:11:53.660086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:30.679986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.798859+0000","last_change":"2024-05-15T18:08:39.194038+0000","last_active":"2024-05-15T18:11:46.798859+0000","last_peered":"2024-05-15T18:11:46.798859+0000","last_clean":"2024-05-15T18:11:46.798859+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:11:46.798859+0000","last_undegraded":"2024-05-15T18:11:46.798859+0000","last_fullsized":"2024-05-15T18:11:46.798859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:23:21.748030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408742+0000","last_change":"2024-05-15T18:08:37.173486+0000","last_active":"2024-05-15T18:09:19.408742+0000","last_peered":"2024-05-15T18:09:19.408742+0000","last_clean":"2024-05-15T18:09:19.408742+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:09:19.408742+0000","last_undegraded":"2024-05-15T18:09:19.408742+0000","last_fullsized":"2024-05-15T18:09:19.408742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:26:45.671930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402302+0000","last_change":"2024-05-15T18:08:41.193621+0000","last_active":"2024-05-15T18:09:19.402302+0000","last_peered":"2024-05-15T18:09:19.402302+0000","last_clean":"2024-05-15T18:09:19.402302+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:09:19.402302+0000","last_undegraded":"2024-05-15T18:09:19.402302+0000","last_fullsized":"2024-05-15T18:09:19.402302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:49.471489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'41","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.995296+0000","last_change":"2024-05-15T18:08:43.190370+0000","last_active":"2024-05-15T18:10:44.995296+0000","last_peered":"2024-05-15T18:10:44.995296+0000","last_clean":"2024-05-15T18:10:44.995296+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:10:44.995296+0000","last_undegraded":"2024-05-15T18:10:44.995296+0000","last_fullsized":"2024-05-15T18:10:44.995296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:30:17.103247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399470+0000","last_change":"2024-05-15T18:08:45.198524+0000","last_active":"2024-05-15T18:09:19.399470+0000","last_peered":"2024-05-15T18:09:19.399470+0000","last_clean":"2024-05-15T18:09:19.399470+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:09:19.399470+0000","last_undegraded":"2024-05-15T18:09:19.399470+0000","last_fullsized":"2024-05-15T18:09:19.399470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.647715+0000","last_change":"2024-05-15T18:08:47.221822+0000","last_active":"2024-05-15T18:10:02.647715+0000","last_peered":"2024-05-15T18:10:02.647715+0000","last_clean":"2024-05-15T18:10:02.647715+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:10:02.647715+0000","last_undegraded":"2024-05-15T18:10:02.647715+0000","last_fullsized":"2024-05-15T18:10:02.647715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:13.338228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.411141+0000","last_change":"2024-05-15T18:08:39.186448+0000","last_active":"2024-05-15T18:10:46.411141+0000","last_peered":"2024-05-15T18:10:46.411141+0000","last_clean":"2024-05-15T18:10:46.411141+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:10:46.411141+0000","last_undegraded":"2024-05-15T18:10:46.411141+0000","last_fullsized":"2024-05-15T18:10:46.411141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:19.504092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.409682+0000","last_change":"2024-05-15T18:08:37.179060+0000","last_active":"2024-05-15T18:09:19.409682+0000","last_peered":"2024-05-15T18:09:19.409682+0000","last_clean":"2024-05-15T18:09:19.409682+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:09:19.409682+0000","last_undegraded":"2024-05-15T18:09:19.409682+0000","last_fullsized":"2024-05-15T18:09:19.409682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"22'1","reported_seq":220,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.626700+0000","last_change":"2024-05-15T18:08:41.193828+0000","last_active":"2024-05-15T18:11:53.626700+0000","last_peered":"2024-05-15T18:11:53.626700+0000","last_clean":"2024-05-15T18:11:53.626700+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:11:53.626700+0000","last_undegraded":"2024-05-15T18:11:53.626700+0000","last_fullsized":"2024-05-15T18:11:53.626700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:53.033474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'30","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.975080+0000","last_change":"2024-05-15T18:08:43.205152+0000","last_active":"2024-05-15T18:10:44.975080+0000","last_peered":"2024-05-15T18:10:44.975080+0000","last_clean":"2024-05-15T18:10:44.975080+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:10:44.975080+0000","last_undegraded":"2024-05-15T18:10:44.975080+0000","last_fullsized":"2024-05-15T18:10:44.975080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:54:29.654507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399047+0000","last_change":"2024-05-15T18:08:45.207980+0000","last_active":"2024-05-15T18:09:19.399047+0000","last_peered":"2024-05-15T18:09:19.399047+0000","last_clean":"2024-05-15T18:09:19.399047+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:09:19.399047+0000","last_undegraded":"2024-05-15T18:09:19.399047+0000","last_fullsized":"2024-05-15T18:09:19.399047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:57.088948+0000","last_change":"2024-05-15T18:08:47.217227+0000","last_active":"2024-05-15T18:09:57.088948+0000","last_peered":"2024-05-15T18:09:57.088948+0000","last_clean":"2024-05-15T18:09:57.088948+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:09:57.088948+0000","last_undegraded":"2024-05-15T18:09:57.088948+0000","last_fullsized":"2024-05-15T18:09:57.088948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.102085+0000","last_change":"2024-05-15T18:08:39.185744+0000","last_active":"2024-05-15T18:11:47.102085+0000","last_peered":"2024-05-15T18:11:47.102085+0000","last_clean":"2024-05-15T18:11:47.102085+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:11:47.102085+0000","last_undegraded":"2024-05-15T18:11:47.102085+0000","last_fullsized":"2024-05-15T18:11:47.102085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:45:26.536969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.761148+0000","last_change":"2024-05-15T18:08:37.181644+0000","last_active":"2024-05-15T18:11:46.761148+0000","last_peered":"2024-05-15T18:11:46.761148+0000","last_clean":"2024-05-15T18:11:46.761148+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:11:46.761148+0000","last_undegraded":"2024-05-15T18:11:46.761148+0000","last_fullsized":"2024-05-15T18:11:46.761148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:40.709421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400858+0000","last_change":"2024-05-15T18:08:41.191195+0000","last_active":"2024-05-15T18:09:19.400858+0000","last_peered":"2024-05-15T18:09:19.400858+0000","last_clean":"2024-05-15T18:09:19.400858+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:09:19.400858+0000","last_undegraded":"2024-05-15T18:09:19.400858+0000","last_fullsized":"2024-05-15T18:09:19.400858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:55.559496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997111+0000","last_change":"2024-05-15T18:08:43.205104+0000","last_active":"2024-05-15T18:10:44.997111+0000","last_peered":"2024-05-15T18:10:44.997111+0000","last_clean":"2024-05-15T18:10:44.997111+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:10:44.997111+0000","last_undegraded":"2024-05-15T18:10:44.997111+0000","last_fullsized":"2024-05-15T18:10:44.997111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:18.034720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":400,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.661216+0000","last_change":"2024-05-15T18:08:45.205456+0000","last_active":"2024-05-15T18:11:53.661216+0000","last_peered":"2024-05-15T18:11:53.661216+0000","last_clean":"2024-05-15T18:11:53.661216+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:11:53.661216+0000","last_undegraded":"2024-05-15T18:11:53.661216+0000","last_fullsized":"2024-05-15T18:11:53.661216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400131+0000","last_change":"2024-05-15T18:08:47.218349+0000","last_active":"2024-05-15T18:09:19.400131+0000","last_peered":"2024-05-15T18:09:19.400131+0000","last_clean":"2024-05-15T18:09:19.400131+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:09:19.400131+0000","last_undegraded":"2024-05-15T18:09:19.400131+0000","last_fullsized":"2024-05-15T18:09:19.400131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:17:22.049537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075674+0000","last_change":"2024-05-15T18:08:39.180538+0000","last_active":"2024-05-15T18:11:47.075674+0000","last_peered":"2024-05-15T18:11:47.075674+0000","last_clean":"2024-05-15T18:11:47.075674+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:11:47.075674+0000","last_undegraded":"2024-05-15T18:11:47.075674+0000","last_fullsized":"2024-05-15T18:11:47.075674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:45:42.717056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399222+0000","last_change":"2024-05-15T18:08:37.179976+0000","last_active":"2024-05-15T18:09:19.399222+0000","last_peered":"2024-05-15T18:09:19.399222+0000","last_clean":"2024-05-15T18:09:19.399222+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:09:19.399222+0000","last_undegraded":"2024-05-15T18:09:19.399222+0000","last_fullsized":"2024-05-15T18:09:19.399222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:26.717872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399581+0000","last_change":"2024-05-15T18:08:41.193806+0000","last_active":"2024-05-15T18:09:19.399581+0000","last_peered":"2024-05-15T18:09:19.399581+0000","last_clean":"2024-05-15T18:09:19.399581+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:09:19.399581+0000","last_undegraded":"2024-05-15T18:09:19.399581+0000","last_fullsized":"2024-05-15T18:09:19.399581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:03:24.766255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'54","reported_seq":110,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.998912+0000","last_change":"2024-05-15T18:08:43.201489+0000","last_active":"2024-05-15T18:10:44.998912+0000","last_peered":"2024-05-15T18:10:44.998912+0000","last_clean":"2024-05-15T18:10:44.998912+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:10:44.998912+0000","last_undegraded":"2024-05-15T18:10:44.998912+0000","last_fullsized":"2024-05-15T18:10:44.998912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:49:29.914900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398840+0000","last_change":"2024-05-15T18:08:45.200667+0000","last_active":"2024-05-15T18:09:19.398840+0000","last_peered":"2024-05-15T18:09:19.398840+0000","last_clean":"2024-05-15T18:09:19.398840+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:09:19.398840+0000","last_undegraded":"2024-05-15T18:09:19.398840+0000","last_fullsized":"2024-05-15T18:09:19.398840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'18","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.205345+0000","last_change":"2024-05-15T18:08:47.219473+0000","last_active":"2024-05-15T18:11:47.205345+0000","last_peered":"2024-05-15T18:11:47.205345+0000","last_clean":"2024-05-15T18:11:47.205345+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:11:47.205345+0000","last_undegraded":"2024-05-15T18:11:47.205345+0000","last_fullsized":"2024-05-15T18:11:47.205345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:54.139301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.801094+0000","last_change":"2024-05-15T18:08:39.191385+0000","last_active":"2024-05-15T18:11:46.801094+0000","last_peered":"2024-05-15T18:11:46.801094+0000","last_clean":"2024-05-15T18:11:46.801094+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:11:46.801094+0000","last_undegraded":"2024-05-15T18:11:46.801094+0000","last_fullsized":"2024-05-15T18:11:46.801094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:51.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399685+0000","last_change":"2024-05-15T18:08:37.181014+0000","last_active":"2024-05-15T18:09:19.399685+0000","last_peered":"2024-05-15T18:09:19.399685+0000","last_clean":"2024-05-15T18:09:19.399685+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:09:19.399685+0000","last_undegraded":"2024-05-15T18:09:19.399685+0000","last_fullsized":"2024-05-15T18:09:19.399685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408267+0000","last_change":"2024-05-15T18:08:41.189363+0000","last_active":"2024-05-15T18:09:19.408267+0000","last_peered":"2024-05-15T18:09:19.408267+0000","last_clean":"2024-05-15T18:09:19.408267+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:09:19.408267+0000","last_undegraded":"2024-05-15T18:09:19.408267+0000","last_fullsized":"2024-05-15T18:09:19.408267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:55.939790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'32","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.979398+0000","last_change":"2024-05-15T18:08:43.192533+0000","last_active":"2024-05-15T18:10:44.979398+0000","last_peered":"2024-05-15T18:10:44.979398+0000","last_clean":"2024-05-15T18:10:44.979398+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:10:44.979398+0000","last_undegraded":"2024-05-15T18:10:44.979398+0000","last_fullsized":"2024-05-15T18:10:44.979398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:12.568108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403941+0000","last_change":"2024-05-15T18:08:45.210581+0000","last_active":"2024-05-15T18:09:19.403941+0000","last_peered":"2024-05-15T18:09:19.403941+0000","last_clean":"2024-05-15T18:09:19.403941+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:09:19.403941+0000","last_undegraded":"2024-05-15T18:09:19.403941+0000","last_fullsized":"2024-05-15T18:09:19.403941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:56:14.840773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393707+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:10:48.393707+0000","last_peered":"2024-05-15T18:10:48.393707+0000","last_clean":"2024-05-15T18:10:48.393707+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:10:48.393707+0000","last_undegraded":"2024-05-15T18:10:48.393707+0000","last_fullsized":"2024-05-15T18:10:48.393707+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:06:12.136063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075396+0000","last_change":"2024-05-15T18:08:39.192086+0000","last_active":"2024-05-15T18:11:47.075396+0000","last_peered":"2024-05-15T18:11:47.075396+0000","last_clean":"2024-05-15T18:11:47.075396+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:11:47.075396+0000","last_undegraded":"2024-05-15T18:11:47.075396+0000","last_fullsized":"2024-05-15T18:11:47.075396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:08.553549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399520+0000","last_change":"2024-05-15T18:08:37.182183+0000","last_active":"2024-05-15T18:09:19.399520+0000","last_peered":"2024-05-15T18:09:19.399520+0000","last_clean":"2024-05-15T18:09:19.399520+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:09:19.399520+0000","last_undegraded":"2024-05-15T18:09:19.399520+0000","last_fullsized":"2024-05-15T18:09:19.399520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:19.415597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401501+0000","last_change":"2024-05-15T18:08:41.188718+0000","last_active":"2024-05-15T18:09:19.401501+0000","last_peered":"2024-05-15T18:09:19.401501+0000","last_clean":"2024-05-15T18:09:19.401501+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:09:19.401501+0000","last_undegraded":"2024-05-15T18:09:19.401501+0000","last_fullsized":"2024-05-15T18:09:19.401501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:42.285433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.006001+0000","last_change":"2024-05-15T18:08:43.194313+0000","last_active":"2024-05-15T18:10:45.006001+0000","last_peered":"2024-05-15T18:10:45.006001+0000","last_clean":"2024-05-15T18:10:45.006001+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:10:45.006001+0000","last_undegraded":"2024-05-15T18:10:45.006001+0000","last_fullsized":"2024-05-15T18:10:45.006001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:19.416460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'282","reported_seq":403,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.209358+0000","last_change":"2024-05-15T18:08:45.200646+0000","last_active":"2024-05-15T18:11:47.209358+0000","last_peered":"2024-05-15T18:11:47.209358+0000","last_clean":"2024-05-15T18:11:47.209358+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:11:47.209358+0000","last_undegraded":"2024-05-15T18:11:47.209358+0000","last_fullsized":"2024-05-15T18:11:47.209358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:10:00.536207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390249+0000","last_change":"2024-05-15T18:08:47.215424+0000","last_active":"2024-05-15T18:10:54.390249+0000","last_peered":"2024-05-15T18:10:54.390249+0000","last_clean":"2024-05-15T18:10:54.390249+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:10:54.390249+0000","last_undegraded":"2024-05-15T18:10:54.390249+0000","last_fullsized":"2024-05-15T18:10:54.390249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:38:08.396108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.800027+0000","last_change":"2024-05-15T18:08:39.187057+0000","last_active":"2024-05-15T18:11:46.800027+0000","last_peered":"2024-05-15T18:11:46.800027+0000","last_clean":"2024-05-15T18:11:46.800027+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:11:46.800027+0000","last_undegraded":"2024-05-15T18:11:46.800027+0000","last_fullsized":"2024-05-15T18:11:46.800027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.015300+0000","last_change":"2024-05-15T18:08:37.185221+0000","last_active":"2024-05-15T18:11:47.015300+0000","last_peered":"2024-05-15T18:11:47.015300+0000","last_clean":"2024-05-15T18:11:47.015300+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:11:47.015300+0000","last_undegraded":"2024-05-15T18:11:47.015300+0000","last_fullsized":"2024-05-15T18:11:47.015300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:28:54.139077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":413,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.048905+0000","last_change":"2024-05-15T18:08:41.190951+0000","last_active":"2024-05-15T18:10:46.048905+0000","last_peered":"2024-05-15T18:10:46.048905+0000","last_clean":"2024-05-15T18:10:46.048905+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:10:46.048905+0000","last_undegraded":"2024-05-15T18:10:46.048905+0000","last_fullsized":"2024-05-15T18:10:46.048905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:49.382359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399598+0000","last_change":"2024-05-15T18:08:43.204683+0000","last_active":"2024-05-15T18:09:19.399598+0000","last_peered":"2024-05-15T18:09:19.399598+0000","last_clean":"2024-05-15T18:09:19.399598+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:09:19.399598+0000","last_undegraded":"2024-05-15T18:09:19.399598+0000","last_fullsized":"2024-05-15T18:09:19.399598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:53.977325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'282","reported_seq":459,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.165903+0000","last_change":"2024-05-15T18:08:45.199310+0000","last_active":"2024-05-15T18:11:47.165903+0000","last_peered":"2024-05-15T18:11:47.165903+0000","last_clean":"2024-05-15T18:11:47.165903+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:11:47.165903+0000","last_undegraded":"2024-05-15T18:11:47.165903+0000","last_fullsized":"2024-05-15T18:11:47.165903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:47.091936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.189456+0000","last_change":"2024-05-15T18:08:47.215824+0000","last_active":"2024-05-15T18:10:46.189456+0000","last_peered":"2024-05-15T18:10:46.189456+0000","last_clean":"2024-05-15T18:10:46.189456+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:10:46.189456+0000","last_undegraded":"2024-05-15T18:10:46.189456+0000","last_fullsized":"2024-05-15T18:10:46.189456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:24:54.483230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082864+0000","last_change":"2024-05-15T18:08:39.194733+0000","last_active":"2024-05-15T18:09:20.082864+0000","last_peered":"2024-05-15T18:09:20.082864+0000","last_clean":"2024-05-15T18:09:20.082864+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:09:20.082864+0000","last_undegraded":"2024-05-15T18:09:20.082864+0000","last_fullsized":"2024-05-15T18:09:20.082864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:57.618713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398143+0000","last_change":"2024-05-15T18:08:37.183998+0000","last_active":"2024-05-15T18:09:19.398143+0000","last_peered":"2024-05-15T18:09:19.398143+0000","last_clean":"2024-05-15T18:09:19.398143+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:09:19.398143+0000","last_undegraded":"2024-05-15T18:09:19.398143+0000","last_fullsized":"2024-05-15T18:09:19.398143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:37.009803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399709+0000","last_change":"2024-05-15T18:08:41.189678+0000","last_active":"2024-05-15T18:09:19.399709+0000","last_peered":"2024-05-15T18:09:19.399709+0000","last_clean":"2024-05-15T18:09:19.399709+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:09:19.399709+0000","last_undegraded":"2024-05-15T18:09:19.399709+0000","last_fullsized":"2024-05-15T18:09:19.399709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:35.879769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'38","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.991934+0000","last_change":"2024-05-15T18:08:43.192247+0000","last_active":"2024-05-15T18:10:44.991934+0000","last_peered":"2024-05-15T18:10:44.991934+0000","last_clean":"2024-05-15T18:10:44.991934+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:10:44.991934+0000","last_undegraded":"2024-05-15T18:10:44.991934+0000","last_fullsized":"2024-05-15T18:10:44.991934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:20:02.720208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406471+0000","last_change":"2024-05-15T18:08:45.204036+0000","last_active":"2024-05-15T18:09:19.406471+0000","last_peered":"2024-05-15T18:09:19.406471+0000","last_clean":"2024-05-15T18:09:19.406471+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:09:19.406471+0000","last_undegraded":"2024-05-15T18:09:19.406471+0000","last_fullsized":"2024-05-15T18:09:19.406471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:50.743550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.207224+0000","last_change":"2024-05-15T18:08:47.214760+0000","last_active":"2024-05-15T18:11:47.207224+0000","last_peered":"2024-05-15T18:11:47.207224+0000","last_clean":"2024-05-15T18:11:47.207224+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:11:47.207224+0000","last_undegraded":"2024-05-15T18:11:47.207224+0000","last_fullsized":"2024-05-15T18:11:47.207224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:10.382678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401664+0000","last_change":"2024-05-15T18:08:39.189647+0000","last_active":"2024-05-15T18:09:19.401664+0000","last_peered":"2024-05-15T18:09:19.401664+0000","last_clean":"2024-05-15T18:09:19.401664+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:09:19.401664+0000","last_undegraded":"2024-05-15T18:09:19.401664+0000","last_fullsized":"2024-05-15T18:09:19.401664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:38.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399372+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:09:19.399372+0000","last_peered":"2024-05-15T18:09:19.399372+0000","last_clean":"2024-05-15T18:09:19.399372+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:09:19.399372+0000","last_undegraded":"2024-05-15T18:09:19.399372+0000","last_fullsized":"2024-05-15T18:09:19.399372+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:38:29.703834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399455+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:09:19.399455+0000","last_peered":"2024-05-15T18:09:19.399455+0000","last_clean":"2024-05-15T18:09:19.399455+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:09:19.399455+0000","last_undegraded":"2024-05-15T18:09:19.399455+0000","last_fullsized":"2024-05-15T18:09:19.399455+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:51:30.696652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398630+0000","last_change":"2024-05-15T18:08:37.186535+0000","last_active":"2024-05-15T18:09:19.398630+0000","last_peered":"2024-05-15T18:09:19.398630+0000","last_clean":"2024-05-15T18:09:19.398630+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:09:19.398630+0000","last_undegraded":"2024-05-15T18:09:19.398630+0000","last_fullsized":"2024-05-15T18:09:19.398630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:41.333162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403085+0000","last_change":"2024-05-15T18:08:41.191173+0000","last_active":"2024-05-15T18:09:19.403085+0000","last_peered":"2024-05-15T18:09:19.403085+0000","last_clean":"2024-05-15T18:09:19.403085+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:09:19.403085+0000","last_undegraded":"2024-05-15T18:09:19.403085+0000","last_fullsized":"2024-05-15T18:09:19.403085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:19:33.825447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'76","reported_seq":145,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.003655+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:45.003655+0000","last_peered":"2024-05-15T18:10:45.003655+0000","last_clean":"2024-05-15T18:10:45.003655+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:10:45.003655+0000","last_undegraded":"2024-05-15T18:10:45.003655+0000","last_fullsized":"2024-05-15T18:10:45.003655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:19.100640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401279+0000","last_change":"2024-05-15T18:08:45.208179+0000","last_active":"2024-05-15T18:09:19.401279+0000","last_peered":"2024-05-15T18:09:19.401279+0000","last_clean":"2024-05-15T18:09:19.401279+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:09:19.401279+0000","last_undegraded":"2024-05-15T18:09:19.401279+0000","last_fullsized":"2024-05-15T18:09:19.401279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:13:39.895143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":167,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.117287+0000","last_change":"2024-05-15T18:08:47.212621+0000","last_active":"2024-05-15T18:11:47.117287+0000","last_peered":"2024-05-15T18:11:47.117287+0000","last_clean":"2024-05-15T18:11:47.117287+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:11:47.117287+0000","last_undegraded":"2024-05-15T18:11:47.117287+0000","last_fullsized":"2024-05-15T18:11:47.117287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:45.928963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817460+0000","last_change":"2024-05-15T18:08:39.180830+0000","last_active":"2024-05-15T18:09:20.817460+0000","last_peered":"2024-05-15T18:09:20.817460+0000","last_clean":"2024-05-15T18:09:20.817460+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:09:20.817460+0000","last_undegraded":"2024-05-15T18:09:20.817460+0000","last_fullsized":"2024-05-15T18:09:20.817460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:44.720954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398139+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:09:19.398139+0000","last_peered":"2024-05-15T18:09:19.398139+0000","last_clean":"2024-05-15T18:09:19.398139+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:09:19.398139+0000","last_undegraded":"2024-05-15T18:09:19.398139+0000","last_fullsized":"2024-05-15T18:09:19.398139+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:44:53.976619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399209+0000","last_change":"2024-05-15T18:08:37.179663+0000","last_active":"2024-05-15T18:09:19.399209+0000","last_peered":"2024-05-15T18:09:19.399209+0000","last_clean":"2024-05-15T18:09:19.399209+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:09:19.399209+0000","last_undegraded":"2024-05-15T18:09:19.399209+0000","last_fullsized":"2024-05-15T18:09:19.399209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:26:15.485126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404825+0000","last_change":"2024-05-15T18:08:41.192861+0000","last_active":"2024-05-15T18:09:19.404825+0000","last_peered":"2024-05-15T18:09:19.404825+0000","last_clean":"2024-05-15T18:09:19.404825+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:09:19.404825+0000","last_undegraded":"2024-05-15T18:09:19.404825+0000","last_fullsized":"2024-05-15T18:09:19.404825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:32.544124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'276","reported_seq":479,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274219+0000","last_change":"2024-05-15T18:08:43.197473+0000","last_active":"2024-05-15T18:11:46.274219+0000","last_peered":"2024-05-15T18:11:46.274219+0000","last_clean":"2024-05-15T18:11:46.274219+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:11:46.274219+0000","last_undegraded":"2024-05-15T18:11:46.274219+0000","last_fullsized":"2024-05-15T18:11:46.274219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:56.013010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":363,"num_read_kb":363,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400972+0000","last_change":"2024-05-15T18:08:45.210778+0000","last_active":"2024-05-15T18:09:19.400972+0000","last_peered":"2024-05-15T18:09:19.400972+0000","last_clean":"2024-05-15T18:09:19.400972+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:09:19.400972+0000","last_undegraded":"2024-05-15T18:09:19.400972+0000","last_fullsized":"2024-05-15T18:09:19.400972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:40:44.142402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.643784+0000","last_change":"2024-05-15T18:08:47.217222+0000","last_active":"2024-05-15T18:10:02.643784+0000","last_peered":"2024-05-15T18:10:02.643784+0000","last_clean":"2024-05-15T18:10:02.643784+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:10:02.643784+0000","last_undegraded":"2024-05-15T18:10:02.643784+0000","last_fullsized":"2024-05-15T18:10:02.643784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075441+0000","last_change":"2024-05-15T18:08:39.186998+0000","last_active":"2024-05-15T18:11:47.075441+0000","last_peered":"2024-05-15T18:11:47.075441+0000","last_clean":"2024-05-15T18:11:47.075441+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:11:47.075441+0000","last_undegraded":"2024-05-15T18:11:47.075441+0000","last_fullsized":"2024-05-15T18:11:47.075441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405333+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:09:19.405333+0000","last_peered":"2024-05-15T18:09:19.405333+0000","last_clean":"2024-05-15T18:09:19.405333+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:09:19.405333+0000","last_undegraded":"2024-05-15T18:09:19.405333+0000","last_fullsized":"2024-05-15T18:09:19.405333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398590+0000","last_change":"2024-05-15T18:08:37.173060+0000","last_active":"2024-05-15T18:09:19.398590+0000","last_peered":"2024-05-15T18:09:19.398590+0000","last_clean":"2024-05-15T18:09:19.398590+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:09:19.398590+0000","last_undegraded":"2024-05-15T18:09:19.398590+0000","last_fullsized":"2024-05-15T18:09:19.398590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.417136+0000","last_change":"2024-05-15T18:09:19.416671+0000","last_active":"2024-05-15T18:09:19.417136+0000","last_peered":"2024-05-15T18:09:19.417136+0000","last_clean":"2024-05-15T18:09:19.417136+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:09:19.417136+0000","last_undegraded":"2024-05-15T18:09:19.417136+0000","last_fullsized":"2024-05-15T18:09:19.417136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:46.020343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'17","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274261+0000","last_change":"2024-05-15T18:08:43.195546+0000","last_active":"2024-05-15T18:11:46.274261+0000","last_peered":"2024-05-15T18:11:46.274261+0000","last_clean":"2024-05-15T18:11:46.274261+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:11:46.274261+0000","last_undegraded":"2024-05-15T18:11:46.274261+0000","last_fullsized":"2024-05-15T18:11:46.274261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:45:01.029538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400090+0000","last_change":"2024-05-15T18:08:45.204246+0000","last_active":"2024-05-15T18:09:19.400090+0000","last_peered":"2024-05-15T18:09:19.400090+0000","last_clean":"2024-05-15T18:09:19.400090+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:09:19.400090+0000","last_undegraded":"2024-05-15T18:09:19.400090+0000","last_fullsized":"2024-05-15T18:09:19.400090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:36.559499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398480+0000","last_change":"2024-05-15T18:08:47.219388+0000","last_active":"2024-05-15T18:09:19.398480+0000","last_peered":"2024-05-15T18:09:19.398480+0000","last_clean":"2024-05-15T18:09:19.398480+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:09:19.398480+0000","last_undegraded":"2024-05-15T18:09:19.398480+0000","last_fullsized":"2024-05-15T18:09:19.398480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:49.062143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027543+0000","last_change":"2024-05-15T18:08:39.184088+0000","last_active":"2024-05-15T18:11:47.027543+0000","last_peered":"2024-05-15T18:11:47.027543+0000","last_clean":"2024-05-15T18:11:47.027543+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:11:47.027543+0000","last_undegraded":"2024-05-15T18:11:47.027543+0000","last_fullsized":"2024-05-15T18:11:47.027543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398689+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:09:19.398689+0000","last_peered":"2024-05-15T18:09:19.398689+0000","last_clean":"2024-05-15T18:09:19.398689+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:09:19.398689+0000","last_undegraded":"2024-05-15T18:09:19.398689+0000","last_fullsized":"2024-05-15T18:09:19.398689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:36:43.128557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406217+0000","last_change":"2024-05-15T18:08:37.173069+0000","last_active":"2024-05-15T18:09:19.406217+0000","last_peered":"2024-05-15T18:09:19.406217+0000","last_clean":"2024-05-15T18:09:19.406217+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:09:19.406217+0000","last_undegraded":"2024-05-15T18:09:19.406217+0000","last_fullsized":"2024-05-15T18:09:19.406217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:03:28.461086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401267+0000","last_change":"2024-05-15T18:08:41.191439+0000","last_active":"2024-05-15T18:09:19.401267+0000","last_peered":"2024-05-15T18:09:19.401267+0000","last_clean":"2024-05-15T18:09:19.401267+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:09:19.401267+0000","last_undegraded":"2024-05-15T18:09:19.401267+0000","last_fullsized":"2024-05-15T18:09:19.401267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:23:42.753008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'14","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.426994+0000","last_change":"2024-05-15T18:08:43.202158+0000","last_active":"2024-05-15T18:11:46.426994+0000","last_peered":"2024-05-15T18:11:46.426994+0000","last_clean":"2024-05-15T18:11:46.426994+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:11:46.426994+0000","last_undegraded":"2024-05-15T18:11:46.426994+0000","last_fullsized":"2024-05-15T18:11:46.426994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:58:30.776682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404053+0000","last_change":"2024-05-15T18:08:45.211047+0000","last_active":"2024-05-15T18:09:19.404053+0000","last_peered":"2024-05-15T18:09:19.404053+0000","last_clean":"2024-05-15T18:09:19.404053+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:09:19.404053+0000","last_undegraded":"2024-05-15T18:09:19.404053+0000","last_fullsized":"2024-05-15T18:09:19.404053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:32.852658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.169134+0000","last_change":"2024-05-15T18:08:47.221837+0000","last_active":"2024-05-15T18:10:46.169134+0000","last_peered":"2024-05-15T18:10:46.169134+0000","last_clean":"2024-05-15T18:10:46.169134+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:10:46.169134+0000","last_undegraded":"2024-05-15T18:10:46.169134+0000","last_fullsized":"2024-05-15T18:10:46.169134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:52.042498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'7","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.413696+0000","last_change":"2024-05-15T18:08:39.194112+0000","last_active":"2024-05-15T18:10:46.413696+0000","last_peered":"2024-05-15T18:10:46.413696+0000","last_clean":"2024-05-15T18:10:46.413696+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:10:46.413696+0000","last_undegraded":"2024-05-15T18:10:46.413696+0000","last_fullsized":"2024-05-15T18:10:46.413696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:34.314353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408561+0000","last_change":"2024-05-15T18:08:37.173933+0000","last_active":"2024-05-15T18:09:19.408561+0000","last_peered":"2024-05-15T18:09:19.408561+0000","last_clean":"2024-05-15T18:09:19.408561+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:09:19.408561+0000","last_undegraded":"2024-05-15T18:09:19.408561+0000","last_fullsized":"2024-05-15T18:09:19.408561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400028+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:09:19.400028+0000","last_peered":"2024-05-15T18:09:19.400028+0000","last_clean":"2024-05-15T18:09:19.400028+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:09:19.400028+0000","last_undegraded":"2024-05-15T18:09:19.400028+0000","last_fullsized":"2024-05-15T18:09:19.400028+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:56:48.800779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.228107+0000","last_change":"2024-05-15T18:08:41.195863+0000","last_active":"2024-05-15T18:11:47.228107+0000","last_peered":"2024-05-15T18:11:47.228107+0000","last_clean":"2024-05-15T18:11:47.228107+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:11:47.228107+0000","last_undegraded":"2024-05-15T18:11:47.228107+0000","last_fullsized":"2024-05-15T18:11:47.228107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:40:08.456674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'67","reported_seq":134,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.792224+0000","last_change":"2024-05-15T18:08:43.200791+0000","last_active":"2024-05-15T18:11:53.792224+0000","last_peered":"2024-05-15T18:11:53.792224+0000","last_clean":"2024-05-15T18:11:53.792224+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:11:53.792224+0000","last_undegraded":"2024-05-15T18:11:53.792224+0000","last_fullsized":"2024-05-15T18:11:53.792224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:58:52.336305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405836+0000","last_change":"2024-05-15T18:08:45.198343+0000","last_active":"2024-05-15T18:09:19.405836+0000","last_peered":"2024-05-15T18:09:19.405836+0000","last_clean":"2024-05-15T18:09:19.405836+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:09:19.405836+0000","last_undegraded":"2024-05-15T18:09:19.405836+0000","last_fullsized":"2024-05-15T18:09:19.405836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:44.763619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.350044+0000","last_change":"2024-05-15T18:08:47.215201+0000","last_active":"2024-05-15T18:10:46.350044+0000","last_peered":"2024-05-15T18:10:46.350044+0000","last_clean":"2024-05-15T18:10:46.350044+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:10:46.350044+0000","last_undegraded":"2024-05-15T18:10:46.350044+0000","last_fullsized":"2024-05-15T18:10:46.350044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:59:36.775916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101867+0000","last_change":"2024-05-15T18:09:19.415333+0000","last_active":"2024-05-15T18:11:47.101867+0000","last_peered":"2024-05-15T18:11:47.101867+0000","last_clean":"2024-05-15T18:11:47.101867+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:11:47.101867+0000","last_undegraded":"2024-05-15T18:11:47.101867+0000","last_fullsized":"2024-05-15T18:11:47.101867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400285+0000","last_change":"2024-05-15T18:08:37.180268+0000","last_active":"2024-05-15T18:09:19.400285+0000","last_peered":"2024-05-15T18:09:19.400285+0000","last_clean":"2024-05-15T18:09:19.400285+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:09:19.400285+0000","last_undegraded":"2024-05-15T18:09:19.400285+0000","last_fullsized":"2024-05-15T18:09:19.400285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:22:41.796585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401559+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:09:19.401559+0000","last_peered":"2024-05-15T18:09:19.401559+0000","last_clean":"2024-05-15T18:09:19.401559+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:09:19.401559+0000","last_undegraded":"2024-05-15T18:09:19.401559+0000","last_fullsized":"2024-05-15T18:09:19.401559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:13.458538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399025+0000","last_change":"2024-05-15T18:08:41.191700+0000","last_active":"2024-05-15T18:09:19.399025+0000","last_peered":"2024-05-15T18:09:19.399025+0000","last_clean":"2024-05-15T18:09:19.399025+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:09:19.399025+0000","last_undegraded":"2024-05-15T18:09:19.399025+0000","last_fullsized":"2024-05-15T18:09:19.399025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:54.945021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402578+0000","last_change":"2024-05-15T18:08:43.197679+0000","last_active":"2024-05-15T18:09:19.402578+0000","last_peered":"2024-05-15T18:09:19.402578+0000","last_clean":"2024-05-15T18:09:19.402578+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:09:19.402578+0000","last_undegraded":"2024-05-15T18:09:19.402578+0000","last_fullsized":"2024-05-15T18:09:19.402578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:33.125848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'282","reported_seq":346,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.274176+0000","last_change":"2024-05-15T18:08:45.204211+0000","last_active":"2024-05-15T18:11:46.274176+0000","last_peered":"2024-05-15T18:11:46.274176+0000","last_clean":"2024-05-15T18:11:46.274176+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:46.274176+0000","last_undegraded":"2024-05-15T18:11:46.274176+0000","last_fullsized":"2024-05-15T18:11:46.274176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:01:11.331448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.839010+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:10:02.839010+0000","last_peered":"2024-05-15T18:10:02.839010+0000","last_clean":"2024-05-15T18:10:02.839010+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:10:02.839010+0000","last_undegraded":"2024-05-15T18:10:02.839010+0000","last_fullsized":"2024-05-15T18:10:02.839010+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:42:27.490184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'1","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392336+0000","last_change":"2024-05-15T18:08:39.188916+0000","last_active":"2024-05-15T18:10:38.392336+0000","last_peered":"2024-05-15T18:10:38.392336+0000","last_clean":"2024-05-15T18:10:38.392336+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:10:38.392336+0000","last_undegraded":"2024-05-15T18:10:38.392336+0000","last_fullsized":"2024-05-15T18:10:38.392336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:40:47.464267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.831319+0000","last_change":"2024-05-15T18:08:37.184221+0000","last_active":"2024-05-15T18:10:02.831319+0000","last_peered":"2024-05-15T18:10:02.831319+0000","last_clean":"2024-05-15T18:10:02.831319+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:10:02.831319+0000","last_undegraded":"2024-05-15T18:10:02.831319+0000","last_fullsized":"2024-05-15T18:10:02.831319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:08.495247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:35:14.064562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400602+0000","last_change":"2024-05-15T18:08:41.191409+0000","last_active":"2024-05-15T18:09:19.400602+0000","last_peered":"2024-05-15T18:09:19.400602+0000","last_clean":"2024-05-15T18:09:19.400602+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:09:19.400602+0000","last_undegraded":"2024-05-15T18:09:19.400602+0000","last_fullsized":"2024-05-15T18:09:19.400602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:43.076562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399422+0000","last_change":"2024-05-15T18:08:43.205538+0000","last_active":"2024-05-15T18:09:19.399422+0000","last_peered":"2024-05-15T18:09:19.399422+0000","last_clean":"2024-05-15T18:09:19.399422+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:09:19.399422+0000","last_undegraded":"2024-05-15T18:09:19.399422+0000","last_fullsized":"2024-05-15T18:09:19.399422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:04.322801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":392,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.658899+0000","last_change":"2024-05-15T18:08:45.198430+0000","last_active":"2024-05-15T18:11:53.658899+0000","last_peered":"2024-05-15T18:11:53.658899+0000","last_clean":"2024-05-15T18:11:53.658899+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:11:53.658899+0000","last_undegraded":"2024-05-15T18:11:53.658899+0000","last_fullsized":"2024-05-15T18:11:53.658899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:30:20.124986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401547+0000","last_change":"2024-05-15T18:08:47.222589+0000","last_active":"2024-05-15T18:09:19.401547+0000","last_peered":"2024-05-15T18:09:19.401547+0000","last_clean":"2024-05-15T18:09:19.401547+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:09:19.401547+0000","last_undegraded":"2024-05-15T18:09:19.401547+0000","last_fullsized":"2024-05-15T18:09:19.401547+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:53.589231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894689+0000","last_change":"2024-05-15T18:08:39.185262+0000","last_active":"2024-05-15T18:11:46.894689+0000","last_peered":"2024-05-15T18:11:46.894689+0000","last_clean":"2024-05-15T18:11:46.894689+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:11:46.894689+0000","last_undegraded":"2024-05-15T18:11:46.894689+0000","last_fullsized":"2024-05-15T18:11:46.894689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:15:10.502882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.629114+0000","last_change":"2024-05-15T18:08:37.179237+0000","last_active":"2024-05-15T18:10:02.629114+0000","last_peered":"2024-05-15T18:10:02.629114+0000","last_clean":"2024-05-15T18:10:02.629114+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:10:02.629114+0000","last_undegraded":"2024-05-15T18:10:02.629114+0000","last_fullsized":"2024-05-15T18:10:02.629114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:06:20.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.404325+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:09:19.404325+0000","last_peered":"2024-05-15T18:09:19.404325+0000","last_clean":"2024-05-15T18:09:19.404325+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:09:19.404325+0000","last_undegraded":"2024-05-15T18:09:19.404325+0000","last_fullsized":"2024-05-15T18:09:19.404325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:33:34.798074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399868+0000","last_change":"2024-05-15T18:08:41.192405+0000","last_active":"2024-05-15T18:09:19.399868+0000","last_peered":"2024-05-15T18:09:19.399868+0000","last_clean":"2024-05-15T18:09:19.399868+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:09:19.399868+0000","last_undegraded":"2024-05-15T18:09:19.399868+0000","last_fullsized":"2024-05-15T18:09:19.399868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:14.835496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'83","reported_seq":155,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393153+0000","last_change":"2024-05-15T18:08:43.199434+0000","last_active":"2024-05-15T18:10:48.393153+0000","last_peered":"2024-05-15T18:10:48.393153+0000","last_clean":"2024-05-15T18:10:48.393153+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:10:48.393153+0000","last_undegraded":"2024-05-15T18:10:48.393153+0000","last_fullsized":"2024-05-15T18:10:48.393153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:57.566833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6026,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399270+0000","last_change":"2024-05-15T18:08:45.201179+0000","last_active":"2024-05-15T18:09:19.399270+0000","last_peered":"2024-05-15T18:09:19.399270+0000","last_clean":"2024-05-15T18:09:19.399270+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:09:19.399270+0000","last_undegraded":"2024-05-15T18:09:19.399270+0000","last_fullsized":"2024-05-15T18:09:19.399270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:18.850871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408019+0000","last_change":"2024-05-15T18:08:47.209997+0000","last_active":"2024-05-15T18:09:19.408019+0000","last_peered":"2024-05-15T18:09:19.408019+0000","last_clean":"2024-05-15T18:09:19.408019+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:09:19.408019+0000","last_undegraded":"2024-05-15T18:09:19.408019+0000","last_fullsized":"2024-05-15T18:09:19.408019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:11.856816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.897494+0000","last_change":"2024-05-15T18:08:47.219593+0000","last_active":"2024-05-15T18:11:46.897494+0000","last_peered":"2024-05-15T18:11:46.897494+0000","last_clean":"2024-05-15T18:11:46.897494+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:11:46.897494+0000","last_undegraded":"2024-05-15T18:11:46.897494+0000","last_fullsized":"2024-05-15T18:11:46.897494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:35:20.857650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.820271+0000","last_change":"2024-05-15T18:08:39.185432+0000","last_active":"2024-05-15T18:09:20.820271+0000","last_peered":"2024-05-15T18:09:20.820271+0000","last_clean":"2024-05-15T18:09:20.820271+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:09:20.820271+0000","last_undegraded":"2024-05-15T18:09:20.820271+0000","last_fullsized":"2024-05-15T18:09:20.820271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399246+0000","last_change":"2024-05-15T18:08:37.185935+0000","last_active":"2024-05-15T18:09:19.399246+0000","last_peered":"2024-05-15T18:09:19.399246+0000","last_clean":"2024-05-15T18:09:19.399246+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:09:19.399246+0000","last_undegraded":"2024-05-15T18:09:19.399246+0000","last_fullsized":"2024-05-15T18:09:19.399246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:44.983084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407349+0000","last_change":"2024-05-15T18:09:19.404553+0000","last_active":"2024-05-15T18:09:19.407349+0000","last_peered":"2024-05-15T18:09:19.407349+0000","last_clean":"2024-05-15T18:09:19.407349+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:09:19.407349+0000","last_undegraded":"2024-05-15T18:09:19.407349+0000","last_fullsized":"2024-05-15T18:09:19.407349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:21:02.315463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'33","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.996245+0000","last_change":"2024-05-15T18:08:43.204709+0000","last_active":"2024-05-15T18:10:44.996245+0000","last_peered":"2024-05-15T18:10:44.996245+0000","last_clean":"2024-05-15T18:10:44.996245+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:10:44.996245+0000","last_undegraded":"2024-05-15T18:10:44.996245+0000","last_fullsized":"2024-05-15T18:10:44.996245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:50.124485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399714+0000","last_change":"2024-05-15T18:08:45.208742+0000","last_active":"2024-05-15T18:09:19.399714+0000","last_peered":"2024-05-15T18:09:19.399714+0000","last_clean":"2024-05-15T18:09:19.399714+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:09:19.399714+0000","last_undegraded":"2024-05-15T18:09:19.399714+0000","last_fullsized":"2024-05-15T18:09:19.399714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:53:19.949081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.822180+0000","last_change":"2024-05-15T18:08:47.216635+0000","last_active":"2024-05-15T18:11:46.822180+0000","last_peered":"2024-05-15T18:11:46.822180+0000","last_clean":"2024-05-15T18:11:46.822180+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:11:46.822180+0000","last_undegraded":"2024-05-15T18:11:46.822180+0000","last_fullsized":"2024-05-15T18:11:46.822180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:25:14.134900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'5","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114135+0000","last_change":"2024-05-15T18:08:39.192773+0000","last_active":"2024-05-15T18:11:47.114135+0000","last_peered":"2024-05-15T18:11:47.114135+0000","last_clean":"2024-05-15T18:11:47.114135+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:11:47.114135+0000","last_undegraded":"2024-05-15T18:11:47.114135+0000","last_fullsized":"2024-05-15T18:11:47.114135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395528+0000","last_change":"2024-05-15T18:08:37.178179+0000","last_active":"2024-05-15T18:11:03.395528+0000","last_peered":"2024-05-15T18:11:03.395528+0000","last_clean":"2024-05-15T18:11:03.395528+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:11:03.395528+0000","last_undegraded":"2024-05-15T18:11:03.395528+0000","last_fullsized":"2024-05-15T18:11:03.395528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400105+0000","last_change":"2024-05-15T18:08:41.192415+0000","last_active":"2024-05-15T18:09:19.400105+0000","last_peered":"2024-05-15T18:09:19.400105+0000","last_clean":"2024-05-15T18:09:19.400105+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:09:19.400105+0000","last_undegraded":"2024-05-15T18:09:19.400105+0000","last_fullsized":"2024-05-15T18:09:19.400105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:33:26.664611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'5","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.431632+0000","last_change":"2024-05-15T18:08:43.195098+0000","last_active":"2024-05-15T18:11:46.431632+0000","last_peered":"2024-05-15T18:11:46.431632+0000","last_clean":"2024-05-15T18:11:46.431632+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:11:46.431632+0000","last_undegraded":"2024-05-15T18:11:46.431632+0000","last_fullsized":"2024-05-15T18:11:46.431632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:56.349586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405485+0000","last_change":"2024-05-15T18:08:45.208464+0000","last_active":"2024-05-15T18:09:19.405485+0000","last_peered":"2024-05-15T18:09:19.405485+0000","last_clean":"2024-05-15T18:09:19.405485+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:09:19.405485+0000","last_undegraded":"2024-05-15T18:09:19.405485+0000","last_fullsized":"2024-05-15T18:09:19.405485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:55.283378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.083949+0000","last_change":"2024-05-15T18:08:47.209757+0000","last_active":"2024-05-15T18:09:20.083949+0000","last_peered":"2024-05-15T18:09:20.083949+0000","last_clean":"2024-05-15T18:09:20.083949+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:09:20.083949+0000","last_undegraded":"2024-05-15T18:09:20.083949+0000","last_fullsized":"2024-05-15T18:09:20.083949+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901409+0000","last_change":"2024-05-15T18:08:39.182386+0000","last_active":"2024-05-15T18:11:46.901409+0000","last_peered":"2024-05-15T18:11:46.901409+0000","last_clean":"2024-05-15T18:11:46.901409+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:11:46.901409+0000","last_undegraded":"2024-05-15T18:11:46.901409+0000","last_fullsized":"2024-05-15T18:11:46.901409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:43:43.340798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408230+0000","last_change":"2024-05-15T18:08:37.176233+0000","last_active":"2024-05-15T18:09:19.408230+0000","last_peered":"2024-05-15T18:09:19.408230+0000","last_clean":"2024-05-15T18:09:19.408230+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:09:19.408230+0000","last_undegraded":"2024-05-15T18:09:19.408230+0000","last_fullsized":"2024-05-15T18:09:19.408230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:06:51.917750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.405491+0000","last_change":"2024-05-15T18:08:41.196522+0000","last_active":"2024-05-15T18:09:19.405491+0000","last_peered":"2024-05-15T18:09:19.405491+0000","last_clean":"2024-05-15T18:09:19.405491+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:09:19.405491+0000","last_undegraded":"2024-05-15T18:09:19.405491+0000","last_fullsized":"2024-05-15T18:09:19.405491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:21.511313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'44","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.729640+0000","last_change":"2024-05-15T18:08:43.192531+0000","last_active":"2024-05-15T18:11:53.729640+0000","last_peered":"2024-05-15T18:11:53.729640+0000","last_clean":"2024-05-15T18:11:53.729640+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:11:53.729640+0000","last_undegraded":"2024-05-15T18:11:53.729640+0000","last_fullsized":"2024-05-15T18:11:53.729640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:53.275341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399776+0000","last_change":"2024-05-15T18:08:45.200867+0000","last_active":"2024-05-15T18:09:19.399776+0000","last_peered":"2024-05-15T18:09:19.399776+0000","last_clean":"2024-05-15T18:09:19.399776+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:09:19.399776+0000","last_undegraded":"2024-05-15T18:09:19.399776+0000","last_fullsized":"2024-05-15T18:09:19.399776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:44:09.850036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398845+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:09:19.398845+0000","last_peered":"2024-05-15T18:09:19.398845+0000","last_clean":"2024-05-15T18:09:19.398845+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:09:19.398845+0000","last_undegraded":"2024-05-15T18:09:19.398845+0000","last_fullsized":"2024-05-15T18:09:19.398845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:58:53.641365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318729+0000","last_change":"2024-05-15T18:08:39.188917+0000","last_active":"2024-05-15T18:10:43.318729+0000","last_peered":"2024-05-15T18:10:43.318729+0000","last_clean":"2024-05-15T18:10:43.318729+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:10:43.318729+0000","last_undegraded":"2024-05-15T18:10:43.318729+0000","last_fullsized":"2024-05-15T18:10:43.318729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:15.401901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402731+0000","last_change":"2024-05-15T18:08:37.176555+0000","last_active":"2024-05-15T18:09:19.402731+0000","last_peered":"2024-05-15T18:09:19.402731+0000","last_clean":"2024-05-15T18:09:19.402731+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:09:19.402731+0000","last_undegraded":"2024-05-15T18:09:19.402731+0000","last_fullsized":"2024-05-15T18:09:19.402731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400688+0000","last_change":"2024-05-15T18:08:41.191236+0000","last_active":"2024-05-15T18:09:19.400688+0000","last_peered":"2024-05-15T18:09:19.400688+0000","last_clean":"2024-05-15T18:09:19.400688+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:09:19.400688+0000","last_undegraded":"2024-05-15T18:09:19.400688+0000","last_fullsized":"2024-05-15T18:09:19.400688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:09.434305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'31","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395415+0000","last_change":"2024-05-15T18:08:43.194399+0000","last_active":"2024-05-15T18:11:03.395415+0000","last_peered":"2024-05-15T18:11:03.395415+0000","last_clean":"2024-05-15T18:11:03.395415+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:11:03.395415+0000","last_undegraded":"2024-05-15T18:11:03.395415+0000","last_fullsized":"2024-05-15T18:11:03.395415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:34:44.292771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408147+0000","last_change":"2024-05-15T18:08:45.204060+0000","last_active":"2024-05-15T18:09:19.408147+0000","last_peered":"2024-05-15T18:09:19.408147+0000","last_clean":"2024-05-15T18:09:19.408147+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:09:19.408147+0000","last_undegraded":"2024-05-15T18:09:19.408147+0000","last_fullsized":"2024-05-15T18:09:19.408147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:35.133885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075577+0000","last_change":"2024-05-15T18:08:39.186233+0000","last_active":"2024-05-15T18:11:47.075577+0000","last_peered":"2024-05-15T18:11:47.075577+0000","last_clean":"2024-05-15T18:11:47.075577+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:11:47.075577+0000","last_undegraded":"2024-05-15T18:11:47.075577+0000","last_fullsized":"2024-05-15T18:11:47.075577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:06:29.111289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398303+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:09:19.398303+0000","last_peered":"2024-05-15T18:09:19.398303+0000","last_clean":"2024-05-15T18:09:19.398303+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:09:19.398303+0000","last_undegraded":"2024-05-15T18:09:19.398303+0000","last_fullsized":"2024-05-15T18:09:19.398303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:52.211486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401191+0000","last_change":"2024-05-15T18:08:41.191159+0000","last_active":"2024-05-15T18:09:19.401191+0000","last_peered":"2024-05-15T18:09:19.401191+0000","last_clean":"2024-05-15T18:09:19.401191+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:09:19.401191+0000","last_undegraded":"2024-05-15T18:09:19.401191+0000","last_fullsized":"2024-05-15T18:09:19.401191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:59.022200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'60","reported_seq":124,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.785018+0000","last_change":"2024-05-15T18:08:43.194657+0000","last_active":"2024-05-15T18:11:53.785018+0000","last_peered":"2024-05-15T18:11:53.785018+0000","last_clean":"2024-05-15T18:11:53.785018+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:11:53.785018+0000","last_undegraded":"2024-05-15T18:11:53.785018+0000","last_fullsized":"2024-05-15T18:11:53.785018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:47:48.735514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407819+0000","last_change":"2024-05-15T18:08:45.205356+0000","last_active":"2024-05-15T18:09:19.407819+0000","last_peered":"2024-05-15T18:09:19.407819+0000","last_clean":"2024-05-15T18:09:19.407819+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:09:19.407819+0000","last_undegraded":"2024-05-15T18:09:19.407819+0000","last_fullsized":"2024-05-15T18:09:19.407819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:39:01.866675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.346448+0000","last_change":"2024-05-15T18:08:47.215443+0000","last_active":"2024-05-15T18:10:46.346448+0000","last_peered":"2024-05-15T18:10:46.346448+0000","last_clean":"2024-05-15T18:10:46.346448+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:10:46.346448+0000","last_undegraded":"2024-05-15T18:10:46.346448+0000","last_fullsized":"2024-05-15T18:10:46.346448+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:49:38.789697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.353058+0000","last_change":"2024-05-15T18:08:39.186914+0000","last_active":"2024-05-15T18:09:20.353058+0000","last_peered":"2024-05-15T18:09:20.353058+0000","last_clean":"2024-05-15T18:09:20.353058+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:09:20.353058+0000","last_undegraded":"2024-05-15T18:09:20.353058+0000","last_fullsized":"2024-05-15T18:09:20.353058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407422+0000","last_change":"2024-05-15T18:09:19.405624+0000","last_active":"2024-05-15T18:09:19.407422+0000","last_peered":"2024-05-15T18:09:19.407422+0000","last_clean":"2024-05-15T18:09:19.407422+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:09:19.407422+0000","last_undegraded":"2024-05-15T18:09:19.407422+0000","last_fullsized":"2024-05-15T18:09:19.407422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:48.812098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.407740+0000","last_change":"2024-05-15T18:08:41.191786+0000","last_active":"2024-05-15T18:09:19.407740+0000","last_peered":"2024-05-15T18:09:19.407740+0000","last_clean":"2024-05-15T18:09:19.407740+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:09:19.407740+0000","last_undegraded":"2024-05-15T18:09:19.407740+0000","last_fullsized":"2024-05-15T18:09:19.407740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:46:36.321574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'37","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397808+0000","last_change":"2024-05-15T18:08:43.204941+0000","last_active":"2024-05-15T18:11:13.397808+0000","last_peered":"2024-05-15T18:11:13.397808+0000","last_clean":"2024-05-15T18:11:13.397808+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:11:13.397808+0000","last_undegraded":"2024-05-15T18:11:13.397808+0000","last_fullsized":"2024-05-15T18:11:13.397808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:18:25.567210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403966+0000","last_change":"2024-05-15T18:08:45.208563+0000","last_active":"2024-05-15T18:09:19.403966+0000","last_peered":"2024-05-15T18:09:19.403966+0000","last_clean":"2024-05-15T18:09:19.403966+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:09:19.403966+0000","last_undegraded":"2024-05-15T18:09:19.403966+0000","last_fullsized":"2024-05-15T18:09:19.403966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:58.960395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398176+0000","last_change":"2024-05-15T18:08:47.218586+0000","last_active":"2024-05-15T18:09:19.398176+0000","last_peered":"2024-05-15T18:09:19.398176+0000","last_clean":"2024-05-15T18:09:19.398176+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:09:19.398176+0000","last_undegraded":"2024-05-15T18:09:19.398176+0000","last_fullsized":"2024-05-15T18:09:19.398176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:32:15.970197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.320156+0000","last_change":"2024-05-15T18:08:39.191981+0000","last_active":"2024-05-15T18:10:43.320156+0000","last_peered":"2024-05-15T18:10:43.320156+0000","last_clean":"2024-05-15T18:10:43.320156+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:10:43.320156+0000","last_undegraded":"2024-05-15T18:10:43.320156+0000","last_fullsized":"2024-05-15T18:10:43.320156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:58.705649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.020626+0000","last_change":"2024-05-15T18:08:37.175536+0000","last_active":"2024-05-15T18:11:47.020626+0000","last_peered":"2024-05-15T18:11:47.020626+0000","last_clean":"2024-05-15T18:11:47.020626+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:11:47.020626+0000","last_undegraded":"2024-05-15T18:11:47.020626+0000","last_fullsized":"2024-05-15T18:11:47.020626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.406884+0000","last_change":"2024-05-15T18:08:41.191062+0000","last_active":"2024-05-15T18:09:19.406884+0000","last_peered":"2024-05-15T18:09:19.406884+0000","last_clean":"2024-05-15T18:09:19.406884+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:09:19.406884+0000","last_undegraded":"2024-05-15T18:09:19.406884+0000","last_fullsized":"2024-05-15T18:09:19.406884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:24.557536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'36","reported_seq":83,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.778128+0000","last_change":"2024-05-15T18:08:43.201223+0000","last_active":"2024-05-15T18:11:53.778128+0000","last_peered":"2024-05-15T18:11:53.778128+0000","last_clean":"2024-05-15T18:11:53.778128+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:11:53.778128+0000","last_undegraded":"2024-05-15T18:11:53.778128+0000","last_fullsized":"2024-05-15T18:11:53.778128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:42.755582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400126+0000","last_change":"2024-05-15T18:08:45.198201+0000","last_active":"2024-05-15T18:09:19.400126+0000","last_peered":"2024-05-15T18:09:19.400126+0000","last_clean":"2024-05-15T18:09:19.400126+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:09:19.400126+0000","last_undegraded":"2024-05-15T18:09:19.400126+0000","last_fullsized":"2024-05-15T18:09:19.400126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:02:29.429253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.407284+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:10:46.407284+0000","last_peered":"2024-05-15T18:10:46.407284+0000","last_clean":"2024-05-15T18:10:46.407284+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:10:46.407284+0000","last_undegraded":"2024-05-15T18:10:46.407284+0000","last_fullsized":"2024-05-15T18:10:46.407284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:05.039222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'5","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.111277+0000","last_change":"2024-05-15T18:08:39.184374+0000","last_active":"2024-05-15T18:11:47.111277+0000","last_peered":"2024-05-15T18:11:47.111277+0000","last_clean":"2024-05-15T18:11:47.111277+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:11:47.111277+0000","last_undegraded":"2024-05-15T18:11:47.111277+0000","last_fullsized":"2024-05-15T18:11:47.111277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:24:30.545908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.023254+0000","last_change":"2024-05-15T18:08:37.183470+0000","last_active":"2024-05-15T18:11:47.023254+0000","last_peered":"2024-05-15T18:11:47.023254+0000","last_clean":"2024-05-15T18:11:47.023254+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:11:47.023254+0000","last_undegraded":"2024-05-15T18:11:47.023254+0000","last_fullsized":"2024-05-15T18:11:47.023254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:28:26.016738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403818+0000","last_change":"2024-05-15T18:08:41.190070+0000","last_active":"2024-05-15T18:09:19.403818+0000","last_peered":"2024-05-15T18:09:19.403818+0000","last_clean":"2024-05-15T18:09:19.403818+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:09:19.403818+0000","last_undegraded":"2024-05-15T18:09:19.403818+0000","last_fullsized":"2024-05-15T18:09:19.403818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:17.766305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.737811+0000","last_change":"2024-05-15T18:08:43.205310+0000","last_active":"2024-05-15T18:09:19.737811+0000","last_peered":"2024-05-15T18:09:19.737811+0000","last_clean":"2024-05-15T18:09:19.737811+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:09:19.737811+0000","last_undegraded":"2024-05-15T18:09:19.737811+0000","last_fullsized":"2024-05-15T18:09:19.737811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:56.886685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'282","reported_seq":370,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.219182+0000","last_change":"2024-05-15T18:08:45.207348+0000","last_active":"2024-05-15T18:11:47.219182+0000","last_peered":"2024-05-15T18:11:47.219182+0000","last_clean":"2024-05-15T18:11:47.219182+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:11:47.219182+0000","last_undegraded":"2024-05-15T18:11:47.219182+0000","last_fullsized":"2024-05-15T18:11:47.219182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:58.021047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.397876+0000","last_change":"2024-05-15T18:08:47.219182+0000","last_active":"2024-05-15T18:09:19.397876+0000","last_peered":"2024-05-15T18:09:19.397876+0000","last_clean":"2024-05-15T18:09:19.397876+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:09:19.397876+0000","last_undegraded":"2024-05-15T18:09:19.397876+0000","last_fullsized":"2024-05-15T18:09:19.397876+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:01.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.817578+0000","last_change":"2024-05-15T18:08:39.180759+0000","last_active":"2024-05-15T18:09:20.817578+0000","last_peered":"2024-05-15T18:09:20.817578+0000","last_clean":"2024-05-15T18:09:20.817578+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:09:20.817578+0000","last_undegraded":"2024-05-15T18:09:20.817578+0000","last_fullsized":"2024-05-15T18:09:20.817578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.403310+0000","last_change":"2024-05-15T18:08:37.176826+0000","last_active":"2024-05-15T18:09:19.403310+0000","last_peered":"2024-05-15T18:09:19.403310+0000","last_clean":"2024-05-15T18:09:19.403310+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:09:19.403310+0000","last_undegraded":"2024-05-15T18:09:19.403310+0000","last_fullsized":"2024-05-15T18:09:19.403310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401017+0000","last_change":"2024-05-15T18:08:41.192691+0000","last_active":"2024-05-15T18:09:19.401017+0000","last_peered":"2024-05-15T18:09:19.401017+0000","last_clean":"2024-05-15T18:09:19.401017+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:09:19.401017+0000","last_undegraded":"2024-05-15T18:09:19.401017+0000","last_fullsized":"2024-05-15T18:09:19.401017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:43:17.409123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'36","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.973083+0000","last_change":"2024-05-15T18:08:43.191489+0000","last_active":"2024-05-15T18:10:44.973083+0000","last_peered":"2024-05-15T18:10:44.973083+0000","last_clean":"2024-05-15T18:10:44.973083+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:10:44.973083+0000","last_undegraded":"2024-05-15T18:10:44.973083+0000","last_fullsized":"2024-05-15T18:10:44.973083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:58.528171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398467+0000","last_change":"2024-05-15T18:08:45.204577+0000","last_active":"2024-05-15T18:09:19.398467+0000","last_peered":"2024-05-15T18:09:19.398467+0000","last_clean":"2024-05-15T18:09:19.398467+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:09:19.398467+0000","last_undegraded":"2024-05-15T18:09:19.398467+0000","last_fullsized":"2024-05-15T18:09:19.398467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:43.922183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.511708+0000","last_change":"2024-05-15T18:08:47.217145+0000","last_active":"2024-05-15T18:11:46.511708+0000","last_peered":"2024-05-15T18:11:46.511708+0000","last_clean":"2024-05-15T18:11:46.511708+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:11:46.511708+0000","last_undegraded":"2024-05-15T18:11:46.511708+0000","last_fullsized":"2024-05-15T18:11:46.511708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:04:24.221148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841386+0000","last_change":"2024-05-15T18:08:39.180684+0000","last_active":"2024-05-15T18:10:02.841386+0000","last_peered":"2024-05-15T18:10:02.841386+0000","last_clean":"2024-05-15T18:10:02.841386+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:10:02.841386+0000","last_undegraded":"2024-05-15T18:10:02.841386+0000","last_fullsized":"2024-05-15T18:10:02.841386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:58:21.423233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401981+0000","last_change":"2024-05-15T18:08:37.185723+0000","last_active":"2024-05-15T18:09:19.401981+0000","last_peered":"2024-05-15T18:09:19.401981+0000","last_clean":"2024-05-15T18:09:19.401981+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:09:19.401981+0000","last_undegraded":"2024-05-15T18:09:19.401981+0000","last_fullsized":"2024-05-15T18:09:19.401981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:33.641924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408093+0000","last_change":"2024-05-15T18:08:41.194992+0000","last_active":"2024-05-15T18:09:19.408093+0000","last_peered":"2024-05-15T18:09:19.408093+0000","last_clean":"2024-05-15T18:09:19.408093+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:09:19.408093+0000","last_undegraded":"2024-05-15T18:09:19.408093+0000","last_fullsized":"2024-05-15T18:09:19.408093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:05:46.750498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'33","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.803395+0000","last_change":"2024-05-15T18:08:43.200599+0000","last_active":"2024-05-15T18:11:53.803395+0000","last_peered":"2024-05-15T18:11:53.803395+0000","last_clean":"2024-05-15T18:11:53.803395+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:11:53.803395+0000","last_undegraded":"2024-05-15T18:11:53.803395+0000","last_fullsized":"2024-05-15T18:11:53.803395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:22:01.411491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398116+0000","last_change":"2024-05-15T18:08:45.208564+0000","last_active":"2024-05-15T18:09:19.398116+0000","last_peered":"2024-05-15T18:09:19.398116+0000","last_clean":"2024-05-15T18:09:19.398116+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:09:19.398116+0000","last_undegraded":"2024-05-15T18:09:19.398116+0000","last_fullsized":"2024-05-15T18:09:19.398116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:04.792785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399101+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:09:19.399101+0000","last_peered":"2024-05-15T18:09:19.399101+0000","last_clean":"2024-05-15T18:09:19.399101+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:09:19.399101+0000","last_undegraded":"2024-05-15T18:09:19.399101+0000","last_fullsized":"2024-05-15T18:09:19.399101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:07:18.365146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.799158+0000","last_change":"2024-05-15T18:08:39.181861+0000","last_active":"2024-05-15T18:11:46.799158+0000","last_peered":"2024-05-15T18:11:46.799158+0000","last_clean":"2024-05-15T18:11:46.799158+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:11:46.799158+0000","last_undegraded":"2024-05-15T18:11:46.799158+0000","last_fullsized":"2024-05-15T18:11:46.799158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:44.835287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400551+0000","last_change":"2024-05-15T18:08:37.180611+0000","last_active":"2024-05-15T18:09:19.400551+0000","last_peered":"2024-05-15T18:09:19.400551+0000","last_clean":"2024-05-15T18:09:19.400551+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:09:19.400551+0000","last_undegraded":"2024-05-15T18:09:19.400551+0000","last_fullsized":"2024-05-15T18:09:19.400551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:10.580802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400217+0000","last_change":"2024-05-15T18:08:41.195751+0000","last_active":"2024-05-15T18:09:19.400217+0000","last_peered":"2024-05-15T18:09:19.400217+0000","last_clean":"2024-05-15T18:09:19.400217+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:09:19.400217+0000","last_undegraded":"2024-05-15T18:09:19.400217+0000","last_fullsized":"2024-05-15T18:09:19.400217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:11:46.842509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'26","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.997990+0000","last_change":"2024-05-15T18:08:43.205423+0000","last_active":"2024-05-15T18:10:44.997990+0000","last_peered":"2024-05-15T18:10:44.997990+0000","last_clean":"2024-05-15T18:10:44.997990+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:10:44.997990+0000","last_undegraded":"2024-05-15T18:10:44.997990+0000","last_fullsized":"2024-05-15T18:10:44.997990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:00:28.309886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398390+0000","last_change":"2024-05-15T18:08:45.208319+0000","last_active":"2024-05-15T18:09:19.398390+0000","last_peered":"2024-05-15T18:09:19.398390+0000","last_clean":"2024-05-15T18:09:19.398390+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:09:19.398390+0000","last_undegraded":"2024-05-15T18:09:19.398390+0000","last_fullsized":"2024-05-15T18:09:19.398390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:07.440878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.008319+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:10:45.008319+0000","last_peered":"2024-05-15T18:10:45.008319+0000","last_clean":"2024-05-15T18:10:45.008319+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:10:45.008319+0000","last_undegraded":"2024-05-15T18:10:45.008319+0000","last_fullsized":"2024-05-15T18:10:45.008319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:41:14.101874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318342+0000","last_change":"2024-05-15T18:08:39.182951+0000","last_active":"2024-05-15T18:10:43.318342+0000","last_peered":"2024-05-15T18:10:43.318342+0000","last_clean":"2024-05-15T18:10:43.318342+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:10:43.318342+0000","last_undegraded":"2024-05-15T18:10:43.318342+0000","last_fullsized":"2024-05-15T18:10:43.318342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:13:28.725507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.361686+0000","last_change":"2024-05-15T18:08:37.173604+0000","last_active":"2024-05-15T18:10:46.361686+0000","last_peered":"2024-05-15T18:10:46.361686+0000","last_clean":"2024-05-15T18:10:46.361686+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:10:46.361686+0000","last_undegraded":"2024-05-15T18:10:46.361686+0000","last_fullsized":"2024-05-15T18:10:46.361686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'2","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.690398+0000","last_change":"2024-05-15T18:08:41.194807+0000","last_active":"2024-05-15T18:10:43.690398+0000","last_peered":"2024-05-15T18:10:43.690398+0000","last_clean":"2024-05-15T18:10:43.690398+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:10:43.690398+0000","last_undegraded":"2024-05-15T18:10:43.690398+0000","last_fullsized":"2024-05-15T18:10:43.690398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:05:20.276747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'32","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.432549+0000","last_change":"2024-05-15T18:08:43.204827+0000","last_active":"2024-05-15T18:11:46.432549+0000","last_peered":"2024-05-15T18:11:46.432549+0000","last_clean":"2024-05-15T18:11:46.432549+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:11:46.432549+0000","last_undegraded":"2024-05-15T18:11:46.432549+0000","last_fullsized":"2024-05-15T18:11:46.432549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:25:58.418358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399211+0000","last_change":"2024-05-15T18:08:45.209586+0000","last_active":"2024-05-15T18:09:19.399211+0000","last_peered":"2024-05-15T18:09:19.399211+0000","last_clean":"2024-05-15T18:09:19.399211+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:09:19.399211+0000","last_undegraded":"2024-05-15T18:09:19.399211+0000","last_fullsized":"2024-05-15T18:09:19.399211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:27:13.449679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:45.011056+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:10:45.011056+0000","last_peered":"2024-05-15T18:10:45.011056+0000","last_clean":"2024-05-15T18:10:45.011056+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:10:45.011056+0000","last_undegraded":"2024-05-15T18:10:45.011056+0000","last_fullsized":"2024-05-15T18:10:45.011056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:34:17.179772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.101917+0000","last_change":"2024-05-15T18:08:39.193212+0000","last_active":"2024-05-15T18:11:47.101917+0000","last_peered":"2024-05-15T18:11:47.101917+0000","last_clean":"2024-05-15T18:11:47.101917+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:11:47.101917+0000","last_undegraded":"2024-05-15T18:11:47.101917+0000","last_fullsized":"2024-05-15T18:11:47.101917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:55:36.876278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'5","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392439+0000","last_change":"2024-05-15T18:08:37.175025+0000","last_active":"2024-05-15T18:10:43.392439+0000","last_peered":"2024-05-15T18:10:43.392439+0000","last_clean":"2024-05-15T18:10:43.392439+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:10:43.392439+0000","last_undegraded":"2024-05-15T18:10:43.392439+0000","last_fullsized":"2024-05-15T18:10:43.392439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:37:08.990281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":13,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.894085+0000","last_change":"2024-05-15T18:08:39.182556+0000","last_active":"2024-05-15T18:11:46.894085+0000","last_peered":"2024-05-15T18:11:46.894085+0000","last_clean":"2024-05-15T18:11:46.894085+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:11:46.894085+0000","last_undegraded":"2024-05-15T18:11:46.894085+0000","last_fullsized":"2024-05-15T18:11:46.894085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.097398+0000","last_change":"2024-05-15T18:08:37.174455+0000","last_active":"2024-05-15T18:11:47.097398+0000","last_peered":"2024-05-15T18:11:47.097398+0000","last_clean":"2024-05-15T18:11:47.097398+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:11:47.097398+0000","last_undegraded":"2024-05-15T18:11:47.097398+0000","last_fullsized":"2024-05-15T18:11:47.097398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:53:55.433344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.736540+0000","last_change":"2024-05-15T18:08:39.182083+0000","last_active":"2024-05-15T18:09:19.736540+0000","last_peered":"2024-05-15T18:09:19.736540+0000","last_clean":"2024-05-15T18:09:19.736540+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:09:19.736540+0000","last_undegraded":"2024-05-15T18:09:19.736540+0000","last_fullsized":"2024-05-15T18:09:19.736540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:16:51.998451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399083+0000","last_change":"2024-05-15T18:08:37.180276+0000","last_active":"2024-05-15T18:09:19.399083+0000","last_peered":"2024-05-15T18:09:19.399083+0000","last_clean":"2024-05-15T18:09:19.399083+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:09:19.399083+0000","last_undegraded":"2024-05-15T18:09:19.399083+0000","last_fullsized":"2024-05-15T18:09:19.399083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:42.498474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036744+0000","last_change":"2024-05-15T18:08:39.183629+0000","last_active":"2024-05-15T18:11:47.036744+0000","last_peered":"2024-05-15T18:11:47.036744+0000","last_clean":"2024-05-15T18:11:47.036744+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:11:47.036744+0000","last_undegraded":"2024-05-15T18:11:47.036744+0000","last_fullsized":"2024-05-15T18:11:47.036744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:52:54.219122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.685943+0000","last_change":"2024-05-15T18:08:37.180039+0000","last_active":"2024-05-15T18:11:46.685943+0000","last_peered":"2024-05-15T18:11:46.685943+0000","last_clean":"2024-05-15T18:11:46.685943+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:11:46.685943+0000","last_undegraded":"2024-05-15T18:11:46.685943+0000","last_fullsized":"2024-05-15T18:11:46.685943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081223+0000","last_change":"2024-05-15T18:08:39.183461+0000","last_active":"2024-05-15T18:11:47.081223+0000","last_peered":"2024-05-15T18:11:47.081223+0000","last_clean":"2024-05-15T18:11:47.081223+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:11:47.081223+0000","last_undegraded":"2024-05-15T18:11:47.081223+0000","last_fullsized":"2024-05-15T18:11:47.081223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:48:44.506109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.017699+0000","last_change":"2024-05-15T18:08:37.173194+0000","last_active":"2024-05-15T18:11:47.017699+0000","last_peered":"2024-05-15T18:11:47.017699+0000","last_clean":"2024-05-15T18:11:47.017699+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:47.017699+0000","last_undegraded":"2024-05-15T18:11:47.017699+0000","last_fullsized":"2024-05-15T18:11:47.017699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'7","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392566+0000","last_change":"2024-05-15T18:08:39.193040+0000","last_active":"2024-05-15T18:10:43.392566+0000","last_peered":"2024-05-15T18:10:43.392566+0000","last_clean":"2024-05-15T18:10:43.392566+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:10:43.392566+0000","last_undegraded":"2024-05-15T18:10:43.392566+0000","last_fullsized":"2024-05-15T18:10:43.392566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:51:39.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393392+0000","last_change":"2024-05-15T18:08:37.177086+0000","last_active":"2024-05-15T18:10:48.393392+0000","last_peered":"2024-05-15T18:10:48.393392+0000","last_clean":"2024-05-15T18:10:48.393392+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:10:48.393392+0000","last_undegraded":"2024-05-15T18:10:48.393392+0000","last_fullsized":"2024-05-15T18:10:48.393392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:00:34.224249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'7","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081078+0000","last_change":"2024-05-15T18:08:39.187231+0000","last_active":"2024-05-15T18:11:47.081078+0000","last_peered":"2024-05-15T18:11:47.081078+0000","last_clean":"2024-05-15T18:11:47.081078+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:11:47.081078+0000","last_undegraded":"2024-05-15T18:11:47.081078+0000","last_fullsized":"2024-05-15T18:11:47.081078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:00.009607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408334+0000","last_change":"2024-05-15T18:08:37.185249+0000","last_active":"2024-05-15T18:09:19.408334+0000","last_peered":"2024-05-15T18:09:19.408334+0000","last_clean":"2024-05-15T18:09:19.408334+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:09:19.408334+0000","last_undegraded":"2024-05-15T18:09:19.408334+0000","last_fullsized":"2024-05-15T18:09:19.408334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:23.578384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:02.841468+0000","last_change":"2024-05-15T18:08:39.182188+0000","last_active":"2024-05-15T18:10:02.841468+0000","last_peered":"2024-05-15T18:10:02.841468+0000","last_clean":"2024-05-15T18:10:02.841468+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:10:02.841468+0000","last_undegraded":"2024-05-15T18:10:02.841468+0000","last_fullsized":"2024-05-15T18:10:02.841468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:03.738707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401192+0000","last_change":"2024-05-15T18:08:37.173289+0000","last_active":"2024-05-15T18:09:19.401192+0000","last_peered":"2024-05-15T18:09:19.401192+0000","last_clean":"2024-05-15T18:09:19.401192+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:09:19.401192+0000","last_undegraded":"2024-05-15T18:09:19.401192+0000","last_fullsized":"2024-05-15T18:09:19.401192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:49:25.723441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.027663+0000","last_change":"2024-05-15T18:08:39.185677+0000","last_active":"2024-05-15T18:11:47.027663+0000","last_peered":"2024-05-15T18:11:47.027663+0000","last_clean":"2024-05-15T18:11:47.027663+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:11:47.027663+0000","last_undegraded":"2024-05-15T18:11:47.027663+0000","last_fullsized":"2024-05-15T18:11:47.027663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:22:07.754341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'1","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393745+0000","last_change":"2024-05-15T18:08:37.174784+0000","last_active":"2024-05-15T18:10:48.393745+0000","last_peered":"2024-05-15T18:10:48.393745+0000","last_clean":"2024-05-15T18:10:48.393745+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:10:48.393745+0000","last_undegraded":"2024-05-15T18:10:48.393745+0000","last_fullsized":"2024-05-15T18:10:48.393745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:11:01.731072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.080429+0000","last_change":"2024-05-15T18:08:39.184051+0000","last_active":"2024-05-15T18:09:20.080429+0000","last_peered":"2024-05-15T18:09:20.080429+0000","last_clean":"2024-05-15T18:09:20.080429+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:09:20.080429+0000","last_undegraded":"2024-05-15T18:09:20.080429+0000","last_fullsized":"2024-05-15T18:09:20.080429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:31:52.335026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399053+0000","last_change":"2024-05-15T18:08:37.179943+0000","last_active":"2024-05-15T18:09:19.399053+0000","last_peered":"2024-05-15T18:09:19.399053+0000","last_clean":"2024-05-15T18:09:19.399053+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:09:19.399053+0000","last_undegraded":"2024-05-15T18:09:19.399053+0000","last_fullsized":"2024-05-15T18:09:19.399053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:34.380824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075510+0000","last_change":"2024-05-15T18:09:19.409291+0000","last_active":"2024-05-15T18:11:47.075510+0000","last_peered":"2024-05-15T18:11:47.075510+0000","last_clean":"2024-05-15T18:11:47.075510+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:11:47.075510+0000","last_undegraded":"2024-05-15T18:11:47.075510+0000","last_fullsized":"2024-05-15T18:11:47.075510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:44:15.086081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.399908+0000","last_change":"2024-05-15T18:08:37.180111+0000","last_active":"2024-05-15T18:09:19.399908+0000","last_peered":"2024-05-15T18:09:19.399908+0000","last_clean":"2024-05-15T18:09:19.399908+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:09:19.399908+0000","last_undegraded":"2024-05-15T18:09:19.399908+0000","last_fullsized":"2024-05-15T18:09:19.399908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075128+0000","last_change":"2024-05-15T18:08:39.180126+0000","last_active":"2024-05-15T18:11:47.075128+0000","last_peered":"2024-05-15T18:11:47.075128+0000","last_clean":"2024-05-15T18:11:47.075128+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:11:47.075128+0000","last_undegraded":"2024-05-15T18:11:47.075128+0000","last_fullsized":"2024-05-15T18:11:47.075128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:55:53.932569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.402839+0000","last_change":"2024-05-15T18:08:37.178460+0000","last_active":"2024-05-15T18:09:19.402839+0000","last_peered":"2024-05-15T18:09:19.402839+0000","last_clean":"2024-05-15T18:09:19.402839+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:09:19.402839+0000","last_undegraded":"2024-05-15T18:09:19.402839+0000","last_fullsized":"2024-05-15T18:09:19.402839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:55:57.446189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'7","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901964+0000","last_change":"2024-05-15T18:08:39.193285+0000","last_active":"2024-05-15T18:11:46.901964+0000","last_peered":"2024-05-15T18:11:46.901964+0000","last_clean":"2024-05-15T18:11:46.901964+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:11:46.901964+0000","last_undegraded":"2024-05-15T18:11:46.901964+0000","last_fullsized":"2024-05-15T18:11:46.901964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:40.788960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.246822+0000","last_change":"2024-05-15T18:08:37.183430+0000","last_active":"2024-05-15T18:10:46.246822+0000","last_peered":"2024-05-15T18:10:46.246822+0000","last_clean":"2024-05-15T18:10:46.246822+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:10:46.246822+0000","last_undegraded":"2024-05-15T18:10:46.246822+0000","last_fullsized":"2024-05-15T18:10:46.246822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:16:22.035101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.318832+0000","last_change":"2024-05-15T18:08:39.187902+0000","last_active":"2024-05-15T18:10:43.318832+0000","last_peered":"2024-05-15T18:10:43.318832+0000","last_clean":"2024-05-15T18:10:43.318832+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:10:43.318832+0000","last_undegraded":"2024-05-15T18:10:43.318832+0000","last_fullsized":"2024-05-15T18:10:43.318832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:38:35.649559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401767+0000","last_change":"2024-05-15T18:08:37.181882+0000","last_active":"2024-05-15T18:09:19.401767+0000","last_peered":"2024-05-15T18:09:19.401767+0000","last_clean":"2024-05-15T18:09:19.401767+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:09:19.401767+0000","last_undegraded":"2024-05-15T18:09:19.401767+0000","last_fullsized":"2024-05-15T18:09:19.401767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:01.779453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.400257+0000","last_change":"2024-05-15T18:08:39.188670+0000","last_active":"2024-05-15T18:09:19.400257+0000","last_peered":"2024-05-15T18:09:19.400257+0000","last_clean":"2024-05-15T18:09:19.400257+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:09:19.400257+0000","last_undegraded":"2024-05-15T18:09:19.400257+0000","last_fullsized":"2024-05-15T18:09:19.400257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:47.375138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.408417+0000","last_change":"2024-05-15T18:08:37.179459+0000","last_active":"2024-05-15T18:09:19.408417+0000","last_peered":"2024-05-15T18:09:19.408417+0000","last_clean":"2024-05-15T18:09:19.408417+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:09:19.408417+0000","last_undegraded":"2024-05-15T18:09:19.408417+0000","last_fullsized":"2024-05-15T18:09:19.408417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:33:36.233943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.075176+0000","last_change":"2024-05-15T18:08:39.178597+0000","last_active":"2024-05-15T18:11:47.075176+0000","last_peered":"2024-05-15T18:11:47.075176+0000","last_clean":"2024-05-15T18:11:47.075176+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:11:47.075176+0000","last_undegraded":"2024-05-15T18:11:47.075176+0000","last_fullsized":"2024-05-15T18:11:47.075176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:26:39.017439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.012658+0000","last_change":"2024-05-15T18:09:19.409578+0000","last_active":"2024-05-15T18:11:47.012658+0000","last_peered":"2024-05-15T18:11:47.012658+0000","last_clean":"2024-05-15T18:11:47.012658+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:11:47.012658+0000","last_undegraded":"2024-05-15T18:11:47.012658+0000","last_fullsized":"2024-05-15T18:11:47.012658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:50.864491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398577+0000","last_change":"2024-05-15T18:08:37.182059+0000","last_active":"2024-05-15T18:09:19.398577+0000","last_peered":"2024-05-15T18:09:19.398577+0000","last_clean":"2024-05-15T18:09:19.398577+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:09:19.398577+0000","last_undegraded":"2024-05-15T18:09:19.398577+0000","last_fullsized":"2024-05-15T18:09:19.398577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:38.781325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.401588+0000","last_change":"2024-05-15T18:08:39.190238+0000","last_active":"2024-05-15T18:09:19.401588+0000","last_peered":"2024-05-15T18:09:19.401588+0000","last_clean":"2024-05-15T18:09:19.401588+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:09:19.401588+0000","last_undegraded":"2024-05-15T18:09:19.401588+0000","last_fullsized":"2024-05-15T18:09:19.401588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:34:03.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:19.398913+0000","last_change":"2024-05-15T18:08:37.180082+0000","last_active":"2024-05-15T18:09:19.398913+0000","last_peered":"2024-05-15T18:09:19.398913+0000","last_clean":"2024-05-15T18:09:19.398913+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:09:19.398913+0000","last_undegraded":"2024-05-15T18:09:19.398913+0000","last_fullsized":"2024-05-15T18:09:19.398913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:22:54.721927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:09:20.082913+0000","last_change":"2024-05-15T18:08:39.192652+0000","last_active":"2024-05-15T18:09:20.082913+0000","last_peered":"2024-05-15T18:09:20.082913+0000","last_clean":"2024-05-15T18:09:20.082913+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:09:20.082913+0000","last_undegraded":"2024-05-15T18:09:20.082913+0000","last_fullsized":"2024-05-15T18:09:20.082913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:27:22.550315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17417088,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34840576,"data_stored":34834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673008,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":132984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48692,"kb_used_data":13356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323148,"statfs":{"total":96636764160,"available":96586903552,"internally_reserved":0,"allocated":13676544,"data_stored":13357679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705710,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52672,"kb_used_data":17336,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319168,"statfs":{"total":96636764160,"available":96582828032,"internally_reserved":0,"allocated":17752064,"data_stored":17499215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41044,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330796,"statfs":{"total":96636764160,"available":96594735104,"internally_reserved":0,"allocated":5844992,"data_stored":5555704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.415 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.416 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.417 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.418 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.418 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.418 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.418 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.418 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.418 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.419 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.420 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.421 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.422 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.423 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.424 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.425 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.426 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-15T18:08:25.125447+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=25, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.426 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.426 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.426 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.426 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.426 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.427 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.428 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.429 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.430 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.431 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.432 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.433 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.434 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.435 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.436 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.437 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.438 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.439 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.440 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.441 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.442 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.443 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.443 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.443 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.443 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:11:58.443 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T18:12:18.444 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:12:18.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.583+0000 7f566784e640 1 Processor -- start 2024-05-15T18:12:18.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.583+0000 7f566784e640 1 -- start start 2024-05-15T18:12:18.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f566784e640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f566012c5b0 0x7f566012c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:18.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f566784e640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5660113dd0 con 0x7f566012ced0 2024-05-15T18:12:18.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f566784e640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f5660072290 con 0x7f566012c5b0 2024-05-15T18:12:18.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f56655ea640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f566012c5b0 0x7f566012c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:18.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f5664de9640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f566012ced0 0x7f566006e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:58462/0 (socket says 172.21.15.3:58462) 2024-05-15T18:12:18.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f5664de9640 1 -- 172.21.15.3:0/2208415675 learned_addr learned my addr 172.21.15.3:0/2208415675 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:12:18.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f56655ea640 1 -- 172.21.15.3:0/2208415675 >> v1:172.21.15.3:6789/0 conn(0x7f566012ced0 legacy=0x7f566006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:18.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.584+0000 7f56655ea640 1 -- 172.21.15.3:0/2208415675 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566012c390 con 0x7f566012c5b0 2024-05-15T18:12:18.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.585+0000 7f56655ea640 1 --2- 172.21.15.3:0/2208415675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f566012c990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f565c009720 tx=0x7f565c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5178a447c8f1aefb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.585+0000 7f5657fff640 1 -- 172.21.15.3:0/2208415675 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c0316d0 con 0x7f566012c5b0 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.585+0000 7f5657fff640 1 -- 172.21.15.3:0/2208415675 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c037070 con 0x7f566012c5b0 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.585+0000 7f5657fff640 1 -- 172.21.15.3:0/2208415675 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c0319c0 con 0x7f566012c5b0 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.586+0000 7f566784e640 1 -- 172.21.15.3:0/2208415675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 msgr2=0x7f566012c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.586+0000 7f566784e640 1 --2- 172.21.15.3:0/2208415675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f566012c990 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f565c009720 tx=0x7f565c02b840 comp rx=0 tx=0).stop 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.586+0000 7f566784e640 1 -- 172.21.15.3:0/2208415675 shutdown_connections 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.586+0000 7f566784e640 1 --2- 172.21.15.3:0/2208415675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f566012c990 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.586+0000 7f566784e640 1 -- 172.21.15.3:0/2208415675 >> 172.21.15.3:0/2208415675 conn(0x7f5660099380 msgr2=0x7f5660099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.586+0000 7f566784e640 1 -- 172.21.15.3:0/2208415675 shutdown_connections 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.586+0000 7f566784e640 1 -- 172.21.15.3:0/2208415675 wait complete. 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.587+0000 7f566784e640 1 Processor -- start 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.587+0000 7f566784e640 1 -- start start 2024-05-15T18:12:18.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.587+0000 7f566784e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f56601c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.587+0000 7f566784e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5660113b10 con 0x7f566012c5b0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.587+0000 7f56655ea640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f56601c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.587+0000 7f56655ea640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f56601c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55008/0 (socket says 172.21.15.3:55008) 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.587+0000 7f56655ea640 1 -- 172.21.15.3:0/1650855762 learned_addr learned my addr 172.21.15.3:0/1650855762 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.588+0000 7f56655ea640 1 -- 172.21.15.3:0/1650855762 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5660071cf0 con 0x7f566012c5b0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.588+0000 7f56655ea640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f56601c33d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f565c009720 tx=0x7f565c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.588+0000 7f5655ffb640 1 -- 172.21.15.3:0/1650855762 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c032770 con 0x7f566012c5b0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.588+0000 7f5655ffb640 1 -- 172.21.15.3:0/1650855762 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c032910 con 0x7f566012c5b0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.588+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566011c440 con 0x7f566012c5b0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.588+0000 7f5655ffb640 1 -- 172.21.15.3:0/1650855762 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c032bf0 con 0x7f566012c5b0 2024-05-15T18:12:18.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.588+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56601c3910 con 0x7f566012c5b0 2024-05-15T18:12:18.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.589+0000 7f5655ffb640 1 -- 172.21.15.3:0/1650855762 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f565c04d3f0 con 0x7f566012c5b0 2024-05-15T18:12:18.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.589+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5660062e90 con 0x7f566012c5b0 2024-05-15T18:12:18.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.589+0000 7f5655ffb640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5644038060 0x7f564403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:18.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.589+0000 7f5655ffb640 1 -- 172.21.15.3:0/1650855762 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f565c02f050 con 0x7f566012c5b0 2024-05-15T18:12:18.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.590+0000 7f5664de9640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5644038060 0x7f564403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:18.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.590+0000 7f5664de9640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5644038060 0x7f564403a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5650007fd0 tx=0x7f5650007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:18.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.594+0000 7f5655ffb640 1 -- 172.21.15.3:0/1650855762 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f565c040070 con 0x7f566012c5b0 2024-05-15T18:12:18.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.775+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f566012b650 con 0x7f5644038060 2024-05-15T18:12:18.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.791+0000 7f5655ffb640 1 -- 172.21.15.3:0/1650855762 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658055 (secure 0 0 0) 0x7f566012b650 con 0x7f5644038060 2024-05-15T18:12:18.776 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:12:18.782 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:12:18.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.795+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5644038060 msgr2=0x7f564403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:18.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.795+0000 7f566784e640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5644038060 0x7f564403a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5650007fd0 tx=0x7f5650007ac0 comp rx=0 tx=0).stop 2024-05-15T18:12:18.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 msgr2=0x7f56601c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:18.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f56601c33d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f565c009720 tx=0x7f565c0046c0 comp rx=0 tx=0).stop 2024-05-15T18:12:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 shutdown_connections 2024-05-15T18:12:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f5644038060 0x7f564403a520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 --2- 172.21.15.3:0/1650855762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f566012c5b0 0x7f56601c33d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 >> 172.21.15.3:0/1650855762 conn(0x7f5660099380 msgr2=0x7f566009b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:12:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 shutdown_connections 2024-05-15T18:12:18.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:18.796+0000 7f566784e640 1 -- 172.21.15.3:0/1650855762 wait complete. 2024-05-15T18:12:18.785 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-05-15T18:12:18.384604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4722,"ondisk_log_size":4722,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148280,"kb_used_data":2776,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339080,"statfs":{"total":386547056640,"available":386395217920,"internally_reserved":0,"allocated":2842624,"data_stored":1707986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":148956946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003924"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392623+0000","last_change":"2024-05-15T18:08:37.185277+0000","last_active":"2024-05-15T18:10:43.392623+0000","last_peered":"2024-05-15T18:10:43.392623+0000","last_clean":"2024-05-15T18:10:43.392623+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:10:43.392623+0000","last_undegraded":"2024-05-15T18:10:43.392623+0000","last_fullsized":"2024-05-15T18:10:43.392623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114069+0000","last_change":"2024-05-15T18:08:39.181950+0000","last_active":"2024-05-15T18:11:47.114069+0000","last_peered":"2024-05-15T18:11:47.114069+0000","last_clean":"2024-05-15T18:11:47.114069+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:11:47.114069+0000","last_undegraded":"2024-05-15T18:11:47.114069+0000","last_fullsized":"2024-05-15T18:11:47.114069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388679+0000","last_change":"2024-05-15T18:08:37.180815+0000","last_active":"2024-05-15T18:10:44.388679+0000","last_peered":"2024-05-15T18:10:44.388679+0000","last_clean":"2024-05-15T18:10:44.388679+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:10:44.388679+0000","last_undegraded":"2024-05-15T18:10:44.388679+0000","last_fullsized":"2024-05-15T18:10:44.388679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.808560+0000","last_change":"2024-05-15T18:08:39.183780+0000","last_active":"2024-05-15T18:11:46.808560+0000","last_peered":"2024-05-15T18:11:46.808560+0000","last_clean":"2024-05-15T18:11:46.808560+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:11:46.808560+0000","last_undegraded":"2024-05-15T18:11:46.808560+0000","last_fullsized":"2024-05-15T18:11:46.808560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393178+0000","last_change":"2024-05-15T18:08:37.186280+0000","last_active":"2024-05-15T18:10:43.393178+0000","last_peered":"2024-05-15T18:10:43.393178+0000","last_clean":"2024-05-15T18:10:43.393178+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:10:43.393178+0000","last_undegraded":"2024-05-15T18:10:43.393178+0000","last_fullsized":"2024-05-15T18:10:43.393178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397008+0000","last_change":"2024-05-15T18:08:39.184797+0000","last_active":"2024-05-15T18:11:08.397008+0000","last_peered":"2024-05-15T18:11:08.397008+0000","last_clean":"2024-05-15T18:11:08.397008+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:11:08.397008+0000","last_undegraded":"2024-05-15T18:11:08.397008+0000","last_fullsized":"2024-05-15T18:11:08.397008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.388586+0000","last_change":"2024-05-15T18:08:37.174049+0000","last_active":"2024-05-15T18:10:46.388586+0000","last_peered":"2024-05-15T18:10:46.388586+0000","last_clean":"2024-05-15T18:10:46.388586+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:10:46.388586+0000","last_undegraded":"2024-05-15T18:10:46.388586+0000","last_fullsized":"2024-05-15T18:10:46.388586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'11","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.162104+0000","last_change":"2024-05-15T18:08:39.181113+0000","last_active":"2024-05-15T18:11:47.162104+0000","last_peered":"2024-05-15T18:11:47.162104+0000","last_clean":"2024-05-15T18:11:47.162104+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:11:47.162104+0000","last_undegraded":"2024-05-15T18:11:47.162104+0000","last_fullsized":"2024-05-15T18:11:47.162104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397047+0000","last_change":"2024-05-15T18:08:37.179942+0000","last_active":"2024-05-15T18:11:08.397047+0000","last_peered":"2024-05-15T18:11:08.397047+0000","last_clean":"2024-05-15T18:11:08.397047+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:11:08.397047+0000","last_undegraded":"2024-05-15T18:11:08.397047+0000","last_fullsized":"2024-05-15T18:11:08.397047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.391964+0000","last_change":"2024-05-15T18:08:39.185769+0000","last_active":"2024-05-15T18:10:38.391964+0000","last_peered":"2024-05-15T18:10:38.391964+0000","last_clean":"2024-05-15T18:10:38.391964+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:10:38.391964+0000","last_undegraded":"2024-05-15T18:10:38.391964+0000","last_fullsized":"2024-05-15T18:10:38.391964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396114+0000","last_change":"2024-05-15T18:08:37.178875+0000","last_active":"2024-05-15T18:11:08.396114+0000","last_peered":"2024-05-15T18:11:08.396114+0000","last_clean":"2024-05-15T18:11:08.396114+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:11:08.396114+0000","last_undegraded":"2024-05-15T18:11:08.396114+0000","last_fullsized":"2024-05-15T18:11:08.396114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.034610+0000","last_change":"2024-05-15T18:08:39.189004+0000","last_active":"2024-05-15T18:11:47.034610+0000","last_peered":"2024-05-15T18:11:47.034610+0000","last_clean":"2024-05-15T18:11:47.034610+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:11:47.034610+0000","last_undegraded":"2024-05-15T18:11:47.034610+0000","last_fullsized":"2024-05-15T18:11:47.034610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396959+0000","last_change":"2024-05-15T18:08:37.177010+0000","last_active":"2024-05-15T18:11:08.396959+0000","last_peered":"2024-05-15T18:11:08.396959+0000","last_clean":"2024-05-15T18:11:08.396959+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:11:08.396959+0000","last_undegraded":"2024-05-15T18:11:08.396959+0000","last_fullsized":"2024-05-15T18:11:08.396959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'5","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.160195+0000","last_change":"2024-05-15T18:08:39.187168+0000","last_active":"2024-05-15T18:11:47.160195+0000","last_peered":"2024-05-15T18:11:47.160195+0000","last_clean":"2024-05-15T18:11:47.160195+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:11:47.160195+0000","last_undegraded":"2024-05-15T18:11:47.160195+0000","last_fullsized":"2024-05-15T18:11:47.160195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:09.392429+0000","last_change":"2024-05-15T18:08:37.180981+0000","last_active":"2024-05-15T18:11:09.392429+0000","last_peered":"2024-05-15T18:11:09.392429+0000","last_clean":"2024-05-15T18:11:09.392429+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:11:09.392429+0000","last_undegraded":"2024-05-15T18:11:09.392429+0000","last_fullsized":"2024-05-15T18:11:09.392429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.113886+0000","last_change":"2024-05-15T18:08:39.185117+0000","last_active":"2024-05-15T18:11:47.113886+0000","last_peered":"2024-05-15T18:11:47.113886+0000","last_clean":"2024-05-15T18:11:47.113886+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:11:47.113886+0000","last_undegraded":"2024-05-15T18:11:47.113886+0000","last_fullsized":"2024-05-15T18:11:47.113886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114012+0000","last_change":"2024-05-15T18:08:39.186238+0000","last_active":"2024-05-15T18:11:47.114012+0000","last_peered":"2024-05-15T18:11:47.114012+0000","last_clean":"2024-05-15T18:11:47.114012+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:11:47.114012+0000","last_undegraded":"2024-05-15T18:11:47.114012+0000","last_fullsized":"2024-05-15T18:11:47.114012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395767+0000","last_change":"2024-05-15T18:08:37.177868+0000","last_active":"2024-05-15T18:11:03.395767+0000","last_peered":"2024-05-15T18:11:03.395767+0000","last_clean":"2024-05-15T18:11:03.395767+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:11:03.395767+0000","last_undegraded":"2024-05-15T18:11:03.395767+0000","last_fullsized":"2024-05-15T18:11:03.395767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'5","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.160255+0000","last_change":"2024-05-15T18:08:39.184998+0000","last_active":"2024-05-15T18:11:47.160255+0000","last_peered":"2024-05-15T18:11:47.160255+0000","last_clean":"2024-05-15T18:11:47.160255+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:11:47.160255+0000","last_undegraded":"2024-05-15T18:11:47.160255+0000","last_fullsized":"2024-05-15T18:11:47.160255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395577+0000","last_change":"2024-05-15T18:08:37.179232+0000","last_active":"2024-05-15T18:11:03.395577+0000","last_peered":"2024-05-15T18:11:03.395577+0000","last_clean":"2024-05-15T18:11:03.395577+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:11:03.395577+0000","last_undegraded":"2024-05-15T18:11:03.395577+0000","last_fullsized":"2024-05-15T18:11:03.395577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394856+0000","last_change":"2024-05-15T18:08:39.187737+0000","last_active":"2024-05-15T18:10:58.394856+0000","last_peered":"2024-05-15T18:10:58.394856+0000","last_clean":"2024-05-15T18:10:58.394856+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:10:58.394856+0000","last_undegraded":"2024-05-15T18:10:58.394856+0000","last_fullsized":"2024-05-15T18:10:58.394856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395664+0000","last_change":"2024-05-15T18:08:37.176725+0000","last_active":"2024-05-15T18:11:03.395664+0000","last_peered":"2024-05-15T18:11:03.395664+0000","last_clean":"2024-05-15T18:11:03.395664+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:11:03.395664+0000","last_undegraded":"2024-05-15T18:11:03.395664+0000","last_fullsized":"2024-05-15T18:11:03.395664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.080443+0000","last_change":"2024-05-15T18:08:39.183706+0000","last_active":"2024-05-15T18:11:47.080443+0000","last_peered":"2024-05-15T18:11:47.080443+0000","last_clean":"2024-05-15T18:11:47.080443+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:11:47.080443+0000","last_undegraded":"2024-05-15T18:11:47.080443+0000","last_fullsized":"2024-05-15T18:11:47.080443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395645+0000","last_change":"2024-05-15T18:08:37.173166+0000","last_active":"2024-05-15T18:11:03.395645+0000","last_peered":"2024-05-15T18:11:03.395645+0000","last_clean":"2024-05-15T18:11:03.395645+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:11:03.395645+0000","last_undegraded":"2024-05-15T18:11:03.395645+0000","last_fullsized":"2024-05-15T18:11:03.395645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395458+0000","last_change":"2024-05-15T18:08:39.183490+0000","last_active":"2024-05-15T18:11:03.395458+0000","last_peered":"2024-05-15T18:11:03.395458+0000","last_clean":"2024-05-15T18:11:03.395458+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:11:03.395458+0000","last_undegraded":"2024-05-15T18:11:03.395458+0000","last_fullsized":"2024-05-15T18:11:03.395458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721623+0000","last_change":"2024-05-15T18:08:37.180056+0000","last_active":"2024-05-15T18:11:53.721623+0000","last_peered":"2024-05-15T18:11:53.721623+0000","last_clean":"2024-05-15T18:11:53.721623+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:11:53.721623+0000","last_undegraded":"2024-05-15T18:11:53.721623+0000","last_fullsized":"2024-05-15T18:11:53.721623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395678+0000","last_change":"2024-05-15T18:08:39.180165+0000","last_active":"2024-05-15T18:11:03.395678+0000","last_peered":"2024-05-15T18:11:03.395678+0000","last_clean":"2024-05-15T18:11:03.395678+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:11:03.395678+0000","last_undegraded":"2024-05-15T18:11:03.395678+0000","last_fullsized":"2024-05-15T18:11:03.395678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395433+0000","last_change":"2024-05-15T18:08:37.181235+0000","last_active":"2024-05-15T18:10:58.395433+0000","last_peered":"2024-05-15T18:10:58.395433+0000","last_clean":"2024-05-15T18:10:58.395433+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:10:58.395433+0000","last_undegraded":"2024-05-15T18:10:58.395433+0000","last_fullsized":"2024-05-15T18:10:58.395433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.123110+0000","last_change":"2024-05-15T18:08:47.223064+0000","last_active":"2024-05-15T18:11:47.123110+0000","last_peered":"2024-05-15T18:11:47.123110+0000","last_clean":"2024-05-15T18:11:47.123110+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:11:47.123110+0000","last_undegraded":"2024-05-15T18:11:47.123110+0000","last_fullsized":"2024-05-15T18:11:47.123110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.108709+0000","last_change":"2024-05-15T18:09:19.408744+0000","last_active":"2024-05-15T18:11:47.108709+0000","last_peered":"2024-05-15T18:11:47.108709+0000","last_clean":"2024-05-15T18:11:47.108709+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:11:47.108709+0000","last_undegraded":"2024-05-15T18:11:47.108709+0000","last_fullsized":"2024-05-15T18:11:47.108709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395481+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:10:58.395481+0000","last_peered":"2024-05-15T18:10:58.395481+0000","last_clean":"2024-05-15T18:10:58.395481+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:10:58.395481+0000","last_undegraded":"2024-05-15T18:10:58.395481+0000","last_fullsized":"2024-05-15T18:10:58.395481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'5","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.471375+0000","last_change":"2024-05-15T18:12:00.471407+0000","last_active":"2024-05-15T18:12:00.471375+0000","last_peered":"2024-05-15T18:12:00.471375+0000","last_clean":"2024-05-15T18:12:00.471375+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:12:00.471375+0000","last_undegraded":"2024-05-15T18:12:00.471375+0000","last_fullsized":"2024-05-15T18:12:00.471375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.471292+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:32.955699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.750267+0000","last_change":"2024-05-15T18:08:43.205617+0000","last_active":"2024-05-15T18:11:53.750267+0000","last_peered":"2024-05-15T18:11:53.750267+0000","last_clean":"2024-05-15T18:11:53.750267+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:11:53.750267+0000","last_undegraded":"2024-05-15T18:11:53.750267+0000","last_fullsized":"2024-05-15T18:11:53.750267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.165954+0000","last_change":"2024-05-15T18:12:06.165990+0000","last_active":"2024-05-15T18:12:06.165954+0000","last_peered":"2024-05-15T18:12:06.165954+0000","last_clean":"2024-05-15T18:12:06.165954+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:12:06.165954+0000","last_undegraded":"2024-05-15T18:12:06.165954+0000","last_fullsized":"2024-05-15T18:12:06.165954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.165871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:13.434904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.082436+0000","last_change":"2024-05-15T18:08:47.223088+0000","last_active":"2024-05-15T18:11:47.082436+0000","last_peered":"2024-05-15T18:11:47.082436+0000","last_clean":"2024-05-15T18:11:47.082436+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:11:47.082436+0000","last_undegraded":"2024-05-15T18:11:47.082436+0000","last_fullsized":"2024-05-15T18:11:47.082436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.110867+0000","last_change":"2024-05-15T18:08:39.182435+0000","last_active":"2024-05-15T18:11:47.110867+0000","last_peered":"2024-05-15T18:11:47.110867+0000","last_clean":"2024-05-15T18:11:47.110867+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:11:47.110867+0000","last_undegraded":"2024-05-15T18:11:47.110867+0000","last_fullsized":"2024-05-15T18:11:47.110867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394676+0000","last_change":"2024-05-15T18:08:37.176655+0000","last_active":"2024-05-15T18:10:58.394676+0000","last_peered":"2024-05-15T18:10:58.394676+0000","last_clean":"2024-05-15T18:10:58.394676+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:10:58.394676+0000","last_undegraded":"2024-05-15T18:10:58.394676+0000","last_fullsized":"2024-05-15T18:10:58.394676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:04.391835+0000","last_change":"2024-05-15T18:08:41.190513+0000","last_active":"2024-05-15T18:11:04.391835+0000","last_peered":"2024-05-15T18:11:04.391835+0000","last_clean":"2024-05-15T18:11:04.391835+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:11:04.391835+0000","last_undegraded":"2024-05-15T18:11:04.391835+0000","last_fullsized":"2024-05-15T18:11:04.391835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.191773+0000","last_change":"2024-05-15T18:12:04.191810+0000","last_active":"2024-05-15T18:12:04.191773+0000","last_peered":"2024-05-15T18:12:04.191773+0000","last_clean":"2024-05-15T18:12:04.191773+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:12:04.191773+0000","last_undegraded":"2024-05-15T18:12:04.191773+0000","last_fullsized":"2024-05-15T18:12:04.191773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.191688+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:12.868591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.280655+0000","last_change":"2024-05-15T18:11:59.280691+0000","last_active":"2024-05-15T18:11:59.280655+0000","last_peered":"2024-05-15T18:11:59.280655+0000","last_clean":"2024-05-15T18:11:59.280655+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:11:59.280655+0000","last_undegraded":"2024-05-15T18:11:59.280655+0000","last_fullsized":"2024-05-15T18:11:59.280655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.280542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:02.064253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:19.394024+0000","last_change":"2024-05-15T18:08:47.215478+0000","last_active":"2024-05-15T18:11:19.394024+0000","last_peered":"2024-05-15T18:11:19.394024+0000","last_clean":"2024-05-15T18:11:19.394024+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:11:19.394024+0000","last_undegraded":"2024-05-15T18:11:19.394024+0000","last_fullsized":"2024-05-15T18:11:19.394024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396365+0000","last_change":"2024-05-15T18:08:39.180798+0000","last_active":"2024-05-15T18:11:03.396365+0000","last_peered":"2024-05-15T18:11:03.396365+0000","last_clean":"2024-05-15T18:11:03.396365+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:11:03.396365+0000","last_undegraded":"2024-05-15T18:11:03.396365+0000","last_fullsized":"2024-05-15T18:11:03.396365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395383+0000","last_change":"2024-05-15T18:08:37.185177+0000","last_active":"2024-05-15T18:10:58.395383+0000","last_peered":"2024-05-15T18:10:58.395383+0000","last_clean":"2024-05-15T18:10:58.395383+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:10:58.395383+0000","last_undegraded":"2024-05-15T18:10:58.395383+0000","last_fullsized":"2024-05-15T18:10:58.395383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:48.401606+0000","last_change":"2024-05-15T18:09:19.410089+0000","last_active":"2024-05-15T18:11:48.401606+0000","last_peered":"2024-05-15T18:11:48.401606+0000","last_clean":"2024-05-15T18:11:48.401606+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:11:48.401606+0000","last_undegraded":"2024-05-15T18:11:48.401606+0000","last_fullsized":"2024-05-15T18:11:48.401606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.538861+0000","last_change":"2024-05-15T18:12:05.538899+0000","last_active":"2024-05-15T18:12:05.538861+0000","last_peered":"2024-05-15T18:12:05.538861+0000","last_clean":"2024-05-15T18:12:05.538861+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:12:05.538861+0000","last_undegraded":"2024-05-15T18:12:05.538861+0000","last_fullsized":"2024-05-15T18:12:05.538861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.538773+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:15:58.392906+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'285","reported_seq":408,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.818678+0000","last_change":"2024-05-15T18:08:45.210771+0000","last_active":"2024-05-15T18:11:53.818678+0000","last_peered":"2024-05-15T18:11:53.818678+0000","last_clean":"2024-05-15T18:11:53.818678+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:11:53.818678+0000","last_undegraded":"2024-05-15T18:11:53.818678+0000","last_fullsized":"2024-05-15T18:11:53.818678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:18.397395+0000","last_change":"2024-05-15T18:08:47.220509+0000","last_active":"2024-05-15T18:11:18.397395+0000","last_peered":"2024-05-15T18:11:18.397395+0000","last_clean":"2024-05-15T18:11:18.397395+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:11:18.397395+0000","last_undegraded":"2024-05-15T18:11:18.397395+0000","last_fullsized":"2024-05-15T18:11:18.397395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'23","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.160098+0000","last_change":"2024-05-15T18:08:39.187144+0000","last_active":"2024-05-15T18:11:47.160098+0000","last_peered":"2024-05-15T18:11:47.160098+0000","last_clean":"2024-05-15T18:11:47.160098+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:11:47.160098+0000","last_undegraded":"2024-05-15T18:11:47.160098+0000","last_fullsized":"2024-05-15T18:11:47.160098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394761+0000","last_change":"2024-05-15T18:08:37.176800+0000","last_active":"2024-05-15T18:10:58.394761+0000","last_peered":"2024-05-15T18:10:58.394761+0000","last_clean":"2024-05-15T18:10:58.394761+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:10:58.394761+0000","last_undegraded":"2024-05-15T18:10:58.394761+0000","last_fullsized":"2024-05-15T18:10:58.394761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.344739+0000","last_change":"2024-05-15T18:12:04.344763+0000","last_active":"2024-05-15T18:12:04.344739+0000","last_peered":"2024-05-15T18:12:04.344739+0000","last_clean":"2024-05-15T18:12:04.344739+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:12:04.344739+0000","last_undegraded":"2024-05-15T18:12:04.344739+0000","last_fullsized":"2024-05-15T18:12:04.344739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.344646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:55.480863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.490821+0000","last_change":"2024-05-15T18:12:03.490856+0000","last_active":"2024-05-15T18:12:03.490821+0000","last_peered":"2024-05-15T18:12:03.490821+0000","last_clean":"2024-05-15T18:12:03.490821+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:12:03.490821+0000","last_undegraded":"2024-05-15T18:12:03.490821+0000","last_fullsized":"2024-05-15T18:12:03.490821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.490731+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:32.129481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":447,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.892996+0000","last_change":"2024-05-15T18:11:59.893055+0000","last_active":"2024-05-15T18:11:59.892996+0000","last_peered":"2024-05-15T18:11:59.892996+0000","last_clean":"2024-05-15T18:11:59.892996+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:59.892996+0000","last_undegraded":"2024-05-15T18:11:59.892996+0000","last_fullsized":"2024-05-15T18:11:59.892996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.892887+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:38.810690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.323300+0000","last_change":"2024-05-15T18:12:10.323325+0000","last_active":"2024-05-15T18:12:10.323300+0000","last_peered":"2024-05-15T18:12:10.323300+0000","last_clean":"2024-05-15T18:12:10.323300+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:12:10.323300+0000","last_undegraded":"2024-05-15T18:12:10.323300+0000","last_fullsized":"2024-05-15T18:12:10.323300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.323182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:01.360177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394019+0000","last_change":"2024-05-15T18:08:37.173486+0000","last_active":"2024-05-15T18:10:53.394019+0000","last_peered":"2024-05-15T18:10:53.394019+0000","last_clean":"2024-05-15T18:10:53.394019+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:10:53.394019+0000","last_undegraded":"2024-05-15T18:10:53.394019+0000","last_fullsized":"2024-05-15T18:10:53.394019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.051678+0000","last_change":"2024-05-15T18:12:12.051699+0000","last_active":"2024-05-15T18:12:12.051678+0000","last_peered":"2024-05-15T18:12:12.051678+0000","last_clean":"2024-05-15T18:12:12.051678+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:12:12.051678+0000","last_undegraded":"2024-05-15T18:12:12.051678+0000","last_fullsized":"2024-05-15T18:12:12.051678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.051591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:28:19.702252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'52","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.558204+0000","last_change":"2024-05-15T18:12:11.558253+0000","last_active":"2024-05-15T18:12:11.558204+0000","last_peered":"2024-05-15T18:12:11.558204+0000","last_clean":"2024-05-15T18:12:11.558204+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:12:11.558204+0000","last_undegraded":"2024-05-15T18:12:11.558204+0000","last_fullsized":"2024-05-15T18:12:11.558204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.558113+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:52.322479+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.845687+0000","last_change":"2024-05-15T18:12:00.845711+0000","last_active":"2024-05-15T18:12:00.845687+0000","last_peered":"2024-05-15T18:12:00.845687+0000","last_clean":"2024-05-15T18:12:00.845687+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:12:00.845687+0000","last_undegraded":"2024-05-15T18:12:00.845687+0000","last_fullsized":"2024-05-15T18:12:00.845687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.845599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:10.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393899+0000","last_change":"2024-05-15T18:08:47.221822+0000","last_active":"2024-05-15T18:10:53.393899+0000","last_peered":"2024-05-15T18:10:53.393899+0000","last_clean":"2024-05-15T18:10:53.393899+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:10:53.393899+0000","last_undegraded":"2024-05-15T18:10:53.393899+0000","last_fullsized":"2024-05-15T18:10:53.393899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393263+0000","last_change":"2024-05-15T18:08:39.186448+0000","last_active":"2024-05-15T18:10:48.393263+0000","last_peered":"2024-05-15T18:10:48.393263+0000","last_clean":"2024-05-15T18:10:48.393263+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:10:48.393263+0000","last_undegraded":"2024-05-15T18:10:48.393263+0000","last_fullsized":"2024-05-15T18:10:48.393263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393959+0000","last_change":"2024-05-15T18:08:37.179060+0000","last_active":"2024-05-15T18:10:53.393959+0000","last_peered":"2024-05-15T18:10:53.393959+0000","last_clean":"2024-05-15T18:10:53.393959+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:10:53.393959+0000","last_undegraded":"2024-05-15T18:10:53.393959+0000","last_fullsized":"2024-05-15T18:10:53.393959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"22'1","reported_seq":221,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.648080+0000","last_change":"2024-05-15T18:08:41.193828+0000","last_active":"2024-05-15T18:11:53.648080+0000","last_peered":"2024-05-15T18:11:53.648080+0000","last_clean":"2024-05-15T18:11:53.648080+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:11:53.648080+0000","last_undegraded":"2024-05-15T18:11:53.648080+0000","last_fullsized":"2024-05-15T18:11:53.648080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'33","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.807780+0000","last_change":"2024-05-15T18:08:43.205152+0000","last_active":"2024-05-15T18:11:53.807780+0000","last_peered":"2024-05-15T18:11:53.807780+0000","last_clean":"2024-05-15T18:11:53.807780+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:11:53.807780+0000","last_undegraded":"2024-05-15T18:11:53.807780+0000","last_fullsized":"2024-05-15T18:11:53.807780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.922884+0000","last_change":"2024-05-15T18:12:09.922907+0000","last_active":"2024-05-15T18:12:09.922884+0000","last_peered":"2024-05-15T18:12:09.922884+0000","last_clean":"2024-05-15T18:12:09.922884+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:12:09.922884+0000","last_undegraded":"2024-05-15T18:12:09.922884+0000","last_fullsized":"2024-05-15T18:12:09.922884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.922780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:29.778911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'3","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394095+0000","last_change":"2024-05-15T18:08:47.217227+0000","last_active":"2024-05-15T18:10:53.394095+0000","last_peered":"2024-05-15T18:10:53.394095+0000","last_clean":"2024-05-15T18:10:53.394095+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:10:53.394095+0000","last_undegraded":"2024-05-15T18:10:53.394095+0000","last_fullsized":"2024-05-15T18:10:53.394095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.113952+0000","last_change":"2024-05-15T18:08:39.185744+0000","last_active":"2024-05-15T18:11:47.113952+0000","last_peered":"2024-05-15T18:11:47.113952+0000","last_clean":"2024-05-15T18:11:47.113952+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:11:47.113952+0000","last_undegraded":"2024-05-15T18:11:47.113952+0000","last_fullsized":"2024-05-15T18:11:47.113952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721089+0000","last_change":"2024-05-15T18:08:37.181644+0000","last_active":"2024-05-15T18:11:53.721089+0000","last_peered":"2024-05-15T18:11:53.721089+0000","last_clean":"2024-05-15T18:11:53.721089+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:11:53.721089+0000","last_undegraded":"2024-05-15T18:11:53.721089+0000","last_fullsized":"2024-05-15T18:11:53.721089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:59.391140+0000","last_change":"2024-05-15T18:08:41.191195+0000","last_active":"2024-05-15T18:10:59.391140+0000","last_peered":"2024-05-15T18:10:59.391140+0000","last_clean":"2024-05-15T18:10:59.391140+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:10:59.391140+0000","last_undegraded":"2024-05-15T18:10:59.391140+0000","last_fullsized":"2024-05-15T18:10:59.391140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'39","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.769694+0000","last_change":"2024-05-15T18:08:43.205104+0000","last_active":"2024-05-15T18:11:53.769694+0000","last_peered":"2024-05-15T18:11:53.769694+0000","last_clean":"2024-05-15T18:11:53.769694+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:11:53.769694+0000","last_undegraded":"2024-05-15T18:11:53.769694+0000","last_fullsized":"2024-05-15T18:11:53.769694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":409,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.833108+0000","last_change":"2024-05-15T18:12:05.833181+0000","last_active":"2024-05-15T18:12:05.833108+0000","last_peered":"2024-05-15T18:12:05.833108+0000","last_clean":"2024-05-15T18:12:05.833108+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:12:05.833108+0000","last_undegraded":"2024-05-15T18:12:05.833108+0000","last_fullsized":"2024-05-15T18:12:05.833108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.833005+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:50.024912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:59.391187+0000","last_change":"2024-05-15T18:08:47.218349+0000","last_active":"2024-05-15T18:10:59.391187+0000","last_peered":"2024-05-15T18:10:59.391187+0000","last_clean":"2024-05-15T18:10:59.391187+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:10:59.391187+0000","last_undegraded":"2024-05-15T18:10:59.391187+0000","last_fullsized":"2024-05-15T18:10:59.391187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.080983+0000","last_change":"2024-05-15T18:08:39.180538+0000","last_active":"2024-05-15T18:11:47.080983+0000","last_peered":"2024-05-15T18:11:47.080983+0000","last_clean":"2024-05-15T18:11:47.080983+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:11:47.080983+0000","last_undegraded":"2024-05-15T18:11:47.080983+0000","last_fullsized":"2024-05-15T18:11:47.080983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394615+0000","last_change":"2024-05-15T18:08:37.179976+0000","last_active":"2024-05-15T18:10:53.394615+0000","last_peered":"2024-05-15T18:10:53.394615+0000","last_clean":"2024-05-15T18:10:53.394615+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:10:53.394615+0000","last_undegraded":"2024-05-15T18:10:53.394615+0000","last_fullsized":"2024-05-15T18:10:53.394615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390286+0000","last_change":"2024-05-15T18:08:41.193806+0000","last_active":"2024-05-15T18:10:54.390286+0000","last_peered":"2024-05-15T18:10:54.390286+0000","last_clean":"2024-05-15T18:10:54.390286+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:10:54.390286+0000","last_undegraded":"2024-05-15T18:10:54.390286+0000","last_fullsized":"2024-05-15T18:10:54.390286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.357135+0000","last_change":"2024-05-15T18:12:03.357175+0000","last_active":"2024-05-15T18:12:03.357135+0000","last_peered":"2024-05-15T18:12:03.357135+0000","last_clean":"2024-05-15T18:12:03.357135+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:12:03.357135+0000","last_undegraded":"2024-05-15T18:12:03.357135+0000","last_fullsized":"2024-05-15T18:12:03.357135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.357042+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:36.663893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.920891+0000","last_change":"2024-05-15T18:11:58.920914+0000","last_active":"2024-05-15T18:11:58.920891+0000","last_peered":"2024-05-15T18:11:58.920891+0000","last_clean":"2024-05-15T18:11:58.920891+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:11:58.920891+0000","last_undegraded":"2024-05-15T18:11:58.920891+0000","last_fullsized":"2024-05-15T18:11:58.920891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.920801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:00:11.891898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'18","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.208786+0000","last_change":"2024-05-15T18:08:47.219473+0000","last_active":"2024-05-15T18:11:47.208786+0000","last_peered":"2024-05-15T18:11:47.208786+0000","last_clean":"2024-05-15T18:11:47.208786+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:11:47.208786+0000","last_undegraded":"2024-05-15T18:11:47.208786+0000","last_fullsized":"2024-05-15T18:11:47.208786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.808065+0000","last_change":"2024-05-15T18:08:39.191385+0000","last_active":"2024-05-15T18:11:46.808065+0000","last_peered":"2024-05-15T18:11:46.808065+0000","last_clean":"2024-05-15T18:11:46.808065+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:11:46.808065+0000","last_undegraded":"2024-05-15T18:11:46.808065+0000","last_fullsized":"2024-05-15T18:11:46.808065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390311+0000","last_change":"2024-05-15T18:08:37.181014+0000","last_active":"2024-05-15T18:10:54.390311+0000","last_peered":"2024-05-15T18:10:54.390311+0000","last_clean":"2024-05-15T18:10:54.390311+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:10:54.390311+0000","last_undegraded":"2024-05-15T18:10:54.390311+0000","last_fullsized":"2024-05-15T18:10:54.390311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394756+0000","last_change":"2024-05-15T18:08:41.189363+0000","last_active":"2024-05-15T18:10:58.394756+0000","last_peered":"2024-05-15T18:10:58.394756+0000","last_clean":"2024-05-15T18:10:58.394756+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:10:58.394756+0000","last_undegraded":"2024-05-15T18:10:58.394756+0000","last_fullsized":"2024-05-15T18:10:58.394756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.153352+0000","last_change":"2024-05-15T18:12:05.153393+0000","last_active":"2024-05-15T18:12:05.153352+0000","last_peered":"2024-05-15T18:12:05.153352+0000","last_clean":"2024-05-15T18:12:05.153352+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:12:05.153352+0000","last_undegraded":"2024-05-15T18:12:05.153352+0000","last_fullsized":"2024-05-15T18:12:05.153352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.153268+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:23:48.552424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396388+0000","last_change":"2024-05-15T18:08:45.210581+0000","last_active":"2024-05-15T18:11:03.396388+0000","last_peered":"2024-05-15T18:11:03.396388+0000","last_clean":"2024-05-15T18:11:03.396388+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:11:03.396388+0000","last_undegraded":"2024-05-15T18:11:03.396388+0000","last_fullsized":"2024-05-15T18:11:03.396388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.165412+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:11:47.165412+0000","last_peered":"2024-05-15T18:11:47.165412+0000","last_clean":"2024-05-15T18:11:47.165412+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:11:47.165412+0000","last_undegraded":"2024-05-15T18:11:47.165412+0000","last_fullsized":"2024-05-15T18:11:47.165412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.318634+0000","last_change":"2024-05-15T18:12:12.318664+0000","last_active":"2024-05-15T18:12:12.318634+0000","last_peered":"2024-05-15T18:12:12.318634+0000","last_clean":"2024-05-15T18:12:12.318634+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:12:12.318634+0000","last_undegraded":"2024-05-15T18:12:12.318634+0000","last_fullsized":"2024-05-15T18:12:12.318634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.318542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:02.692777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393870+0000","last_change":"2024-05-15T18:08:37.182183+0000","last_active":"2024-05-15T18:10:48.393870+0000","last_peered":"2024-05-15T18:10:48.393870+0000","last_clean":"2024-05-15T18:10:48.393870+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:10:48.393870+0000","last_undegraded":"2024-05-15T18:10:48.393870+0000","last_fullsized":"2024-05-15T18:10:48.393870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:59.391166+0000","last_change":"2024-05-15T18:08:41.188718+0000","last_active":"2024-05-15T18:10:59.391166+0000","last_peered":"2024-05-15T18:10:59.391166+0000","last_clean":"2024-05-15T18:10:59.391166+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:10:59.391166+0000","last_undegraded":"2024-05-15T18:10:59.391166+0000","last_fullsized":"2024-05-15T18:10:59.391166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.592664+0000","last_change":"2024-05-15T18:12:09.592703+0000","last_active":"2024-05-15T18:12:09.592664+0000","last_peered":"2024-05-15T18:12:09.592664+0000","last_clean":"2024-05-15T18:12:09.592664+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:12:09.592664+0000","last_undegraded":"2024-05-15T18:12:09.592664+0000","last_fullsized":"2024-05-15T18:12:09.592664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.592581+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:53:31.226178+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":415,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.470688+0000","last_change":"2024-05-15T18:12:00.470721+0000","last_active":"2024-05-15T18:12:00.470688+0000","last_peered":"2024-05-15T18:12:00.470688+0000","last_clean":"2024-05-15T18:12:00.470688+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:12:00.470688+0000","last_undegraded":"2024-05-15T18:12:00.470688+0000","last_fullsized":"2024-05-15T18:12:00.470688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.470590+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:35.192862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.167252+0000","last_change":"2024-05-15T18:08:47.215424+0000","last_active":"2024-05-15T18:11:47.167252+0000","last_peered":"2024-05-15T18:11:47.167252+0000","last_clean":"2024-05-15T18:11:47.167252+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:11:47.167252+0000","last_undegraded":"2024-05-15T18:11:47.167252+0000","last_fullsized":"2024-05-15T18:11:47.167252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.808629+0000","last_change":"2024-05-15T18:08:39.187057+0000","last_active":"2024-05-15T18:11:46.808629+0000","last_peered":"2024-05-15T18:11:46.808629+0000","last_clean":"2024-05-15T18:11:46.808629+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:11:46.808629+0000","last_undegraded":"2024-05-15T18:11:46.808629+0000","last_fullsized":"2024-05-15T18:11:46.808629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.017392+0000","last_change":"2024-05-15T18:08:37.185221+0000","last_active":"2024-05-15T18:11:47.017392+0000","last_peered":"2024-05-15T18:11:47.017392+0000","last_clean":"2024-05-15T18:11:47.017392+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:11:47.017392+0000","last_undegraded":"2024-05-15T18:11:47.017392+0000","last_fullsized":"2024-05-15T18:11:47.017392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'3","reported_seq":418,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.647701+0000","last_change":"2024-05-15T18:08:41.190951+0000","last_active":"2024-05-15T18:11:53.647701+0000","last_peered":"2024-05-15T18:11:53.647701+0000","last_clean":"2024-05-15T18:11:53.647701+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:11:53.647701+0000","last_undegraded":"2024-05-15T18:11:53.647701+0000","last_fullsized":"2024-05-15T18:11:53.647701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.331808+0000","last_change":"2024-05-15T18:12:09.331845+0000","last_active":"2024-05-15T18:12:09.331808+0000","last_peered":"2024-05-15T18:12:09.331808+0000","last_clean":"2024-05-15T18:12:09.331808+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:12:09.331808+0000","last_undegraded":"2024-05-15T18:12:09.331808+0000","last_fullsized":"2024-05-15T18:12:09.331808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.331720+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:28.300746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":471,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.276017+0000","last_change":"2024-05-15T18:12:00.276044+0000","last_active":"2024-05-15T18:12:00.276017+0000","last_peered":"2024-05-15T18:12:00.276017+0000","last_clean":"2024-05-15T18:12:00.276017+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:12:00.276017+0000","last_undegraded":"2024-05-15T18:12:00.276017+0000","last_fullsized":"2024-05-15T18:12:00.276017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.275912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:39.193715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393819+0000","last_change":"2024-05-15T18:08:47.215824+0000","last_active":"2024-05-15T18:10:53.393819+0000","last_peered":"2024-05-15T18:10:53.393819+0000","last_clean":"2024-05-15T18:10:53.393819+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:10:53.393819+0000","last_undegraded":"2024-05-15T18:10:53.393819+0000","last_fullsized":"2024-05-15T18:10:53.393819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394165+0000","last_change":"2024-05-15T18:08:39.194733+0000","last_active":"2024-05-15T18:10:53.394165+0000","last_peered":"2024-05-15T18:10:53.394165+0000","last_clean":"2024-05-15T18:10:53.394165+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:10:53.394165+0000","last_undegraded":"2024-05-15T18:10:53.394165+0000","last_fullsized":"2024-05-15T18:10:53.394165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393728+0000","last_change":"2024-05-15T18:08:37.183998+0000","last_active":"2024-05-15T18:10:48.393728+0000","last_peered":"2024-05-15T18:10:48.393728+0000","last_clean":"2024-05-15T18:10:48.393728+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:10:48.393728+0000","last_undegraded":"2024-05-15T18:10:48.393728+0000","last_fullsized":"2024-05-15T18:10:48.393728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.354846+0000","last_change":"2024-05-15T18:12:08.354871+0000","last_active":"2024-05-15T18:12:08.354846+0000","last_peered":"2024-05-15T18:12:08.354846+0000","last_clean":"2024-05-15T18:12:08.354846+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:12:08.354846+0000","last_undegraded":"2024-05-15T18:12:08.354846+0000","last_fullsized":"2024-05-15T18:12:08.354846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.354757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:02.756370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.149819+0000","last_change":"2024-05-15T18:12:07.149858+0000","last_active":"2024-05-15T18:12:07.149819+0000","last_peered":"2024-05-15T18:12:07.149819+0000","last_clean":"2024-05-15T18:12:07.149819+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:12:07.149819+0000","last_undegraded":"2024-05-15T18:12:07.149819+0000","last_fullsized":"2024-05-15T18:12:07.149819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.149716+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:51.341623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.495674+0000","last_change":"2024-05-15T18:11:59.495696+0000","last_active":"2024-05-15T18:11:59.495674+0000","last_peered":"2024-05-15T18:11:59.495674+0000","last_clean":"2024-05-15T18:11:59.495674+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:11:59.495674+0000","last_undegraded":"2024-05-15T18:11:59.495674+0000","last_fullsized":"2024-05-15T18:11:59.495674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.495587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:27.408105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.086166+0000","last_change":"2024-05-15T18:12:10.086196+0000","last_active":"2024-05-15T18:12:10.086166+0000","last_peered":"2024-05-15T18:12:10.086166+0000","last_clean":"2024-05-15T18:12:10.086166+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:12:10.086166+0000","last_undegraded":"2024-05-15T18:12:10.086166+0000","last_fullsized":"2024-05-15T18:12:10.086166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.086069+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:14:22.063457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393165+0000","last_change":"2024-05-15T18:08:39.189647+0000","last_active":"2024-05-15T18:10:43.393165+0000","last_peered":"2024-05-15T18:10:43.393165+0000","last_clean":"2024-05-15T18:10:43.393165+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:10:43.393165+0000","last_undegraded":"2024-05-15T18:10:43.393165+0000","last_fullsized":"2024-05-15T18:10:43.393165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":200,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:28.390427+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:10:28.390427+0000","last_peered":"2024-05-15T18:10:28.390427+0000","last_clean":"2024-05-15T18:10:28.390427+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:10:28.390427+0000","last_undegraded":"2024-05-15T18:10:28.390427+0000","last_fullsized":"2024-05-15T18:10:28.390427+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392446+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:10:38.392446+0000","last_peered":"2024-05-15T18:10:38.392446+0000","last_clean":"2024-05-15T18:10:38.392446+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:10:38.392446+0000","last_undegraded":"2024-05-15T18:10:38.392446+0000","last_fullsized":"2024-05-15T18:10:38.392446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393101+0000","last_change":"2024-05-15T18:08:37.186535+0000","last_active":"2024-05-15T18:10:43.393101+0000","last_peered":"2024-05-15T18:10:43.393101+0000","last_clean":"2024-05-15T18:10:43.393101+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:10:43.393101+0000","last_undegraded":"2024-05-15T18:10:43.393101+0000","last_fullsized":"2024-05-15T18:10:43.393101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393365+0000","last_change":"2024-05-15T18:08:41.191173+0000","last_active":"2024-05-15T18:10:48.393365+0000","last_peered":"2024-05-15T18:10:48.393365+0000","last_clean":"2024-05-15T18:10:48.393365+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:10:48.393365+0000","last_undegraded":"2024-05-15T18:10:48.393365+0000","last_fullsized":"2024-05-15T18:10:48.393365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.302427+0000","last_change":"2024-05-15T18:12:13.302463+0000","last_active":"2024-05-15T18:12:13.302427+0000","last_peered":"2024-05-15T18:12:13.302427+0000","last_clean":"2024-05-15T18:12:13.302427+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:12:13.302427+0000","last_undegraded":"2024-05-15T18:12:13.302427+0000","last_fullsized":"2024-05-15T18:12:13.302427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.302331+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:17.032807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.959229+0000","last_change":"2024-05-15T18:12:13.959264+0000","last_active":"2024-05-15T18:12:13.959229+0000","last_peered":"2024-05-15T18:12:13.959229+0000","last_clean":"2024-05-15T18:12:13.959229+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:12:13.959229+0000","last_undegraded":"2024-05-15T18:12:13.959229+0000","last_fullsized":"2024-05-15T18:12:13.959229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.959124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:07.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":168,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.121595+0000","last_change":"2024-05-15T18:08:47.212621+0000","last_active":"2024-05-15T18:11:47.121595+0000","last_peered":"2024-05-15T18:11:47.121595+0000","last_clean":"2024-05-15T18:11:47.121595+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:11:47.121595+0000","last_undegraded":"2024-05-15T18:11:47.121595+0000","last_fullsized":"2024-05-15T18:11:47.121595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393949+0000","last_change":"2024-05-15T18:08:39.180830+0000","last_active":"2024-05-15T18:10:48.393949+0000","last_peered":"2024-05-15T18:10:48.393949+0000","last_clean":"2024-05-15T18:10:48.393949+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:10:48.393949+0000","last_undegraded":"2024-05-15T18:10:48.393949+0000","last_fullsized":"2024-05-15T18:10:48.393949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:33.391565+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:10:33.391565+0000","last_peered":"2024-05-15T18:10:33.391565+0000","last_clean":"2024-05-15T18:10:33.391565+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:10:33.391565+0000","last_undegraded":"2024-05-15T18:10:33.391565+0000","last_fullsized":"2024-05-15T18:10:33.391565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388580+0000","last_change":"2024-05-15T18:08:37.179663+0000","last_active":"2024-05-15T18:10:44.388580+0000","last_peered":"2024-05-15T18:10:44.388580+0000","last_clean":"2024-05-15T18:10:44.388580+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:10:44.388580+0000","last_undegraded":"2024-05-15T18:10:44.388580+0000","last_fullsized":"2024-05-15T18:10:44.388580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.426538+0000","last_change":"2024-05-15T18:12:01.426564+0000","last_active":"2024-05-15T18:12:01.426538+0000","last_peered":"2024-05-15T18:12:01.426538+0000","last_clean":"2024-05-15T18:12:01.426538+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:12:01.426538+0000","last_undegraded":"2024-05-15T18:12:01.426538+0000","last_fullsized":"2024-05-15T18:12:01.426538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.426444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:20.013172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'293","reported_seq":518,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.240316+0000","last_change":"2024-05-15T18:12:03.240363+0000","last_active":"2024-05-15T18:12:03.240316+0000","last_peered":"2024-05-15T18:12:03.240316+0000","last_clean":"2024-05-15T18:12:03.240316+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:12:03.240316+0000","last_undegraded":"2024-05-15T18:12:03.240316+0000","last_fullsized":"2024-05-15T18:12:03.240316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'293","last_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_deep_scrub":"31'293","last_deep_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.240231+0000","objects_scrubbed":10,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:29:17.206611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394640+0000","last_change":"2024-05-15T18:08:45.210778+0000","last_active":"2024-05-15T18:10:53.394640+0000","last_peered":"2024-05-15T18:10:53.394640+0000","last_clean":"2024-05-15T18:10:53.394640+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:10:53.394640+0000","last_undegraded":"2024-05-15T18:10:53.394640+0000","last_fullsized":"2024-05-15T18:10:53.394640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394896+0000","last_change":"2024-05-15T18:08:47.217222+0000","last_active":"2024-05-15T18:10:58.394896+0000","last_peered":"2024-05-15T18:10:58.394896+0000","last_clean":"2024-05-15T18:10:58.394896+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:10:58.394896+0000","last_undegraded":"2024-05-15T18:10:58.394896+0000","last_fullsized":"2024-05-15T18:10:58.394896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.080604+0000","last_change":"2024-05-15T18:08:39.186998+0000","last_active":"2024-05-15T18:11:47.080604+0000","last_peered":"2024-05-15T18:11:47.080604+0000","last_clean":"2024-05-15T18:11:47.080604+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:11:47.080604+0000","last_undegraded":"2024-05-15T18:11:47.080604+0000","last_fullsized":"2024-05-15T18:11:47.080604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:33.391125+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:10:33.391125+0000","last_peered":"2024-05-15T18:10:33.391125+0000","last_clean":"2024-05-15T18:10:33.391125+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:10:33.391125+0000","last_undegraded":"2024-05-15T18:10:33.391125+0000","last_fullsized":"2024-05-15T18:10:33.391125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387819+0000","last_change":"2024-05-15T18:08:37.173060+0000","last_active":"2024-05-15T18:10:39.387819+0000","last_peered":"2024-05-15T18:10:39.387819+0000","last_clean":"2024-05-15T18:10:39.387819+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:10:39.387819+0000","last_undegraded":"2024-05-15T18:10:39.387819+0000","last_fullsized":"2024-05-15T18:10:39.387819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393977+0000","last_change":"2024-05-15T18:09:19.416671+0000","last_active":"2024-05-15T18:10:53.393977+0000","last_peered":"2024-05-15T18:10:53.393977+0000","last_clean":"2024-05-15T18:10:53.393977+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:10:53.393977+0000","last_undegraded":"2024-05-15T18:10:53.393977+0000","last_fullsized":"2024-05-15T18:10:53.393977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.543399+0000","last_change":"2024-05-15T18:12:07.543438+0000","last_active":"2024-05-15T18:12:07.543399+0000","last_peered":"2024-05-15T18:12:07.543399+0000","last_clean":"2024-05-15T18:12:07.543399+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:12:07.543399+0000","last_undegraded":"2024-05-15T18:12:07.543399+0000","last_fullsized":"2024-05-15T18:12:07.543399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.543314+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:32.467749+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.928878+0000","last_change":"2024-05-15T18:11:57.928898+0000","last_active":"2024-05-15T18:11:57.928878+0000","last_peered":"2024-05-15T18:11:57.928878+0000","last_clean":"2024-05-15T18:11:57.928878+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:11:57.928878+0000","last_undegraded":"2024-05-15T18:11:57.928878+0000","last_fullsized":"2024-05-15T18:11:57.928878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.928793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.522391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396277+0000","last_change":"2024-05-15T18:08:47.219388+0000","last_active":"2024-05-15T18:11:03.396277+0000","last_peered":"2024-05-15T18:11:03.396277+0000","last_clean":"2024-05-15T18:11:03.396277+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:11:03.396277+0000","last_undegraded":"2024-05-15T18:11:03.396277+0000","last_fullsized":"2024-05-15T18:11:03.396277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036760+0000","last_change":"2024-05-15T18:08:39.184088+0000","last_active":"2024-05-15T18:11:47.036760+0000","last_peered":"2024-05-15T18:11:47.036760+0000","last_clean":"2024-05-15T18:11:47.036760+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:11:47.036760+0000","last_undegraded":"2024-05-15T18:11:47.036760+0000","last_fullsized":"2024-05-15T18:11:47.036760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392402+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:10:38.392402+0000","last_peered":"2024-05-15T18:10:38.392402+0000","last_clean":"2024-05-15T18:10:38.392402+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:10:38.392402+0000","last_undegraded":"2024-05-15T18:10:38.392402+0000","last_fullsized":"2024-05-15T18:10:38.392402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392512+0000","last_change":"2024-05-15T18:08:37.173069+0000","last_active":"2024-05-15T18:10:43.392512+0000","last_peered":"2024-05-15T18:10:43.392512+0000","last_clean":"2024-05-15T18:10:43.392512+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:10:43.392512+0000","last_undegraded":"2024-05-15T18:10:43.392512+0000","last_fullsized":"2024-05-15T18:10:43.392512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:49.389523+0000","last_change":"2024-05-15T18:08:41.191439+0000","last_active":"2024-05-15T18:10:49.389523+0000","last_peered":"2024-05-15T18:10:49.389523+0000","last_clean":"2024-05-15T18:10:49.389523+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:10:49.389523+0000","last_undegraded":"2024-05-15T18:10:49.389523+0000","last_fullsized":"2024-05-15T18:10:49.389523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.380207+0000","last_change":"2024-05-15T18:12:05.380243+0000","last_active":"2024-05-15T18:12:05.380207+0000","last_peered":"2024-05-15T18:12:05.380207+0000","last_clean":"2024-05-15T18:12:05.380207+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:12:05.380207+0000","last_undegraded":"2024-05-15T18:12:05.380207+0000","last_fullsized":"2024-05-15T18:12:05.380207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.380117+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:27.585526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395626+0000","last_change":"2024-05-15T18:08:45.211047+0000","last_active":"2024-05-15T18:10:58.395626+0000","last_peered":"2024-05-15T18:10:58.395626+0000","last_clean":"2024-05-15T18:10:58.395626+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:10:58.395626+0000","last_undegraded":"2024-05-15T18:10:58.395626+0000","last_fullsized":"2024-05-15T18:10:58.395626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394796+0000","last_change":"2024-05-15T18:08:47.221837+0000","last_active":"2024-05-15T18:10:58.394796+0000","last_peered":"2024-05-15T18:10:58.394796+0000","last_clean":"2024-05-15T18:10:58.394796+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:10:58.394796+0000","last_undegraded":"2024-05-15T18:10:58.394796+0000","last_fullsized":"2024-05-15T18:10:58.394796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'7","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.160271+0000","last_change":"2024-05-15T18:08:39.194112+0000","last_active":"2024-05-15T18:11:47.160271+0000","last_peered":"2024-05-15T18:11:47.160271+0000","last_clean":"2024-05-15T18:11:47.160271+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:11:47.160271+0000","last_undegraded":"2024-05-15T18:11:47.160271+0000","last_fullsized":"2024-05-15T18:11:47.160271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392561+0000","last_change":"2024-05-15T18:08:37.173933+0000","last_active":"2024-05-15T18:10:43.392561+0000","last_peered":"2024-05-15T18:10:43.392561+0000","last_clean":"2024-05-15T18:10:43.392561+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:10:43.392561+0000","last_undegraded":"2024-05-15T18:10:43.392561+0000","last_fullsized":"2024-05-15T18:10:43.392561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387920+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:10:39.387920+0000","last_peered":"2024-05-15T18:10:39.387920+0000","last_clean":"2024-05-15T18:10:39.387920+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:10:39.387920+0000","last_undegraded":"2024-05-15T18:10:39.387920+0000","last_fullsized":"2024-05-15T18:10:39.387920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.927177+0000","last_change":"2024-05-15T18:12:12.927216+0000","last_active":"2024-05-15T18:12:12.927177+0000","last_peered":"2024-05-15T18:12:12.927177+0000","last_clean":"2024-05-15T18:12:12.927177+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:12:12.927177+0000","last_undegraded":"2024-05-15T18:12:12.927177+0000","last_fullsized":"2024-05-15T18:12:12.927177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.927083+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:24.672114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.879798+0000","last_change":"2024-05-15T18:12:06.879840+0000","last_active":"2024-05-15T18:12:06.879798+0000","last_peered":"2024-05-15T18:12:06.879798+0000","last_clean":"2024-05-15T18:12:06.879798+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:12:06.879798+0000","last_undegraded":"2024-05-15T18:12:06.879798+0000","last_fullsized":"2024-05-15T18:12:06.879798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.879711+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:16.898190+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.431117+0000","last_change":"2024-05-15T18:12:01.431143+0000","last_active":"2024-05-15T18:12:01.431117+0000","last_peered":"2024-05-15T18:12:01.431117+0000","last_clean":"2024-05-15T18:12:01.431117+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:12:01.431117+0000","last_undegraded":"2024-05-15T18:12:01.431117+0000","last_fullsized":"2024-05-15T18:12:01.431117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.431023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:47.755595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:04.391879+0000","last_change":"2024-05-15T18:08:47.215201+0000","last_active":"2024-05-15T18:11:04.391879+0000","last_peered":"2024-05-15T18:11:04.391879+0000","last_clean":"2024-05-15T18:11:04.391879+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:11:04.391879+0000","last_undegraded":"2024-05-15T18:11:04.391879+0000","last_fullsized":"2024-05-15T18:11:04.391879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114211+0000","last_change":"2024-05-15T18:09:19.415333+0000","last_active":"2024-05-15T18:11:47.114211+0000","last_peered":"2024-05-15T18:11:47.114211+0000","last_clean":"2024-05-15T18:11:47.114211+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:11:47.114211+0000","last_undegraded":"2024-05-15T18:11:47.114211+0000","last_fullsized":"2024-05-15T18:11:47.114211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388641+0000","last_change":"2024-05-15T18:08:37.180268+0000","last_active":"2024-05-15T18:10:44.388641+0000","last_peered":"2024-05-15T18:10:44.388641+0000","last_clean":"2024-05-15T18:10:44.388641+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:10:44.388641+0000","last_undegraded":"2024-05-15T18:10:44.388641+0000","last_fullsized":"2024-05-15T18:10:44.388641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392486+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:10:38.392486+0000","last_peered":"2024-05-15T18:10:38.392486+0000","last_clean":"2024-05-15T18:10:38.392486+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:10:38.392486+0000","last_undegraded":"2024-05-15T18:10:38.392486+0000","last_fullsized":"2024-05-15T18:10:38.392486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.391560+0000","last_change":"2024-05-15T18:12:02.391600+0000","last_active":"2024-05-15T18:12:02.391560+0000","last_peered":"2024-05-15T18:12:02.391560+0000","last_clean":"2024-05-15T18:12:02.391560+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:12:02.391560+0000","last_undegraded":"2024-05-15T18:12:02.391560+0000","last_fullsized":"2024-05-15T18:12:02.391560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.391444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:04.938967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.233207+0000","last_change":"2024-05-15T18:12:01.233258+0000","last_active":"2024-05-15T18:12:01.233207+0000","last_peered":"2024-05-15T18:12:01.233207+0000","last_clean":"2024-05-15T18:12:01.233207+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:12:01.233207+0000","last_undegraded":"2024-05-15T18:12:01.233207+0000","last_fullsized":"2024-05-15T18:12:01.233207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.233115+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:11.007085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":358,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.323746+0000","last_change":"2024-05-15T18:11:58.323821+0000","last_active":"2024-05-15T18:11:58.323746+0000","last_peered":"2024-05-15T18:11:58.323746+0000","last_clean":"2024-05-15T18:11:58.323746+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:58.323746+0000","last_undegraded":"2024-05-15T18:11:58.323746+0000","last_fullsized":"2024-05-15T18:11:58.323746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.323633+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.917231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396379+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:11:03.396379+0000","last_peered":"2024-05-15T18:11:03.396379+0000","last_clean":"2024-05-15T18:11:03.396379+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:11:03.396379+0000","last_undegraded":"2024-05-15T18:11:03.396379+0000","last_fullsized":"2024-05-15T18:11:03.396379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'1","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.162190+0000","last_change":"2024-05-15T18:08:39.188916+0000","last_active":"2024-05-15T18:11:47.162190+0000","last_peered":"2024-05-15T18:11:47.162190+0000","last_clean":"2024-05-15T18:11:47.162190+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:11:47.162190+0000","last_undegraded":"2024-05-15T18:11:47.162190+0000","last_fullsized":"2024-05-15T18:11:47.162190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393971+0000","last_change":"2024-05-15T18:08:37.184221+0000","last_active":"2024-05-15T18:10:48.393971+0000","last_peered":"2024-05-15T18:10:48.393971+0000","last_clean":"2024-05-15T18:10:48.393971+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:10:48.393971+0000","last_undegraded":"2024-05-15T18:10:48.393971+0000","last_fullsized":"2024-05-15T18:10:48.393971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387957+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:10:39.387957+0000","last_peered":"2024-05-15T18:10:39.387957+0000","last_clean":"2024-05-15T18:10:39.387957+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:10:39.387957+0000","last_undegraded":"2024-05-15T18:10:39.387957+0000","last_fullsized":"2024-05-15T18:10:39.387957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.358909+0000","last_change":"2024-05-15T18:12:06.358934+0000","last_active":"2024-05-15T18:12:06.358909+0000","last_peered":"2024-05-15T18:12:06.358909+0000","last_clean":"2024-05-15T18:12:06.358909+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:12:06.358909+0000","last_undegraded":"2024-05-15T18:12:06.358909+0000","last_fullsized":"2024-05-15T18:12:06.358909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.358819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:07.242813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'11","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393860+0000","last_change":"2024-05-15T18:08:43.205538+0000","last_active":"2024-05-15T18:10:48.393860+0000","last_peered":"2024-05-15T18:10:48.393860+0000","last_clean":"2024-05-15T18:10:48.393860+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:10:48.393860+0000","last_undegraded":"2024-05-15T18:10:48.393860+0000","last_fullsized":"2024-05-15T18:10:48.393860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":401,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.886627+0000","last_change":"2024-05-15T18:12:02.886655+0000","last_active":"2024-05-15T18:12:02.886627+0000","last_peered":"2024-05-15T18:12:02.886627+0000","last_clean":"2024-05-15T18:12:02.886627+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:12:02.886627+0000","last_undegraded":"2024-05-15T18:12:02.886627+0000","last_fullsized":"2024-05-15T18:12:02.886627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.886536+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:13.272929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395621+0000","last_change":"2024-05-15T18:08:47.222589+0000","last_active":"2024-05-15T18:11:03.395621+0000","last_peered":"2024-05-15T18:11:03.395621+0000","last_clean":"2024-05-15T18:11:03.395621+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:11:03.395621+0000","last_undegraded":"2024-05-15T18:11:03.395621+0000","last_fullsized":"2024-05-15T18:11:03.395621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901990+0000","last_change":"2024-05-15T18:08:39.185262+0000","last_active":"2024-05-15T18:11:46.901990+0000","last_peered":"2024-05-15T18:11:46.901990+0000","last_clean":"2024-05-15T18:11:46.901990+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:11:46.901990+0000","last_undegraded":"2024-05-15T18:11:46.901990+0000","last_fullsized":"2024-05-15T18:11:46.901990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393412+0000","last_change":"2024-05-15T18:08:37.179237+0000","last_active":"2024-05-15T18:10:48.393412+0000","last_peered":"2024-05-15T18:10:48.393412+0000","last_clean":"2024-05-15T18:10:48.393412+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:10:48.393412+0000","last_undegraded":"2024-05-15T18:10:48.393412+0000","last_fullsized":"2024-05-15T18:10:48.393412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393213+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:10:43.393213+0000","last_peered":"2024-05-15T18:10:43.393213+0000","last_clean":"2024-05-15T18:10:43.393213+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:10:43.393213+0000","last_undegraded":"2024-05-15T18:10:43.393213+0000","last_fullsized":"2024-05-15T18:10:43.393213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.448833+0000","last_change":"2024-05-15T18:11:59.448854+0000","last_active":"2024-05-15T18:11:59.448833+0000","last_peered":"2024-05-15T18:11:59.448833+0000","last_clean":"2024-05-15T18:11:59.448833+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:11:59.448833+0000","last_undegraded":"2024-05-15T18:11:59.448833+0000","last_fullsized":"2024-05-15T18:11:59.448833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.448742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:12:37.217420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.502515+0000","last_change":"2024-05-15T18:12:04.502595+0000","last_active":"2024-05-15T18:12:04.502515+0000","last_peered":"2024-05-15T18:12:04.502515+0000","last_clean":"2024-05-15T18:12:04.502515+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:12:04.502515+0000","last_undegraded":"2024-05-15T18:12:04.502515+0000","last_fullsized":"2024-05-15T18:12:04.502515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.502398+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:28.778374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:56.955848+0000","last_change":"2024-05-15T18:11:56.955872+0000","last_active":"2024-05-15T18:11:56.955848+0000","last_peered":"2024-05-15T18:11:56.955848+0000","last_clean":"2024-05-15T18:11:56.955848+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:11:56.955848+0000","last_undegraded":"2024-05-15T18:11:56.955848+0000","last_fullsized":"2024-05-15T18:11:56.955848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_clean_scrub_stamp":"2024-05-15T18:11:56.955763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:30.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395506+0000","last_change":"2024-05-15T18:08:47.209997+0000","last_active":"2024-05-15T18:11:03.395506+0000","last_peered":"2024-05-15T18:11:03.395506+0000","last_clean":"2024-05-15T18:11:03.395506+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:11:03.395506+0000","last_undegraded":"2024-05-15T18:11:03.395506+0000","last_fullsized":"2024-05-15T18:11:03.395506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.904324+0000","last_change":"2024-05-15T18:08:47.219593+0000","last_active":"2024-05-15T18:11:46.904324+0000","last_peered":"2024-05-15T18:11:46.904324+0000","last_clean":"2024-05-15T18:11:46.904324+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:11:46.904324+0000","last_undegraded":"2024-05-15T18:11:46.904324+0000","last_fullsized":"2024-05-15T18:11:46.904324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394708+0000","last_change":"2024-05-15T18:08:39.185432+0000","last_active":"2024-05-15T18:10:58.394708+0000","last_peered":"2024-05-15T18:10:58.394708+0000","last_clean":"2024-05-15T18:10:58.394708+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:10:58.394708+0000","last_undegraded":"2024-05-15T18:10:58.394708+0000","last_fullsized":"2024-05-15T18:10:58.394708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395527+0000","last_change":"2024-05-15T18:08:37.185935+0000","last_active":"2024-05-15T18:10:58.395527+0000","last_peered":"2024-05-15T18:10:58.395527+0000","last_clean":"2024-05-15T18:10:58.395527+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:10:58.395527+0000","last_undegraded":"2024-05-15T18:10:58.395527+0000","last_fullsized":"2024-05-15T18:10:58.395527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395581+0000","last_change":"2024-05-15T18:09:19.404553+0000","last_active":"2024-05-15T18:11:03.395581+0000","last_peered":"2024-05-15T18:11:03.395581+0000","last_clean":"2024-05-15T18:11:03.395581+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:11:03.395581+0000","last_undegraded":"2024-05-15T18:11:03.395581+0000","last_fullsized":"2024-05-15T18:11:03.395581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.350517+0000","last_change":"2024-05-15T18:12:11.350568+0000","last_active":"2024-05-15T18:12:11.350517+0000","last_peered":"2024-05-15T18:12:11.350517+0000","last_clean":"2024-05-15T18:12:11.350517+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:12:11.350517+0000","last_undegraded":"2024-05-15T18:12:11.350517+0000","last_fullsized":"2024-05-15T18:12:11.350517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.350399+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:11.134147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396926+0000","last_change":"2024-05-15T18:08:45.208742+0000","last_active":"2024-05-15T18:11:08.396926+0000","last_peered":"2024-05-15T18:11:08.396926+0000","last_clean":"2024-05-15T18:11:08.396926+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:11:08.396926+0000","last_undegraded":"2024-05-15T18:11:08.396926+0000","last_fullsized":"2024-05-15T18:11:08.396926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.032141+0000","last_change":"2024-05-15T18:08:47.216635+0000","last_active":"2024-05-15T18:11:47.032141+0000","last_peered":"2024-05-15T18:11:47.032141+0000","last_clean":"2024-05-15T18:11:47.032141+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:11:47.032141+0000","last_undegraded":"2024-05-15T18:11:47.032141+0000","last_fullsized":"2024-05-15T18:11:47.032141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'5","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.162275+0000","last_change":"2024-05-15T18:08:39.192773+0000","last_active":"2024-05-15T18:11:47.162275+0000","last_peered":"2024-05-15T18:11:47.162275+0000","last_clean":"2024-05-15T18:11:47.162275+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:11:47.162275+0000","last_undegraded":"2024-05-15T18:11:47.162275+0000","last_fullsized":"2024-05-15T18:11:47.162275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721477+0000","last_change":"2024-05-15T18:08:37.178179+0000","last_active":"2024-05-15T18:11:53.721477+0000","last_peered":"2024-05-15T18:11:53.721477+0000","last_clean":"2024-05-15T18:11:53.721477+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:11:53.721477+0000","last_undegraded":"2024-05-15T18:11:53.721477+0000","last_fullsized":"2024-05-15T18:11:53.721477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.464665+0000","last_change":"2024-05-15T18:11:58.464695+0000","last_active":"2024-05-15T18:11:58.464665+0000","last_peered":"2024-05-15T18:11:58.464665+0000","last_clean":"2024-05-15T18:11:58.464665+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:11:58.464665+0000","last_undegraded":"2024-05-15T18:11:58.464665+0000","last_fullsized":"2024-05-15T18:11:58.464665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.464557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:27.556332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.875011+0000","last_change":"2024-05-15T18:12:08.875048+0000","last_active":"2024-05-15T18:12:08.875011+0000","last_peered":"2024-05-15T18:12:08.875011+0000","last_clean":"2024-05-15T18:12:08.875011+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:12:08.875011+0000","last_undegraded":"2024-05-15T18:12:08.875011+0000","last_fullsized":"2024-05-15T18:12:08.875011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.874911+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:19.931974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.544246+0000","last_change":"2024-05-15T18:12:10.544278+0000","last_active":"2024-05-15T18:12:10.544246+0000","last_peered":"2024-05-15T18:12:10.544246+0000","last_clean":"2024-05-15T18:12:10.544246+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:12:10.544246+0000","last_undegraded":"2024-05-15T18:12:10.544246+0000","last_fullsized":"2024-05-15T18:12:10.544246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.544159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:52.334749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:19.394087+0000","last_change":"2024-05-15T18:08:47.209757+0000","last_active":"2024-05-15T18:11:19.394087+0000","last_peered":"2024-05-15T18:11:19.394087+0000","last_clean":"2024-05-15T18:11:19.394087+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:11:19.394087+0000","last_undegraded":"2024-05-15T18:11:19.394087+0000","last_fullsized":"2024-05-15T18:11:19.394087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.903209+0000","last_change":"2024-05-15T18:08:39.182386+0000","last_active":"2024-05-15T18:11:46.903209+0000","last_peered":"2024-05-15T18:11:46.903209+0000","last_clean":"2024-05-15T18:11:46.903209+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:11:46.903209+0000","last_undegraded":"2024-05-15T18:11:46.903209+0000","last_fullsized":"2024-05-15T18:11:46.903209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395566+0000","last_change":"2024-05-15T18:08:37.176233+0000","last_active":"2024-05-15T18:11:03.395566+0000","last_peered":"2024-05-15T18:11:03.395566+0000","last_clean":"2024-05-15T18:11:03.395566+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:11:03.395566+0000","last_undegraded":"2024-05-15T18:11:03.395566+0000","last_fullsized":"2024-05-15T18:11:03.395566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.579110+0000","last_change":"2024-05-15T18:12:12.579133+0000","last_active":"2024-05-15T18:12:12.579110+0000","last_peered":"2024-05-15T18:12:12.579110+0000","last_clean":"2024-05-15T18:12:12.579110+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:12:12.579110+0000","last_undegraded":"2024-05-15T18:12:12.579110+0000","last_fullsized":"2024-05-15T18:12:12.579110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.579011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:22.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'48","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.881810+0000","last_change":"2024-05-15T18:12:11.881882+0000","last_active":"2024-05-15T18:12:11.881810+0000","last_peered":"2024-05-15T18:12:11.881810+0000","last_clean":"2024-05-15T18:12:11.881810+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:12:11.881810+0000","last_undegraded":"2024-05-15T18:12:11.881810+0000","last_fullsized":"2024-05-15T18:12:11.881810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.881671+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:22.316063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.359537+0000","last_change":"2024-05-15T18:11:57.359562+0000","last_active":"2024-05-15T18:11:57.359537+0000","last_peered":"2024-05-15T18:11:57.359537+0000","last_clean":"2024-05-15T18:11:57.359537+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:11:57.359537+0000","last_undegraded":"2024-05-15T18:11:57.359537+0000","last_fullsized":"2024-05-15T18:11:57.359537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.359393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:31.155528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:18.398472+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:11:18.398472+0000","last_peered":"2024-05-15T18:11:18.398472+0000","last_clean":"2024-05-15T18:11:18.398472+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:11:18.398472+0000","last_undegraded":"2024-05-15T18:11:18.398472+0000","last_fullsized":"2024-05-15T18:11:18.398472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395330+0000","last_change":"2024-05-15T18:08:39.188917+0000","last_active":"2024-05-15T18:10:58.395330+0000","last_peered":"2024-05-15T18:10:58.395330+0000","last_clean":"2024-05-15T18:10:58.395330+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:10:58.395330+0000","last_undegraded":"2024-05-15T18:10:58.395330+0000","last_fullsized":"2024-05-15T18:10:58.395330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395751+0000","last_change":"2024-05-15T18:08:37.176555+0000","last_active":"2024-05-15T18:11:03.395751+0000","last_peered":"2024-05-15T18:11:03.395751+0000","last_clean":"2024-05-15T18:11:03.395751+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:11:03.395751+0000","last_undegraded":"2024-05-15T18:11:03.395751+0000","last_fullsized":"2024-05-15T18:11:03.395751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.315137+0000","last_change":"2024-05-15T18:12:07.315160+0000","last_active":"2024-05-15T18:12:07.315137+0000","last_peered":"2024-05-15T18:12:07.315137+0000","last_clean":"2024-05-15T18:12:07.315137+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:12:07.315137+0000","last_undegraded":"2024-05-15T18:12:07.315137+0000","last_fullsized":"2024-05-15T18:12:07.315137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.315047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:28.990916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.589070+0000","last_change":"2024-05-15T18:12:08.589118+0000","last_active":"2024-05-15T18:12:08.589070+0000","last_peered":"2024-05-15T18:12:08.589070+0000","last_clean":"2024-05-15T18:12:08.589070+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:12:08.589070+0000","last_undegraded":"2024-05-15T18:12:08.589070+0000","last_fullsized":"2024-05-15T18:12:08.589070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.588987+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:48.582117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.517728+0000","last_change":"2024-05-15T18:11:58.517779+0000","last_active":"2024-05-15T18:11:58.517728+0000","last_peered":"2024-05-15T18:11:58.517728+0000","last_clean":"2024-05-15T18:11:58.517728+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:11:58.517728+0000","last_undegraded":"2024-05-15T18:11:58.517728+0000","last_fullsized":"2024-05-15T18:11:58.517728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.517616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:10:30.693406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081201+0000","last_change":"2024-05-15T18:08:39.186233+0000","last_active":"2024-05-15T18:11:47.081201+0000","last_peered":"2024-05-15T18:11:47.081201+0000","last_clean":"2024-05-15T18:11:47.081201+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:11:47.081201+0000","last_undegraded":"2024-05-15T18:11:47.081201+0000","last_fullsized":"2024-05-15T18:11:47.081201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396177+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:11:03.396177+0000","last_peered":"2024-05-15T18:11:03.396177+0000","last_clean":"2024-05-15T18:11:03.396177+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:11:03.396177+0000","last_undegraded":"2024-05-15T18:11:03.396177+0000","last_fullsized":"2024-05-15T18:11:03.396177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388690+0000","last_change":"2024-05-15T18:08:41.191159+0000","last_active":"2024-05-15T18:10:44.388690+0000","last_peered":"2024-05-15T18:10:44.388690+0000","last_clean":"2024-05-15T18:10:44.388690+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:10:44.388690+0000","last_undegraded":"2024-05-15T18:10:44.388690+0000","last_fullsized":"2024-05-15T18:10:44.388690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.892641+0000","last_change":"2024-05-15T18:12:10.892676+0000","last_active":"2024-05-15T18:12:10.892641+0000","last_peered":"2024-05-15T18:12:10.892641+0000","last_clean":"2024-05-15T18:12:10.892641+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:12:10.892641+0000","last_undegraded":"2024-05-15T18:12:10.892641+0000","last_fullsized":"2024-05-15T18:12:10.892641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.892546+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:09.452875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.474146+0000","last_change":"2024-05-15T18:12:02.474184+0000","last_active":"2024-05-15T18:12:02.474146+0000","last_peered":"2024-05-15T18:12:02.474146+0000","last_clean":"2024-05-15T18:12:02.474146+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:12:02.474146+0000","last_undegraded":"2024-05-15T18:12:02.474146+0000","last_fullsized":"2024-05-15T18:12:02.474146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.474022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:25:37.061500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:09.392486+0000","last_change":"2024-05-15T18:08:47.215443+0000","last_active":"2024-05-15T18:11:09.392486+0000","last_peered":"2024-05-15T18:11:09.392486+0000","last_clean":"2024-05-15T18:11:09.392486+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:11:09.392486+0000","last_undegraded":"2024-05-15T18:11:09.392486+0000","last_fullsized":"2024-05-15T18:11:09.392486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387968+0000","last_change":"2024-05-15T18:08:39.186914+0000","last_active":"2024-05-15T18:10:39.387968+0000","last_peered":"2024-05-15T18:10:39.387968+0000","last_clean":"2024-05-15T18:10:39.387968+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:10:39.387968+0000","last_undegraded":"2024-05-15T18:10:39.387968+0000","last_fullsized":"2024-05-15T18:10:39.387968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395526+0000","last_change":"2024-05-15T18:09:19.405624+0000","last_active":"2024-05-15T18:11:03.395526+0000","last_peered":"2024-05-15T18:11:03.395526+0000","last_clean":"2024-05-15T18:11:03.395526+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:11:03.395526+0000","last_undegraded":"2024-05-15T18:11:03.395526+0000","last_fullsized":"2024-05-15T18:11:03.395526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393277+0000","last_change":"2024-05-15T18:08:41.191786+0000","last_active":"2024-05-15T18:10:48.393277+0000","last_peered":"2024-05-15T18:10:48.393277+0000","last_clean":"2024-05-15T18:10:48.393277+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:10:48.393277+0000","last_undegraded":"2024-05-15T18:10:48.393277+0000","last_fullsized":"2024-05-15T18:10:48.393277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'40","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.716465+0000","last_change":"2024-05-15T18:08:43.204941+0000","last_active":"2024-05-15T18:11:53.716465+0000","last_peered":"2024-05-15T18:11:53.716465+0000","last_clean":"2024-05-15T18:11:53.716465+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:11:53.716465+0000","last_undegraded":"2024-05-15T18:11:53.716465+0000","last_fullsized":"2024-05-15T18:11:53.716465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.212353+0000","last_change":"2024-05-15T18:12:02.212375+0000","last_active":"2024-05-15T18:12:02.212353+0000","last_peered":"2024-05-15T18:12:02.212353+0000","last_clean":"2024-05-15T18:12:02.212353+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:12:02.212353+0000","last_undegraded":"2024-05-15T18:12:02.212353+0000","last_fullsized":"2024-05-15T18:12:02.212353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.212266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:31.297851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396986+0000","last_change":"2024-05-15T18:08:47.218586+0000","last_active":"2024-05-15T18:11:08.396986+0000","last_peered":"2024-05-15T18:11:08.396986+0000","last_clean":"2024-05-15T18:11:08.396986+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:11:08.396986+0000","last_undegraded":"2024-05-15T18:11:08.396986+0000","last_fullsized":"2024-05-15T18:11:08.396986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397117+0000","last_change":"2024-05-15T18:08:39.191981+0000","last_active":"2024-05-15T18:11:08.397117+0000","last_peered":"2024-05-15T18:11:08.397117+0000","last_clean":"2024-05-15T18:11:08.397117+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:11:08.397117+0000","last_undegraded":"2024-05-15T18:11:08.397117+0000","last_fullsized":"2024-05-15T18:11:08.397117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.022946+0000","last_change":"2024-05-15T18:08:37.175536+0000","last_active":"2024-05-15T18:11:47.022946+0000","last_peered":"2024-05-15T18:11:47.022946+0000","last_clean":"2024-05-15T18:11:47.022946+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:11:47.022946+0000","last_undegraded":"2024-05-15T18:11:47.022946+0000","last_fullsized":"2024-05-15T18:11:47.022946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.396752+0000","last_change":"2024-05-15T18:08:41.191062+0000","last_active":"2024-05-15T18:11:13.396752+0000","last_peered":"2024-05-15T18:11:13.396752+0000","last_clean":"2024-05-15T18:11:13.396752+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:11:13.396752+0000","last_undegraded":"2024-05-15T18:11:13.396752+0000","last_fullsized":"2024-05-15T18:11:13.396752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.854084+0000","last_change":"2024-05-15T18:12:04.854126+0000","last_active":"2024-05-15T18:12:04.854084+0000","last_peered":"2024-05-15T18:12:04.854084+0000","last_clean":"2024-05-15T18:12:04.854084+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:12:04.854084+0000","last_undegraded":"2024-05-15T18:12:04.854084+0000","last_fullsized":"2024-05-15T18:12:04.854084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.853980+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:12.123012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.875727+0000","last_change":"2024-05-15T18:12:03.875755+0000","last_active":"2024-05-15T18:12:03.875727+0000","last_peered":"2024-05-15T18:12:03.875727+0000","last_clean":"2024-05-15T18:12:03.875727+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:12:03.875727+0000","last_undegraded":"2024-05-15T18:12:03.875727+0000","last_fullsized":"2024-05-15T18:12:03.875727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.875637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:24.820098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396939+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:11:08.396939+0000","last_peered":"2024-05-15T18:11:08.396939+0000","last_clean":"2024-05-15T18:11:08.396939+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:11:08.396939+0000","last_undegraded":"2024-05-15T18:11:08.396939+0000","last_fullsized":"2024-05-15T18:11:08.396939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'5","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.159441+0000","last_change":"2024-05-15T18:08:39.184374+0000","last_active":"2024-05-15T18:11:47.159441+0000","last_peered":"2024-05-15T18:11:47.159441+0000","last_clean":"2024-05-15T18:11:47.159441+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:11:47.159441+0000","last_undegraded":"2024-05-15T18:11:47.159441+0000","last_fullsized":"2024-05-15T18:11:47.159441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.025486+0000","last_change":"2024-05-15T18:08:37.183470+0000","last_active":"2024-05-15T18:11:47.025486+0000","last_peered":"2024-05-15T18:11:47.025486+0000","last_clean":"2024-05-15T18:11:47.025486+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:11:47.025486+0000","last_undegraded":"2024-05-15T18:11:47.025486+0000","last_fullsized":"2024-05-15T18:11:47.025486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397145+0000","last_change":"2024-05-15T18:08:41.190070+0000","last_active":"2024-05-15T18:11:13.397145+0000","last_peered":"2024-05-15T18:11:13.397145+0000","last_clean":"2024-05-15T18:11:13.397145+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:11:13.397145+0000","last_undegraded":"2024-05-15T18:11:13.397145+0000","last_fullsized":"2024-05-15T18:11:13.397145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'11","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393195+0000","last_change":"2024-05-15T18:08:43.205310+0000","last_active":"2024-05-15T18:10:43.393195+0000","last_peered":"2024-05-15T18:10:43.393195+0000","last_clean":"2024-05-15T18:10:43.393195+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:10:43.393195+0000","last_undegraded":"2024-05-15T18:10:43.393195+0000","last_fullsized":"2024-05-15T18:10:43.393195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":382,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.505720+0000","last_change":"2024-05-15T18:12:06.505746+0000","last_active":"2024-05-15T18:12:06.505720+0000","last_peered":"2024-05-15T18:12:06.505720+0000","last_clean":"2024-05-15T18:12:06.505720+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:12:06.505720+0000","last_undegraded":"2024-05-15T18:12:06.505720+0000","last_fullsized":"2024-05-15T18:12:06.505720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.505630+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:15:15.678261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396883+0000","last_change":"2024-05-15T18:08:47.219182+0000","last_active":"2024-05-15T18:11:08.396883+0000","last_peered":"2024-05-15T18:11:08.396883+0000","last_clean":"2024-05-15T18:11:08.396883+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:11:08.396883+0000","last_undegraded":"2024-05-15T18:11:08.396883+0000","last_fullsized":"2024-05-15T18:11:08.396883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396147+0000","last_change":"2024-05-15T18:08:39.180759+0000","last_active":"2024-05-15T18:11:08.396147+0000","last_peered":"2024-05-15T18:11:08.396147+0000","last_clean":"2024-05-15T18:11:08.396147+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:11:08.396147+0000","last_undegraded":"2024-05-15T18:11:08.396147+0000","last_fullsized":"2024-05-15T18:11:08.396147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396467+0000","last_change":"2024-05-15T18:08:37.176826+0000","last_active":"2024-05-15T18:11:08.396467+0000","last_peered":"2024-05-15T18:11:08.396467+0000","last_clean":"2024-05-15T18:11:08.396467+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:11:08.396467+0000","last_undegraded":"2024-05-15T18:11:08.396467+0000","last_fullsized":"2024-05-15T18:11:08.396467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.101386+0000","last_change":"2024-05-15T18:12:13.101422+0000","last_active":"2024-05-15T18:12:13.101386+0000","last_peered":"2024-05-15T18:12:13.101386+0000","last_clean":"2024-05-15T18:12:13.101386+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:12:13.101386+0000","last_undegraded":"2024-05-15T18:12:13.101386+0000","last_fullsized":"2024-05-15T18:12:13.101386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.101295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:02:45.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.136885+0000","last_change":"2024-05-15T18:12:08.136923+0000","last_active":"2024-05-15T18:12:08.136885+0000","last_peered":"2024-05-15T18:12:08.136885+0000","last_clean":"2024-05-15T18:12:08.136885+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:12:08.136885+0000","last_undegraded":"2024-05-15T18:12:08.136885+0000","last_fullsized":"2024-05-15T18:12:08.136885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.136791+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:18.155270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.879979+0000","last_change":"2024-05-15T18:12:01.880039+0000","last_active":"2024-05-15T18:12:01.879979+0000","last_peered":"2024-05-15T18:12:01.879979+0000","last_clean":"2024-05-15T18:12:01.879979+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:12:01.879979+0000","last_undegraded":"2024-05-15T18:12:01.879979+0000","last_fullsized":"2024-05-15T18:12:01.879979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.879852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:30.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.805402+0000","last_change":"2024-05-15T18:08:47.217145+0000","last_active":"2024-05-15T18:11:46.805402+0000","last_peered":"2024-05-15T18:11:46.805402+0000","last_clean":"2024-05-15T18:11:46.805402+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:11:46.805402+0000","last_undegraded":"2024-05-15T18:11:46.805402+0000","last_fullsized":"2024-05-15T18:11:46.805402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396125+0000","last_change":"2024-05-15T18:08:39.180684+0000","last_active":"2024-05-15T18:11:08.396125+0000","last_peered":"2024-05-15T18:11:08.396125+0000","last_clean":"2024-05-15T18:11:08.396125+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:11:08.396125+0000","last_undegraded":"2024-05-15T18:11:08.396125+0000","last_fullsized":"2024-05-15T18:11:08.396125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397102+0000","last_change":"2024-05-15T18:08:37.185723+0000","last_active":"2024-05-15T18:11:08.397102+0000","last_peered":"2024-05-15T18:11:08.397102+0000","last_clean":"2024-05-15T18:11:08.397102+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:11:08.397102+0000","last_undegraded":"2024-05-15T18:11:08.397102+0000","last_fullsized":"2024-05-15T18:11:08.397102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.396723+0000","last_change":"2024-05-15T18:08:41.194992+0000","last_active":"2024-05-15T18:11:13.396723+0000","last_peered":"2024-05-15T18:11:13.396723+0000","last_clean":"2024-05-15T18:11:13.396723+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:11:13.396723+0000","last_undegraded":"2024-05-15T18:11:13.396723+0000","last_fullsized":"2024-05-15T18:11:13.396723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.850349+0000","last_change":"2024-05-15T18:12:07.850386+0000","last_active":"2024-05-15T18:12:07.850349+0000","last_peered":"2024-05-15T18:12:07.850349+0000","last_clean":"2024-05-15T18:12:07.850349+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:12:07.850349+0000","last_undegraded":"2024-05-15T18:12:07.850349+0000","last_fullsized":"2024-05-15T18:12:07.850349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.850240+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:45.111188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397705+0000","last_change":"2024-05-15T18:08:45.208564+0000","last_active":"2024-05-15T18:11:13.397705+0000","last_peered":"2024-05-15T18:11:13.397705+0000","last_clean":"2024-05-15T18:11:13.397705+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:11:13.397705+0000","last_undegraded":"2024-05-15T18:11:13.397705+0000","last_fullsized":"2024-05-15T18:11:13.397705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397860+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:11:13.397860+0000","last_peered":"2024-05-15T18:11:13.397860+0000","last_clean":"2024-05-15T18:11:13.397860+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:11:13.397860+0000","last_undegraded":"2024-05-15T18:11:13.397860+0000","last_fullsized":"2024-05-15T18:11:13.397860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.807434+0000","last_change":"2024-05-15T18:08:39.181861+0000","last_active":"2024-05-15T18:11:46.807434+0000","last_peered":"2024-05-15T18:11:46.807434+0000","last_clean":"2024-05-15T18:11:46.807434+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:11:46.807434+0000","last_undegraded":"2024-05-15T18:11:46.807434+0000","last_fullsized":"2024-05-15T18:11:46.807434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387978+0000","last_change":"2024-05-15T18:08:37.180611+0000","last_active":"2024-05-15T18:10:39.387978+0000","last_peered":"2024-05-15T18:10:39.387978+0000","last_clean":"2024-05-15T18:10:39.387978+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:10:39.387978+0000","last_undegraded":"2024-05-15T18:10:39.387978+0000","last_fullsized":"2024-05-15T18:10:39.387978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.110609+0000","last_change":"2024-05-15T18:12:09.110633+0000","last_active":"2024-05-15T18:12:09.110609+0000","last_peered":"2024-05-15T18:12:09.110609+0000","last_clean":"2024-05-15T18:12:09.110609+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:12:09.110609+0000","last_undegraded":"2024-05-15T18:12:09.110609+0000","last_fullsized":"2024-05-15T18:12:09.110609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.110521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:26.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'29","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.772455+0000","last_change":"2024-05-15T18:08:43.205423+0000","last_active":"2024-05-15T18:11:53.772455+0000","last_peered":"2024-05-15T18:11:53.772455+0000","last_clean":"2024-05-15T18:11:53.772455+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:11:53.772455+0000","last_undegraded":"2024-05-15T18:11:53.772455+0000","last_fullsized":"2024-05-15T18:11:53.772455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:18.398420+0000","last_change":"2024-05-15T18:08:45.208319+0000","last_active":"2024-05-15T18:11:18.398420+0000","last_peered":"2024-05-15T18:11:18.398420+0000","last_clean":"2024-05-15T18:11:18.398420+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:11:18.398420+0000","last_undegraded":"2024-05-15T18:11:18.398420+0000","last_fullsized":"2024-05-15T18:11:18.398420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397830+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:11:13.397830+0000","last_peered":"2024-05-15T18:11:13.397830+0000","last_clean":"2024-05-15T18:11:13.397830+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:11:13.397830+0000","last_undegraded":"2024-05-15T18:11:13.397830+0000","last_fullsized":"2024-05-15T18:11:13.397830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395381+0000","last_change":"2024-05-15T18:08:39.182951+0000","last_active":"2024-05-15T18:11:03.395381+0000","last_peered":"2024-05-15T18:11:03.395381+0000","last_clean":"2024-05-15T18:11:03.395381+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:11:03.395381+0000","last_undegraded":"2024-05-15T18:11:03.395381+0000","last_fullsized":"2024-05-15T18:11:03.395381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.364028+0000","last_change":"2024-05-15T18:08:37.173604+0000","last_active":"2024-05-15T18:10:46.364028+0000","last_peered":"2024-05-15T18:10:46.364028+0000","last_clean":"2024-05-15T18:10:46.364028+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:10:46.364028+0000","last_undegraded":"2024-05-15T18:10:46.364028+0000","last_fullsized":"2024-05-15T18:10:46.364028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.076973+0000","last_change":"2024-05-15T18:12:11.076997+0000","last_active":"2024-05-15T18:12:11.076973+0000","last_peered":"2024-05-15T18:12:11.076973+0000","last_clean":"2024-05-15T18:12:11.076973+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:12:11.076973+0000","last_undegraded":"2024-05-15T18:12:11.076973+0000","last_fullsized":"2024-05-15T18:12:11.076973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.076888+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:44.712782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'35","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.782823+0000","last_change":"2024-05-15T18:08:43.204827+0000","last_active":"2024-05-15T18:11:53.782823+0000","last_peered":"2024-05-15T18:11:53.782823+0000","last_clean":"2024-05-15T18:11:53.782823+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:11:53.782823+0000","last_undegraded":"2024-05-15T18:11:53.782823+0000","last_fullsized":"2024-05-15T18:11:53.782823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:42.174540+0000","last_clean_scrub_stamp":"2024-05-15T18:08:42.174540+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:14.393207+0000","last_change":"2024-05-15T18:08:45.209586+0000","last_active":"2024-05-15T18:11:14.393207+0000","last_peered":"2024-05-15T18:11:14.393207+0000","last_clean":"2024-05-15T18:11:14.393207+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:11:14.393207+0000","last_undegraded":"2024-05-15T18:11:14.393207+0000","last_fullsized":"2024-05-15T18:11:14.393207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397061+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:11:08.397061+0000","last_peered":"2024-05-15T18:11:08.397061+0000","last_clean":"2024-05-15T18:11:08.397061+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:11:08.397061+0000","last_undegraded":"2024-05-15T18:11:08.397061+0000","last_fullsized":"2024-05-15T18:11:08.397061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114000+0000","last_change":"2024-05-15T18:08:39.193212+0000","last_active":"2024-05-15T18:11:47.114000+0000","last_peered":"2024-05-15T18:11:47.114000+0000","last_clean":"2024-05-15T18:11:47.114000+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:11:47.114000+0000","last_undegraded":"2024-05-15T18:11:47.114000+0000","last_fullsized":"2024-05-15T18:11:47.114000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721844+0000","last_change":"2024-05-15T18:08:37.175025+0000","last_active":"2024-05-15T18:11:53.721844+0000","last_peered":"2024-05-15T18:11:53.721844+0000","last_clean":"2024-05-15T18:11:53.721844+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:53.721844+0000","last_undegraded":"2024-05-15T18:11:53.721844+0000","last_fullsized":"2024-05-15T18:11:53.721844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.901612+0000","last_change":"2024-05-15T18:08:39.182556+0000","last_active":"2024-05-15T18:11:46.901612+0000","last_peered":"2024-05-15T18:11:46.901612+0000","last_clean":"2024-05-15T18:11:46.901612+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:11:46.901612+0000","last_undegraded":"2024-05-15T18:11:46.901612+0000","last_fullsized":"2024-05-15T18:11:46.901612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.099660+0000","last_change":"2024-05-15T18:08:37.174455+0000","last_active":"2024-05-15T18:11:47.099660+0000","last_peered":"2024-05-15T18:11:47.099660+0000","last_clean":"2024-05-15T18:11:47.099660+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:11:47.099660+0000","last_undegraded":"2024-05-15T18:11:47.099660+0000","last_fullsized":"2024-05-15T18:11:47.099660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393924+0000","last_change":"2024-05-15T18:08:39.182083+0000","last_active":"2024-05-15T18:10:48.393924+0000","last_peered":"2024-05-15T18:10:48.393924+0000","last_clean":"2024-05-15T18:10:48.393924+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:10:48.393924+0000","last_undegraded":"2024-05-15T18:10:48.393924+0000","last_fullsized":"2024-05-15T18:10:48.393924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393114+0000","last_change":"2024-05-15T18:08:37.180276+0000","last_active":"2024-05-15T18:10:43.393114+0000","last_peered":"2024-05-15T18:10:43.393114+0000","last_clean":"2024-05-15T18:10:43.393114+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:10:43.393114+0000","last_undegraded":"2024-05-15T18:10:43.393114+0000","last_fullsized":"2024-05-15T18:10:43.393114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036819+0000","last_change":"2024-05-15T18:08:39.183629+0000","last_active":"2024-05-15T18:11:47.036819+0000","last_peered":"2024-05-15T18:11:47.036819+0000","last_clean":"2024-05-15T18:11:47.036819+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:11:47.036819+0000","last_undegraded":"2024-05-15T18:11:47.036819+0000","last_fullsized":"2024-05-15T18:11:47.036819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721570+0000","last_change":"2024-05-15T18:08:37.180039+0000","last_active":"2024-05-15T18:11:53.721570+0000","last_peered":"2024-05-15T18:11:53.721570+0000","last_clean":"2024-05-15T18:11:53.721570+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:11:53.721570+0000","last_undegraded":"2024-05-15T18:11:53.721570+0000","last_fullsized":"2024-05-15T18:11:53.721570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081355+0000","last_change":"2024-05-15T18:08:39.183461+0000","last_active":"2024-05-15T18:11:47.081355+0000","last_peered":"2024-05-15T18:11:47.081355+0000","last_clean":"2024-05-15T18:11:47.081355+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:11:47.081355+0000","last_undegraded":"2024-05-15T18:11:47.081355+0000","last_fullsized":"2024-05-15T18:11:47.081355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.020243+0000","last_change":"2024-05-15T18:08:37.173194+0000","last_active":"2024-05-15T18:11:47.020243+0000","last_peered":"2024-05-15T18:11:47.020243+0000","last_clean":"2024-05-15T18:11:47.020243+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:47.020243+0000","last_undegraded":"2024-05-15T18:11:47.020243+0000","last_fullsized":"2024-05-15T18:11:47.020243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'7","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.162287+0000","last_change":"2024-05-15T18:08:39.193040+0000","last_active":"2024-05-15T18:11:47.162287+0000","last_peered":"2024-05-15T18:11:47.162287+0000","last_clean":"2024-05-15T18:11:47.162287+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:11:47.162287+0000","last_undegraded":"2024-05-15T18:11:47.162287+0000","last_fullsized":"2024-05-15T18:11:47.162287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.720904+0000","last_change":"2024-05-15T18:08:37.177086+0000","last_active":"2024-05-15T18:11:53.720904+0000","last_peered":"2024-05-15T18:11:53.720904+0000","last_clean":"2024-05-15T18:11:53.720904+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:11:53.720904+0000","last_undegraded":"2024-05-15T18:11:53.720904+0000","last_fullsized":"2024-05-15T18:11:53.720904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'7","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.160058+0000","last_change":"2024-05-15T18:08:39.187231+0000","last_active":"2024-05-15T18:11:47.160058+0000","last_peered":"2024-05-15T18:11:47.160058+0000","last_clean":"2024-05-15T18:11:47.160058+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:11:47.160058+0000","last_undegraded":"2024-05-15T18:11:47.160058+0000","last_fullsized":"2024-05-15T18:11:47.160058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393235+0000","last_change":"2024-05-15T18:08:37.185249+0000","last_active":"2024-05-15T18:10:48.393235+0000","last_peered":"2024-05-15T18:10:48.393235+0000","last_clean":"2024-05-15T18:10:48.393235+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:10:48.393235+0000","last_undegraded":"2024-05-15T18:10:48.393235+0000","last_fullsized":"2024-05-15T18:10:48.393235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392502+0000","last_change":"2024-05-15T18:08:39.182188+0000","last_active":"2024-05-15T18:10:43.392502+0000","last_peered":"2024-05-15T18:10:43.392502+0000","last_clean":"2024-05-15T18:10:43.392502+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:10:43.392502+0000","last_undegraded":"2024-05-15T18:10:43.392502+0000","last_fullsized":"2024-05-15T18:10:43.392502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:49.389595+0000","last_change":"2024-05-15T18:08:37.173289+0000","last_active":"2024-05-15T18:10:49.389595+0000","last_peered":"2024-05-15T18:10:49.389595+0000","last_clean":"2024-05-15T18:10:49.389595+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:10:49.389595+0000","last_undegraded":"2024-05-15T18:10:49.389595+0000","last_fullsized":"2024-05-15T18:10:49.389595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036819+0000","last_change":"2024-05-15T18:08:39.185677+0000","last_active":"2024-05-15T18:11:47.036819+0000","last_peered":"2024-05-15T18:11:47.036819+0000","last_clean":"2024-05-15T18:11:47.036819+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:11:47.036819+0000","last_undegraded":"2024-05-15T18:11:47.036819+0000","last_fullsized":"2024-05-15T18:11:47.036819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721657+0000","last_change":"2024-05-15T18:08:37.174784+0000","last_active":"2024-05-15T18:11:53.721657+0000","last_peered":"2024-05-15T18:11:53.721657+0000","last_clean":"2024-05-15T18:11:53.721657+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:11:53.721657+0000","last_undegraded":"2024-05-15T18:11:53.721657+0000","last_fullsized":"2024-05-15T18:11:53.721657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395611+0000","last_change":"2024-05-15T18:08:39.184051+0000","last_active":"2024-05-15T18:10:58.395611+0000","last_peered":"2024-05-15T18:10:58.395611+0000","last_clean":"2024-05-15T18:10:58.395611+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:10:58.395611+0000","last_undegraded":"2024-05-15T18:10:58.395611+0000","last_fullsized":"2024-05-15T18:10:58.395611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390217+0000","last_change":"2024-05-15T18:08:37.179943+0000","last_active":"2024-05-15T18:10:54.390217+0000","last_peered":"2024-05-15T18:10:54.390217+0000","last_clean":"2024-05-15T18:10:54.390217+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:10:54.390217+0000","last_undegraded":"2024-05-15T18:10:54.390217+0000","last_fullsized":"2024-05-15T18:10:54.390217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081145+0000","last_change":"2024-05-15T18:09:19.409291+0000","last_active":"2024-05-15T18:11:47.081145+0000","last_peered":"2024-05-15T18:11:47.081145+0000","last_clean":"2024-05-15T18:11:47.081145+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:11:47.081145+0000","last_undegraded":"2024-05-15T18:11:47.081145+0000","last_fullsized":"2024-05-15T18:11:47.081145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393994+0000","last_change":"2024-05-15T18:08:37.180111+0000","last_active":"2024-05-15T18:10:53.393994+0000","last_peered":"2024-05-15T18:10:53.393994+0000","last_clean":"2024-05-15T18:10:53.393994+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:10:53.393994+0000","last_undegraded":"2024-05-15T18:10:53.393994+0000","last_fullsized":"2024-05-15T18:10:53.393994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.080974+0000","last_change":"2024-05-15T18:08:39.180126+0000","last_active":"2024-05-15T18:11:47.080974+0000","last_peered":"2024-05-15T18:11:47.080974+0000","last_clean":"2024-05-15T18:11:47.080974+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:11:47.080974+0000","last_undegraded":"2024-05-15T18:11:47.080974+0000","last_fullsized":"2024-05-15T18:11:47.080974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394051+0000","last_change":"2024-05-15T18:08:37.178460+0000","last_active":"2024-05-15T18:10:53.394051+0000","last_peered":"2024-05-15T18:10:53.394051+0000","last_clean":"2024-05-15T18:10:53.394051+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:10:53.394051+0000","last_undegraded":"2024-05-15T18:10:53.394051+0000","last_fullsized":"2024-05-15T18:10:53.394051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'7","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.162254+0000","last_change":"2024-05-15T18:08:39.193285+0000","last_active":"2024-05-15T18:11:47.162254+0000","last_peered":"2024-05-15T18:11:47.162254+0000","last_clean":"2024-05-15T18:11:47.162254+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:11:47.162254+0000","last_undegraded":"2024-05-15T18:11:47.162254+0000","last_fullsized":"2024-05-15T18:11:47.162254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394628+0000","last_change":"2024-05-15T18:08:37.183430+0000","last_active":"2024-05-15T18:10:53.394628+0000","last_peered":"2024-05-15T18:10:53.394628+0000","last_clean":"2024-05-15T18:10:53.394628+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:10:53.394628+0000","last_undegraded":"2024-05-15T18:10:53.394628+0000","last_fullsized":"2024-05-15T18:10:53.394628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394013+0000","last_change":"2024-05-15T18:08:39.187902+0000","last_active":"2024-05-15T18:10:53.394013+0000","last_peered":"2024-05-15T18:10:53.394013+0000","last_clean":"2024-05-15T18:10:53.394013+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:10:53.394013+0000","last_undegraded":"2024-05-15T18:10:53.394013+0000","last_fullsized":"2024-05-15T18:10:53.394013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394668+0000","last_change":"2024-05-15T18:08:37.181882+0000","last_active":"2024-05-15T18:10:53.394668+0000","last_peered":"2024-05-15T18:10:53.394668+0000","last_clean":"2024-05-15T18:10:53.394668+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:10:53.394668+0000","last_undegraded":"2024-05-15T18:10:53.394668+0000","last_fullsized":"2024-05-15T18:10:53.394668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394558+0000","last_change":"2024-05-15T18:08:39.188670+0000","last_active":"2024-05-15T18:10:53.394558+0000","last_peered":"2024-05-15T18:10:53.394558+0000","last_clean":"2024-05-15T18:10:53.394558+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:10:53.394558+0000","last_undegraded":"2024-05-15T18:10:53.394558+0000","last_fullsized":"2024-05-15T18:10:53.394558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394778+0000","last_change":"2024-05-15T18:08:37.179459+0000","last_active":"2024-05-15T18:10:58.394778+0000","last_peered":"2024-05-15T18:10:58.394778+0000","last_clean":"2024-05-15T18:10:58.394778+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:10:58.394778+0000","last_undegraded":"2024-05-15T18:10:58.394778+0000","last_fullsized":"2024-05-15T18:10:58.394778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.080936+0000","last_change":"2024-05-15T18:08:39.178597+0000","last_active":"2024-05-15T18:11:47.080936+0000","last_peered":"2024-05-15T18:11:47.080936+0000","last_clean":"2024-05-15T18:11:47.080936+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:11:47.080936+0000","last_undegraded":"2024-05-15T18:11:47.080936+0000","last_fullsized":"2024-05-15T18:11:47.080936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.014991+0000","last_change":"2024-05-15T18:09:19.409578+0000","last_active":"2024-05-15T18:11:47.014991+0000","last_peered":"2024-05-15T18:11:47.014991+0000","last_clean":"2024-05-15T18:11:47.014991+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:11:47.014991+0000","last_undegraded":"2024-05-15T18:11:47.014991+0000","last_fullsized":"2024-05-15T18:11:47.014991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395301+0000","last_change":"2024-05-15T18:08:37.182059+0000","last_active":"2024-05-15T18:10:58.395301+0000","last_peered":"2024-05-15T18:10:58.395301+0000","last_clean":"2024-05-15T18:10:58.395301+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:10:58.395301+0000","last_undegraded":"2024-05-15T18:10:58.395301+0000","last_fullsized":"2024-05-15T18:10:58.395301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:04.391927+0000","last_change":"2024-05-15T18:08:39.190238+0000","last_active":"2024-05-15T18:11:04.391927+0000","last_peered":"2024-05-15T18:11:04.391927+0000","last_clean":"2024-05-15T18:11:04.391927+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:11:04.391927+0000","last_undegraded":"2024-05-15T18:11:04.391927+0000","last_fullsized":"2024-05-15T18:11:04.391927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:59.391082+0000","last_change":"2024-05-15T18:08:37.180082+0000","last_active":"2024-05-15T18:10:59.391082+0000","last_peered":"2024-05-15T18:10:59.391082+0000","last_clean":"2024-05-15T18:10:59.391082+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:10:59.391082+0000","last_undegraded":"2024-05-15T18:10:59.391082+0000","last_fullsized":"2024-05-15T18:10:59.391082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395724+0000","last_change":"2024-05-15T18:08:39.192652+0000","last_active":"2024-05-15T18:11:03.395724+0000","last_peered":"2024-05-15T18:11:03.395724+0000","last_clean":"2024-05-15T18:11:03.395724+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:11:03.395724+0000","last_undegraded":"2024-05-15T18:11:03.395724+0000","last_fullsized":"2024-05-15T18:11:03.395724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1488,"ondisk_log_size":1488,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":132984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35772,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336068,"statfs":{"total":96636764160,"available":96600133632,"internally_reserved":0,"allocated":446464,"data_stored":133185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705714,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":720289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705714,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:12:18.841 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.841 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.841 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.841 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.841 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.842 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.843 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.844 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.845 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.846 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.847 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.848 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.849 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-15T18:08:25.125447+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=25, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.850 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.851 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.852 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.852 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.852 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.852 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.852 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.852 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.852 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.853 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.853 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.853 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.853 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.853 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.853 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.854 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.855 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.856 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.857 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.858 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.859 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-15T18:08:42.174540+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=42, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.860 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.861 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.862 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.863 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.864 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.864 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.864 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.864 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.864 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.864 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:18.864 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T18:12:38.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:12:38.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.004+0000 7f78aa8e6640 1 Processor -- start 2024-05-15T18:12:38.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.005+0000 7f78aa8e6640 1 -- start start 2024-05-15T18:12:38.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.005+0000 7f78aa8e6640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f78a412f580 0x7f78a4131970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:38.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.005+0000 7f78aa8e6640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a4113dd0 con 0x7f78a412c5b0 2024-05-15T18:12:38.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.005+0000 7f78aa8e6640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f78a4072290 con 0x7f78a412f580 2024-05-15T18:12:38.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.005+0000 7f78a37fe640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f78a412f580 0x7f78a4131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:38.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.005+0000 7f78a3fff640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f78a412c5b0 0x7f78a412c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:37660/0 (socket says 172.21.15.3:37660) 2024-05-15T18:12:38.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.005+0000 7f78a3fff640 1 -- 172.21.15.3:0/4032202359 learned_addr learned my addr 172.21.15.3:0/4032202359 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:12:38.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.006+0000 7f78a37fe640 1 -- 172.21.15.3:0/4032202359 >> v1:172.21.15.3:6789/0 conn(0x7f78a412c5b0 legacy=0x7f78a412c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:38.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.006+0000 7f78a37fe640 1 -- 172.21.15.3:0/4032202359 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a412c390 con 0x7f78a412f580 2024-05-15T18:12:38.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.006+0000 7f78a37fe640 1 --2- 172.21.15.3:0/4032202359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412f580 0x7f78a4131970 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7898009720 tx=0x7f789802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4b582af1e8eedc server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:38.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.006+0000 7f78a2ffd640 1 -- 172.21.15.3:0/4032202359 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78980316d0 con 0x7f78a412f580 2024-05-15T18:12:38.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78a2ffd640 1 -- 172.21.15.3:0/4032202359 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7898037070 con 0x7f78a412f580 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78a2ffd640 1 -- 172.21.15.3:0/4032202359 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78980319c0 con 0x7f78a412f580 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78aa8e6640 1 -- 172.21.15.3:0/4032202359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412f580 msgr2=0x7f78a4131970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78aa8e6640 1 --2- 172.21.15.3:0/4032202359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412f580 0x7f78a4131970 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7898009720 tx=0x7f789802b840 comp rx=0 tx=0).stop 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78aa8e6640 1 -- 172.21.15.3:0/4032202359 shutdown_connections 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78aa8e6640 1 --2- 172.21.15.3:0/4032202359 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412f580 0x7f78a4131970 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78aa8e6640 1 -- 172.21.15.3:0/4032202359 >> 172.21.15.3:0/4032202359 conn(0x7f78a4099380 msgr2=0x7f78a4099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78aa8e6640 1 -- 172.21.15.3:0/4032202359 shutdown_connections 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.007+0000 7f78aa8e6640 1 -- 172.21.15.3:0/4032202359 wait complete. 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.008+0000 7f78aa8e6640 1 Processor -- start 2024-05-15T18:12:38.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.008+0000 7f78aa8e6640 1 -- start start 2024-05-15T18:12:38.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78aa8e6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412c5b0 0x7f78a4128110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:38.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78aa8e6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f78a4113990 con 0x7f78a412c5b0 2024-05-15T18:12:38.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412c5b0 0x7f78a4128110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:38.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412c5b0 0x7f78a4128110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57670/0 (socket says 172.21.15.3:57670) 2024-05-15T18:12:38.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a3fff640 1 -- 172.21.15.3:0/3399306550 learned_addr learned my addr 172.21.15.3:0/3399306550 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a3fff640 1 -- 172.21.15.3:0/3399306550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a41145d0 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a3fff640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412c5b0 0x7f78a4128110 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f789400c380 tx=0x7f789400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a0ff9640 1 -- 172.21.15.3:0/3399306550 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7894005c10 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a0ff9640 1 -- 172.21.15.3:0/3399306550 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7894005db0 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a4128650 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78a0ff9640 1 -- 172.21.15.3:0/3399306550 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7894004930 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.009+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a4128b20 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.010+0000 7f78a0ff9640 1 -- 172.21.15.3:0/3399306550 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f789401a020 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.010+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a4128d50 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.011+0000 7f78a0ff9640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7890038060 0x7f789003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.011+0000 7f78a0ff9640 1 -- 172.21.15.3:0/3399306550 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f789404b180 con 0x7f78a412c5b0 2024-05-15T18:12:38.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.011+0000 7f78a37fe640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7890038060 0x7f789003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:38.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.012+0000 7f78a37fe640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7890038060 0x7f789003a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7898036000 tx=0x7f7898008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:38.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.016+0000 7f78a0ff9640 1 -- 172.21.15.3:0/3399306550 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f78940127f0 con 0x7f78a412c5b0 2024-05-15T18:12:39.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.198+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78a41230d0 con 0x7f7890038060 2024-05-15T18:12:39.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.213+0000 7f78a0ff9640 1 -- 172.21.15.3:0/3399306550 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661159 (secure 0 0 0) 0x7f78a41230d0 con 0x7f7890038060 2024-05-15T18:12:39.199 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:12:39.204 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7890038060 msgr2=0x7f789003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7890038060 0x7f789003a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7898036000 tx=0x7f7898008030 comp rx=0 tx=0).stop 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412c5b0 msgr2=0x7f78a4128110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412c5b0 0x7f78a4128110 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f789400c380 tx=0x7f789400c840 comp rx=0 tx=0).stop 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 shutdown_connections 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f7890038060 0x7f789003a520 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 --2- 172.21.15.3:0/3399306550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78a412c5b0 0x7f78a4128110 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 >> 172.21.15.3:0/3399306550 conn(0x7f78a4099380 msgr2=0x7f78a412ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 shutdown_connections 2024-05-15T18:12:39.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:39.218+0000 7f78aa8e6640 1 -- 172.21.15.3:0/3399306550 wait complete. 2024-05-15T18:12:39.208 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-05-15T18:12:38.391204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4773,"ondisk_log_size":4773,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156600,"kb_used_data":2776,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330760,"statfs":{"total":386547056640,"available":386386698240,"internally_reserved":0,"allocated":2842624,"data_stored":1707986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":157476626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003967"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.568030+0000","last_change":"2024-05-15T18:12:23.568060+0000","last_active":"2024-05-15T18:12:23.568030+0000","last_peered":"2024-05-15T18:12:23.568030+0000","last_clean":"2024-05-15T18:12:23.568030+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:12:23.568030+0000","last_undegraded":"2024-05-15T18:12:23.568030+0000","last_fullsized":"2024-05-15T18:12:23.568030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.567934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:17.103555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.013697+0000","last_change":"2024-05-15T18:12:28.013727+0000","last_active":"2024-05-15T18:12:28.013697+0000","last_peered":"2024-05-15T18:12:28.013697+0000","last_clean":"2024-05-15T18:12:28.013697+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:12:28.013697+0000","last_undegraded":"2024-05-15T18:12:28.013697+0000","last_fullsized":"2024-05-15T18:12:28.013697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.013596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:49.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.121761+0000","last_change":"2024-05-15T18:12:33.121845+0000","last_active":"2024-05-15T18:12:33.121761+0000","last_peered":"2024-05-15T18:12:33.121761+0000","last_clean":"2024-05-15T18:12:33.121761+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:12:33.121761+0000","last_undegraded":"2024-05-15T18:12:33.121761+0000","last_fullsized":"2024-05-15T18:12:33.121761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.121644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:10.755036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":72,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.808560+0000","last_change":"2024-05-15T18:08:39.183780+0000","last_active":"2024-05-15T18:11:46.808560+0000","last_peered":"2024-05-15T18:11:46.808560+0000","last_clean":"2024-05-15T18:11:46.808560+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:11:46.808560+0000","last_undegraded":"2024-05-15T18:11:46.808560+0000","last_fullsized":"2024-05-15T18:11:46.808560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393178+0000","last_change":"2024-05-15T18:08:37.186280+0000","last_active":"2024-05-15T18:10:43.393178+0000","last_peered":"2024-05-15T18:10:43.393178+0000","last_clean":"2024-05-15T18:10:43.393178+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:10:43.393178+0000","last_undegraded":"2024-05-15T18:10:43.393178+0000","last_fullsized":"2024-05-15T18:10:43.393178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397008+0000","last_change":"2024-05-15T18:08:39.184797+0000","last_active":"2024-05-15T18:11:08.397008+0000","last_peered":"2024-05-15T18:11:08.397008+0000","last_clean":"2024-05-15T18:11:08.397008+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:11:08.397008+0000","last_undegraded":"2024-05-15T18:11:08.397008+0000","last_fullsized":"2024-05-15T18:11:08.397008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.388586+0000","last_change":"2024-05-15T18:08:37.174049+0000","last_active":"2024-05-15T18:10:46.388586+0000","last_peered":"2024-05-15T18:10:46.388586+0000","last_clean":"2024-05-15T18:10:46.388586+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:10:46.388586+0000","last_undegraded":"2024-05-15T18:10:46.388586+0000","last_fullsized":"2024-05-15T18:10:46.388586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'11","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.162104+0000","last_change":"2024-05-15T18:08:39.181113+0000","last_active":"2024-05-15T18:11:47.162104+0000","last_peered":"2024-05-15T18:11:47.162104+0000","last_clean":"2024-05-15T18:11:47.162104+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:11:47.162104+0000","last_undegraded":"2024-05-15T18:11:47.162104+0000","last_fullsized":"2024-05-15T18:11:47.162104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397047+0000","last_change":"2024-05-15T18:08:37.179942+0000","last_active":"2024-05-15T18:11:08.397047+0000","last_peered":"2024-05-15T18:11:08.397047+0000","last_clean":"2024-05-15T18:11:08.397047+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:11:08.397047+0000","last_undegraded":"2024-05-15T18:11:08.397047+0000","last_fullsized":"2024-05-15T18:11:08.397047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.391964+0000","last_change":"2024-05-15T18:08:39.185769+0000","last_active":"2024-05-15T18:10:38.391964+0000","last_peered":"2024-05-15T18:10:38.391964+0000","last_clean":"2024-05-15T18:10:38.391964+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:10:38.391964+0000","last_undegraded":"2024-05-15T18:10:38.391964+0000","last_fullsized":"2024-05-15T18:10:38.391964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396114+0000","last_change":"2024-05-15T18:08:37.178875+0000","last_active":"2024-05-15T18:11:08.396114+0000","last_peered":"2024-05-15T18:11:08.396114+0000","last_clean":"2024-05-15T18:11:08.396114+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:11:08.396114+0000","last_undegraded":"2024-05-15T18:11:08.396114+0000","last_fullsized":"2024-05-15T18:11:08.396114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.204063+0000","last_change":"2024-05-15T18:12:31.204112+0000","last_active":"2024-05-15T18:12:31.204063+0000","last_peered":"2024-05-15T18:12:31.204063+0000","last_clean":"2024-05-15T18:12:31.204063+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:12:31.204063+0000","last_undegraded":"2024-05-15T18:12:31.204063+0000","last_fullsized":"2024-05-15T18:12:31.204063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.203970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:59.549282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396959+0000","last_change":"2024-05-15T18:08:37.177010+0000","last_active":"2024-05-15T18:11:08.396959+0000","last_peered":"2024-05-15T18:11:08.396959+0000","last_clean":"2024-05-15T18:11:08.396959+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:11:08.396959+0000","last_undegraded":"2024-05-15T18:11:08.396959+0000","last_fullsized":"2024-05-15T18:11:08.396959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'6","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.549222+0000","last_change":"2024-05-15T18:12:19.549269+0000","last_active":"2024-05-15T18:12:19.549222+0000","last_peered":"2024-05-15T18:12:19.549222+0000","last_clean":"2024-05-15T18:12:19.549222+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:12:19.549222+0000","last_undegraded":"2024-05-15T18:12:19.549222+0000","last_fullsized":"2024-05-15T18:12:19.549222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.549105+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:39.405237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.174271+0000","last_change":"2024-05-15T18:12:31.174295+0000","last_active":"2024-05-15T18:12:31.174271+0000","last_peered":"2024-05-15T18:12:31.174271+0000","last_clean":"2024-05-15T18:12:31.174271+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:12:31.174271+0000","last_undegraded":"2024-05-15T18:12:31.174271+0000","last_fullsized":"2024-05-15T18:12:31.174271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.174181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:20.484887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.576330+0000","last_change":"2024-05-15T18:12:28.576366+0000","last_active":"2024-05-15T18:12:28.576330+0000","last_peered":"2024-05-15T18:12:28.576330+0000","last_clean":"2024-05-15T18:12:28.576330+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:12:28.576330+0000","last_undegraded":"2024-05-15T18:12:28.576330+0000","last_fullsized":"2024-05-15T18:12:28.576330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.576233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:31.123756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114012+0000","last_change":"2024-05-15T18:08:39.186238+0000","last_active":"2024-05-15T18:11:47.114012+0000","last_peered":"2024-05-15T18:11:47.114012+0000","last_clean":"2024-05-15T18:11:47.114012+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:11:47.114012+0000","last_undegraded":"2024-05-15T18:11:47.114012+0000","last_fullsized":"2024-05-15T18:11:47.114012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395767+0000","last_change":"2024-05-15T18:08:37.177868+0000","last_active":"2024-05-15T18:11:03.395767+0000","last_peered":"2024-05-15T18:11:03.395767+0000","last_clean":"2024-05-15T18:11:03.395767+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:11:03.395767+0000","last_undegraded":"2024-05-15T18:11:03.395767+0000","last_fullsized":"2024-05-15T18:11:03.395767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.089743+0000","last_change":"2024-05-15T18:12:32.089786+0000","last_active":"2024-05-15T18:12:32.089743+0000","last_peered":"2024-05-15T18:12:32.089743+0000","last_clean":"2024-05-15T18:12:32.089743+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:12:32.089743+0000","last_undegraded":"2024-05-15T18:12:32.089743+0000","last_fullsized":"2024-05-15T18:12:32.089743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.089658+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:06.944435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.585777+0000","last_change":"2024-05-15T18:12:29.585802+0000","last_active":"2024-05-15T18:12:29.585777+0000","last_peered":"2024-05-15T18:12:29.585777+0000","last_clean":"2024-05-15T18:12:29.585777+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:12:29.585777+0000","last_undegraded":"2024-05-15T18:12:29.585777+0000","last_fullsized":"2024-05-15T18:12:29.585777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.585687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:42.151668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394856+0000","last_change":"2024-05-15T18:08:39.187737+0000","last_active":"2024-05-15T18:10:58.394856+0000","last_peered":"2024-05-15T18:10:58.394856+0000","last_clean":"2024-05-15T18:10:58.394856+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:10:58.394856+0000","last_undegraded":"2024-05-15T18:10:58.394856+0000","last_fullsized":"2024-05-15T18:10:58.394856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395664+0000","last_change":"2024-05-15T18:08:37.176725+0000","last_active":"2024-05-15T18:11:03.395664+0000","last_peered":"2024-05-15T18:11:03.395664+0000","last_clean":"2024-05-15T18:11:03.395664+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:11:03.395664+0000","last_undegraded":"2024-05-15T18:11:03.395664+0000","last_fullsized":"2024-05-15T18:11:03.395664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.080443+0000","last_change":"2024-05-15T18:08:39.183706+0000","last_active":"2024-05-15T18:11:47.080443+0000","last_peered":"2024-05-15T18:11:47.080443+0000","last_clean":"2024-05-15T18:11:47.080443+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:11:47.080443+0000","last_undegraded":"2024-05-15T18:11:47.080443+0000","last_fullsized":"2024-05-15T18:11:47.080443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395645+0000","last_change":"2024-05-15T18:08:37.173166+0000","last_active":"2024-05-15T18:11:03.395645+0000","last_peered":"2024-05-15T18:11:03.395645+0000","last_clean":"2024-05-15T18:11:03.395645+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:11:03.395645+0000","last_undegraded":"2024-05-15T18:11:03.395645+0000","last_fullsized":"2024-05-15T18:11:03.395645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.545131+0000","last_change":"2024-05-15T18:12:26.545156+0000","last_active":"2024-05-15T18:12:26.545131+0000","last_peered":"2024-05-15T18:12:26.545131+0000","last_clean":"2024-05-15T18:12:26.545131+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:12:26.545131+0000","last_undegraded":"2024-05-15T18:12:26.545131+0000","last_fullsized":"2024-05-15T18:12:26.545131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.545026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:35.527326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721623+0000","last_change":"2024-05-15T18:08:37.180056+0000","last_active":"2024-05-15T18:11:53.721623+0000","last_peered":"2024-05-15T18:11:53.721623+0000","last_clean":"2024-05-15T18:11:53.721623+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:11:53.721623+0000","last_undegraded":"2024-05-15T18:11:53.721623+0000","last_fullsized":"2024-05-15T18:11:53.721623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.063183+0000","last_change":"2024-05-15T18:12:29.063209+0000","last_active":"2024-05-15T18:12:29.063183+0000","last_peered":"2024-05-15T18:12:29.063183+0000","last_clean":"2024-05-15T18:12:29.063183+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:12:29.063183+0000","last_undegraded":"2024-05-15T18:12:29.063183+0000","last_fullsized":"2024-05-15T18:12:29.063183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.063096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:21.253645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395433+0000","last_change":"2024-05-15T18:08:37.181235+0000","last_active":"2024-05-15T18:10:58.395433+0000","last_peered":"2024-05-15T18:10:58.395433+0000","last_clean":"2024-05-15T18:10:58.395433+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:10:58.395433+0000","last_undegraded":"2024-05-15T18:10:58.395433+0000","last_fullsized":"2024-05-15T18:10:58.395433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.123110+0000","last_change":"2024-05-15T18:08:47.223064+0000","last_active":"2024-05-15T18:11:47.123110+0000","last_peered":"2024-05-15T18:11:47.123110+0000","last_clean":"2024-05-15T18:11:47.123110+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:11:47.123110+0000","last_undegraded":"2024-05-15T18:11:47.123110+0000","last_fullsized":"2024-05-15T18:11:47.123110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.108709+0000","last_change":"2024-05-15T18:09:19.408744+0000","last_active":"2024-05-15T18:11:47.108709+0000","last_peered":"2024-05-15T18:11:47.108709+0000","last_clean":"2024-05-15T18:11:47.108709+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:11:47.108709+0000","last_undegraded":"2024-05-15T18:11:47.108709+0000","last_fullsized":"2024-05-15T18:11:47.108709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395481+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:10:58.395481+0000","last_peered":"2024-05-15T18:10:58.395481+0000","last_clean":"2024-05-15T18:10:58.395481+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:10:58.395481+0000","last_undegraded":"2024-05-15T18:10:58.395481+0000","last_fullsized":"2024-05-15T18:10:58.395481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'5","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.471375+0000","last_change":"2024-05-15T18:12:00.471407+0000","last_active":"2024-05-15T18:12:00.471375+0000","last_peered":"2024-05-15T18:12:00.471375+0000","last_clean":"2024-05-15T18:12:00.471375+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:12:00.471375+0000","last_undegraded":"2024-05-15T18:12:00.471375+0000","last_fullsized":"2024-05-15T18:12:00.471375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.471292+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:32.955699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.208450+0000","last_change":"2024-05-15T18:12:22.208523+0000","last_active":"2024-05-15T18:12:22.208450+0000","last_peered":"2024-05-15T18:12:22.208450+0000","last_clean":"2024-05-15T18:12:22.208450+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:12:22.208450+0000","last_undegraded":"2024-05-15T18:12:22.208450+0000","last_fullsized":"2024-05-15T18:12:22.208450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.208343+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:44.847137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.165954+0000","last_change":"2024-05-15T18:12:06.165990+0000","last_active":"2024-05-15T18:12:06.165954+0000","last_peered":"2024-05-15T18:12:06.165954+0000","last_clean":"2024-05-15T18:12:06.165954+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:12:06.165954+0000","last_undegraded":"2024-05-15T18:12:06.165954+0000","last_fullsized":"2024-05-15T18:12:06.165954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.165871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:13.434904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.082436+0000","last_change":"2024-05-15T18:08:47.223088+0000","last_active":"2024-05-15T18:11:47.082436+0000","last_peered":"2024-05-15T18:11:47.082436+0000","last_clean":"2024-05-15T18:11:47.082436+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:11:47.082436+0000","last_undegraded":"2024-05-15T18:11:47.082436+0000","last_fullsized":"2024-05-15T18:11:47.082436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.110867+0000","last_change":"2024-05-15T18:08:39.182435+0000","last_active":"2024-05-15T18:11:47.110867+0000","last_peered":"2024-05-15T18:11:47.110867+0000","last_clean":"2024-05-15T18:11:47.110867+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:11:47.110867+0000","last_undegraded":"2024-05-15T18:11:47.110867+0000","last_fullsized":"2024-05-15T18:11:47.110867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394676+0000","last_change":"2024-05-15T18:08:37.176655+0000","last_active":"2024-05-15T18:10:58.394676+0000","last_peered":"2024-05-15T18:10:58.394676+0000","last_clean":"2024-05-15T18:10:58.394676+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:10:58.394676+0000","last_undegraded":"2024-05-15T18:10:58.394676+0000","last_fullsized":"2024-05-15T18:10:58.394676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.076827+0000","last_change":"2024-05-15T18:12:21.076858+0000","last_active":"2024-05-15T18:12:21.076827+0000","last_peered":"2024-05-15T18:12:21.076827+0000","last_clean":"2024-05-15T18:12:21.076827+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:12:21.076827+0000","last_undegraded":"2024-05-15T18:12:21.076827+0000","last_fullsized":"2024-05-15T18:12:21.076827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.076736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:12.212953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.191773+0000","last_change":"2024-05-15T18:12:04.191810+0000","last_active":"2024-05-15T18:12:04.191773+0000","last_peered":"2024-05-15T18:12:04.191773+0000","last_clean":"2024-05-15T18:12:04.191773+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:12:04.191773+0000","last_undegraded":"2024-05-15T18:12:04.191773+0000","last_fullsized":"2024-05-15T18:12:04.191773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.191688+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:12.868591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.280655+0000","last_change":"2024-05-15T18:11:59.280691+0000","last_active":"2024-05-15T18:11:59.280655+0000","last_peered":"2024-05-15T18:11:59.280655+0000","last_clean":"2024-05-15T18:11:59.280655+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:11:59.280655+0000","last_undegraded":"2024-05-15T18:11:59.280655+0000","last_fullsized":"2024-05-15T18:11:59.280655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.280542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:02.064253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:19.394024+0000","last_change":"2024-05-15T18:08:47.215478+0000","last_active":"2024-05-15T18:11:19.394024+0000","last_peered":"2024-05-15T18:11:19.394024+0000","last_clean":"2024-05-15T18:11:19.394024+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:11:19.394024+0000","last_undegraded":"2024-05-15T18:11:19.394024+0000","last_fullsized":"2024-05-15T18:11:19.394024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396365+0000","last_change":"2024-05-15T18:08:39.180798+0000","last_active":"2024-05-15T18:11:03.396365+0000","last_peered":"2024-05-15T18:11:03.396365+0000","last_clean":"2024-05-15T18:11:03.396365+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:11:03.396365+0000","last_undegraded":"2024-05-15T18:11:03.396365+0000","last_fullsized":"2024-05-15T18:11:03.396365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395383+0000","last_change":"2024-05-15T18:08:37.185177+0000","last_active":"2024-05-15T18:10:58.395383+0000","last_peered":"2024-05-15T18:10:58.395383+0000","last_clean":"2024-05-15T18:10:58.395383+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:10:58.395383+0000","last_undegraded":"2024-05-15T18:10:58.395383+0000","last_fullsized":"2024-05-15T18:10:58.395383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:48.401606+0000","last_change":"2024-05-15T18:09:19.410089+0000","last_active":"2024-05-15T18:11:48.401606+0000","last_peered":"2024-05-15T18:11:48.401606+0000","last_clean":"2024-05-15T18:11:48.401606+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:11:48.401606+0000","last_undegraded":"2024-05-15T18:11:48.401606+0000","last_fullsized":"2024-05-15T18:11:48.401606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.538861+0000","last_change":"2024-05-15T18:12:05.538899+0000","last_active":"2024-05-15T18:12:05.538861+0000","last_peered":"2024-05-15T18:12:05.538861+0000","last_clean":"2024-05-15T18:12:05.538861+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:12:05.538861+0000","last_undegraded":"2024-05-15T18:12:05.538861+0000","last_fullsized":"2024-05-15T18:12:05.538861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.538773+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:15:58.392906+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'286","reported_seq":417,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.258996+0000","last_change":"2024-05-15T18:12:29.259026+0000","last_active":"2024-05-15T18:12:29.258996+0000","last_peered":"2024-05-15T18:12:29.258996+0000","last_clean":"2024-05-15T18:12:29.258996+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:12:29.258996+0000","last_undegraded":"2024-05-15T18:12:29.258996+0000","last_fullsized":"2024-05-15T18:12:29.258996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.258908+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:17:31.038888+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:18.397395+0000","last_change":"2024-05-15T18:08:47.220509+0000","last_active":"2024-05-15T18:11:18.397395+0000","last_peered":"2024-05-15T18:11:18.397395+0000","last_clean":"2024-05-15T18:11:18.397395+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:11:18.397395+0000","last_undegraded":"2024-05-15T18:11:18.397395+0000","last_fullsized":"2024-05-15T18:11:18.397395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'24","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.163243+0000","last_change":"2024-05-15T18:12:27.163303+0000","last_active":"2024-05-15T18:12:27.163243+0000","last_peered":"2024-05-15T18:12:27.163243+0000","last_clean":"2024-05-15T18:12:27.163243+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:12:27.163243+0000","last_undegraded":"2024-05-15T18:12:27.163243+0000","last_fullsized":"2024-05-15T18:12:27.163243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.163125+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:48.445585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.394761+0000","last_change":"2024-05-15T18:08:37.176800+0000","last_active":"2024-05-15T18:10:58.394761+0000","last_peered":"2024-05-15T18:10:58.394761+0000","last_clean":"2024-05-15T18:10:58.394761+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:10:58.394761+0000","last_undegraded":"2024-05-15T18:10:58.394761+0000","last_fullsized":"2024-05-15T18:10:58.394761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.344739+0000","last_change":"2024-05-15T18:12:04.344763+0000","last_active":"2024-05-15T18:12:04.344739+0000","last_peered":"2024-05-15T18:12:04.344739+0000","last_clean":"2024-05-15T18:12:04.344739+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:12:04.344739+0000","last_undegraded":"2024-05-15T18:12:04.344739+0000","last_fullsized":"2024-05-15T18:12:04.344739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.344646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:55.480863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.490821+0000","last_change":"2024-05-15T18:12:03.490856+0000","last_active":"2024-05-15T18:12:03.490821+0000","last_peered":"2024-05-15T18:12:03.490821+0000","last_clean":"2024-05-15T18:12:03.490821+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:12:03.490821+0000","last_undegraded":"2024-05-15T18:12:03.490821+0000","last_fullsized":"2024-05-15T18:12:03.490821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.490731+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:32.129481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":447,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.892996+0000","last_change":"2024-05-15T18:11:59.893055+0000","last_active":"2024-05-15T18:11:59.892996+0000","last_peered":"2024-05-15T18:11:59.892996+0000","last_clean":"2024-05-15T18:11:59.892996+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:59.892996+0000","last_undegraded":"2024-05-15T18:11:59.892996+0000","last_fullsized":"2024-05-15T18:11:59.892996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.892887+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:38.810690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.323300+0000","last_change":"2024-05-15T18:12:10.323325+0000","last_active":"2024-05-15T18:12:10.323300+0000","last_peered":"2024-05-15T18:12:10.323300+0000","last_clean":"2024-05-15T18:12:10.323300+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:12:10.323300+0000","last_undegraded":"2024-05-15T18:12:10.323300+0000","last_fullsized":"2024-05-15T18:12:10.323300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.323182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:01.360177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394019+0000","last_change":"2024-05-15T18:08:37.173486+0000","last_active":"2024-05-15T18:10:53.394019+0000","last_peered":"2024-05-15T18:10:53.394019+0000","last_clean":"2024-05-15T18:10:53.394019+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:10:53.394019+0000","last_undegraded":"2024-05-15T18:10:53.394019+0000","last_fullsized":"2024-05-15T18:10:53.394019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.051678+0000","last_change":"2024-05-15T18:12:12.051699+0000","last_active":"2024-05-15T18:12:12.051678+0000","last_peered":"2024-05-15T18:12:12.051678+0000","last_clean":"2024-05-15T18:12:12.051678+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:12:12.051678+0000","last_undegraded":"2024-05-15T18:12:12.051678+0000","last_fullsized":"2024-05-15T18:12:12.051678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.051591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:28:19.702252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'52","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.558204+0000","last_change":"2024-05-15T18:12:11.558253+0000","last_active":"2024-05-15T18:12:11.558204+0000","last_peered":"2024-05-15T18:12:11.558204+0000","last_clean":"2024-05-15T18:12:11.558204+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:12:11.558204+0000","last_undegraded":"2024-05-15T18:12:11.558204+0000","last_fullsized":"2024-05-15T18:12:11.558204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.558113+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:52.322479+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.845687+0000","last_change":"2024-05-15T18:12:00.845711+0000","last_active":"2024-05-15T18:12:00.845687+0000","last_peered":"2024-05-15T18:12:00.845687+0000","last_clean":"2024-05-15T18:12:00.845687+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:12:00.845687+0000","last_undegraded":"2024-05-15T18:12:00.845687+0000","last_fullsized":"2024-05-15T18:12:00.845687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.845599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:10.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393899+0000","last_change":"2024-05-15T18:08:47.221822+0000","last_active":"2024-05-15T18:10:53.393899+0000","last_peered":"2024-05-15T18:10:53.393899+0000","last_clean":"2024-05-15T18:10:53.393899+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:10:53.393899+0000","last_undegraded":"2024-05-15T18:10:53.393899+0000","last_fullsized":"2024-05-15T18:10:53.393899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393263+0000","last_change":"2024-05-15T18:08:39.186448+0000","last_active":"2024-05-15T18:10:48.393263+0000","last_peered":"2024-05-15T18:10:48.393263+0000","last_clean":"2024-05-15T18:10:48.393263+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:10:48.393263+0000","last_undegraded":"2024-05-15T18:10:48.393263+0000","last_fullsized":"2024-05-15T18:10:48.393263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.535746+0000","last_change":"2024-05-15T18:12:31.535769+0000","last_active":"2024-05-15T18:12:31.535746+0000","last_peered":"2024-05-15T18:12:31.535746+0000","last_clean":"2024-05-15T18:12:31.535746+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:12:31.535746+0000","last_undegraded":"2024-05-15T18:12:31.535746+0000","last_fullsized":"2024-05-15T18:12:31.535746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.535653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.741063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"31'2","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.011085+0000","last_change":"2024-05-15T18:12:15.011129+0000","last_active":"2024-05-15T18:12:15.011085+0000","last_peered":"2024-05-15T18:12:15.011085+0000","last_clean":"2024-05-15T18:12:15.011085+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:12:15.011085+0000","last_undegraded":"2024-05-15T18:12:15.011085+0000","last_fullsized":"2024-05-15T18:12:15.011085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.010984+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:44.102759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.305450+0000","last_change":"2024-05-15T18:12:27.305526+0000","last_active":"2024-05-15T18:12:27.305450+0000","last_peered":"2024-05-15T18:12:27.305450+0000","last_clean":"2024-05-15T18:12:27.305450+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:12:27.305450+0000","last_undegraded":"2024-05-15T18:12:27.305450+0000","last_fullsized":"2024-05-15T18:12:27.305450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.305346+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:08:55.301055+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.922884+0000","last_change":"2024-05-15T18:12:09.922907+0000","last_active":"2024-05-15T18:12:09.922884+0000","last_peered":"2024-05-15T18:12:09.922884+0000","last_clean":"2024-05-15T18:12:09.922884+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:12:09.922884+0000","last_undegraded":"2024-05-15T18:12:09.922884+0000","last_fullsized":"2024-05-15T18:12:09.922884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.922780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:29.778911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.970185+0000","last_change":"2024-05-15T18:12:21.970242+0000","last_active":"2024-05-15T18:12:21.970185+0000","last_peered":"2024-05-15T18:12:21.970185+0000","last_clean":"2024-05-15T18:12:21.970185+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:12:21.970185+0000","last_undegraded":"2024-05-15T18:12:21.970185+0000","last_fullsized":"2024-05-15T18:12:21.970185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.970081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:32.198122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.113952+0000","last_change":"2024-05-15T18:08:39.185744+0000","last_active":"2024-05-15T18:11:47.113952+0000","last_peered":"2024-05-15T18:11:47.113952+0000","last_clean":"2024-05-15T18:11:47.113952+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:11:47.113952+0000","last_undegraded":"2024-05-15T18:11:47.113952+0000","last_fullsized":"2024-05-15T18:11:47.113952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721089+0000","last_change":"2024-05-15T18:08:37.181644+0000","last_active":"2024-05-15T18:11:53.721089+0000","last_peered":"2024-05-15T18:11:53.721089+0000","last_clean":"2024-05-15T18:11:53.721089+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:11:53.721089+0000","last_undegraded":"2024-05-15T18:11:53.721089+0000","last_fullsized":"2024-05-15T18:11:53.721089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.068542+0000","last_change":"2024-05-15T18:12:19.068568+0000","last_active":"2024-05-15T18:12:19.068542+0000","last_peered":"2024-05-15T18:12:19.068542+0000","last_clean":"2024-05-15T18:12:19.068542+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:12:19.068542+0000","last_undegraded":"2024-05-15T18:12:19.068542+0000","last_fullsized":"2024-05-15T18:12:19.068542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.068452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:21.615975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.293128+0000","last_change":"2024-05-15T18:12:28.293167+0000","last_active":"2024-05-15T18:12:28.293128+0000","last_peered":"2024-05-15T18:12:28.293128+0000","last_clean":"2024-05-15T18:12:28.293128+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:12:28.293128+0000","last_undegraded":"2024-05-15T18:12:28.293128+0000","last_fullsized":"2024-05-15T18:12:28.293128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.293044+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:30.668147+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":409,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.833108+0000","last_change":"2024-05-15T18:12:05.833181+0000","last_active":"2024-05-15T18:12:05.833108+0000","last_peered":"2024-05-15T18:12:05.833108+0000","last_clean":"2024-05-15T18:12:05.833108+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:12:05.833108+0000","last_undegraded":"2024-05-15T18:12:05.833108+0000","last_fullsized":"2024-05-15T18:12:05.833108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.833005+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:50.024912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:59.391187+0000","last_change":"2024-05-15T18:08:47.218349+0000","last_active":"2024-05-15T18:10:59.391187+0000","last_peered":"2024-05-15T18:10:59.391187+0000","last_clean":"2024-05-15T18:10:59.391187+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:10:59.391187+0000","last_undegraded":"2024-05-15T18:10:59.391187+0000","last_fullsized":"2024-05-15T18:10:59.391187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.609693+0000","last_change":"2024-05-15T18:12:21.609722+0000","last_active":"2024-05-15T18:12:21.609693+0000","last_peered":"2024-05-15T18:12:21.609693+0000","last_clean":"2024-05-15T18:12:21.609693+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:12:21.609693+0000","last_undegraded":"2024-05-15T18:12:21.609693+0000","last_fullsized":"2024-05-15T18:12:21.609693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.609598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:32.043990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394615+0000","last_change":"2024-05-15T18:08:37.179976+0000","last_active":"2024-05-15T18:10:53.394615+0000","last_peered":"2024-05-15T18:10:53.394615+0000","last_clean":"2024-05-15T18:10:53.394615+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:10:53.394615+0000","last_undegraded":"2024-05-15T18:10:53.394615+0000","last_fullsized":"2024-05-15T18:10:53.394615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.982022+0000","last_change":"2024-05-15T18:12:15.982070+0000","last_active":"2024-05-15T18:12:15.982022+0000","last_peered":"2024-05-15T18:12:15.982022+0000","last_clean":"2024-05-15T18:12:15.982022+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:12:15.982022+0000","last_undegraded":"2024-05-15T18:12:15.982022+0000","last_fullsized":"2024-05-15T18:12:15.982022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.981892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:27.521839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.357135+0000","last_change":"2024-05-15T18:12:03.357175+0000","last_active":"2024-05-15T18:12:03.357135+0000","last_peered":"2024-05-15T18:12:03.357135+0000","last_clean":"2024-05-15T18:12:03.357135+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:12:03.357135+0000","last_undegraded":"2024-05-15T18:12:03.357135+0000","last_fullsized":"2024-05-15T18:12:03.357135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.357042+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:36.663893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.920891+0000","last_change":"2024-05-15T18:11:58.920914+0000","last_active":"2024-05-15T18:11:58.920891+0000","last_peered":"2024-05-15T18:11:58.920891+0000","last_clean":"2024-05-15T18:11:58.920891+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:11:58.920891+0000","last_undegraded":"2024-05-15T18:11:58.920891+0000","last_fullsized":"2024-05-15T18:11:58.920891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.920801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:00:11.891898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'18","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.208786+0000","last_change":"2024-05-15T18:08:47.219473+0000","last_active":"2024-05-15T18:11:47.208786+0000","last_peered":"2024-05-15T18:11:47.208786+0000","last_clean":"2024-05-15T18:11:47.208786+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:11:47.208786+0000","last_undegraded":"2024-05-15T18:11:47.208786+0000","last_fullsized":"2024-05-15T18:11:47.208786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.808065+0000","last_change":"2024-05-15T18:08:39.191385+0000","last_active":"2024-05-15T18:11:46.808065+0000","last_peered":"2024-05-15T18:11:46.808065+0000","last_clean":"2024-05-15T18:11:46.808065+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:11:46.808065+0000","last_undegraded":"2024-05-15T18:11:46.808065+0000","last_fullsized":"2024-05-15T18:11:46.808065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.201606+0000","last_change":"2024-05-15T18:12:29.201631+0000","last_active":"2024-05-15T18:12:29.201606+0000","last_peered":"2024-05-15T18:12:29.201606+0000","last_clean":"2024-05-15T18:12:29.201606+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:12:29.201606+0000","last_undegraded":"2024-05-15T18:12:29.201606+0000","last_fullsized":"2024-05-15T18:12:29.201606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.201511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:36.487260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.549280+0000","last_change":"2024-05-15T18:12:17.549324+0000","last_active":"2024-05-15T18:12:17.549280+0000","last_peered":"2024-05-15T18:12:17.549280+0000","last_clean":"2024-05-15T18:12:17.549280+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:12:17.549280+0000","last_undegraded":"2024-05-15T18:12:17.549280+0000","last_fullsized":"2024-05-15T18:12:17.549280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.549183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:54.810132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.153352+0000","last_change":"2024-05-15T18:12:05.153393+0000","last_active":"2024-05-15T18:12:05.153352+0000","last_peered":"2024-05-15T18:12:05.153352+0000","last_clean":"2024-05-15T18:12:05.153352+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:12:05.153352+0000","last_undegraded":"2024-05-15T18:12:05.153352+0000","last_fullsized":"2024-05-15T18:12:05.153352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.153268+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:23:48.552424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.235621+0000","last_change":"2024-05-15T18:12:25.235658+0000","last_active":"2024-05-15T18:12:25.235621+0000","last_peered":"2024-05-15T18:12:25.235621+0000","last_clean":"2024-05-15T18:12:25.235621+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:12:25.235621+0000","last_undegraded":"2024-05-15T18:12:25.235621+0000","last_fullsized":"2024-05-15T18:12:25.235621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.235510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:10.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.165412+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:11:47.165412+0000","last_peered":"2024-05-15T18:11:47.165412+0000","last_clean":"2024-05-15T18:11:47.165412+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:11:47.165412+0000","last_undegraded":"2024-05-15T18:11:47.165412+0000","last_fullsized":"2024-05-15T18:11:47.165412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.318634+0000","last_change":"2024-05-15T18:12:12.318664+0000","last_active":"2024-05-15T18:12:12.318634+0000","last_peered":"2024-05-15T18:12:12.318634+0000","last_clean":"2024-05-15T18:12:12.318634+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:12:12.318634+0000","last_undegraded":"2024-05-15T18:12:12.318634+0000","last_fullsized":"2024-05-15T18:12:12.318634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.318542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:02.692777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393870+0000","last_change":"2024-05-15T18:08:37.182183+0000","last_active":"2024-05-15T18:10:48.393870+0000","last_peered":"2024-05-15T18:10:48.393870+0000","last_clean":"2024-05-15T18:10:48.393870+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:10:48.393870+0000","last_undegraded":"2024-05-15T18:10:48.393870+0000","last_fullsized":"2024-05-15T18:10:48.393870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.119348+0000","last_change":"2024-05-15T18:12:23.119374+0000","last_active":"2024-05-15T18:12:23.119348+0000","last_peered":"2024-05-15T18:12:23.119348+0000","last_clean":"2024-05-15T18:12:23.119348+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:12:23.119348+0000","last_undegraded":"2024-05-15T18:12:23.119348+0000","last_fullsized":"2024-05-15T18:12:23.119348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.119253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:24.003247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.592664+0000","last_change":"2024-05-15T18:12:09.592703+0000","last_active":"2024-05-15T18:12:09.592664+0000","last_peered":"2024-05-15T18:12:09.592664+0000","last_clean":"2024-05-15T18:12:09.592664+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:12:09.592664+0000","last_undegraded":"2024-05-15T18:12:09.592664+0000","last_fullsized":"2024-05-15T18:12:09.592664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.592581+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:53:31.226178+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":415,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.470688+0000","last_change":"2024-05-15T18:12:00.470721+0000","last_active":"2024-05-15T18:12:00.470688+0000","last_peered":"2024-05-15T18:12:00.470688+0000","last_clean":"2024-05-15T18:12:00.470688+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:12:00.470688+0000","last_undegraded":"2024-05-15T18:12:00.470688+0000","last_fullsized":"2024-05-15T18:12:00.470688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.470590+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:35.192862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.167252+0000","last_change":"2024-05-15T18:08:47.215424+0000","last_active":"2024-05-15T18:11:47.167252+0000","last_peered":"2024-05-15T18:11:47.167252+0000","last_clean":"2024-05-15T18:11:47.167252+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:11:47.167252+0000","last_undegraded":"2024-05-15T18:11:47.167252+0000","last_fullsized":"2024-05-15T18:11:47.167252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.808629+0000","last_change":"2024-05-15T18:08:39.187057+0000","last_active":"2024-05-15T18:11:46.808629+0000","last_peered":"2024-05-15T18:11:46.808629+0000","last_clean":"2024-05-15T18:11:46.808629+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:11:46.808629+0000","last_undegraded":"2024-05-15T18:11:46.808629+0000","last_fullsized":"2024-05-15T18:11:46.808629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.017392+0000","last_change":"2024-05-15T18:08:37.185221+0000","last_active":"2024-05-15T18:11:47.017392+0000","last_peered":"2024-05-15T18:11:47.017392+0000","last_clean":"2024-05-15T18:11:47.017392+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:11:47.017392+0000","last_undegraded":"2024-05-15T18:11:47.017392+0000","last_fullsized":"2024-05-15T18:11:47.017392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.095863+0000","last_change":"2024-05-15T18:12:16.095898+0000","last_active":"2024-05-15T18:12:16.095863+0000","last_peered":"2024-05-15T18:12:16.095863+0000","last_clean":"2024-05-15T18:12:16.095863+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:12:16.095863+0000","last_undegraded":"2024-05-15T18:12:16.095863+0000","last_fullsized":"2024-05-15T18:12:16.095863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.095781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:17.249315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.331808+0000","last_change":"2024-05-15T18:12:09.331845+0000","last_active":"2024-05-15T18:12:09.331808+0000","last_peered":"2024-05-15T18:12:09.331808+0000","last_clean":"2024-05-15T18:12:09.331808+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:12:09.331808+0000","last_undegraded":"2024-05-15T18:12:09.331808+0000","last_fullsized":"2024-05-15T18:12:09.331808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.331720+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:28.300746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":471,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.276017+0000","last_change":"2024-05-15T18:12:00.276044+0000","last_active":"2024-05-15T18:12:00.276017+0000","last_peered":"2024-05-15T18:12:00.276017+0000","last_clean":"2024-05-15T18:12:00.276017+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:12:00.276017+0000","last_undegraded":"2024-05-15T18:12:00.276017+0000","last_fullsized":"2024-05-15T18:12:00.276017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.275912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:39.193715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393819+0000","last_change":"2024-05-15T18:08:47.215824+0000","last_active":"2024-05-15T18:10:53.393819+0000","last_peered":"2024-05-15T18:10:53.393819+0000","last_clean":"2024-05-15T18:10:53.393819+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:10:53.393819+0000","last_undegraded":"2024-05-15T18:10:53.393819+0000","last_fullsized":"2024-05-15T18:10:53.393819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.032486+0000","last_change":"2024-05-15T18:12:19.032552+0000","last_active":"2024-05-15T18:12:19.032486+0000","last_peered":"2024-05-15T18:12:19.032486+0000","last_clean":"2024-05-15T18:12:19.032486+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:12:19.032486+0000","last_undegraded":"2024-05-15T18:12:19.032486+0000","last_fullsized":"2024-05-15T18:12:19.032486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.032366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:37.619094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393728+0000","last_change":"2024-05-15T18:08:37.183998+0000","last_active":"2024-05-15T18:10:48.393728+0000","last_peered":"2024-05-15T18:10:48.393728+0000","last_clean":"2024-05-15T18:10:48.393728+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:10:48.393728+0000","last_undegraded":"2024-05-15T18:10:48.393728+0000","last_fullsized":"2024-05-15T18:10:48.393728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.354846+0000","last_change":"2024-05-15T18:12:08.354871+0000","last_active":"2024-05-15T18:12:08.354846+0000","last_peered":"2024-05-15T18:12:08.354846+0000","last_clean":"2024-05-15T18:12:08.354846+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:12:08.354846+0000","last_undegraded":"2024-05-15T18:12:08.354846+0000","last_fullsized":"2024-05-15T18:12:08.354846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.354757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:02.756370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.149819+0000","last_change":"2024-05-15T18:12:07.149858+0000","last_active":"2024-05-15T18:12:07.149819+0000","last_peered":"2024-05-15T18:12:07.149819+0000","last_clean":"2024-05-15T18:12:07.149819+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:12:07.149819+0000","last_undegraded":"2024-05-15T18:12:07.149819+0000","last_fullsized":"2024-05-15T18:12:07.149819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.149716+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:51.341623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.495674+0000","last_change":"2024-05-15T18:11:59.495696+0000","last_active":"2024-05-15T18:11:59.495674+0000","last_peered":"2024-05-15T18:11:59.495674+0000","last_clean":"2024-05-15T18:11:59.495674+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:11:59.495674+0000","last_undegraded":"2024-05-15T18:11:59.495674+0000","last_fullsized":"2024-05-15T18:11:59.495674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.495587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:27.408105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.086166+0000","last_change":"2024-05-15T18:12:10.086196+0000","last_active":"2024-05-15T18:12:10.086166+0000","last_peered":"2024-05-15T18:12:10.086166+0000","last_clean":"2024-05-15T18:12:10.086166+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:12:10.086166+0000","last_undegraded":"2024-05-15T18:12:10.086166+0000","last_fullsized":"2024-05-15T18:12:10.086166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.086069+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:14:22.063457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.274833+0000","last_change":"2024-05-15T18:12:15.274855+0000","last_active":"2024-05-15T18:12:15.274833+0000","last_peered":"2024-05-15T18:12:15.274833+0000","last_clean":"2024-05-15T18:12:15.274833+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:12:15.274833+0000","last_undegraded":"2024-05-15T18:12:15.274833+0000","last_fullsized":"2024-05-15T18:12:15.274833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.274744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:50.129521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":201,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.182436+0000","last_change":"2024-05-15T18:08:26.216167+0000","last_active":"2024-05-15T18:11:57.182436+0000","last_peered":"2024-05-15T18:11:57.182436+0000","last_clean":"2024-05-15T18:11:57.182436+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:11:57.182436+0000","last_undegraded":"2024-05-15T18:11:57.182436+0000","last_fullsized":"2024-05-15T18:11:57.182436+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:25.125447+0000","last_clean_scrub_stamp":"2024-05-15T18:08:25.125447+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392446+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:10:38.392446+0000","last_peered":"2024-05-15T18:10:38.392446+0000","last_clean":"2024-05-15T18:10:38.392446+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:10:38.392446+0000","last_undegraded":"2024-05-15T18:10:38.392446+0000","last_fullsized":"2024-05-15T18:10:38.392446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393101+0000","last_change":"2024-05-15T18:08:37.186535+0000","last_active":"2024-05-15T18:10:43.393101+0000","last_peered":"2024-05-15T18:10:43.393101+0000","last_clean":"2024-05-15T18:10:43.393101+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:10:43.393101+0000","last_undegraded":"2024-05-15T18:10:43.393101+0000","last_fullsized":"2024-05-15T18:10:43.393101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.108807+0000","last_change":"2024-05-15T18:12:15.108833+0000","last_active":"2024-05-15T18:12:15.108807+0000","last_peered":"2024-05-15T18:12:15.108807+0000","last_clean":"2024-05-15T18:12:15.108807+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:12:15.108807+0000","last_undegraded":"2024-05-15T18:12:15.108807+0000","last_fullsized":"2024-05-15T18:12:15.108807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.108718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:50:47.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.302427+0000","last_change":"2024-05-15T18:12:13.302463+0000","last_active":"2024-05-15T18:12:13.302427+0000","last_peered":"2024-05-15T18:12:13.302427+0000","last_clean":"2024-05-15T18:12:13.302427+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:12:13.302427+0000","last_undegraded":"2024-05-15T18:12:13.302427+0000","last_fullsized":"2024-05-15T18:12:13.302427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.302331+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:17.032807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.959229+0000","last_change":"2024-05-15T18:12:13.959264+0000","last_active":"2024-05-15T18:12:13.959229+0000","last_peered":"2024-05-15T18:12:13.959229+0000","last_clean":"2024-05-15T18:12:13.959229+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:12:13.959229+0000","last_undegraded":"2024-05-15T18:12:13.959229+0000","last_fullsized":"2024-05-15T18:12:13.959229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.959124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:07.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.529852+0000","last_change":"2024-05-15T18:12:18.529885+0000","last_active":"2024-05-15T18:12:18.529852+0000","last_peered":"2024-05-15T18:12:18.529852+0000","last_clean":"2024-05-15T18:12:18.529852+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:12:18.529852+0000","last_undegraded":"2024-05-15T18:12:18.529852+0000","last_fullsized":"2024-05-15T18:12:18.529852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'85","last_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_deep_scrub":"31'85","last_deep_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.529758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:29.586821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393949+0000","last_change":"2024-05-15T18:08:39.180830+0000","last_active":"2024-05-15T18:10:48.393949+0000","last_peered":"2024-05-15T18:10:48.393949+0000","last_clean":"2024-05-15T18:10:48.393949+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:10:48.393949+0000","last_undegraded":"2024-05-15T18:10:48.393949+0000","last_fullsized":"2024-05-15T18:10:48.393949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.085532+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:11:58.085532+0000","last_peered":"2024-05-15T18:11:58.085532+0000","last_clean":"2024-05-15T18:11:58.085532+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:11:58.085532+0000","last_undegraded":"2024-05-15T18:11:58.085532+0000","last_fullsized":"2024-05-15T18:11:58.085532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388580+0000","last_change":"2024-05-15T18:08:37.179663+0000","last_active":"2024-05-15T18:10:44.388580+0000","last_peered":"2024-05-15T18:10:44.388580+0000","last_clean":"2024-05-15T18:10:44.388580+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:10:44.388580+0000","last_undegraded":"2024-05-15T18:10:44.388580+0000","last_fullsized":"2024-05-15T18:10:44.388580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.426538+0000","last_change":"2024-05-15T18:12:01.426564+0000","last_active":"2024-05-15T18:12:01.426538+0000","last_peered":"2024-05-15T18:12:01.426538+0000","last_clean":"2024-05-15T18:12:01.426538+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:12:01.426538+0000","last_undegraded":"2024-05-15T18:12:01.426538+0000","last_fullsized":"2024-05-15T18:12:01.426538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.426444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:20.013172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'293","reported_seq":518,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.240316+0000","last_change":"2024-05-15T18:12:03.240363+0000","last_active":"2024-05-15T18:12:03.240316+0000","last_peered":"2024-05-15T18:12:03.240316+0000","last_clean":"2024-05-15T18:12:03.240316+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:12:03.240316+0000","last_undegraded":"2024-05-15T18:12:03.240316+0000","last_fullsized":"2024-05-15T18:12:03.240316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'293","last_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_deep_scrub":"31'293","last_deep_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.240231+0000","objects_scrubbed":10,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:29:17.206611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.216712+0000","last_change":"2024-05-15T18:12:33.216735+0000","last_active":"2024-05-15T18:12:33.216712+0000","last_peered":"2024-05-15T18:12:33.216712+0000","last_clean":"2024-05-15T18:12:33.216712+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:12:33.216712+0000","last_undegraded":"2024-05-15T18:12:33.216712+0000","last_fullsized":"2024-05-15T18:12:33.216712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.216625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:46.914136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.079397+0000","last_change":"2024-05-15T18:12:18.079442+0000","last_active":"2024-05-15T18:12:18.079397+0000","last_peered":"2024-05-15T18:12:18.079397+0000","last_clean":"2024-05-15T18:12:18.079397+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:12:18.079397+0000","last_undegraded":"2024-05-15T18:12:18.079397+0000","last_fullsized":"2024-05-15T18:12:18.079397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.079282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:50.563689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.080604+0000","last_change":"2024-05-15T18:08:39.186998+0000","last_active":"2024-05-15T18:11:47.080604+0000","last_peered":"2024-05-15T18:11:47.080604+0000","last_clean":"2024-05-15T18:11:47.080604+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:11:47.080604+0000","last_undegraded":"2024-05-15T18:11:47.080604+0000","last_fullsized":"2024-05-15T18:11:47.080604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:33.391125+0000","last_change":"2024-05-15T18:08:31.153301+0000","last_active":"2024-05-15T18:10:33.391125+0000","last_peered":"2024-05-15T18:10:33.391125+0000","last_clean":"2024-05-15T18:10:33.391125+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:10:33.391125+0000","last_undegraded":"2024-05-15T18:10:33.391125+0000","last_fullsized":"2024-05-15T18:10:33.391125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387819+0000","last_change":"2024-05-15T18:08:37.173060+0000","last_active":"2024-05-15T18:10:39.387819+0000","last_peered":"2024-05-15T18:10:39.387819+0000","last_clean":"2024-05-15T18:10:39.387819+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:10:39.387819+0000","last_undegraded":"2024-05-15T18:10:39.387819+0000","last_fullsized":"2024-05-15T18:10:39.387819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"22'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393977+0000","last_change":"2024-05-15T18:09:19.416671+0000","last_active":"2024-05-15T18:10:53.393977+0000","last_peered":"2024-05-15T18:10:53.393977+0000","last_clean":"2024-05-15T18:10:53.393977+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:10:53.393977+0000","last_undegraded":"2024-05-15T18:10:53.393977+0000","last_fullsized":"2024-05-15T18:10:53.393977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":101,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.543399+0000","last_change":"2024-05-15T18:12:07.543438+0000","last_active":"2024-05-15T18:12:07.543399+0000","last_peered":"2024-05-15T18:12:07.543399+0000","last_clean":"2024-05-15T18:12:07.543399+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:12:07.543399+0000","last_undegraded":"2024-05-15T18:12:07.543399+0000","last_fullsized":"2024-05-15T18:12:07.543399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.543314+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:32.467749+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.928878+0000","last_change":"2024-05-15T18:11:57.928898+0000","last_active":"2024-05-15T18:11:57.928878+0000","last_peered":"2024-05-15T18:11:57.928878+0000","last_clean":"2024-05-15T18:11:57.928878+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:11:57.928878+0000","last_undegraded":"2024-05-15T18:11:57.928878+0000","last_fullsized":"2024-05-15T18:11:57.928878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.928793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.522391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396277+0000","last_change":"2024-05-15T18:08:47.219388+0000","last_active":"2024-05-15T18:11:03.396277+0000","last_peered":"2024-05-15T18:11:03.396277+0000","last_clean":"2024-05-15T18:11:03.396277+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:11:03.396277+0000","last_undegraded":"2024-05-15T18:11:03.396277+0000","last_fullsized":"2024-05-15T18:11:03.396277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036760+0000","last_change":"2024-05-15T18:08:39.184088+0000","last_active":"2024-05-15T18:11:47.036760+0000","last_peered":"2024-05-15T18:11:47.036760+0000","last_clean":"2024-05-15T18:11:47.036760+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:11:47.036760+0000","last_undegraded":"2024-05-15T18:11:47.036760+0000","last_fullsized":"2024-05-15T18:11:47.036760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392402+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:10:38.392402+0000","last_peered":"2024-05-15T18:10:38.392402+0000","last_clean":"2024-05-15T18:10:38.392402+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:10:38.392402+0000","last_undegraded":"2024-05-15T18:10:38.392402+0000","last_fullsized":"2024-05-15T18:10:38.392402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392512+0000","last_change":"2024-05-15T18:08:37.173069+0000","last_active":"2024-05-15T18:10:43.392512+0000","last_peered":"2024-05-15T18:10:43.392512+0000","last_clean":"2024-05-15T18:10:43.392512+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:10:43.392512+0000","last_undegraded":"2024-05-15T18:10:43.392512+0000","last_fullsized":"2024-05-15T18:10:43.392512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.016376+0000","last_change":"2024-05-15T18:12:17.016404+0000","last_active":"2024-05-15T18:12:17.016376+0000","last_peered":"2024-05-15T18:12:17.016376+0000","last_clean":"2024-05-15T18:12:17.016376+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:12:17.016376+0000","last_undegraded":"2024-05-15T18:12:17.016376+0000","last_fullsized":"2024-05-15T18:12:17.016376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.016284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:25.998584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.380207+0000","last_change":"2024-05-15T18:12:05.380243+0000","last_active":"2024-05-15T18:12:05.380207+0000","last_peered":"2024-05-15T18:12:05.380207+0000","last_clean":"2024-05-15T18:12:05.380207+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:12:05.380207+0000","last_undegraded":"2024-05-15T18:12:05.380207+0000","last_fullsized":"2024-05-15T18:12:05.380207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.380117+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:27.585526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395626+0000","last_change":"2024-05-15T18:08:45.211047+0000","last_active":"2024-05-15T18:10:58.395626+0000","last_peered":"2024-05-15T18:10:58.395626+0000","last_clean":"2024-05-15T18:10:58.395626+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:10:58.395626+0000","last_undegraded":"2024-05-15T18:10:58.395626+0000","last_fullsized":"2024-05-15T18:10:58.395626+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:44.182576+0000","last_clean_scrub_stamp":"2024-05-15T18:08:44.182576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.010297+0000","last_change":"2024-05-15T18:12:26.010324+0000","last_active":"2024-05-15T18:12:26.010297+0000","last_peered":"2024-05-15T18:12:26.010297+0000","last_clean":"2024-05-15T18:12:26.010297+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:12:26.010297+0000","last_undegraded":"2024-05-15T18:12:26.010297+0000","last_fullsized":"2024-05-15T18:12:26.010297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.010213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:44.979239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.995145+0000","last_change":"2024-05-15T18:12:19.995202+0000","last_active":"2024-05-15T18:12:19.995145+0000","last_peered":"2024-05-15T18:12:19.995145+0000","last_clean":"2024-05-15T18:12:19.995145+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:12:19.995145+0000","last_undegraded":"2024-05-15T18:12:19.995145+0000","last_fullsized":"2024-05-15T18:12:19.995145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.995046+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:22.542569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.392561+0000","last_change":"2024-05-15T18:08:37.173933+0000","last_active":"2024-05-15T18:10:43.392561+0000","last_peered":"2024-05-15T18:10:43.392561+0000","last_clean":"2024-05-15T18:10:43.392561+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:10:43.392561+0000","last_undegraded":"2024-05-15T18:10:43.392561+0000","last_fullsized":"2024-05-15T18:10:43.392561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387920+0000","last_change":"2024-05-15T18:08:31.152334+0000","last_active":"2024-05-15T18:10:39.387920+0000","last_peered":"2024-05-15T18:10:39.387920+0000","last_clean":"2024-05-15T18:10:39.387920+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:10:39.387920+0000","last_undegraded":"2024-05-15T18:10:39.387920+0000","last_fullsized":"2024-05-15T18:10:39.387920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.927177+0000","last_change":"2024-05-15T18:12:12.927216+0000","last_active":"2024-05-15T18:12:12.927177+0000","last_peered":"2024-05-15T18:12:12.927177+0000","last_clean":"2024-05-15T18:12:12.927177+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:12:12.927177+0000","last_undegraded":"2024-05-15T18:12:12.927177+0000","last_fullsized":"2024-05-15T18:12:12.927177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.927083+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:24.672114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":149,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.879798+0000","last_change":"2024-05-15T18:12:06.879840+0000","last_active":"2024-05-15T18:12:06.879798+0000","last_peered":"2024-05-15T18:12:06.879798+0000","last_clean":"2024-05-15T18:12:06.879798+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:12:06.879798+0000","last_undegraded":"2024-05-15T18:12:06.879798+0000","last_fullsized":"2024-05-15T18:12:06.879798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.879711+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:16.898190+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.431117+0000","last_change":"2024-05-15T18:12:01.431143+0000","last_active":"2024-05-15T18:12:01.431117+0000","last_peered":"2024-05-15T18:12:01.431117+0000","last_clean":"2024-05-15T18:12:01.431117+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:12:01.431117+0000","last_undegraded":"2024-05-15T18:12:01.431117+0000","last_fullsized":"2024-05-15T18:12:01.431117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.431023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:47.755595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.148347+0000","last_change":"2024-05-15T18:12:26.148381+0000","last_active":"2024-05-15T18:12:26.148347+0000","last_peered":"2024-05-15T18:12:26.148347+0000","last_clean":"2024-05-15T18:12:26.148347+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:12:26.148347+0000","last_undegraded":"2024-05-15T18:12:26.148347+0000","last_fullsized":"2024-05-15T18:12:26.148347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.148259+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:59.103311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.114211+0000","last_change":"2024-05-15T18:09:19.415333+0000","last_active":"2024-05-15T18:11:47.114211+0000","last_peered":"2024-05-15T18:11:47.114211+0000","last_clean":"2024-05-15T18:11:47.114211+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:11:47.114211+0000","last_undegraded":"2024-05-15T18:11:47.114211+0000","last_fullsized":"2024-05-15T18:11:47.114211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:44.388641+0000","last_change":"2024-05-15T18:08:37.180268+0000","last_active":"2024-05-15T18:10:44.388641+0000","last_peered":"2024-05-15T18:10:44.388641+0000","last_clean":"2024-05-15T18:10:44.388641+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:10:44.388641+0000","last_undegraded":"2024-05-15T18:10:44.388641+0000","last_fullsized":"2024-05-15T18:10:44.388641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:38.392486+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:10:38.392486+0000","last_peered":"2024-05-15T18:10:38.392486+0000","last_clean":"2024-05-15T18:10:38.392486+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:10:38.392486+0000","last_undegraded":"2024-05-15T18:10:38.392486+0000","last_fullsized":"2024-05-15T18:10:38.392486+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.391560+0000","last_change":"2024-05-15T18:12:02.391600+0000","last_active":"2024-05-15T18:12:02.391560+0000","last_peered":"2024-05-15T18:12:02.391560+0000","last_clean":"2024-05-15T18:12:02.391560+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:12:02.391560+0000","last_undegraded":"2024-05-15T18:12:02.391560+0000","last_fullsized":"2024-05-15T18:12:02.391560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.391444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:04.938967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.233207+0000","last_change":"2024-05-15T18:12:01.233258+0000","last_active":"2024-05-15T18:12:01.233207+0000","last_peered":"2024-05-15T18:12:01.233207+0000","last_clean":"2024-05-15T18:12:01.233207+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:12:01.233207+0000","last_undegraded":"2024-05-15T18:12:01.233207+0000","last_fullsized":"2024-05-15T18:12:01.233207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.233115+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:11.007085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":358,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.323746+0000","last_change":"2024-05-15T18:11:58.323821+0000","last_active":"2024-05-15T18:11:58.323746+0000","last_peered":"2024-05-15T18:11:58.323746+0000","last_clean":"2024-05-15T18:11:58.323746+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:58.323746+0000","last_undegraded":"2024-05-15T18:11:58.323746+0000","last_fullsized":"2024-05-15T18:11:58.323746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.323633+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.917231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396379+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:11:03.396379+0000","last_peered":"2024-05-15T18:11:03.396379+0000","last_clean":"2024-05-15T18:11:03.396379+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:11:03.396379+0000","last_undegraded":"2024-05-15T18:11:03.396379+0000","last_fullsized":"2024-05-15T18:11:03.396379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.223775+0000","last_change":"2024-05-15T18:12:18.223814+0000","last_active":"2024-05-15T18:12:18.223775+0000","last_peered":"2024-05-15T18:12:18.223775+0000","last_clean":"2024-05-15T18:12:18.223775+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:12:18.223775+0000","last_undegraded":"2024-05-15T18:12:18.223775+0000","last_fullsized":"2024-05-15T18:12:18.223775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.223691+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:06.085124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393971+0000","last_change":"2024-05-15T18:08:37.184221+0000","last_active":"2024-05-15T18:10:48.393971+0000","last_peered":"2024-05-15T18:10:48.393971+0000","last_clean":"2024-05-15T18:10:48.393971+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:10:48.393971+0000","last_undegraded":"2024-05-15T18:10:48.393971+0000","last_fullsized":"2024-05-15T18:10:48.393971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387957+0000","last_change":"2024-05-15T18:08:31.151108+0000","last_active":"2024-05-15T18:10:39.387957+0000","last_peered":"2024-05-15T18:10:39.387957+0000","last_clean":"2024-05-15T18:10:39.387957+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:10:39.387957+0000","last_undegraded":"2024-05-15T18:10:39.387957+0000","last_fullsized":"2024-05-15T18:10:39.387957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.358909+0000","last_change":"2024-05-15T18:12:06.358934+0000","last_active":"2024-05-15T18:12:06.358909+0000","last_peered":"2024-05-15T18:12:06.358909+0000","last_clean":"2024-05-15T18:12:06.358909+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:12:06.358909+0000","last_undegraded":"2024-05-15T18:12:06.358909+0000","last_fullsized":"2024-05-15T18:12:06.358909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.358819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:07.242813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.223995+0000","last_change":"2024-05-15T18:12:23.224031+0000","last_active":"2024-05-15T18:12:23.223995+0000","last_peered":"2024-05-15T18:12:23.223995+0000","last_clean":"2024-05-15T18:12:23.223995+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:12:23.223995+0000","last_undegraded":"2024-05-15T18:12:23.223995+0000","last_fullsized":"2024-05-15T18:12:23.223995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.223908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:27.882071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":401,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.886627+0000","last_change":"2024-05-15T18:12:02.886655+0000","last_active":"2024-05-15T18:12:02.886627+0000","last_peered":"2024-05-15T18:12:02.886627+0000","last_clean":"2024-05-15T18:12:02.886627+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:12:02.886627+0000","last_undegraded":"2024-05-15T18:12:02.886627+0000","last_fullsized":"2024-05-15T18:12:02.886627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.886536+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:13.272929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395621+0000","last_change":"2024-05-15T18:08:47.222589+0000","last_active":"2024-05-15T18:11:03.395621+0000","last_peered":"2024-05-15T18:11:03.395621+0000","last_clean":"2024-05-15T18:11:03.395621+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:11:03.395621+0000","last_undegraded":"2024-05-15T18:11:03.395621+0000","last_fullsized":"2024-05-15T18:11:03.395621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":74,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.562829+0000","last_change":"2024-05-15T18:12:30.562885+0000","last_active":"2024-05-15T18:12:30.562829+0000","last_peered":"2024-05-15T18:12:30.562829+0000","last_clean":"2024-05-15T18:12:30.562829+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:12:30.562829+0000","last_undegraded":"2024-05-15T18:12:30.562829+0000","last_fullsized":"2024-05-15T18:12:30.562829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.562719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:21.698936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393412+0000","last_change":"2024-05-15T18:08:37.179237+0000","last_active":"2024-05-15T18:10:48.393412+0000","last_peered":"2024-05-15T18:10:48.393412+0000","last_clean":"2024-05-15T18:10:48.393412+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:10:48.393412+0000","last_undegraded":"2024-05-15T18:10:48.393412+0000","last_fullsized":"2024-05-15T18:10:48.393412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393213+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:10:43.393213+0000","last_peered":"2024-05-15T18:10:43.393213+0000","last_clean":"2024-05-15T18:10:43.393213+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:10:43.393213+0000","last_undegraded":"2024-05-15T18:10:43.393213+0000","last_fullsized":"2024-05-15T18:10:43.393213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.448833+0000","last_change":"2024-05-15T18:11:59.448854+0000","last_active":"2024-05-15T18:11:59.448833+0000","last_peered":"2024-05-15T18:11:59.448833+0000","last_clean":"2024-05-15T18:11:59.448833+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:11:59.448833+0000","last_undegraded":"2024-05-15T18:11:59.448833+0000","last_fullsized":"2024-05-15T18:11:59.448833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.448742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:12:37.217420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":191,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.502515+0000","last_change":"2024-05-15T18:12:04.502595+0000","last_active":"2024-05-15T18:12:04.502515+0000","last_peered":"2024-05-15T18:12:04.502515+0000","last_clean":"2024-05-15T18:12:04.502515+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:12:04.502515+0000","last_undegraded":"2024-05-15T18:12:04.502515+0000","last_fullsized":"2024-05-15T18:12:04.502515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.502398+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:28.778374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:56.955848+0000","last_change":"2024-05-15T18:11:56.955872+0000","last_active":"2024-05-15T18:11:56.955848+0000","last_peered":"2024-05-15T18:11:56.955848+0000","last_clean":"2024-05-15T18:11:56.955848+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:11:56.955848+0000","last_undegraded":"2024-05-15T18:11:56.955848+0000","last_fullsized":"2024-05-15T18:11:56.955848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_clean_scrub_stamp":"2024-05-15T18:11:56.955763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:30.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.566752+0000","last_change":"2024-05-15T18:12:14.566798+0000","last_active":"2024-05-15T18:12:14.566752+0000","last_peered":"2024-05-15T18:12:14.566752+0000","last_clean":"2024-05-15T18:12:14.566752+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:12:14.566752+0000","last_undegraded":"2024-05-15T18:12:14.566752+0000","last_fullsized":"2024-05-15T18:12:14.566752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.566649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:21.835682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.904324+0000","last_change":"2024-05-15T18:08:47.219593+0000","last_active":"2024-05-15T18:11:46.904324+0000","last_peered":"2024-05-15T18:11:46.904324+0000","last_clean":"2024-05-15T18:11:46.904324+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:11:46.904324+0000","last_undegraded":"2024-05-15T18:11:46.904324+0000","last_fullsized":"2024-05-15T18:11:46.904324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.511624+0000","last_change":"2024-05-15T18:12:32.511652+0000","last_active":"2024-05-15T18:12:32.511624+0000","last_peered":"2024-05-15T18:12:32.511624+0000","last_clean":"2024-05-15T18:12:32.511624+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:12:32.511624+0000","last_undegraded":"2024-05-15T18:12:32.511624+0000","last_fullsized":"2024-05-15T18:12:32.511624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.511538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:33.395531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395527+0000","last_change":"2024-05-15T18:08:37.185935+0000","last_active":"2024-05-15T18:10:58.395527+0000","last_peered":"2024-05-15T18:10:58.395527+0000","last_clean":"2024-05-15T18:10:58.395527+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:10:58.395527+0000","last_undegraded":"2024-05-15T18:10:58.395527+0000","last_fullsized":"2024-05-15T18:10:58.395527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395581+0000","last_change":"2024-05-15T18:09:19.404553+0000","last_active":"2024-05-15T18:11:03.395581+0000","last_peered":"2024-05-15T18:11:03.395581+0000","last_clean":"2024-05-15T18:11:03.395581+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:11:03.395581+0000","last_undegraded":"2024-05-15T18:11:03.395581+0000","last_fullsized":"2024-05-15T18:11:03.395581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.350517+0000","last_change":"2024-05-15T18:12:11.350568+0000","last_active":"2024-05-15T18:12:11.350517+0000","last_peered":"2024-05-15T18:12:11.350517+0000","last_clean":"2024-05-15T18:12:11.350517+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:12:11.350517+0000","last_undegraded":"2024-05-15T18:12:11.350517+0000","last_fullsized":"2024-05-15T18:12:11.350517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.350399+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:11.134147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.232158+0000","last_change":"2024-05-15T18:12:21.232183+0000","last_active":"2024-05-15T18:12:21.232158+0000","last_peered":"2024-05-15T18:12:21.232158+0000","last_clean":"2024-05-15T18:12:21.232158+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:12:21.232158+0000","last_undegraded":"2024-05-15T18:12:21.232158+0000","last_fullsized":"2024-05-15T18:12:21.232158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.232063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:21.541842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.032141+0000","last_change":"2024-05-15T18:08:47.216635+0000","last_active":"2024-05-15T18:11:47.032141+0000","last_peered":"2024-05-15T18:11:47.032141+0000","last_clean":"2024-05-15T18:11:47.032141+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:11:47.032141+0000","last_undegraded":"2024-05-15T18:11:47.032141+0000","last_fullsized":"2024-05-15T18:11:47.032141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.980328+0000","last_change":"2024-05-15T18:12:24.980362+0000","last_active":"2024-05-15T18:12:24.980328+0000","last_peered":"2024-05-15T18:12:24.980328+0000","last_clean":"2024-05-15T18:12:24.980328+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:12:24.980328+0000","last_undegraded":"2024-05-15T18:12:24.980328+0000","last_fullsized":"2024-05-15T18:12:24.980328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.980229+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:19.381841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'6","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721477+0000","last_change":"2024-05-15T18:08:37.178179+0000","last_active":"2024-05-15T18:11:53.721477+0000","last_peered":"2024-05-15T18:11:53.721477+0000","last_clean":"2024-05-15T18:11:53.721477+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:11:53.721477+0000","last_undegraded":"2024-05-15T18:11:53.721477+0000","last_fullsized":"2024-05-15T18:11:53.721477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.464665+0000","last_change":"2024-05-15T18:11:58.464695+0000","last_active":"2024-05-15T18:11:58.464665+0000","last_peered":"2024-05-15T18:11:58.464665+0000","last_clean":"2024-05-15T18:11:58.464665+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:11:58.464665+0000","last_undegraded":"2024-05-15T18:11:58.464665+0000","last_fullsized":"2024-05-15T18:11:58.464665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.464557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:27.556332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.875011+0000","last_change":"2024-05-15T18:12:08.875048+0000","last_active":"2024-05-15T18:12:08.875011+0000","last_peered":"2024-05-15T18:12:08.875011+0000","last_clean":"2024-05-15T18:12:08.875011+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:12:08.875011+0000","last_undegraded":"2024-05-15T18:12:08.875011+0000","last_fullsized":"2024-05-15T18:12:08.875011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.874911+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:19.931974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.544246+0000","last_change":"2024-05-15T18:12:10.544278+0000","last_active":"2024-05-15T18:12:10.544246+0000","last_peered":"2024-05-15T18:12:10.544246+0000","last_clean":"2024-05-15T18:12:10.544246+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:12:10.544246+0000","last_undegraded":"2024-05-15T18:12:10.544246+0000","last_fullsized":"2024-05-15T18:12:10.544246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.544159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:52.334749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.126720+0000","last_change":"2024-05-15T18:12:22.126750+0000","last_active":"2024-05-15T18:12:22.126720+0000","last_peered":"2024-05-15T18:12:22.126720+0000","last_clean":"2024-05-15T18:12:22.126720+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:12:22.126720+0000","last_undegraded":"2024-05-15T18:12:22.126720+0000","last_fullsized":"2024-05-15T18:12:22.126720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.126615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:44.332025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.156074+0000","last_change":"2024-05-15T18:12:28.156098+0000","last_active":"2024-05-15T18:12:28.156074+0000","last_peered":"2024-05-15T18:12:28.156074+0000","last_clean":"2024-05-15T18:12:28.156074+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:12:28.156074+0000","last_undegraded":"2024-05-15T18:12:28.156074+0000","last_fullsized":"2024-05-15T18:12:28.156074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.155985+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:20.346535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395566+0000","last_change":"2024-05-15T18:08:37.176233+0000","last_active":"2024-05-15T18:11:03.395566+0000","last_peered":"2024-05-15T18:11:03.395566+0000","last_clean":"2024-05-15T18:11:03.395566+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:11:03.395566+0000","last_undegraded":"2024-05-15T18:11:03.395566+0000","last_fullsized":"2024-05-15T18:11:03.395566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.579110+0000","last_change":"2024-05-15T18:12:12.579133+0000","last_active":"2024-05-15T18:12:12.579110+0000","last_peered":"2024-05-15T18:12:12.579110+0000","last_clean":"2024-05-15T18:12:12.579110+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:12:12.579110+0000","last_undegraded":"2024-05-15T18:12:12.579110+0000","last_fullsized":"2024-05-15T18:12:12.579110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.579011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:22.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'48","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.881810+0000","last_change":"2024-05-15T18:12:11.881882+0000","last_active":"2024-05-15T18:12:11.881810+0000","last_peered":"2024-05-15T18:12:11.881810+0000","last_clean":"2024-05-15T18:12:11.881810+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:12:11.881810+0000","last_undegraded":"2024-05-15T18:12:11.881810+0000","last_fullsized":"2024-05-15T18:12:11.881810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.881671+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:22.316063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.359537+0000","last_change":"2024-05-15T18:11:57.359562+0000","last_active":"2024-05-15T18:11:57.359537+0000","last_peered":"2024-05-15T18:11:57.359537+0000","last_clean":"2024-05-15T18:11:57.359537+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:11:57.359537+0000","last_undegraded":"2024-05-15T18:11:57.359537+0000","last_fullsized":"2024-05-15T18:11:57.359537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.359393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:31.155528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:18.398472+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:11:18.398472+0000","last_peered":"2024-05-15T18:11:18.398472+0000","last_clean":"2024-05-15T18:11:18.398472+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:11:18.398472+0000","last_undegraded":"2024-05-15T18:11:18.398472+0000","last_fullsized":"2024-05-15T18:11:18.398472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.235644+0000","last_change":"2024-05-15T18:12:16.235673+0000","last_active":"2024-05-15T18:12:16.235644+0000","last_peered":"2024-05-15T18:12:16.235644+0000","last_clean":"2024-05-15T18:12:16.235644+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:12:16.235644+0000","last_undegraded":"2024-05-15T18:12:16.235644+0000","last_fullsized":"2024-05-15T18:12:16.235644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.235558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:08.093786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395751+0000","last_change":"2024-05-15T18:08:37.176555+0000","last_active":"2024-05-15T18:11:03.395751+0000","last_peered":"2024-05-15T18:11:03.395751+0000","last_clean":"2024-05-15T18:11:03.395751+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:11:03.395751+0000","last_undegraded":"2024-05-15T18:11:03.395751+0000","last_fullsized":"2024-05-15T18:11:03.395751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.315137+0000","last_change":"2024-05-15T18:12:07.315160+0000","last_active":"2024-05-15T18:12:07.315137+0000","last_peered":"2024-05-15T18:12:07.315137+0000","last_clean":"2024-05-15T18:12:07.315137+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:12:07.315137+0000","last_undegraded":"2024-05-15T18:12:07.315137+0000","last_fullsized":"2024-05-15T18:12:07.315137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.315047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:28.990916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.589070+0000","last_change":"2024-05-15T18:12:08.589118+0000","last_active":"2024-05-15T18:12:08.589070+0000","last_peered":"2024-05-15T18:12:08.589070+0000","last_clean":"2024-05-15T18:12:08.589070+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:12:08.589070+0000","last_undegraded":"2024-05-15T18:12:08.589070+0000","last_fullsized":"2024-05-15T18:12:08.589070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.588987+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:48.582117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.517728+0000","last_change":"2024-05-15T18:11:58.517779+0000","last_active":"2024-05-15T18:11:58.517728+0000","last_peered":"2024-05-15T18:11:58.517728+0000","last_clean":"2024-05-15T18:11:58.517728+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:11:58.517728+0000","last_undegraded":"2024-05-15T18:11:58.517728+0000","last_fullsized":"2024-05-15T18:11:58.517728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.517616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:10:30.693406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081201+0000","last_change":"2024-05-15T18:08:39.186233+0000","last_active":"2024-05-15T18:11:47.081201+0000","last_peered":"2024-05-15T18:11:47.081201+0000","last_clean":"2024-05-15T18:11:47.081201+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:11:47.081201+0000","last_undegraded":"2024-05-15T18:11:47.081201+0000","last_fullsized":"2024-05-15T18:11:47.081201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396177+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:11:03.396177+0000","last_peered":"2024-05-15T18:11:03.396177+0000","last_clean":"2024-05-15T18:11:03.396177+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:11:03.396177+0000","last_undegraded":"2024-05-15T18:11:03.396177+0000","last_fullsized":"2024-05-15T18:11:03.396177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.052516+0000","last_change":"2024-05-15T18:12:20.052545+0000","last_active":"2024-05-15T18:12:20.052516+0000","last_peered":"2024-05-15T18:12:20.052516+0000","last_clean":"2024-05-15T18:12:20.052516+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:12:20.052516+0000","last_undegraded":"2024-05-15T18:12:20.052516+0000","last_fullsized":"2024-05-15T18:12:20.052516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.052417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:32.618399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.892641+0000","last_change":"2024-05-15T18:12:10.892676+0000","last_active":"2024-05-15T18:12:10.892641+0000","last_peered":"2024-05-15T18:12:10.892641+0000","last_clean":"2024-05-15T18:12:10.892641+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:12:10.892641+0000","last_undegraded":"2024-05-15T18:12:10.892641+0000","last_fullsized":"2024-05-15T18:12:10.892641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.892546+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:09.452875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.474146+0000","last_change":"2024-05-15T18:12:02.474184+0000","last_active":"2024-05-15T18:12:02.474146+0000","last_peered":"2024-05-15T18:12:02.474146+0000","last_clean":"2024-05-15T18:12:02.474146+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:12:02.474146+0000","last_undegraded":"2024-05-15T18:12:02.474146+0000","last_fullsized":"2024-05-15T18:12:02.474146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.474022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:25:37.061500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:09.392486+0000","last_change":"2024-05-15T18:08:47.215443+0000","last_active":"2024-05-15T18:11:09.392486+0000","last_peered":"2024-05-15T18:11:09.392486+0000","last_clean":"2024-05-15T18:11:09.392486+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:11:09.392486+0000","last_undegraded":"2024-05-15T18:11:09.392486+0000","last_fullsized":"2024-05-15T18:11:09.392486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387968+0000","last_change":"2024-05-15T18:08:39.186914+0000","last_active":"2024-05-15T18:10:39.387968+0000","last_peered":"2024-05-15T18:10:39.387968+0000","last_clean":"2024-05-15T18:10:39.387968+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:10:39.387968+0000","last_undegraded":"2024-05-15T18:10:39.387968+0000","last_fullsized":"2024-05-15T18:10:39.387968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395526+0000","last_change":"2024-05-15T18:09:19.405624+0000","last_active":"2024-05-15T18:11:03.395526+0000","last_peered":"2024-05-15T18:11:03.395526+0000","last_clean":"2024-05-15T18:11:03.395526+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:11:03.395526+0000","last_undegraded":"2024-05-15T18:11:03.395526+0000","last_fullsized":"2024-05-15T18:11:03.395526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.537088+0000","last_change":"2024-05-15T18:12:15.537137+0000","last_active":"2024-05-15T18:12:15.537088+0000","last_peered":"2024-05-15T18:12:15.537088+0000","last_clean":"2024-05-15T18:12:15.537088+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:12:15.537088+0000","last_undegraded":"2024-05-15T18:12:15.537088+0000","last_fullsized":"2024-05-15T18:12:15.537088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.536986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:59.728892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.224399+0000","last_change":"2024-05-15T18:12:30.224462+0000","last_active":"2024-05-15T18:12:30.224399+0000","last_peered":"2024-05-15T18:12:30.224399+0000","last_clean":"2024-05-15T18:12:30.224399+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:12:30.224399+0000","last_undegraded":"2024-05-15T18:12:30.224399+0000","last_fullsized":"2024-05-15T18:12:30.224399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.224290+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:21.279383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.212353+0000","last_change":"2024-05-15T18:12:02.212375+0000","last_active":"2024-05-15T18:12:02.212353+0000","last_peered":"2024-05-15T18:12:02.212353+0000","last_clean":"2024-05-15T18:12:02.212353+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:12:02.212353+0000","last_undegraded":"2024-05-15T18:12:02.212353+0000","last_fullsized":"2024-05-15T18:12:02.212353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.212266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:31.297851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396986+0000","last_change":"2024-05-15T18:08:47.218586+0000","last_active":"2024-05-15T18:11:08.396986+0000","last_peered":"2024-05-15T18:11:08.396986+0000","last_clean":"2024-05-15T18:11:08.396986+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:11:08.396986+0000","last_undegraded":"2024-05-15T18:11:08.396986+0000","last_fullsized":"2024-05-15T18:11:08.396986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.265264+0000","last_change":"2024-05-15T18:12:14.265289+0000","last_active":"2024-05-15T18:12:14.265264+0000","last_peered":"2024-05-15T18:12:14.265264+0000","last_clean":"2024-05-15T18:12:14.265264+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:12:14.265264+0000","last_undegraded":"2024-05-15T18:12:14.265264+0000","last_fullsized":"2024-05-15T18:12:14.265264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.265178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:00:30.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.022946+0000","last_change":"2024-05-15T18:08:37.175536+0000","last_active":"2024-05-15T18:11:47.022946+0000","last_peered":"2024-05-15T18:11:47.022946+0000","last_clean":"2024-05-15T18:11:47.022946+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:11:47.022946+0000","last_undegraded":"2024-05-15T18:11:47.022946+0000","last_fullsized":"2024-05-15T18:11:47.022946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.544729+0000","last_change":"2024-05-15T18:12:16.544771+0000","last_active":"2024-05-15T18:12:16.544729+0000","last_peered":"2024-05-15T18:12:16.544729+0000","last_clean":"2024-05-15T18:12:16.544729+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:12:16.544729+0000","last_undegraded":"2024-05-15T18:12:16.544729+0000","last_fullsized":"2024-05-15T18:12:16.544729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.544617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:26.563096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.854084+0000","last_change":"2024-05-15T18:12:04.854126+0000","last_active":"2024-05-15T18:12:04.854084+0000","last_peered":"2024-05-15T18:12:04.854084+0000","last_clean":"2024-05-15T18:12:04.854084+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:12:04.854084+0000","last_undegraded":"2024-05-15T18:12:04.854084+0000","last_fullsized":"2024-05-15T18:12:04.854084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.853980+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:12.123012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.875727+0000","last_change":"2024-05-15T18:12:03.875755+0000","last_active":"2024-05-15T18:12:03.875727+0000","last_peered":"2024-05-15T18:12:03.875727+0000","last_clean":"2024-05-15T18:12:03.875727+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:12:03.875727+0000","last_undegraded":"2024-05-15T18:12:03.875727+0000","last_fullsized":"2024-05-15T18:12:03.875727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.875637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:24.820098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396939+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:11:08.396939+0000","last_peered":"2024-05-15T18:11:08.396939+0000","last_clean":"2024-05-15T18:11:08.396939+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:11:08.396939+0000","last_undegraded":"2024-05-15T18:11:08.396939+0000","last_fullsized":"2024-05-15T18:11:08.396939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'5","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.159441+0000","last_change":"2024-05-15T18:08:39.184374+0000","last_active":"2024-05-15T18:11:47.159441+0000","last_peered":"2024-05-15T18:11:47.159441+0000","last_clean":"2024-05-15T18:11:47.159441+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:11:47.159441+0000","last_undegraded":"2024-05-15T18:11:47.159441+0000","last_fullsized":"2024-05-15T18:11:47.159441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.025486+0000","last_change":"2024-05-15T18:08:37.183470+0000","last_active":"2024-05-15T18:11:47.025486+0000","last_peered":"2024-05-15T18:11:47.025486+0000","last_clean":"2024-05-15T18:11:47.025486+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:11:47.025486+0000","last_undegraded":"2024-05-15T18:11:47.025486+0000","last_fullsized":"2024-05-15T18:11:47.025486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.091544+0000","last_change":"2024-05-15T18:12:17.091569+0000","last_active":"2024-05-15T18:12:17.091544+0000","last_peered":"2024-05-15T18:12:17.091544+0000","last_clean":"2024-05-15T18:12:17.091544+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:12:17.091544+0000","last_undegraded":"2024-05-15T18:12:17.091544+0000","last_fullsized":"2024-05-15T18:12:17.091544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.091439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:24:24.593459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.281617+0000","last_change":"2024-05-15T18:12:26.281653+0000","last_active":"2024-05-15T18:12:26.281617+0000","last_peered":"2024-05-15T18:12:26.281617+0000","last_clean":"2024-05-15T18:12:26.281617+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:12:26.281617+0000","last_undegraded":"2024-05-15T18:12:26.281617+0000","last_fullsized":"2024-05-15T18:12:26.281617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.281513+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:35.878307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":382,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.505720+0000","last_change":"2024-05-15T18:12:06.505746+0000","last_active":"2024-05-15T18:12:06.505720+0000","last_peered":"2024-05-15T18:12:06.505720+0000","last_clean":"2024-05-15T18:12:06.505720+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:12:06.505720+0000","last_undegraded":"2024-05-15T18:12:06.505720+0000","last_fullsized":"2024-05-15T18:12:06.505720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.505630+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:15:15.678261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396883+0000","last_change":"2024-05-15T18:08:47.219182+0000","last_active":"2024-05-15T18:11:08.396883+0000","last_peered":"2024-05-15T18:11:08.396883+0000","last_clean":"2024-05-15T18:11:08.396883+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:11:08.396883+0000","last_undegraded":"2024-05-15T18:11:08.396883+0000","last_fullsized":"2024-05-15T18:11:08.396883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.574715+0000","last_change":"2024-05-15T18:12:22.574766+0000","last_active":"2024-05-15T18:12:22.574715+0000","last_peered":"2024-05-15T18:12:22.574715+0000","last_clean":"2024-05-15T18:12:22.574715+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:12:22.574715+0000","last_undegraded":"2024-05-15T18:12:22.574715+0000","last_fullsized":"2024-05-15T18:12:22.574715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.574598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:34.319629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396467+0000","last_change":"2024-05-15T18:08:37.176826+0000","last_active":"2024-05-15T18:11:08.396467+0000","last_peered":"2024-05-15T18:11:08.396467+0000","last_clean":"2024-05-15T18:11:08.396467+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:11:08.396467+0000","last_undegraded":"2024-05-15T18:11:08.396467+0000","last_fullsized":"2024-05-15T18:11:08.396467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.101386+0000","last_change":"2024-05-15T18:12:13.101422+0000","last_active":"2024-05-15T18:12:13.101386+0000","last_peered":"2024-05-15T18:12:13.101386+0000","last_clean":"2024-05-15T18:12:13.101386+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:12:13.101386+0000","last_undegraded":"2024-05-15T18:12:13.101386+0000","last_fullsized":"2024-05-15T18:12:13.101386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.101295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:02:45.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.136885+0000","last_change":"2024-05-15T18:12:08.136923+0000","last_active":"2024-05-15T18:12:08.136885+0000","last_peered":"2024-05-15T18:12:08.136885+0000","last_clean":"2024-05-15T18:12:08.136885+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:12:08.136885+0000","last_undegraded":"2024-05-15T18:12:08.136885+0000","last_fullsized":"2024-05-15T18:12:08.136885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.136791+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:18.155270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.879979+0000","last_change":"2024-05-15T18:12:01.880039+0000","last_active":"2024-05-15T18:12:01.879979+0000","last_peered":"2024-05-15T18:12:01.879979+0000","last_clean":"2024-05-15T18:12:01.879979+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:12:01.879979+0000","last_undegraded":"2024-05-15T18:12:01.879979+0000","last_fullsized":"2024-05-15T18:12:01.879979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.879852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:30.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.059723+0000","last_change":"2024-05-15T18:12:14.059771+0000","last_active":"2024-05-15T18:12:14.059723+0000","last_peered":"2024-05-15T18:12:14.059723+0000","last_clean":"2024-05-15T18:12:14.059723+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:12:14.059723+0000","last_undegraded":"2024-05-15T18:12:14.059723+0000","last_fullsized":"2024-05-15T18:12:14.059723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.059612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:52.613050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.579844+0000","last_change":"2024-05-15T18:12:20.579871+0000","last_active":"2024-05-15T18:12:20.579844+0000","last_peered":"2024-05-15T18:12:20.579844+0000","last_clean":"2024-05-15T18:12:20.579844+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:12:20.579844+0000","last_undegraded":"2024-05-15T18:12:20.579844+0000","last_fullsized":"2024-05-15T18:12:20.579844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.579756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:19.140085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397102+0000","last_change":"2024-05-15T18:08:37.185723+0000","last_active":"2024-05-15T18:11:08.397102+0000","last_peered":"2024-05-15T18:11:08.397102+0000","last_clean":"2024-05-15T18:11:08.397102+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:11:08.397102+0000","last_undegraded":"2024-05-15T18:11:08.397102+0000","last_fullsized":"2024-05-15T18:11:08.397102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.532585+0000","last_change":"2024-05-15T18:12:13.532610+0000","last_active":"2024-05-15T18:12:13.532585+0000","last_peered":"2024-05-15T18:12:13.532585+0000","last_clean":"2024-05-15T18:12:13.532585+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:12:13.532585+0000","last_undegraded":"2024-05-15T18:12:13.532585+0000","last_fullsized":"2024-05-15T18:12:13.532585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.532473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:34.476933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.850349+0000","last_change":"2024-05-15T18:12:07.850386+0000","last_active":"2024-05-15T18:12:07.850349+0000","last_peered":"2024-05-15T18:12:07.850349+0000","last_clean":"2024-05-15T18:12:07.850349+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:12:07.850349+0000","last_undegraded":"2024-05-15T18:12:07.850349+0000","last_fullsized":"2024-05-15T18:12:07.850349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.850240+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:45.111188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.202135+0000","last_change":"2024-05-15T18:12:19.202194+0000","last_active":"2024-05-15T18:12:19.202135+0000","last_peered":"2024-05-15T18:12:19.202135+0000","last_clean":"2024-05-15T18:12:19.202135+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:12:19.202135+0000","last_undegraded":"2024-05-15T18:12:19.202135+0000","last_fullsized":"2024-05-15T18:12:19.202135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.202036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:01.433105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397860+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:11:13.397860+0000","last_peered":"2024-05-15T18:11:13.397860+0000","last_clean":"2024-05-15T18:11:13.397860+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:11:13.397860+0000","last_undegraded":"2024-05-15T18:11:13.397860+0000","last_fullsized":"2024-05-15T18:11:13.397860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:46.807434+0000","last_change":"2024-05-15T18:08:39.181861+0000","last_active":"2024-05-15T18:11:46.807434+0000","last_peered":"2024-05-15T18:11:46.807434+0000","last_clean":"2024-05-15T18:11:46.807434+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:11:46.807434+0000","last_undegraded":"2024-05-15T18:11:46.807434+0000","last_fullsized":"2024-05-15T18:11:46.807434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:39.387978+0000","last_change":"2024-05-15T18:08:37.180611+0000","last_active":"2024-05-15T18:10:39.387978+0000","last_peered":"2024-05-15T18:10:39.387978+0000","last_clean":"2024-05-15T18:10:39.387978+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:10:39.387978+0000","last_undegraded":"2024-05-15T18:10:39.387978+0000","last_fullsized":"2024-05-15T18:10:39.387978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.110609+0000","last_change":"2024-05-15T18:12:09.110633+0000","last_active":"2024-05-15T18:12:09.110609+0000","last_peered":"2024-05-15T18:12:09.110609+0000","last_clean":"2024-05-15T18:12:09.110609+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:12:09.110609+0000","last_undegraded":"2024-05-15T18:12:09.110609+0000","last_fullsized":"2024-05-15T18:12:09.110609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.110521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:26.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'31","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.230432+0000","last_change":"2024-05-15T18:12:24.230472+0000","last_active":"2024-05-15T18:12:24.230432+0000","last_peered":"2024-05-15T18:12:24.230432+0000","last_clean":"2024-05-15T18:12:24.230432+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:12:24.230432+0000","last_undegraded":"2024-05-15T18:12:24.230432+0000","last_fullsized":"2024-05-15T18:12:24.230432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.230338+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:28.672249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.200745+0000","last_change":"2024-05-15T18:12:20.200773+0000","last_active":"2024-05-15T18:12:20.200745+0000","last_peered":"2024-05-15T18:12:20.200745+0000","last_clean":"2024-05-15T18:12:20.200745+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:12:20.200745+0000","last_undegraded":"2024-05-15T18:12:20.200745+0000","last_fullsized":"2024-05-15T18:12:20.200745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.200646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:24.107584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397830+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:11:13.397830+0000","last_peered":"2024-05-15T18:11:13.397830+0000","last_clean":"2024-05-15T18:11:13.397830+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:11:13.397830+0000","last_undegraded":"2024-05-15T18:11:13.397830+0000","last_fullsized":"2024-05-15T18:11:13.397830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.561884+0000","last_change":"2024-05-15T18:12:24.561907+0000","last_active":"2024-05-15T18:12:24.561884+0000","last_peered":"2024-05-15T18:12:24.561884+0000","last_clean":"2024-05-15T18:12:24.561884+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:12:24.561884+0000","last_undegraded":"2024-05-15T18:12:24.561884+0000","last_fullsized":"2024-05-15T18:12:24.561884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.561798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:53.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:46.364028+0000","last_change":"2024-05-15T18:08:37.173604+0000","last_active":"2024-05-15T18:10:46.364028+0000","last_peered":"2024-05-15T18:10:46.364028+0000","last_clean":"2024-05-15T18:10:46.364028+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:10:46.364028+0000","last_undegraded":"2024-05-15T18:10:46.364028+0000","last_fullsized":"2024-05-15T18:10:46.364028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.076973+0000","last_change":"2024-05-15T18:12:11.076997+0000","last_active":"2024-05-15T18:12:11.076973+0000","last_peered":"2024-05-15T18:12:11.076973+0000","last_clean":"2024-05-15T18:12:11.076973+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:12:11.076973+0000","last_undegraded":"2024-05-15T18:12:11.076973+0000","last_fullsized":"2024-05-15T18:12:11.076973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.076888+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:44.712782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.195779+0000","last_change":"2024-05-15T18:12:17.195819+0000","last_active":"2024-05-15T18:12:17.195779+0000","last_peered":"2024-05-15T18:12:17.195779+0000","last_clean":"2024-05-15T18:12:17.195779+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:12:17.195779+0000","last_undegraded":"2024-05-15T18:12:17.195779+0000","last_fullsized":"2024-05-15T18:12:17.195779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.195689+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:06.470822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.030201+0000","last_change":"2024-05-15T18:12:18.030230+0000","last_active":"2024-05-15T18:12:18.030201+0000","last_peered":"2024-05-15T18:12:18.030201+0000","last_clean":"2024-05-15T18:12:18.030201+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:12:18.030201+0000","last_undegraded":"2024-05-15T18:12:18.030201+0000","last_fullsized":"2024-05-15T18:12:18.030201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.030108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:36.616836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397061+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:11:08.397061+0000","last_peered":"2024-05-15T18:11:08.397061+0000","last_clean":"2024-05-15T18:11:08.397061+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:11:08.397061+0000","last_undegraded":"2024-05-15T18:11:08.397061+0000","last_fullsized":"2024-05-15T18:11:08.397061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.985766+0000","last_change":"2024-05-15T18:12:22.985820+0000","last_active":"2024-05-15T18:12:22.985766+0000","last_peered":"2024-05-15T18:12:22.985766+0000","last_clean":"2024-05-15T18:12:22.985766+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:12:22.985766+0000","last_undegraded":"2024-05-15T18:12:22.985766+0000","last_fullsized":"2024-05-15T18:12:22.985766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.985658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:45.191068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'6","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721844+0000","last_change":"2024-05-15T18:08:37.175025+0000","last_active":"2024-05-15T18:11:53.721844+0000","last_peered":"2024-05-15T18:11:53.721844+0000","last_clean":"2024-05-15T18:11:53.721844+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:53.721844+0000","last_undegraded":"2024-05-15T18:11:53.721844+0000","last_fullsized":"2024-05-15T18:11:53.721844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.175170+0000","last_change":"2024-05-15T18:12:30.175229+0000","last_active":"2024-05-15T18:12:30.175170+0000","last_peered":"2024-05-15T18:12:30.175170+0000","last_clean":"2024-05-15T18:12:30.175170+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:12:30.175170+0000","last_undegraded":"2024-05-15T18:12:30.175170+0000","last_fullsized":"2024-05-15T18:12:30.175170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.175060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:58.317953+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.099660+0000","last_change":"2024-05-15T18:08:37.174455+0000","last_active":"2024-05-15T18:11:47.099660+0000","last_peered":"2024-05-15T18:11:47.099660+0000","last_clean":"2024-05-15T18:11:47.099660+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:11:47.099660+0000","last_undegraded":"2024-05-15T18:11:47.099660+0000","last_fullsized":"2024-05-15T18:11:47.099660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393924+0000","last_change":"2024-05-15T18:08:39.182083+0000","last_active":"2024-05-15T18:10:48.393924+0000","last_peered":"2024-05-15T18:10:48.393924+0000","last_clean":"2024-05-15T18:10:48.393924+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:10:48.393924+0000","last_undegraded":"2024-05-15T18:10:48.393924+0000","last_fullsized":"2024-05-15T18:10:48.393924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:43.393114+0000","last_change":"2024-05-15T18:08:37.180276+0000","last_active":"2024-05-15T18:10:43.393114+0000","last_peered":"2024-05-15T18:10:43.393114+0000","last_clean":"2024-05-15T18:10:43.393114+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:10:43.393114+0000","last_undegraded":"2024-05-15T18:10:43.393114+0000","last_fullsized":"2024-05-15T18:10:43.393114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.145477+0000","last_change":"2024-05-15T18:12:34.145506+0000","last_active":"2024-05-15T18:12:34.145477+0000","last_peered":"2024-05-15T18:12:34.145477+0000","last_clean":"2024-05-15T18:12:34.145477+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:12:34.145477+0000","last_undegraded":"2024-05-15T18:12:34.145477+0000","last_fullsized":"2024-05-15T18:12:34.145477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.145384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:22.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721570+0000","last_change":"2024-05-15T18:08:37.180039+0000","last_active":"2024-05-15T18:11:53.721570+0000","last_peered":"2024-05-15T18:11:53.721570+0000","last_clean":"2024-05-15T18:11:53.721570+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:11:53.721570+0000","last_undegraded":"2024-05-15T18:11:53.721570+0000","last_fullsized":"2024-05-15T18:11:53.721570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.138888+0000","last_change":"2024-05-15T18:12:32.138916+0000","last_active":"2024-05-15T18:12:32.138888+0000","last_peered":"2024-05-15T18:12:32.138888+0000","last_clean":"2024-05-15T18:12:32.138888+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:12:32.138888+0000","last_undegraded":"2024-05-15T18:12:32.138888+0000","last_fullsized":"2024-05-15T18:12:32.138888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.138787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:48.107090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.020243+0000","last_change":"2024-05-15T18:08:37.173194+0000","last_active":"2024-05-15T18:11:47.020243+0000","last_peered":"2024-05-15T18:11:47.020243+0000","last_clean":"2024-05-15T18:11:47.020243+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:11:47.020243+0000","last_undegraded":"2024-05-15T18:11:47.020243+0000","last_fullsized":"2024-05-15T18:11:47.020243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.970749+0000","last_change":"2024-05-15T18:12:23.970784+0000","last_active":"2024-05-15T18:12:23.970749+0000","last_peered":"2024-05-15T18:12:23.970749+0000","last_clean":"2024-05-15T18:12:23.970749+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:12:23.970749+0000","last_undegraded":"2024-05-15T18:12:23.970749+0000","last_fullsized":"2024-05-15T18:12:23.970749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.970665+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:28:19.811968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.720904+0000","last_change":"2024-05-15T18:08:37.177086+0000","last_active":"2024-05-15T18:11:53.720904+0000","last_peered":"2024-05-15T18:11:53.720904+0000","last_clean":"2024-05-15T18:11:53.720904+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:11:53.720904+0000","last_undegraded":"2024-05-15T18:11:53.720904+0000","last_fullsized":"2024-05-15T18:11:53.720904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'8","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.121061+0000","last_change":"2024-05-15T18:12:25.121090+0000","last_active":"2024-05-15T18:12:25.121061+0000","last_peered":"2024-05-15T18:12:25.121061+0000","last_clean":"2024-05-15T18:12:25.121061+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:12:25.121061+0000","last_undegraded":"2024-05-15T18:12:25.121061+0000","last_fullsized":"2024-05-15T18:12:25.121061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.120969+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:19.624066+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.561005+0000","last_change":"2024-05-15T18:12:25.561063+0000","last_active":"2024-05-15T18:12:25.561005+0000","last_peered":"2024-05-15T18:12:25.561005+0000","last_clean":"2024-05-15T18:12:25.561005+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:12:25.561005+0000","last_undegraded":"2024-05-15T18:12:25.561005+0000","last_fullsized":"2024-05-15T18:12:25.561005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.560894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:37.100840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.044626+0000","last_change":"2024-05-15T18:12:30.044657+0000","last_active":"2024-05-15T18:12:30.044626+0000","last_peered":"2024-05-15T18:12:30.044626+0000","last_clean":"2024-05-15T18:12:30.044626+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:12:30.044626+0000","last_undegraded":"2024-05-15T18:12:30.044626+0000","last_fullsized":"2024-05-15T18:12:30.044626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.044530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:37.330279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:49.389595+0000","last_change":"2024-05-15T18:08:37.173289+0000","last_active":"2024-05-15T18:10:49.389595+0000","last_peered":"2024-05-15T18:10:49.389595+0000","last_clean":"2024-05-15T18:10:49.389595+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:10:49.389595+0000","last_undegraded":"2024-05-15T18:10:49.389595+0000","last_fullsized":"2024-05-15T18:10:49.389595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.036819+0000","last_change":"2024-05-15T18:08:39.185677+0000","last_active":"2024-05-15T18:11:47.036819+0000","last_peered":"2024-05-15T18:11:47.036819+0000","last_clean":"2024-05-15T18:11:47.036819+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:11:47.036819+0000","last_undegraded":"2024-05-15T18:11:47.036819+0000","last_fullsized":"2024-05-15T18:11:47.036819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721657+0000","last_change":"2024-05-15T18:08:37.174784+0000","last_active":"2024-05-15T18:11:53.721657+0000","last_peered":"2024-05-15T18:11:53.721657+0000","last_clean":"2024-05-15T18:11:53.721657+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:11:53.721657+0000","last_undegraded":"2024-05-15T18:11:53.721657+0000","last_fullsized":"2024-05-15T18:11:53.721657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395611+0000","last_change":"2024-05-15T18:08:39.184051+0000","last_active":"2024-05-15T18:10:58.395611+0000","last_peered":"2024-05-15T18:10:58.395611+0000","last_clean":"2024-05-15T18:10:58.395611+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:10:58.395611+0000","last_undegraded":"2024-05-15T18:10:58.395611+0000","last_fullsized":"2024-05-15T18:10:58.395611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:54.390217+0000","last_change":"2024-05-15T18:08:37.179943+0000","last_active":"2024-05-15T18:10:54.390217+0000","last_peered":"2024-05-15T18:10:54.390217+0000","last_clean":"2024-05-15T18:10:54.390217+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:10:54.390217+0000","last_undegraded":"2024-05-15T18:10:54.390217+0000","last_fullsized":"2024-05-15T18:10:54.390217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081145+0000","last_change":"2024-05-15T18:09:19.409291+0000","last_active":"2024-05-15T18:11:47.081145+0000","last_peered":"2024-05-15T18:11:47.081145+0000","last_clean":"2024-05-15T18:11:47.081145+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:11:47.081145+0000","last_undegraded":"2024-05-15T18:11:47.081145+0000","last_fullsized":"2024-05-15T18:11:47.081145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.393994+0000","last_change":"2024-05-15T18:08:37.180111+0000","last_active":"2024-05-15T18:10:53.393994+0000","last_peered":"2024-05-15T18:10:53.393994+0000","last_clean":"2024-05-15T18:10:53.393994+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:10:53.393994+0000","last_undegraded":"2024-05-15T18:10:53.393994+0000","last_fullsized":"2024-05-15T18:10:53.393994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.041100+0000","last_change":"2024-05-15T18:12:31.041130+0000","last_active":"2024-05-15T18:12:31.041100+0000","last_peered":"2024-05-15T18:12:31.041100+0000","last_clean":"2024-05-15T18:12:31.041100+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:12:31.041100+0000","last_undegraded":"2024-05-15T18:12:31.041100+0000","last_fullsized":"2024-05-15T18:12:31.041100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.041007+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:07.255869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394051+0000","last_change":"2024-05-15T18:08:37.178460+0000","last_active":"2024-05-15T18:10:53.394051+0000","last_peered":"2024-05-15T18:10:53.394051+0000","last_clean":"2024-05-15T18:10:53.394051+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:10:53.394051+0000","last_undegraded":"2024-05-15T18:10:53.394051+0000","last_fullsized":"2024-05-15T18:10:53.394051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.988310+0000","last_change":"2024-05-15T18:12:20.988373+0000","last_active":"2024-05-15T18:12:20.988310+0000","last_peered":"2024-05-15T18:12:20.988310+0000","last_clean":"2024-05-15T18:12:20.988310+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:12:20.988310+0000","last_undegraded":"2024-05-15T18:12:20.988310+0000","last_fullsized":"2024-05-15T18:12:20.988310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.988215+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:54.295065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394628+0000","last_change":"2024-05-15T18:08:37.183430+0000","last_active":"2024-05-15T18:10:53.394628+0000","last_peered":"2024-05-15T18:10:53.394628+0000","last_clean":"2024-05-15T18:10:53.394628+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:10:53.394628+0000","last_undegraded":"2024-05-15T18:10:53.394628+0000","last_fullsized":"2024-05-15T18:10:53.394628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394013+0000","last_change":"2024-05-15T18:08:39.187902+0000","last_active":"2024-05-15T18:10:53.394013+0000","last_peered":"2024-05-15T18:10:53.394013+0000","last_clean":"2024-05-15T18:10:53.394013+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:10:53.394013+0000","last_undegraded":"2024-05-15T18:10:53.394013+0000","last_fullsized":"2024-05-15T18:10:53.394013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394668+0000","last_change":"2024-05-15T18:08:37.181882+0000","last_active":"2024-05-15T18:10:53.394668+0000","last_peered":"2024-05-15T18:10:53.394668+0000","last_clean":"2024-05-15T18:10:53.394668+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:10:53.394668+0000","last_undegraded":"2024-05-15T18:10:53.394668+0000","last_fullsized":"2024-05-15T18:10:53.394668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.228063+0000","last_change":"2024-05-15T18:12:32.228088+0000","last_active":"2024-05-15T18:12:32.228063+0000","last_peered":"2024-05-15T18:12:32.228063+0000","last_clean":"2024-05-15T18:12:32.228063+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:12:32.228063+0000","last_undegraded":"2024-05-15T18:12:32.228063+0000","last_fullsized":"2024-05-15T18:12:32.228063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.227938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:25.136580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.546310+0000","last_change":"2024-05-15T18:12:27.546336+0000","last_active":"2024-05-15T18:12:27.546310+0000","last_peered":"2024-05-15T18:12:27.546310+0000","last_clean":"2024-05-15T18:12:27.546310+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:12:27.546310+0000","last_undegraded":"2024-05-15T18:12:27.546310+0000","last_fullsized":"2024-05-15T18:12:27.546310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.546217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:46.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.088263+0000","last_change":"2024-05-15T18:12:33.088288+0000","last_active":"2024-05-15T18:12:33.088263+0000","last_peered":"2024-05-15T18:12:33.088263+0000","last_clean":"2024-05-15T18:12:33.088263+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:12:33.088263+0000","last_undegraded":"2024-05-15T18:12:33.088263+0000","last_fullsized":"2024-05-15T18:12:33.088263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.088145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:24.946373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.014991+0000","last_change":"2024-05-15T18:09:19.409578+0000","last_active":"2024-05-15T18:11:47.014991+0000","last_peered":"2024-05-15T18:11:47.014991+0000","last_clean":"2024-05-15T18:11:47.014991+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:11:47.014991+0000","last_undegraded":"2024-05-15T18:11:47.014991+0000","last_fullsized":"2024-05-15T18:11:47.014991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395301+0000","last_change":"2024-05-15T18:08:37.182059+0000","last_active":"2024-05-15T18:10:58.395301+0000","last_peered":"2024-05-15T18:10:58.395301+0000","last_clean":"2024-05-15T18:10:58.395301+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:10:58.395301+0000","last_undegraded":"2024-05-15T18:10:58.395301+0000","last_fullsized":"2024-05-15T18:10:58.395301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.124776+0000","last_change":"2024-05-15T18:12:24.124812+0000","last_active":"2024-05-15T18:12:24.124776+0000","last_peered":"2024-05-15T18:12:24.124776+0000","last_clean":"2024-05-15T18:12:24.124776+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:12:24.124776+0000","last_undegraded":"2024-05-15T18:12:24.124776+0000","last_fullsized":"2024-05-15T18:12:24.124776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.124681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:45.800550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:59.391082+0000","last_change":"2024-05-15T18:08:37.180082+0000","last_active":"2024-05-15T18:10:59.391082+0000","last_peered":"2024-05-15T18:10:59.391082+0000","last_clean":"2024-05-15T18:10:59.391082+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:10:59.391082+0000","last_undegraded":"2024-05-15T18:10:59.391082+0000","last_fullsized":"2024-05-15T18:10:59.391082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.047409+0000","last_change":"2024-05-15T18:12:27.047454+0000","last_active":"2024-05-15T18:12:27.047409+0000","last_peered":"2024-05-15T18:12:27.047409+0000","last_clean":"2024-05-15T18:12:27.047409+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:12:27.047409+0000","last_undegraded":"2024-05-15T18:12:27.047409+0000","last_fullsized":"2024-05-15T18:12:27.047409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.047320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:59:33.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673016,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":132984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705719,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39932,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331908,"statfs":{"total":96636764160,"available":96595873792,"internally_reserved":0,"allocated":446464,"data_stored":133185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705718,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":720289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705718,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:12:39.219 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.219 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.219 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.219 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.220 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.221 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.222 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.222 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.222 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.222 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.222 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.222 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.222 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.223 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.224 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.224 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.224 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.224 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.224 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.224 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.224 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.225 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.225 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-15T18:08:25.125447+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=25, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.225 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.225 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.225 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.225 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.225 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.226 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-15T18:08:44.182576+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=44, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.227 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.228 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.229 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.230 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.230 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.230 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.230 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.230 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.230 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.231 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.231 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.231 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.231 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.231 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.231 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.231 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.232 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.233 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.234 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.234 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.234 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.234 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:39.234 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T18:12:59.235 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.374+0000 7f44e524c640 1 Processor -- start 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.374+0000 7f44e524c640 1 -- start start 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.374+0000 7f44e524c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f44e012c5b0 0x7f44e012c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44e524c640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e0113dd0 con 0x7f44e012ced0 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44e524c640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f44e0072290 con 0x7f44e012c5b0 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44ded9d640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f44e012c5b0 0x7f44e012c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44de59c640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f44e012ced0 0x7f44e006e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:42562/0 (socket says 172.21.15.3:42562) 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44de59c640 1 -- 172.21.15.3:0/1646484484 learned_addr learned my addr 172.21.15.3:0/1646484484 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44ded9d640 1 --2- 172.21.15.3:0/1646484484 >> v2:172.21.15.3:3300/0 conn(0x7f44e012c5b0 0x7f44e012c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51222/0 (socket says 172.21.15.3:51222) 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44ded9d640 1 -- 172.21.15.3:0/1646484484 >> v1:172.21.15.3:6789/0 conn(0x7f44e012ced0 legacy=0x7f44e006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.375+0000 7f44ded9d640 1 -- 172.21.15.3:0/1646484484 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e012c390 con 0x7f44e012c5b0 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.376+0000 7f44ded9d640 1 --2- 172.21.15.3:0/1646484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e012c990 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009d90 tx=0x7f44d002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73933e42c16e072a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.376+0000 7f44ddd9b640 1 -- 172.21.15.3:0/1646484484 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44d0039070 con 0x7f44e012c5b0 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.376+0000 7f44ddd9b640 1 -- 172.21.15.3:0/1646484484 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d002cb10 con 0x7f44e012c5b0 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.376+0000 7f44ddd9b640 1 -- 172.21.15.3:0/1646484484 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44d002ce10 con 0x7f44e012c5b0 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.376+0000 7f44e524c640 1 -- 172.21.15.3:0/1646484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 msgr2=0x7f44e012c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.376+0000 7f44e524c640 1 --2- 172.21.15.3:0/1646484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e012c990 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009d90 tx=0x7f44d002beb0 comp rx=0 tx=0).stop 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.377+0000 7f44e524c640 1 -- 172.21.15.3:0/1646484484 shutdown_connections 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.377+0000 7f44e524c640 1 --2- 172.21.15.3:0/1646484484 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e012c990 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.377+0000 7f44e524c640 1 -- 172.21.15.3:0/1646484484 >> 172.21.15.3:0/1646484484 conn(0x7f44e0099380 msgr2=0x7f44e0099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.377+0000 7f44e524c640 1 -- 172.21.15.3:0/1646484484 shutdown_connections 2024-05-15T18:12:59.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.377+0000 7f44e524c640 1 -- 172.21.15.3:0/1646484484 wait complete. 2024-05-15T18:12:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.378+0000 7f44e524c640 1 Processor -- start 2024-05-15T18:12:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.378+0000 7f44e524c640 1 -- start start 2024-05-15T18:12:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.378+0000 7f44e524c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e01c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.378+0000 7f44e524c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0113b10 con 0x7f44e012c5b0 2024-05-15T18:12:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.378+0000 7f44ded9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e01c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:59.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.378+0000 7f44ded9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e01c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51226/0 (socket says 172.21.15.3:51226) 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.378+0000 7f44ded9d640 1 -- 172.21.15.3:0/2550729118 learned_addr learned my addr 172.21.15.3:0/2550729118 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.379+0000 7f44ded9d640 1 -- 172.21.15.3:0/2550729118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e0071cf0 con 0x7f44e012c5b0 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.379+0000 7f44ded9d640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e01c33d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009eb0 tx=0x7f44d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.379+0000 7f44c77fe640 1 -- 172.21.15.3:0/2550729118 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44d0044020 con 0x7f44e012c5b0 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.379+0000 7f44c77fe640 1 -- 172.21.15.3:0/2550729118 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d003a040 con 0x7f44e012c5b0 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.379+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e011c440 con 0x7f44e012c5b0 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.379+0000 7f44c77fe640 1 -- 172.21.15.3:0/2550729118 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44d0039070 con 0x7f44e012c5b0 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.379+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01c3910 con 0x7f44e012c5b0 2024-05-15T18:12:59.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.380+0000 7f44c77fe640 1 -- 172.21.15.3:0/2550729118 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f44d0047020 con 0x7f44e012c5b0 2024-05-15T18:12:59.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.380+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e0062e90 con 0x7f44e012c5b0 2024-05-15T18:12:59.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.380+0000 7f44c77fe640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f44cc038060 0x7f44cc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:12:59.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.380+0000 7f44c77fe640 1 -- 172.21.15.3:0/2550729118 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f44d006e6d0 con 0x7f44e012c5b0 2024-05-15T18:12:59.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.381+0000 7f44de59c640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f44cc038060 0x7f44cc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:12:59.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.381+0000 7f44de59c640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f44cc038060 0x7f44cc03a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f44d4000f60 tx=0x7f44d4007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:12:59.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.385+0000 7f44c77fe640 1 -- 172.21.15.3:0/2550729118 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f44d004e030 con 0x7f44e012c5b0 2024-05-15T18:12:59.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.566+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44e012b650 con 0x7f44cc038060 2024-05-15T18:12:59.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.582+0000 7f44c77fe640 1 -- 172.21.15.3:0/2550729118 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664222 (secure 0 0 0) 0x7f44e012b650 con 0x7f44cc038060 2024-05-15T18:12:59.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:12:59.575 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:12:59.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.586+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f44cc038060 msgr2=0x7f44cc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:59.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.586+0000 7f44e524c640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f44cc038060 0x7f44cc03a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f44d4000f60 tx=0x7f44d4007a80 comp rx=0 tx=0).stop 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.586+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 msgr2=0x7f44e01c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.586+0000 7f44e524c640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e01c33d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009eb0 tx=0x7f44d0004a40 comp rx=0 tx=0).stop 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.587+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 shutdown_connections 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.587+0000 7f44e524c640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f44cc038060 0x7f44cc03a520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.587+0000 7f44e524c640 1 --2- 172.21.15.3:0/2550729118 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e012c5b0 0x7f44e01c33d0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.587+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 >> 172.21.15.3:0/2550729118 conn(0x7f44e0099380 msgr2=0x7f44e009b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.587+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 shutdown_connections 2024-05-15T18:12:59.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:12:59.587+0000 7f44e524c640 1 -- 172.21.15.3:0/2550729118 wait complete. 2024-05-15T18:12:59.580 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-05-15T18:12:58.398182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4779,"ondisk_log_size":4779,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156600,"kb_used_data":2776,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330760,"statfs":{"total":386547056640,"available":386386698240,"internally_reserved":0,"allocated":2842624,"data_stored":1707986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":157476626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004318"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.568060+0000","last_change":"2024-05-15T18:12:23.568060+0000","last_active":"2024-05-15T18:12:23.568060+0000","last_peered":"2024-05-15T18:12:23.568060+0000","last_clean":"2024-05-15T18:12:23.568060+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:12:23.568060+0000","last_undegraded":"2024-05-15T18:12:23.568060+0000","last_fullsized":"2024-05-15T18:12:23.568060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.567934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:17.103555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.013697+0000","last_change":"2024-05-15T18:12:28.013727+0000","last_active":"2024-05-15T18:12:28.013697+0000","last_peered":"2024-05-15T18:12:28.013697+0000","last_clean":"2024-05-15T18:12:28.013697+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:12:28.013697+0000","last_undegraded":"2024-05-15T18:12:28.013697+0000","last_fullsized":"2024-05-15T18:12:28.013697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.013596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:49.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.121845+0000","last_change":"2024-05-15T18:12:33.121845+0000","last_active":"2024-05-15T18:12:33.121845+0000","last_peered":"2024-05-15T18:12:33.121845+0000","last_clean":"2024-05-15T18:12:33.121845+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:12:33.121845+0000","last_undegraded":"2024-05-15T18:12:33.121845+0000","last_fullsized":"2024-05-15T18:12:33.121845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.121644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:10.755036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.218618+0000","last_change":"2024-05-15T18:12:39.218647+0000","last_active":"2024-05-15T18:12:39.218618+0000","last_peered":"2024-05-15T18:12:39.218618+0000","last_clean":"2024-05-15T18:12:39.218618+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:12:39.218618+0000","last_undegraded":"2024-05-15T18:12:39.218618+0000","last_fullsized":"2024-05-15T18:12:39.218618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:39.218516+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:39.218516+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.218516+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:50:36.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.140484+0000","last_change":"2024-05-15T18:12:50.140541+0000","last_active":"2024-05-15T18:12:50.140484+0000","last_peered":"2024-05-15T18:12:50.140484+0000","last_clean":"2024-05-15T18:12:50.140484+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:12:50.140484+0000","last_undegraded":"2024-05-15T18:12:50.140484+0000","last_fullsized":"2024-05-15T18:12:50.140484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-15T18:12:50.140371+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-15T18:12:50.140371+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.140371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:42.852685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.178894+0000","last_change":"2024-05-15T18:12:36.178923+0000","last_active":"2024-05-15T18:12:36.178894+0000","last_peered":"2024-05-15T18:12:36.178894+0000","last_clean":"2024-05-15T18:12:36.178894+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:12:36.178894+0000","last_undegraded":"2024-05-15T18:12:36.178894+0000","last_fullsized":"2024-05-15T18:12:36.178894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:36.178803+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:36.178803+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.178803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:50.531119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.552979+0000","last_change":"2024-05-15T18:12:40.553006+0000","last_active":"2024-05-15T18:12:40.552979+0000","last_peered":"2024-05-15T18:12:40.552979+0000","last_clean":"2024-05-15T18:12:40.552979+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:12:40.552979+0000","last_undegraded":"2024-05-15T18:12:40.552979+0000","last_fullsized":"2024-05-15T18:12:40.552979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:40.552895+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:40.552895+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.552895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:16.767758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'12","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.209841+0000","last_change":"2024-05-15T18:12:44.209878+0000","last_active":"2024-05-15T18:12:44.209841+0000","last_peered":"2024-05-15T18:12:44.209841+0000","last_clean":"2024-05-15T18:12:44.209841+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:12:44.209841+0000","last_undegraded":"2024-05-15T18:12:44.209841+0000","last_fullsized":"2024-05-15T18:12:44.209841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:44.209754+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:44.209754+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.209754+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:06.347702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397047+0000","last_change":"2024-05-15T18:08:37.179942+0000","last_active":"2024-05-15T18:11:08.397047+0000","last_peered":"2024-05-15T18:11:08.397047+0000","last_clean":"2024-05-15T18:11:08.397047+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:11:08.397047+0000","last_undegraded":"2024-05-15T18:11:08.397047+0000","last_fullsized":"2024-05-15T18:11:08.397047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.026703+0000","last_change":"2024-05-15T18:12:36.026703+0000","last_active":"2024-05-15T18:12:36.026703+0000","last_peered":"2024-05-15T18:12:36.026703+0000","last_clean":"2024-05-15T18:12:36.026703+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:12:36.026703+0000","last_undegraded":"2024-05-15T18:12:36.026703+0000","last_fullsized":"2024-05-15T18:12:36.026703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:36.026558+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:36.026558+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.026558+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:18:30.277678+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.525739+0000","last_change":"2024-05-15T18:12:33.525782+0000","last_active":"2024-05-15T18:12:33.525739+0000","last_peered":"2024-05-15T18:12:33.525739+0000","last_clean":"2024-05-15T18:12:33.525739+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:12:33.525739+0000","last_undegraded":"2024-05-15T18:12:33.525739+0000","last_fullsized":"2024-05-15T18:12:33.525739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.525633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.525633+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.525633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:55.201502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.204112+0000","last_change":"2024-05-15T18:12:31.204112+0000","last_active":"2024-05-15T18:12:31.204112+0000","last_peered":"2024-05-15T18:12:31.204112+0000","last_clean":"2024-05-15T18:12:31.204112+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:12:31.204112+0000","last_undegraded":"2024-05-15T18:12:31.204112+0000","last_fullsized":"2024-05-15T18:12:31.204112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.203970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:59.549282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396959+0000","last_change":"2024-05-15T18:08:37.177010+0000","last_active":"2024-05-15T18:11:08.396959+0000","last_peered":"2024-05-15T18:11:08.396959+0000","last_clean":"2024-05-15T18:11:08.396959+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:11:08.396959+0000","last_undegraded":"2024-05-15T18:11:08.396959+0000","last_fullsized":"2024-05-15T18:11:08.396959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'6","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.549269+0000","last_change":"2024-05-15T18:12:19.549269+0000","last_active":"2024-05-15T18:12:19.549269+0000","last_peered":"2024-05-15T18:12:19.549269+0000","last_clean":"2024-05-15T18:12:19.549269+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:12:19.549269+0000","last_undegraded":"2024-05-15T18:12:19.549269+0000","last_fullsized":"2024-05-15T18:12:19.549269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.549105+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:39.405237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.174271+0000","last_change":"2024-05-15T18:12:31.174295+0000","last_active":"2024-05-15T18:12:31.174271+0000","last_peered":"2024-05-15T18:12:31.174271+0000","last_clean":"2024-05-15T18:12:31.174271+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:12:31.174271+0000","last_undegraded":"2024-05-15T18:12:31.174271+0000","last_fullsized":"2024-05-15T18:12:31.174271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.174181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:20.484887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.576366+0000","last_change":"2024-05-15T18:12:28.576366+0000","last_active":"2024-05-15T18:12:28.576366+0000","last_peered":"2024-05-15T18:12:28.576366+0000","last_clean":"2024-05-15T18:12:28.576366+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:12:28.576366+0000","last_undegraded":"2024-05-15T18:12:28.576366+0000","last_fullsized":"2024-05-15T18:12:28.576366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.576233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:31.123756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.185694+0000","last_change":"2024-05-15T18:12:34.185742+0000","last_active":"2024-05-15T18:12:34.185694+0000","last_peered":"2024-05-15T18:12:34.185694+0000","last_clean":"2024-05-15T18:12:34.185694+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:12:34.185694+0000","last_undegraded":"2024-05-15T18:12:34.185694+0000","last_fullsized":"2024-05-15T18:12:34.185694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:34.185583+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:34.185583+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.185583+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:37:51.790032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.969352+0000","last_change":"2024-05-15T18:12:40.969411+0000","last_active":"2024-05-15T18:12:40.969352+0000","last_peered":"2024-05-15T18:12:40.969352+0000","last_clean":"2024-05-15T18:12:40.969352+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:12:40.969352+0000","last_undegraded":"2024-05-15T18:12:40.969352+0000","last_fullsized":"2024-05-15T18:12:40.969352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:40.969246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:40.969246+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.969246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:45.627408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.089743+0000","last_change":"2024-05-15T18:12:32.089786+0000","last_active":"2024-05-15T18:12:32.089743+0000","last_peered":"2024-05-15T18:12:32.089743+0000","last_clean":"2024-05-15T18:12:32.089743+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:12:32.089743+0000","last_undegraded":"2024-05-15T18:12:32.089743+0000","last_fullsized":"2024-05-15T18:12:32.089743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.089658+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:06.944435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.585777+0000","last_change":"2024-05-15T18:12:29.585802+0000","last_active":"2024-05-15T18:12:29.585777+0000","last_peered":"2024-05-15T18:12:29.585777+0000","last_clean":"2024-05-15T18:12:29.585777+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:12:29.585777+0000","last_undegraded":"2024-05-15T18:12:29.585777+0000","last_fullsized":"2024-05-15T18:12:29.585777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.585687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:42.151668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.950384+0000","last_change":"2024-05-15T18:12:39.950416+0000","last_active":"2024-05-15T18:12:39.950384+0000","last_peered":"2024-05-15T18:12:39.950384+0000","last_clean":"2024-05-15T18:12:39.950384+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:12:39.950384+0000","last_undegraded":"2024-05-15T18:12:39.950384+0000","last_fullsized":"2024-05-15T18:12:39.950384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:39.950291+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:39.950291+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.950291+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:02.589085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.947787+0000","last_change":"2024-05-15T18:12:48.947819+0000","last_active":"2024-05-15T18:12:48.947787+0000","last_peered":"2024-05-15T18:12:48.947787+0000","last_clean":"2024-05-15T18:12:48.947787+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:12:48.947787+0000","last_undegraded":"2024-05-15T18:12:48.947787+0000","last_fullsized":"2024-05-15T18:12:48.947787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.947695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.947695+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.947695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:17.293007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.081466+0000","last_change":"2024-05-15T18:12:36.081492+0000","last_active":"2024-05-15T18:12:36.081466+0000","last_peered":"2024-05-15T18:12:36.081466+0000","last_clean":"2024-05-15T18:12:36.081466+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:12:36.081466+0000","last_undegraded":"2024-05-15T18:12:36.081466+0000","last_fullsized":"2024-05-15T18:12:36.081466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:36.081367+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:36.081367+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.081367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:18.312435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.004712+0000","last_change":"2024-05-15T18:12:45.004735+0000","last_active":"2024-05-15T18:12:45.004712+0000","last_peered":"2024-05-15T18:12:45.004712+0000","last_clean":"2024-05-15T18:12:45.004712+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:12:45.004712+0000","last_undegraded":"2024-05-15T18:12:45.004712+0000","last_fullsized":"2024-05-15T18:12:45.004712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:45.004620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:45.004620+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.004620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:13.000330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.545131+0000","last_change":"2024-05-15T18:12:26.545156+0000","last_active":"2024-05-15T18:12:26.545131+0000","last_peered":"2024-05-15T18:12:26.545131+0000","last_clean":"2024-05-15T18:12:26.545131+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:12:26.545131+0000","last_undegraded":"2024-05-15T18:12:26.545131+0000","last_fullsized":"2024-05-15T18:12:26.545131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.545026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:35.527326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.101747+0000","last_change":"2024-05-15T18:12:41.101813+0000","last_active":"2024-05-15T18:12:41.101747+0000","last_peered":"2024-05-15T18:12:41.101747+0000","last_clean":"2024-05-15T18:12:41.101747+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:12:41.101747+0000","last_undegraded":"2024-05-15T18:12:41.101747+0000","last_fullsized":"2024-05-15T18:12:41.101747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:41.101640+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:41.101640+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.101640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:28:35.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.063183+0000","last_change":"2024-05-15T18:12:29.063209+0000","last_active":"2024-05-15T18:12:29.063183+0000","last_peered":"2024-05-15T18:12:29.063183+0000","last_clean":"2024-05-15T18:12:29.063183+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:12:29.063183+0000","last_undegraded":"2024-05-15T18:12:29.063183+0000","last_fullsized":"2024-05-15T18:12:29.063183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.063096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:21.253645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395433+0000","last_change":"2024-05-15T18:08:37.181235+0000","last_active":"2024-05-15T18:10:58.395433+0000","last_peered":"2024-05-15T18:10:58.395433+0000","last_clean":"2024-05-15T18:10:58.395433+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:10:58.395433+0000","last_undegraded":"2024-05-15T18:10:58.395433+0000","last_fullsized":"2024-05-15T18:10:58.395433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'35","reported_seq":100,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.123110+0000","last_change":"2024-05-15T18:08:47.223064+0000","last_active":"2024-05-15T18:11:47.123110+0000","last_peered":"2024-05-15T18:11:47.123110+0000","last_clean":"2024-05-15T18:11:47.123110+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:11:47.123110+0000","last_undegraded":"2024-05-15T18:11:47.123110+0000","last_fullsized":"2024-05-15T18:11:47.123110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.585841+0000","last_change":"2024-05-15T18:12:49.585867+0000","last_active":"2024-05-15T18:12:49.585841+0000","last_peered":"2024-05-15T18:12:49.585841+0000","last_clean":"2024-05-15T18:12:49.585841+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:12:49.585841+0000","last_undegraded":"2024-05-15T18:12:49.585841+0000","last_fullsized":"2024-05-15T18:12:49.585841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:49.585746+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:49.585746+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.585746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:54.027658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395481+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:10:58.395481+0000","last_peered":"2024-05-15T18:10:58.395481+0000","last_clean":"2024-05-15T18:10:58.395481+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:10:58.395481+0000","last_undegraded":"2024-05-15T18:10:58.395481+0000","last_fullsized":"2024-05-15T18:10:58.395481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'5","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.471375+0000","last_change":"2024-05-15T18:12:00.471407+0000","last_active":"2024-05-15T18:12:00.471375+0000","last_peered":"2024-05-15T18:12:00.471375+0000","last_clean":"2024-05-15T18:12:00.471375+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:12:00.471375+0000","last_undegraded":"2024-05-15T18:12:00.471375+0000","last_fullsized":"2024-05-15T18:12:00.471375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.471292+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:32.955699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.208450+0000","last_change":"2024-05-15T18:12:22.208523+0000","last_active":"2024-05-15T18:12:22.208450+0000","last_peered":"2024-05-15T18:12:22.208450+0000","last_clean":"2024-05-15T18:12:22.208450+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:12:22.208450+0000","last_undegraded":"2024-05-15T18:12:22.208450+0000","last_fullsized":"2024-05-15T18:12:22.208450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.208343+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:44.847137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.165954+0000","last_change":"2024-05-15T18:12:06.165990+0000","last_active":"2024-05-15T18:12:06.165954+0000","last_peered":"2024-05-15T18:12:06.165954+0000","last_clean":"2024-05-15T18:12:06.165954+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:12:06.165954+0000","last_undegraded":"2024-05-15T18:12:06.165954+0000","last_fullsized":"2024-05-15T18:12:06.165954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.165871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:13.434904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.082436+0000","last_change":"2024-05-15T18:08:47.223088+0000","last_active":"2024-05-15T18:11:47.082436+0000","last_peered":"2024-05-15T18:11:47.082436+0000","last_clean":"2024-05-15T18:11:47.082436+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:11:47.082436+0000","last_undegraded":"2024-05-15T18:11:47.082436+0000","last_fullsized":"2024-05-15T18:11:47.082436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.200972+0000","last_change":"2024-05-15T18:12:40.201023+0000","last_active":"2024-05-15T18:12:40.200972+0000","last_peered":"2024-05-15T18:12:40.200972+0000","last_clean":"2024-05-15T18:12:40.200972+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:12:40.200972+0000","last_undegraded":"2024-05-15T18:12:40.200972+0000","last_fullsized":"2024-05-15T18:12:40.200972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:40.200860+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:40.200860+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.200860+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:21:23.692098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.616194+0000","last_change":"2024-05-15T18:12:43.616233+0000","last_active":"2024-05-15T18:12:43.616194+0000","last_peered":"2024-05-15T18:12:43.616194+0000","last_clean":"2024-05-15T18:12:43.616194+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:12:43.616194+0000","last_undegraded":"2024-05-15T18:12:43.616194+0000","last_fullsized":"2024-05-15T18:12:43.616194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:43.616071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:43.616071+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.616071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:24.027421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.076827+0000","last_change":"2024-05-15T18:12:21.076858+0000","last_active":"2024-05-15T18:12:21.076827+0000","last_peered":"2024-05-15T18:12:21.076827+0000","last_clean":"2024-05-15T18:12:21.076827+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:12:21.076827+0000","last_undegraded":"2024-05-15T18:12:21.076827+0000","last_fullsized":"2024-05-15T18:12:21.076827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.076736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:12.212953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.191773+0000","last_change":"2024-05-15T18:12:04.191810+0000","last_active":"2024-05-15T18:12:04.191773+0000","last_peered":"2024-05-15T18:12:04.191773+0000","last_clean":"2024-05-15T18:12:04.191773+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:12:04.191773+0000","last_undegraded":"2024-05-15T18:12:04.191773+0000","last_fullsized":"2024-05-15T18:12:04.191773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.191688+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:12.868591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.280655+0000","last_change":"2024-05-15T18:11:59.280691+0000","last_active":"2024-05-15T18:11:59.280655+0000","last_peered":"2024-05-15T18:11:59.280655+0000","last_clean":"2024-05-15T18:11:59.280655+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:11:59.280655+0000","last_undegraded":"2024-05-15T18:11:59.280655+0000","last_fullsized":"2024-05-15T18:11:59.280655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.280542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:02.064253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:19.394024+0000","last_change":"2024-05-15T18:08:47.215478+0000","last_active":"2024-05-15T18:11:19.394024+0000","last_peered":"2024-05-15T18:11:19.394024+0000","last_clean":"2024-05-15T18:11:19.394024+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:11:19.394024+0000","last_undegraded":"2024-05-15T18:11:19.394024+0000","last_fullsized":"2024-05-15T18:11:19.394024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.129734+0000","last_change":"2024-05-15T18:12:47.129758+0000","last_active":"2024-05-15T18:12:47.129734+0000","last_peered":"2024-05-15T18:12:47.129734+0000","last_clean":"2024-05-15T18:12:47.129734+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:12:47.129734+0000","last_undegraded":"2024-05-15T18:12:47.129734+0000","last_fullsized":"2024-05-15T18:12:47.129734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:47.129645+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:47.129645+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.129645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:46:33.776122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395383+0000","last_change":"2024-05-15T18:08:37.185177+0000","last_active":"2024-05-15T18:10:58.395383+0000","last_peered":"2024-05-15T18:10:58.395383+0000","last_clean":"2024-05-15T18:10:58.395383+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:10:58.395383+0000","last_undegraded":"2024-05-15T18:10:58.395383+0000","last_fullsized":"2024-05-15T18:10:58.395383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.564300+0000","last_change":"2024-05-15T18:12:50.564324+0000","last_active":"2024-05-15T18:12:50.564300+0000","last_peered":"2024-05-15T18:12:50.564300+0000","last_clean":"2024-05-15T18:12:50.564300+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:12:50.564300+0000","last_undegraded":"2024-05-15T18:12:50.564300+0000","last_fullsized":"2024-05-15T18:12:50.564300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.564204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.564204+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.564204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:35.485709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.538861+0000","last_change":"2024-05-15T18:12:05.538899+0000","last_active":"2024-05-15T18:12:05.538861+0000","last_peered":"2024-05-15T18:12:05.538861+0000","last_clean":"2024-05-15T18:12:05.538861+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:12:05.538861+0000","last_undegraded":"2024-05-15T18:12:05.538861+0000","last_fullsized":"2024-05-15T18:12:05.538861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.538773+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:15:58.392906+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'286","reported_seq":417,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.258996+0000","last_change":"2024-05-15T18:12:29.259026+0000","last_active":"2024-05-15T18:12:29.258996+0000","last_peered":"2024-05-15T18:12:29.258996+0000","last_clean":"2024-05-15T18:12:29.258996+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:12:29.258996+0000","last_undegraded":"2024-05-15T18:12:29.258996+0000","last_fullsized":"2024-05-15T18:12:29.258996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.258908+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:17:31.038888+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.567559+0000","last_change":"2024-05-15T18:12:47.567623+0000","last_active":"2024-05-15T18:12:47.567559+0000","last_peered":"2024-05-15T18:12:47.567559+0000","last_clean":"2024-05-15T18:12:47.567559+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:12:47.567559+0000","last_undegraded":"2024-05-15T18:12:47.567559+0000","last_fullsized":"2024-05-15T18:12:47.567559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:47.567440+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:47.567440+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.567440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:10.206233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'24","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.163243+0000","last_change":"2024-05-15T18:12:27.163303+0000","last_active":"2024-05-15T18:12:27.163243+0000","last_peered":"2024-05-15T18:12:27.163243+0000","last_clean":"2024-05-15T18:12:27.163243+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:12:27.163243+0000","last_undegraded":"2024-05-15T18:12:27.163243+0000","last_fullsized":"2024-05-15T18:12:27.163243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.163125+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:48.445585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.905237+0000","last_change":"2024-05-15T18:12:49.905262+0000","last_active":"2024-05-15T18:12:49.905237+0000","last_peered":"2024-05-15T18:12:49.905237+0000","last_clean":"2024-05-15T18:12:49.905237+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:12:49.905237+0000","last_undegraded":"2024-05-15T18:12:49.905237+0000","last_fullsized":"2024-05-15T18:12:49.905237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:49.905153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:49.905153+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.905153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:42.813795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.344739+0000","last_change":"2024-05-15T18:12:04.344763+0000","last_active":"2024-05-15T18:12:04.344739+0000","last_peered":"2024-05-15T18:12:04.344739+0000","last_clean":"2024-05-15T18:12:04.344739+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:12:04.344739+0000","last_undegraded":"2024-05-15T18:12:04.344739+0000","last_fullsized":"2024-05-15T18:12:04.344739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.344646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:55.480863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.490821+0000","last_change":"2024-05-15T18:12:03.490856+0000","last_active":"2024-05-15T18:12:03.490821+0000","last_peered":"2024-05-15T18:12:03.490821+0000","last_clean":"2024-05-15T18:12:03.490821+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:12:03.490821+0000","last_undegraded":"2024-05-15T18:12:03.490821+0000","last_fullsized":"2024-05-15T18:12:03.490821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.490731+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:32.129481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":447,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.892996+0000","last_change":"2024-05-15T18:11:59.893055+0000","last_active":"2024-05-15T18:11:59.892996+0000","last_peered":"2024-05-15T18:11:59.892996+0000","last_clean":"2024-05-15T18:11:59.892996+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:59.892996+0000","last_undegraded":"2024-05-15T18:11:59.892996+0000","last_fullsized":"2024-05-15T18:11:59.892996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.892887+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:38.810690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.323300+0000","last_change":"2024-05-15T18:12:10.323325+0000","last_active":"2024-05-15T18:12:10.323300+0000","last_peered":"2024-05-15T18:12:10.323300+0000","last_clean":"2024-05-15T18:12:10.323300+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:12:10.323300+0000","last_undegraded":"2024-05-15T18:12:10.323300+0000","last_fullsized":"2024-05-15T18:12:10.323300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.323182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:01.360177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.576569+0000","last_change":"2024-05-15T18:12:38.576610+0000","last_active":"2024-05-15T18:12:38.576569+0000","last_peered":"2024-05-15T18:12:38.576569+0000","last_clean":"2024-05-15T18:12:38.576569+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:12:38.576569+0000","last_undegraded":"2024-05-15T18:12:38.576569+0000","last_fullsized":"2024-05-15T18:12:38.576569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:38.576449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:38.576449+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.576449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:45.862198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.051678+0000","last_change":"2024-05-15T18:12:12.051699+0000","last_active":"2024-05-15T18:12:12.051678+0000","last_peered":"2024-05-15T18:12:12.051678+0000","last_clean":"2024-05-15T18:12:12.051678+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:12:12.051678+0000","last_undegraded":"2024-05-15T18:12:12.051678+0000","last_fullsized":"2024-05-15T18:12:12.051678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.051591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:28:19.702252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'52","reported_seq":112,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.558204+0000","last_change":"2024-05-15T18:12:11.558253+0000","last_active":"2024-05-15T18:12:11.558204+0000","last_peered":"2024-05-15T18:12:11.558204+0000","last_clean":"2024-05-15T18:12:11.558204+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:12:11.558204+0000","last_undegraded":"2024-05-15T18:12:11.558204+0000","last_fullsized":"2024-05-15T18:12:11.558204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.558113+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:52.322479+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.845687+0000","last_change":"2024-05-15T18:12:00.845711+0000","last_active":"2024-05-15T18:12:00.845687+0000","last_peered":"2024-05-15T18:12:00.845687+0000","last_clean":"2024-05-15T18:12:00.845687+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:12:00.845687+0000","last_undegraded":"2024-05-15T18:12:00.845687+0000","last_fullsized":"2024-05-15T18:12:00.845687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.845599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:10.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.545453+0000","last_change":"2024-05-15T18:12:48.545505+0000","last_active":"2024-05-15T18:12:48.545453+0000","last_peered":"2024-05-15T18:12:48.545453+0000","last_clean":"2024-05-15T18:12:48.545453+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:12:48.545453+0000","last_undegraded":"2024-05-15T18:12:48.545453+0000","last_fullsized":"2024-05-15T18:12:48.545453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:48.545324+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:48.545324+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.545324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:53.203487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.948033+0000","last_change":"2024-05-15T18:12:37.948068+0000","last_active":"2024-05-15T18:12:37.948033+0000","last_peered":"2024-05-15T18:12:37.948033+0000","last_clean":"2024-05-15T18:12:37.948033+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:12:37.948033+0000","last_undegraded":"2024-05-15T18:12:37.948033+0000","last_fullsized":"2024-05-15T18:12:37.948033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:37.947944+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:37.947944+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.947944+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:41.854882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.535746+0000","last_change":"2024-05-15T18:12:31.535769+0000","last_active":"2024-05-15T18:12:31.535746+0000","last_peered":"2024-05-15T18:12:31.535746+0000","last_clean":"2024-05-15T18:12:31.535746+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:12:31.535746+0000","last_undegraded":"2024-05-15T18:12:31.535746+0000","last_fullsized":"2024-05-15T18:12:31.535746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.535653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.741063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"31'2","reported_seq":230,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.011085+0000","last_change":"2024-05-15T18:12:15.011129+0000","last_active":"2024-05-15T18:12:15.011085+0000","last_peered":"2024-05-15T18:12:15.011085+0000","last_clean":"2024-05-15T18:12:15.011085+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:12:15.011085+0000","last_undegraded":"2024-05-15T18:12:15.011085+0000","last_fullsized":"2024-05-15T18:12:15.011085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.010984+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:44.102759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.305450+0000","last_change":"2024-05-15T18:12:27.305526+0000","last_active":"2024-05-15T18:12:27.305450+0000","last_peered":"2024-05-15T18:12:27.305450+0000","last_clean":"2024-05-15T18:12:27.305450+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:12:27.305450+0000","last_undegraded":"2024-05-15T18:12:27.305450+0000","last_fullsized":"2024-05-15T18:12:27.305450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.305346+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:08:55.301055+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.922884+0000","last_change":"2024-05-15T18:12:09.922907+0000","last_active":"2024-05-15T18:12:09.922884+0000","last_peered":"2024-05-15T18:12:09.922884+0000","last_clean":"2024-05-15T18:12:09.922884+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:12:09.922884+0000","last_undegraded":"2024-05-15T18:12:09.922884+0000","last_fullsized":"2024-05-15T18:12:09.922884+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.922780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:29.778911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.970185+0000","last_change":"2024-05-15T18:12:21.970242+0000","last_active":"2024-05-15T18:12:21.970185+0000","last_peered":"2024-05-15T18:12:21.970185+0000","last_clean":"2024-05-15T18:12:21.970185+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:12:21.970185+0000","last_undegraded":"2024-05-15T18:12:21.970185+0000","last_fullsized":"2024-05-15T18:12:21.970185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.970081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:32.198122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.533309+0000","last_change":"2024-05-15T18:12:34.533336+0000","last_active":"2024-05-15T18:12:34.533309+0000","last_peered":"2024-05-15T18:12:34.533309+0000","last_clean":"2024-05-15T18:12:34.533309+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:12:34.533309+0000","last_undegraded":"2024-05-15T18:12:34.533309+0000","last_fullsized":"2024-05-15T18:12:34.533309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:34.533218+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:34.533218+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.533218+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:29.036315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721089+0000","last_change":"2024-05-15T18:08:37.181644+0000","last_active":"2024-05-15T18:11:53.721089+0000","last_peered":"2024-05-15T18:11:53.721089+0000","last_clean":"2024-05-15T18:11:53.721089+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:11:53.721089+0000","last_undegraded":"2024-05-15T18:11:53.721089+0000","last_fullsized":"2024-05-15T18:11:53.721089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.068542+0000","last_change":"2024-05-15T18:12:19.068568+0000","last_active":"2024-05-15T18:12:19.068542+0000","last_peered":"2024-05-15T18:12:19.068542+0000","last_clean":"2024-05-15T18:12:19.068542+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:12:19.068542+0000","last_undegraded":"2024-05-15T18:12:19.068542+0000","last_fullsized":"2024-05-15T18:12:19.068542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.068452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:21.615975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'46","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.293128+0000","last_change":"2024-05-15T18:12:28.293167+0000","last_active":"2024-05-15T18:12:28.293128+0000","last_peered":"2024-05-15T18:12:28.293128+0000","last_clean":"2024-05-15T18:12:28.293128+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:12:28.293128+0000","last_undegraded":"2024-05-15T18:12:28.293128+0000","last_fullsized":"2024-05-15T18:12:28.293128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.293044+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:30.668147+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":409,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.833108+0000","last_change":"2024-05-15T18:12:05.833181+0000","last_active":"2024-05-15T18:12:05.833108+0000","last_peered":"2024-05-15T18:12:05.833108+0000","last_clean":"2024-05-15T18:12:05.833108+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:12:05.833108+0000","last_undegraded":"2024-05-15T18:12:05.833108+0000","last_fullsized":"2024-05-15T18:12:05.833108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.833005+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:50.024912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:59.391187+0000","last_change":"2024-05-15T18:08:47.218349+0000","last_active":"2024-05-15T18:10:59.391187+0000","last_peered":"2024-05-15T18:10:59.391187+0000","last_clean":"2024-05-15T18:10:59.391187+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:10:59.391187+0000","last_undegraded":"2024-05-15T18:10:59.391187+0000","last_fullsized":"2024-05-15T18:10:59.391187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.609693+0000","last_change":"2024-05-15T18:12:21.609722+0000","last_active":"2024-05-15T18:12:21.609693+0000","last_peered":"2024-05-15T18:12:21.609693+0000","last_clean":"2024-05-15T18:12:21.609693+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:12:21.609693+0000","last_undegraded":"2024-05-15T18:12:21.609693+0000","last_fullsized":"2024-05-15T18:12:21.609693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.609598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:32.043990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394615+0000","last_change":"2024-05-15T18:08:37.179976+0000","last_active":"2024-05-15T18:10:53.394615+0000","last_peered":"2024-05-15T18:10:53.394615+0000","last_clean":"2024-05-15T18:10:53.394615+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:10:53.394615+0000","last_undegraded":"2024-05-15T18:10:53.394615+0000","last_fullsized":"2024-05-15T18:10:53.394615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.982022+0000","last_change":"2024-05-15T18:12:15.982070+0000","last_active":"2024-05-15T18:12:15.982022+0000","last_peered":"2024-05-15T18:12:15.982022+0000","last_clean":"2024-05-15T18:12:15.982022+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:12:15.982022+0000","last_undegraded":"2024-05-15T18:12:15.982022+0000","last_fullsized":"2024-05-15T18:12:15.982022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.981892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:27.521839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.357135+0000","last_change":"2024-05-15T18:12:03.357175+0000","last_active":"2024-05-15T18:12:03.357135+0000","last_peered":"2024-05-15T18:12:03.357135+0000","last_clean":"2024-05-15T18:12:03.357135+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:12:03.357135+0000","last_undegraded":"2024-05-15T18:12:03.357135+0000","last_fullsized":"2024-05-15T18:12:03.357135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.357042+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:36.663893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.920891+0000","last_change":"2024-05-15T18:11:58.920914+0000","last_active":"2024-05-15T18:11:58.920891+0000","last_peered":"2024-05-15T18:11:58.920891+0000","last_clean":"2024-05-15T18:11:58.920891+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:11:58.920891+0000","last_undegraded":"2024-05-15T18:11:58.920891+0000","last_fullsized":"2024-05-15T18:11:58.920891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.920801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:00:11.891898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'18","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.208786+0000","last_change":"2024-05-15T18:08:47.219473+0000","last_active":"2024-05-15T18:11:47.208786+0000","last_peered":"2024-05-15T18:11:47.208786+0000","last_clean":"2024-05-15T18:11:47.208786+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:11:47.208786+0000","last_undegraded":"2024-05-15T18:11:47.208786+0000","last_fullsized":"2024-05-15T18:11:47.208786+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":89,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.855589+0000","last_change":"2024-05-15T18:12:51.855619+0000","last_active":"2024-05-15T18:12:51.855589+0000","last_peered":"2024-05-15T18:12:51.855589+0000","last_clean":"2024-05-15T18:12:51.855589+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:12:51.855589+0000","last_undegraded":"2024-05-15T18:12:51.855589+0000","last_fullsized":"2024-05-15T18:12:51.855589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:51.855472+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:51.855472+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.855472+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:45:43.569013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.201606+0000","last_change":"2024-05-15T18:12:29.201631+0000","last_active":"2024-05-15T18:12:29.201606+0000","last_peered":"2024-05-15T18:12:29.201606+0000","last_clean":"2024-05-15T18:12:29.201606+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:12:29.201606+0000","last_undegraded":"2024-05-15T18:12:29.201606+0000","last_fullsized":"2024-05-15T18:12:29.201606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.201511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:36.487260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.549280+0000","last_change":"2024-05-15T18:12:17.549324+0000","last_active":"2024-05-15T18:12:17.549280+0000","last_peered":"2024-05-15T18:12:17.549280+0000","last_clean":"2024-05-15T18:12:17.549280+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:12:17.549280+0000","last_undegraded":"2024-05-15T18:12:17.549280+0000","last_fullsized":"2024-05-15T18:12:17.549280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.549183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:54.810132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":95,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.153352+0000","last_change":"2024-05-15T18:12:05.153393+0000","last_active":"2024-05-15T18:12:05.153352+0000","last_peered":"2024-05-15T18:12:05.153352+0000","last_clean":"2024-05-15T18:12:05.153352+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:12:05.153352+0000","last_undegraded":"2024-05-15T18:12:05.153352+0000","last_fullsized":"2024-05-15T18:12:05.153352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.153268+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:23:48.552424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.235621+0000","last_change":"2024-05-15T18:12:25.235658+0000","last_active":"2024-05-15T18:12:25.235621+0000","last_peered":"2024-05-15T18:12:25.235621+0000","last_clean":"2024-05-15T18:12:25.235621+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:12:25.235621+0000","last_undegraded":"2024-05-15T18:12:25.235621+0000","last_fullsized":"2024-05-15T18:12:25.235621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.235510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:10.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.086894+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:11:58.086894+0000","last_peered":"2024-05-15T18:11:58.086894+0000","last_clean":"2024-05-15T18:11:58.086894+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:11:58.086894+0000","last_undegraded":"2024-05-15T18:11:58.086894+0000","last_fullsized":"2024-05-15T18:11:58.086894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.318634+0000","last_change":"2024-05-15T18:12:12.318664+0000","last_active":"2024-05-15T18:12:12.318634+0000","last_peered":"2024-05-15T18:12:12.318634+0000","last_clean":"2024-05-15T18:12:12.318634+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:12:12.318634+0000","last_undegraded":"2024-05-15T18:12:12.318634+0000","last_fullsized":"2024-05-15T18:12:12.318634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.318542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:02.692777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.150471+0000","last_change":"2024-05-15T18:12:52.150506+0000","last_active":"2024-05-15T18:12:52.150471+0000","last_peered":"2024-05-15T18:12:52.150471+0000","last_clean":"2024-05-15T18:12:52.150471+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:12:52.150471+0000","last_undegraded":"2024-05-15T18:12:52.150471+0000","last_fullsized":"2024-05-15T18:12:52.150471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:52.150383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:52.150383+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.150383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:43:18.858365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.119348+0000","last_change":"2024-05-15T18:12:23.119374+0000","last_active":"2024-05-15T18:12:23.119348+0000","last_peered":"2024-05-15T18:12:23.119348+0000","last_clean":"2024-05-15T18:12:23.119348+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:12:23.119348+0000","last_undegraded":"2024-05-15T18:12:23.119348+0000","last_fullsized":"2024-05-15T18:12:23.119348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.119253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:24.003247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.592664+0000","last_change":"2024-05-15T18:12:09.592703+0000","last_active":"2024-05-15T18:12:09.592664+0000","last_peered":"2024-05-15T18:12:09.592664+0000","last_clean":"2024-05-15T18:12:09.592664+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:12:09.592664+0000","last_undegraded":"2024-05-15T18:12:09.592664+0000","last_fullsized":"2024-05-15T18:12:09.592664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.592581+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:53:31.226178+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":415,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.470688+0000","last_change":"2024-05-15T18:12:00.470721+0000","last_active":"2024-05-15T18:12:00.470688+0000","last_peered":"2024-05-15T18:12:00.470688+0000","last_clean":"2024-05-15T18:12:00.470688+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:12:00.470688+0000","last_undegraded":"2024-05-15T18:12:00.470688+0000","last_fullsized":"2024-05-15T18:12:00.470688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.470590+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:35.192862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.974325+0000","last_change":"2024-05-15T18:12:52.974355+0000","last_active":"2024-05-15T18:12:52.974325+0000","last_peered":"2024-05-15T18:12:52.974325+0000","last_clean":"2024-05-15T18:12:52.974325+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:12:52.974325+0000","last_undegraded":"2024-05-15T18:12:52.974325+0000","last_fullsized":"2024-05-15T18:12:52.974325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-05-15T18:12:52.974233+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-05-15T18:12:52.974233+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.974233+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:07.326548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.656560+0000","last_change":"2024-05-15T18:12:44.656587+0000","last_active":"2024-05-15T18:12:44.656560+0000","last_peered":"2024-05-15T18:12:44.656560+0000","last_clean":"2024-05-15T18:12:44.656560+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:12:44.656560+0000","last_undegraded":"2024-05-15T18:12:44.656560+0000","last_fullsized":"2024-05-15T18:12:44.656560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:44.656449+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:44.656449+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.656449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:26.887517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.017392+0000","last_change":"2024-05-15T18:08:37.185221+0000","last_active":"2024-05-15T18:11:47.017392+0000","last_peered":"2024-05-15T18:11:47.017392+0000","last_clean":"2024-05-15T18:11:47.017392+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:11:47.017392+0000","last_undegraded":"2024-05-15T18:11:47.017392+0000","last_fullsized":"2024-05-15T18:11:47.017392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":428,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.095863+0000","last_change":"2024-05-15T18:12:16.095898+0000","last_active":"2024-05-15T18:12:16.095863+0000","last_peered":"2024-05-15T18:12:16.095863+0000","last_clean":"2024-05-15T18:12:16.095863+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:12:16.095863+0000","last_undegraded":"2024-05-15T18:12:16.095863+0000","last_fullsized":"2024-05-15T18:12:16.095863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.095781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:17.249315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.331808+0000","last_change":"2024-05-15T18:12:09.331845+0000","last_active":"2024-05-15T18:12:09.331808+0000","last_peered":"2024-05-15T18:12:09.331808+0000","last_clean":"2024-05-15T18:12:09.331808+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:12:09.331808+0000","last_undegraded":"2024-05-15T18:12:09.331808+0000","last_fullsized":"2024-05-15T18:12:09.331808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.331720+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:28.300746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":471,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.276017+0000","last_change":"2024-05-15T18:12:00.276044+0000","last_active":"2024-05-15T18:12:00.276017+0000","last_peered":"2024-05-15T18:12:00.276017+0000","last_clean":"2024-05-15T18:12:00.276017+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:12:00.276017+0000","last_undegraded":"2024-05-15T18:12:00.276017+0000","last_fullsized":"2024-05-15T18:12:00.276017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.275912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:39.193715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.629513+0000","last_change":"2024-05-15T18:12:45.629539+0000","last_active":"2024-05-15T18:12:45.629513+0000","last_peered":"2024-05-15T18:12:45.629513+0000","last_clean":"2024-05-15T18:12:45.629513+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:12:45.629513+0000","last_undegraded":"2024-05-15T18:12:45.629513+0000","last_fullsized":"2024-05-15T18:12:45.629513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:45.629416+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:45.629416+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.629416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:49.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.032486+0000","last_change":"2024-05-15T18:12:19.032552+0000","last_active":"2024-05-15T18:12:19.032486+0000","last_peered":"2024-05-15T18:12:19.032486+0000","last_clean":"2024-05-15T18:12:19.032486+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:12:19.032486+0000","last_undegraded":"2024-05-15T18:12:19.032486+0000","last_fullsized":"2024-05-15T18:12:19.032486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.032366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:37.619094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393728+0000","last_change":"2024-05-15T18:08:37.183998+0000","last_active":"2024-05-15T18:10:48.393728+0000","last_peered":"2024-05-15T18:10:48.393728+0000","last_clean":"2024-05-15T18:10:48.393728+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:10:48.393728+0000","last_undegraded":"2024-05-15T18:10:48.393728+0000","last_fullsized":"2024-05-15T18:10:48.393728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.354846+0000","last_change":"2024-05-15T18:12:08.354871+0000","last_active":"2024-05-15T18:12:08.354846+0000","last_peered":"2024-05-15T18:12:08.354846+0000","last_clean":"2024-05-15T18:12:08.354846+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:12:08.354846+0000","last_undegraded":"2024-05-15T18:12:08.354846+0000","last_fullsized":"2024-05-15T18:12:08.354846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.354757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:02.756370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":107,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.149819+0000","last_change":"2024-05-15T18:12:07.149858+0000","last_active":"2024-05-15T18:12:07.149819+0000","last_peered":"2024-05-15T18:12:07.149819+0000","last_clean":"2024-05-15T18:12:07.149819+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:12:07.149819+0000","last_undegraded":"2024-05-15T18:12:07.149819+0000","last_fullsized":"2024-05-15T18:12:07.149819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.149716+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:51.341623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.495674+0000","last_change":"2024-05-15T18:11:59.495696+0000","last_active":"2024-05-15T18:11:59.495674+0000","last_peered":"2024-05-15T18:11:59.495674+0000","last_clean":"2024-05-15T18:11:59.495674+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:11:59.495674+0000","last_undegraded":"2024-05-15T18:11:59.495674+0000","last_fullsized":"2024-05-15T18:11:59.495674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.495587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:27.408105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.086166+0000","last_change":"2024-05-15T18:12:10.086196+0000","last_active":"2024-05-15T18:12:10.086166+0000","last_peered":"2024-05-15T18:12:10.086166+0000","last_clean":"2024-05-15T18:12:10.086166+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:12:10.086166+0000","last_undegraded":"2024-05-15T18:12:10.086166+0000","last_fullsized":"2024-05-15T18:12:10.086166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.086069+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:14:22.063457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.274855+0000","last_change":"2024-05-15T18:12:15.274855+0000","last_active":"2024-05-15T18:12:15.274855+0000","last_peered":"2024-05-15T18:12:15.274855+0000","last_clean":"2024-05-15T18:12:15.274855+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:12:15.274855+0000","last_undegraded":"2024-05-15T18:12:15.274855+0000","last_fullsized":"2024-05-15T18:12:15.274855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.274744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:50.129521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.016283+0000","last_change":"2024-05-15T18:12:44.016319+0000","last_active":"2024-05-15T18:12:44.016283+0000","last_peered":"2024-05-15T18:12:44.016283+0000","last_clean":"2024-05-15T18:12:44.016283+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:12:44.016283+0000","last_undegraded":"2024-05-15T18:12:44.016283+0000","last_fullsized":"2024-05-15T18:12:44.016283+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-05-15T18:12:44.016193+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-05-15T18:12:44.016193+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.016193+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:53.612988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.085548+0000","last_change":"2024-05-15T18:08:31.150253+0000","last_active":"2024-05-15T18:11:58.085548+0000","last_peered":"2024-05-15T18:11:58.085548+0000","last_clean":"2024-05-15T18:11:58.085548+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:11:58.085548+0000","last_undegraded":"2024-05-15T18:11:58.085548+0000","last_fullsized":"2024-05-15T18:11:58.085548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.161399+0000","last_change":"2024-05-15T18:12:48.161399+0000","last_active":"2024-05-15T18:12:48.161399+0000","last_peered":"2024-05-15T18:12:48.161399+0000","last_clean":"2024-05-15T18:12:48.161399+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:12:48.161399+0000","last_undegraded":"2024-05-15T18:12:48.161399+0000","last_fullsized":"2024-05-15T18:12:48.161399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.161262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.161262+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.161262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:54:13.067615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.108833+0000","last_change":"2024-05-15T18:12:15.108833+0000","last_active":"2024-05-15T18:12:15.108833+0000","last_peered":"2024-05-15T18:12:15.108833+0000","last_clean":"2024-05-15T18:12:15.108833+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:12:15.108833+0000","last_undegraded":"2024-05-15T18:12:15.108833+0000","last_fullsized":"2024-05-15T18:12:15.108833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.108718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:50:47.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.302427+0000","last_change":"2024-05-15T18:12:13.302463+0000","last_active":"2024-05-15T18:12:13.302427+0000","last_peered":"2024-05-15T18:12:13.302427+0000","last_clean":"2024-05-15T18:12:13.302427+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:12:13.302427+0000","last_undegraded":"2024-05-15T18:12:13.302427+0000","last_fullsized":"2024-05-15T18:12:13.302427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.302331+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:17.032807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.959229+0000","last_change":"2024-05-15T18:12:13.959264+0000","last_active":"2024-05-15T18:12:13.959229+0000","last_peered":"2024-05-15T18:12:13.959229+0000","last_clean":"2024-05-15T18:12:13.959229+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:12:13.959229+0000","last_undegraded":"2024-05-15T18:12:13.959229+0000","last_fullsized":"2024-05-15T18:12:13.959229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.959124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:07.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":176,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.529852+0000","last_change":"2024-05-15T18:12:18.529885+0000","last_active":"2024-05-15T18:12:18.529852+0000","last_peered":"2024-05-15T18:12:18.529852+0000","last_clean":"2024-05-15T18:12:18.529852+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:12:18.529852+0000","last_undegraded":"2024-05-15T18:12:18.529852+0000","last_fullsized":"2024-05-15T18:12:18.529852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'85","last_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_deep_scrub":"31'85","last_deep_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.529758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:29.586821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.150064+0000","last_change":"2024-05-15T18:12:46.150090+0000","last_active":"2024-05-15T18:12:46.150064+0000","last_peered":"2024-05-15T18:12:46.150064+0000","last_clean":"2024-05-15T18:12:46.150064+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:12:46.150064+0000","last_undegraded":"2024-05-15T18:12:46.150064+0000","last_fullsized":"2024-05-15T18:12:46.150064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:46.149947+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.149947+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.149947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:44.752649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.085532+0000","last_change":"2024-05-15T18:08:31.152640+0000","last_active":"2024-05-15T18:11:58.085532+0000","last_peered":"2024-05-15T18:11:58.085532+0000","last_clean":"2024-05-15T18:11:58.085532+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:11:58.085532+0000","last_undegraded":"2024-05-15T18:11:58.085532+0000","last_fullsized":"2024-05-15T18:11:58.085532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.033076+0000","last_change":"2024-05-15T18:12:50.033123+0000","last_active":"2024-05-15T18:12:50.033076+0000","last_peered":"2024-05-15T18:12:50.033076+0000","last_clean":"2024-05-15T18:12:50.033076+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:12:50.033076+0000","last_undegraded":"2024-05-15T18:12:50.033076+0000","last_fullsized":"2024-05-15T18:12:50.033076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.032969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.032969+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.032969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:38.076744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.426538+0000","last_change":"2024-05-15T18:12:01.426564+0000","last_active":"2024-05-15T18:12:01.426538+0000","last_peered":"2024-05-15T18:12:01.426538+0000","last_clean":"2024-05-15T18:12:01.426538+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:12:01.426538+0000","last_undegraded":"2024-05-15T18:12:01.426538+0000","last_fullsized":"2024-05-15T18:12:01.426538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.426444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:20.013172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'293","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.240363+0000","last_change":"2024-05-15T18:12:03.240363+0000","last_active":"2024-05-15T18:12:03.240363+0000","last_peered":"2024-05-15T18:12:03.240363+0000","last_clean":"2024-05-15T18:12:03.240363+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:12:03.240363+0000","last_undegraded":"2024-05-15T18:12:03.240363+0000","last_fullsized":"2024-05-15T18:12:03.240363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'293","last_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_deep_scrub":"31'293","last_deep_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.240231+0000","objects_scrubbed":10,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:29:17.206611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.216712+0000","last_change":"2024-05-15T18:12:33.216735+0000","last_active":"2024-05-15T18:12:33.216712+0000","last_peered":"2024-05-15T18:12:33.216712+0000","last_clean":"2024-05-15T18:12:33.216712+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:12:33.216712+0000","last_undegraded":"2024-05-15T18:12:33.216712+0000","last_fullsized":"2024-05-15T18:12:33.216712+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.216625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:46.914136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.079397+0000","last_change":"2024-05-15T18:12:18.079442+0000","last_active":"2024-05-15T18:12:18.079397+0000","last_peered":"2024-05-15T18:12:18.079397+0000","last_clean":"2024-05-15T18:12:18.079397+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:12:18.079397+0000","last_undegraded":"2024-05-15T18:12:18.079397+0000","last_fullsized":"2024-05-15T18:12:18.079397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.079282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:50.563689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.972247+0000","last_change":"2024-05-15T18:12:51.972287+0000","last_active":"2024-05-15T18:12:51.972247+0000","last_peered":"2024-05-15T18:12:51.972247+0000","last_clean":"2024-05-15T18:12:51.972247+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:12:51.972247+0000","last_undegraded":"2024-05-15T18:12:51.972247+0000","last_fullsized":"2024-05-15T18:12:51.972247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:51.972153+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:51.972153+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.972153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:36.602233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.590983+0000","last_change":"2024-05-15T18:12:36.590983+0000","last_active":"2024-05-15T18:12:36.590983+0000","last_peered":"2024-05-15T18:12:36.590983+0000","last_clean":"2024-05-15T18:12:36.590983+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:12:36.590983+0000","last_undegraded":"2024-05-15T18:12:36.590983+0000","last_fullsized":"2024-05-15T18:12:36.590983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:36.590813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:36.590813+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.590813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:57.873273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.125701+0000","last_change":"2024-05-15T18:12:46.125729+0000","last_active":"2024-05-15T18:12:46.125701+0000","last_peered":"2024-05-15T18:12:46.125701+0000","last_clean":"2024-05-15T18:12:46.125701+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:12:46.125701+0000","last_undegraded":"2024-05-15T18:12:46.125701+0000","last_fullsized":"2024-05-15T18:12:46.125701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:46.125590+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.125590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.125590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:16:40.358922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.560699+0000","last_change":"2024-05-15T18:12:51.560727+0000","last_active":"2024-05-15T18:12:51.560699+0000","last_peered":"2024-05-15T18:12:51.560699+0000","last_clean":"2024-05-15T18:12:51.560699+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:12:51.560699+0000","last_undegraded":"2024-05-15T18:12:51.560699+0000","last_fullsized":"2024-05-15T18:12:51.560699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:51.560605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:51.560605+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.560605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:01.157400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.543438+0000","last_change":"2024-05-15T18:12:07.543438+0000","last_active":"2024-05-15T18:12:07.543438+0000","last_peered":"2024-05-15T18:12:07.543438+0000","last_clean":"2024-05-15T18:12:07.543438+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:12:07.543438+0000","last_undegraded":"2024-05-15T18:12:07.543438+0000","last_fullsized":"2024-05-15T18:12:07.543438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.543314+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:32.467749+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.928898+0000","last_change":"2024-05-15T18:11:57.928898+0000","last_active":"2024-05-15T18:11:57.928898+0000","last_peered":"2024-05-15T18:11:57.928898+0000","last_clean":"2024-05-15T18:11:57.928898+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:11:57.928898+0000","last_undegraded":"2024-05-15T18:11:57.928898+0000","last_fullsized":"2024-05-15T18:11:57.928898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.928793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.522391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.124590+0000","last_change":"2024-05-15T18:12:49.124614+0000","last_active":"2024-05-15T18:12:49.124590+0000","last_peered":"2024-05-15T18:12:49.124590+0000","last_clean":"2024-05-15T18:12:49.124590+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:12:49.124590+0000","last_undegraded":"2024-05-15T18:12:49.124590+0000","last_fullsized":"2024-05-15T18:12:49.124590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:49.124505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:49.124505+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.124505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:44:13.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.125516+0000","last_change":"2024-05-15T18:12:38.125516+0000","last_active":"2024-05-15T18:12:38.125516+0000","last_peered":"2024-05-15T18:12:38.125516+0000","last_clean":"2024-05-15T18:12:38.125516+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:12:38.125516+0000","last_undegraded":"2024-05-15T18:12:38.125516+0000","last_fullsized":"2024-05-15T18:12:38.125516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-05-15T18:12:38.125335+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-05-15T18:12:38.125335+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.125335+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:38.435114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.085557+0000","last_change":"2024-05-15T18:08:31.153574+0000","last_active":"2024-05-15T18:11:58.085557+0000","last_peered":"2024-05-15T18:11:58.085557+0000","last_clean":"2024-05-15T18:11:58.085557+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:11:58.085557+0000","last_undegraded":"2024-05-15T18:11:58.085557+0000","last_fullsized":"2024-05-15T18:11:58.085557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.545692+0000","last_change":"2024-05-15T18:12:37.545692+0000","last_active":"2024-05-15T18:12:37.545692+0000","last_peered":"2024-05-15T18:12:37.545692+0000","last_clean":"2024-05-15T18:12:37.545692+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:12:37.545692+0000","last_undegraded":"2024-05-15T18:12:37.545692+0000","last_fullsized":"2024-05-15T18:12:37.545692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.545580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.545580+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.545580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:29.736129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.016404+0000","last_change":"2024-05-15T18:12:17.016404+0000","last_active":"2024-05-15T18:12:17.016404+0000","last_peered":"2024-05-15T18:12:17.016404+0000","last_clean":"2024-05-15T18:12:17.016404+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:12:17.016404+0000","last_undegraded":"2024-05-15T18:12:17.016404+0000","last_fullsized":"2024-05-15T18:12:17.016404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.016284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:25.998584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.380207+0000","last_change":"2024-05-15T18:12:05.380243+0000","last_active":"2024-05-15T18:12:05.380207+0000","last_peered":"2024-05-15T18:12:05.380207+0000","last_clean":"2024-05-15T18:12:05.380207+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:12:05.380207+0000","last_undegraded":"2024-05-15T18:12:05.380207+0000","last_fullsized":"2024-05-15T18:12:05.380207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.380117+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:27.585526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.174211+0000","last_change":"2024-05-15T18:12:37.174237+0000","last_active":"2024-05-15T18:12:37.174211+0000","last_peered":"2024-05-15T18:12:37.174211+0000","last_clean":"2024-05-15T18:12:37.174211+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:12:37.174211+0000","last_undegraded":"2024-05-15T18:12:37.174211+0000","last_fullsized":"2024-05-15T18:12:37.174211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.174120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.174120+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.174120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:57.846747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.010297+0000","last_change":"2024-05-15T18:12:26.010324+0000","last_active":"2024-05-15T18:12:26.010297+0000","last_peered":"2024-05-15T18:12:26.010297+0000","last_clean":"2024-05-15T18:12:26.010297+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:12:26.010297+0000","last_undegraded":"2024-05-15T18:12:26.010297+0000","last_fullsized":"2024-05-15T18:12:26.010297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.010213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:44.979239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'8","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.995202+0000","last_change":"2024-05-15T18:12:19.995202+0000","last_active":"2024-05-15T18:12:19.995202+0000","last_peered":"2024-05-15T18:12:19.995202+0000","last_clean":"2024-05-15T18:12:19.995202+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:12:19.995202+0000","last_undegraded":"2024-05-15T18:12:19.995202+0000","last_fullsized":"2024-05-15T18:12:19.995202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.995046+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:22.542569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.601468+0000","last_change":"2024-05-15T18:12:39.601468+0000","last_active":"2024-05-15T18:12:39.601468+0000","last_peered":"2024-05-15T18:12:39.601468+0000","last_clean":"2024-05-15T18:12:39.601468+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:12:39.601468+0000","last_undegraded":"2024-05-15T18:12:39.601468+0000","last_fullsized":"2024-05-15T18:12:39.601468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-15T18:12:39.601344+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-15T18:12:39.601344+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.601344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:45:07.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.094140+0000","last_change":"2024-05-15T18:12:45.094166+0000","last_active":"2024-05-15T18:12:45.094140+0000","last_peered":"2024-05-15T18:12:45.094140+0000","last_clean":"2024-05-15T18:12:45.094140+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:12:45.094140+0000","last_undegraded":"2024-05-15T18:12:45.094140+0000","last_fullsized":"2024-05-15T18:12:45.094140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:45.094050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:45.094050+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.094050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:38:47.944537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.927216+0000","last_change":"2024-05-15T18:12:12.927216+0000","last_active":"2024-05-15T18:12:12.927216+0000","last_peered":"2024-05-15T18:12:12.927216+0000","last_clean":"2024-05-15T18:12:12.927216+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:12:12.927216+0000","last_undegraded":"2024-05-15T18:12:12.927216+0000","last_fullsized":"2024-05-15T18:12:12.927216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.927083+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:24.672114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.879840+0000","last_change":"2024-05-15T18:12:06.879840+0000","last_active":"2024-05-15T18:12:06.879840+0000","last_peered":"2024-05-15T18:12:06.879840+0000","last_clean":"2024-05-15T18:12:06.879840+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:12:06.879840+0000","last_undegraded":"2024-05-15T18:12:06.879840+0000","last_fullsized":"2024-05-15T18:12:06.879840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.879711+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:16.898190+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.431117+0000","last_change":"2024-05-15T18:12:01.431143+0000","last_active":"2024-05-15T18:12:01.431117+0000","last_peered":"2024-05-15T18:12:01.431117+0000","last_clean":"2024-05-15T18:12:01.431117+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:12:01.431117+0000","last_undegraded":"2024-05-15T18:12:01.431117+0000","last_fullsized":"2024-05-15T18:12:01.431117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.431023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:47.755595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.148347+0000","last_change":"2024-05-15T18:12:26.148381+0000","last_active":"2024-05-15T18:12:26.148347+0000","last_peered":"2024-05-15T18:12:26.148347+0000","last_clean":"2024-05-15T18:12:26.148347+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:12:26.148347+0000","last_undegraded":"2024-05-15T18:12:26.148347+0000","last_fullsized":"2024-05-15T18:12:26.148347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.148259+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:59.103311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.182730+0000","last_change":"2024-05-15T18:09:19.415333+0000","last_active":"2024-05-15T18:11:57.182730+0000","last_peered":"2024-05-15T18:11:57.182730+0000","last_clean":"2024-05-15T18:11:57.182730+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:11:57.182730+0000","last_undegraded":"2024-05-15T18:11:57.182730+0000","last_fullsized":"2024-05-15T18:11:57.182730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.120801+0000","last_change":"2024-05-15T18:12:37.120801+0000","last_active":"2024-05-15T18:12:37.120801+0000","last_peered":"2024-05-15T18:12:37.120801+0000","last_clean":"2024-05-15T18:12:37.120801+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:12:37.120801+0000","last_undegraded":"2024-05-15T18:12:37.120801+0000","last_fullsized":"2024-05-15T18:12:37.120801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.120650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.120650+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.120650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.085550+0000","last_change":"2024-05-15T18:08:31.153377+0000","last_active":"2024-05-15T18:11:58.085550+0000","last_peered":"2024-05-15T18:11:58.085550+0000","last_clean":"2024-05-15T18:11:58.085550+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:11:58.085550+0000","last_undegraded":"2024-05-15T18:11:58.085550+0000","last_fullsized":"2024-05-15T18:11:58.085550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.391600+0000","last_change":"2024-05-15T18:12:02.391600+0000","last_active":"2024-05-15T18:12:02.391600+0000","last_peered":"2024-05-15T18:12:02.391600+0000","last_clean":"2024-05-15T18:12:02.391600+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:12:02.391600+0000","last_undegraded":"2024-05-15T18:12:02.391600+0000","last_fullsized":"2024-05-15T18:12:02.391600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.391444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:04.938967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.233258+0000","last_change":"2024-05-15T18:12:01.233258+0000","last_active":"2024-05-15T18:12:01.233258+0000","last_peered":"2024-05-15T18:12:01.233258+0000","last_clean":"2024-05-15T18:12:01.233258+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:12:01.233258+0000","last_undegraded":"2024-05-15T18:12:01.233258+0000","last_fullsized":"2024-05-15T18:12:01.233258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.233115+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:11.007085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":359,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.323821+0000","last_change":"2024-05-15T18:11:58.323821+0000","last_active":"2024-05-15T18:11:58.323821+0000","last_peered":"2024-05-15T18:11:58.323821+0000","last_clean":"2024-05-15T18:11:58.323821+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:58.323821+0000","last_undegraded":"2024-05-15T18:11:58.323821+0000","last_fullsized":"2024-05-15T18:11:58.323821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.323633+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.917231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396379+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:11:03.396379+0000","last_peered":"2024-05-15T18:11:03.396379+0000","last_clean":"2024-05-15T18:11:03.396379+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:11:03.396379+0000","last_undegraded":"2024-05-15T18:11:03.396379+0000","last_fullsized":"2024-05-15T18:11:03.396379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.223814+0000","last_change":"2024-05-15T18:12:18.223814+0000","last_active":"2024-05-15T18:12:18.223814+0000","last_peered":"2024-05-15T18:12:18.223814+0000","last_clean":"2024-05-15T18:12:18.223814+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:12:18.223814+0000","last_undegraded":"2024-05-15T18:12:18.223814+0000","last_fullsized":"2024-05-15T18:12:18.223814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.223691+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:06.085124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:48.393971+0000","last_change":"2024-05-15T18:08:37.184221+0000","last_active":"2024-05-15T18:10:48.393971+0000","last_peered":"2024-05-15T18:10:48.393971+0000","last_clean":"2024-05-15T18:10:48.393971+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:10:48.393971+0000","last_undegraded":"2024-05-15T18:10:48.393971+0000","last_fullsized":"2024-05-15T18:10:48.393971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.127693+0000","last_change":"2024-05-15T18:12:44.127693+0000","last_active":"2024-05-15T18:12:44.127693+0000","last_peered":"2024-05-15T18:12:44.127693+0000","last_clean":"2024-05-15T18:12:44.127693+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:12:44.127693+0000","last_undegraded":"2024-05-15T18:12:44.127693+0000","last_fullsized":"2024-05-15T18:12:44.127693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:44.127568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:44.127568+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.127568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:12.123278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.358934+0000","last_change":"2024-05-15T18:12:06.358934+0000","last_active":"2024-05-15T18:12:06.358934+0000","last_peered":"2024-05-15T18:12:06.358934+0000","last_clean":"2024-05-15T18:12:06.358934+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:12:06.358934+0000","last_undegraded":"2024-05-15T18:12:06.358934+0000","last_fullsized":"2024-05-15T18:12:06.358934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.358819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:07.242813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.224031+0000","last_change":"2024-05-15T18:12:23.224031+0000","last_active":"2024-05-15T18:12:23.224031+0000","last_peered":"2024-05-15T18:12:23.224031+0000","last_clean":"2024-05-15T18:12:23.224031+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:12:23.224031+0000","last_undegraded":"2024-05-15T18:12:23.224031+0000","last_fullsized":"2024-05-15T18:12:23.224031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.223908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:27.882071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":402,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.886655+0000","last_change":"2024-05-15T18:12:02.886655+0000","last_active":"2024-05-15T18:12:02.886655+0000","last_peered":"2024-05-15T18:12:02.886655+0000","last_clean":"2024-05-15T18:12:02.886655+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:12:02.886655+0000","last_undegraded":"2024-05-15T18:12:02.886655+0000","last_fullsized":"2024-05-15T18:12:02.886655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.886536+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:13.272929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.857023+0000","last_change":"2024-05-15T18:12:52.857048+0000","last_active":"2024-05-15T18:12:52.857023+0000","last_peered":"2024-05-15T18:12:52.857023+0000","last_clean":"2024-05-15T18:12:52.857023+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:12:52.857023+0000","last_undegraded":"2024-05-15T18:12:52.857023+0000","last_fullsized":"2024-05-15T18:12:52.857023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-15T18:12:52.856931+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-15T18:12:52.856931+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.856931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:23:08.871415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.562885+0000","last_change":"2024-05-15T18:12:30.562885+0000","last_active":"2024-05-15T18:12:30.562885+0000","last_peered":"2024-05-15T18:12:30.562885+0000","last_clean":"2024-05-15T18:12:30.562885+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:12:30.562885+0000","last_undegraded":"2024-05-15T18:12:30.562885+0000","last_fullsized":"2024-05-15T18:12:30.562885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.562719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:21.698936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.977262+0000","last_change":"2024-05-15T18:12:36.977312+0000","last_active":"2024-05-15T18:12:36.977262+0000","last_peered":"2024-05-15T18:12:36.977262+0000","last_clean":"2024-05-15T18:12:36.977262+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:12:36.977262+0000","last_undegraded":"2024-05-15T18:12:36.977262+0000","last_fullsized":"2024-05-15T18:12:36.977262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:36.977151+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:36.977151+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.977151+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:32.112263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.085577+0000","last_change":"2024-05-15T18:08:31.286465+0000","last_active":"2024-05-15T18:11:58.085577+0000","last_peered":"2024-05-15T18:11:58.085577+0000","last_clean":"2024-05-15T18:11:58.085577+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:11:58.085577+0000","last_undegraded":"2024-05-15T18:11:58.085577+0000","last_fullsized":"2024-05-15T18:11:58.085577+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:30.137707+0000","last_clean_scrub_stamp":"2024-05-15T18:08:30.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.448854+0000","last_change":"2024-05-15T18:11:59.448854+0000","last_active":"2024-05-15T18:11:59.448854+0000","last_peered":"2024-05-15T18:11:59.448854+0000","last_clean":"2024-05-15T18:11:59.448854+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:11:59.448854+0000","last_undegraded":"2024-05-15T18:11:59.448854+0000","last_fullsized":"2024-05-15T18:11:59.448854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.448742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:12:37.217420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.502595+0000","last_change":"2024-05-15T18:12:04.502595+0000","last_active":"2024-05-15T18:12:04.502595+0000","last_peered":"2024-05-15T18:12:04.502595+0000","last_clean":"2024-05-15T18:12:04.502595+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:12:04.502595+0000","last_undegraded":"2024-05-15T18:12:04.502595+0000","last_fullsized":"2024-05-15T18:12:04.502595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.502398+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:28.778374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:56.955872+0000","last_change":"2024-05-15T18:11:56.955872+0000","last_active":"2024-05-15T18:11:56.955872+0000","last_peered":"2024-05-15T18:11:56.955872+0000","last_clean":"2024-05-15T18:11:56.955872+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:11:56.955872+0000","last_undegraded":"2024-05-15T18:11:56.955872+0000","last_fullsized":"2024-05-15T18:11:56.955872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_clean_scrub_stamp":"2024-05-15T18:11:56.955763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:30.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.566752+0000","last_change":"2024-05-15T18:12:14.566798+0000","last_active":"2024-05-15T18:12:14.566752+0000","last_peered":"2024-05-15T18:12:14.566752+0000","last_clean":"2024-05-15T18:12:14.566752+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:12:14.566752+0000","last_undegraded":"2024-05-15T18:12:14.566752+0000","last_fullsized":"2024-05-15T18:12:14.566752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.566649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:21.835682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.588043+0000","last_change":"2024-05-15T18:12:46.588093+0000","last_active":"2024-05-15T18:12:46.588043+0000","last_peered":"2024-05-15T18:12:46.588043+0000","last_clean":"2024-05-15T18:12:46.588043+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:12:46.588043+0000","last_undegraded":"2024-05-15T18:12:46.588043+0000","last_fullsized":"2024-05-15T18:12:46.588043+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:46.587943+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:46.587943+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.587943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:46.897722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.511624+0000","last_change":"2024-05-15T18:12:32.511652+0000","last_active":"2024-05-15T18:12:32.511624+0000","last_peered":"2024-05-15T18:12:32.511624+0000","last_clean":"2024-05-15T18:12:32.511624+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:12:32.511624+0000","last_undegraded":"2024-05-15T18:12:32.511624+0000","last_fullsized":"2024-05-15T18:12:32.511624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.511538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:33.395531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395527+0000","last_change":"2024-05-15T18:08:37.185935+0000","last_active":"2024-05-15T18:10:58.395527+0000","last_peered":"2024-05-15T18:10:58.395527+0000","last_clean":"2024-05-15T18:10:58.395527+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:10:58.395527+0000","last_undegraded":"2024-05-15T18:10:58.395527+0000","last_fullsized":"2024-05-15T18:10:58.395527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395581+0000","last_change":"2024-05-15T18:09:19.404553+0000","last_active":"2024-05-15T18:11:03.395581+0000","last_peered":"2024-05-15T18:11:03.395581+0000","last_clean":"2024-05-15T18:11:03.395581+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:11:03.395581+0000","last_undegraded":"2024-05-15T18:11:03.395581+0000","last_fullsized":"2024-05-15T18:11:03.395581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:40.167202+0000","last_clean_scrub_stamp":"2024-05-15T18:08:40.167202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.350517+0000","last_change":"2024-05-15T18:12:11.350568+0000","last_active":"2024-05-15T18:12:11.350517+0000","last_peered":"2024-05-15T18:12:11.350517+0000","last_clean":"2024-05-15T18:12:11.350517+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:12:11.350517+0000","last_undegraded":"2024-05-15T18:12:11.350517+0000","last_fullsized":"2024-05-15T18:12:11.350517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.350399+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:11.134147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.232158+0000","last_change":"2024-05-15T18:12:21.232183+0000","last_active":"2024-05-15T18:12:21.232158+0000","last_peered":"2024-05-15T18:12:21.232158+0000","last_clean":"2024-05-15T18:12:21.232158+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:12:21.232158+0000","last_undegraded":"2024-05-15T18:12:21.232158+0000","last_fullsized":"2024-05-15T18:12:21.232158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.232063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:21.541842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:56.735207+0000","last_change":"2024-05-15T18:08:47.216635+0000","last_active":"2024-05-15T18:11:56.735207+0000","last_peered":"2024-05-15T18:11:56.735207+0000","last_clean":"2024-05-15T18:11:56.735207+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:11:56.735207+0000","last_undegraded":"2024-05-15T18:11:56.735207+0000","last_fullsized":"2024-05-15T18:11:56.735207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.980328+0000","last_change":"2024-05-15T18:12:24.980362+0000","last_active":"2024-05-15T18:12:24.980328+0000","last_peered":"2024-05-15T18:12:24.980328+0000","last_clean":"2024-05-15T18:12:24.980328+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:12:24.980328+0000","last_undegraded":"2024-05-15T18:12:24.980328+0000","last_fullsized":"2024-05-15T18:12:24.980328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.980229+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:19.381841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.546242+0000","last_change":"2024-05-15T18:12:35.546282+0000","last_active":"2024-05-15T18:12:35.546242+0000","last_peered":"2024-05-15T18:12:35.546242+0000","last_clean":"2024-05-15T18:12:35.546242+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:12:35.546242+0000","last_undegraded":"2024-05-15T18:12:35.546242+0000","last_fullsized":"2024-05-15T18:12:35.546242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:35.546148+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:35.546148+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.546148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:23:08.501199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.464665+0000","last_change":"2024-05-15T18:11:58.464695+0000","last_active":"2024-05-15T18:11:58.464665+0000","last_peered":"2024-05-15T18:11:58.464665+0000","last_clean":"2024-05-15T18:11:58.464665+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:11:58.464665+0000","last_undegraded":"2024-05-15T18:11:58.464665+0000","last_fullsized":"2024-05-15T18:11:58.464665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.464557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:27.556332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.875011+0000","last_change":"2024-05-15T18:12:08.875048+0000","last_active":"2024-05-15T18:12:08.875011+0000","last_peered":"2024-05-15T18:12:08.875011+0000","last_clean":"2024-05-15T18:12:08.875011+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:12:08.875011+0000","last_undegraded":"2024-05-15T18:12:08.875011+0000","last_fullsized":"2024-05-15T18:12:08.875011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.874911+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:19.931974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.544246+0000","last_change":"2024-05-15T18:12:10.544278+0000","last_active":"2024-05-15T18:12:10.544246+0000","last_peered":"2024-05-15T18:12:10.544246+0000","last_clean":"2024-05-15T18:12:10.544246+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:12:10.544246+0000","last_undegraded":"2024-05-15T18:12:10.544246+0000","last_fullsized":"2024-05-15T18:12:10.544246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.544159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:52.334749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.126720+0000","last_change":"2024-05-15T18:12:22.126750+0000","last_active":"2024-05-15T18:12:22.126720+0000","last_peered":"2024-05-15T18:12:22.126720+0000","last_clean":"2024-05-15T18:12:22.126720+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:12:22.126720+0000","last_undegraded":"2024-05-15T18:12:22.126720+0000","last_fullsized":"2024-05-15T18:12:22.126720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.126615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:44.332025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.156074+0000","last_change":"2024-05-15T18:12:28.156098+0000","last_active":"2024-05-15T18:12:28.156074+0000","last_peered":"2024-05-15T18:12:28.156074+0000","last_clean":"2024-05-15T18:12:28.156074+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:12:28.156074+0000","last_undegraded":"2024-05-15T18:12:28.156074+0000","last_fullsized":"2024-05-15T18:12:28.156074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.155985+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:20.346535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.574489+0000","last_change":"2024-05-15T18:12:42.574548+0000","last_active":"2024-05-15T18:12:42.574489+0000","last_peered":"2024-05-15T18:12:42.574489+0000","last_clean":"2024-05-15T18:12:42.574489+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:12:42.574489+0000","last_undegraded":"2024-05-15T18:12:42.574489+0000","last_fullsized":"2024-05-15T18:12:42.574489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:42.574370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:42.574370+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.574370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:31.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.579110+0000","last_change":"2024-05-15T18:12:12.579133+0000","last_active":"2024-05-15T18:12:12.579110+0000","last_peered":"2024-05-15T18:12:12.579110+0000","last_clean":"2024-05-15T18:12:12.579110+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:12:12.579110+0000","last_undegraded":"2024-05-15T18:12:12.579110+0000","last_fullsized":"2024-05-15T18:12:12.579110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.579011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:22.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'48","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.881810+0000","last_change":"2024-05-15T18:12:11.881882+0000","last_active":"2024-05-15T18:12:11.881810+0000","last_peered":"2024-05-15T18:12:11.881810+0000","last_clean":"2024-05-15T18:12:11.881810+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:12:11.881810+0000","last_undegraded":"2024-05-15T18:12:11.881810+0000","last_fullsized":"2024-05-15T18:12:11.881810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.881671+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:22.316063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.359537+0000","last_change":"2024-05-15T18:11:57.359562+0000","last_active":"2024-05-15T18:11:57.359537+0000","last_peered":"2024-05-15T18:11:57.359537+0000","last_clean":"2024-05-15T18:11:57.359537+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:11:57.359537+0000","last_undegraded":"2024-05-15T18:11:57.359537+0000","last_fullsized":"2024-05-15T18:11:57.359537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.359393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:31.155528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:18.398472+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:11:18.398472+0000","last_peered":"2024-05-15T18:11:18.398472+0000","last_clean":"2024-05-15T18:11:18.398472+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:11:18.398472+0000","last_undegraded":"2024-05-15T18:11:18.398472+0000","last_fullsized":"2024-05-15T18:11:18.398472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.235644+0000","last_change":"2024-05-15T18:12:16.235673+0000","last_active":"2024-05-15T18:12:16.235644+0000","last_peered":"2024-05-15T18:12:16.235644+0000","last_clean":"2024-05-15T18:12:16.235644+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:12:16.235644+0000","last_undegraded":"2024-05-15T18:12:16.235644+0000","last_fullsized":"2024-05-15T18:12:16.235644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.235558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:08.093786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.918478+0000","last_change":"2024-05-15T18:12:47.918512+0000","last_active":"2024-05-15T18:12:47.918478+0000","last_peered":"2024-05-15T18:12:47.918478+0000","last_clean":"2024-05-15T18:12:47.918478+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:12:47.918478+0000","last_undegraded":"2024-05-15T18:12:47.918478+0000","last_fullsized":"2024-05-15T18:12:47.918478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:47.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:47.918385+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:38.973477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.315137+0000","last_change":"2024-05-15T18:12:07.315160+0000","last_active":"2024-05-15T18:12:07.315137+0000","last_peered":"2024-05-15T18:12:07.315137+0000","last_clean":"2024-05-15T18:12:07.315137+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:12:07.315137+0000","last_undegraded":"2024-05-15T18:12:07.315137+0000","last_fullsized":"2024-05-15T18:12:07.315137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.315047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:28.990916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.589070+0000","last_change":"2024-05-15T18:12:08.589118+0000","last_active":"2024-05-15T18:12:08.589070+0000","last_peered":"2024-05-15T18:12:08.589070+0000","last_clean":"2024-05-15T18:12:08.589070+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:12:08.589070+0000","last_undegraded":"2024-05-15T18:12:08.589070+0000","last_fullsized":"2024-05-15T18:12:08.589070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.588987+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:48.582117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.517728+0000","last_change":"2024-05-15T18:11:58.517779+0000","last_active":"2024-05-15T18:11:58.517728+0000","last_peered":"2024-05-15T18:11:58.517728+0000","last_clean":"2024-05-15T18:11:58.517728+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:11:58.517728+0000","last_undegraded":"2024-05-15T18:11:58.517728+0000","last_fullsized":"2024-05-15T18:11:58.517728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.517616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:10:30.693406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.201458+0000","last_change":"2024-05-15T18:12:35.201458+0000","last_active":"2024-05-15T18:12:35.201458+0000","last_peered":"2024-05-15T18:12:35.201458+0000","last_clean":"2024-05-15T18:12:35.201458+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:12:35.201458+0000","last_undegraded":"2024-05-15T18:12:35.201458+0000","last_fullsized":"2024-05-15T18:12:35.201458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:35.201346+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:35.201346+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.201346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:19.831426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396177+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:11:03.396177+0000","last_peered":"2024-05-15T18:11:03.396177+0000","last_clean":"2024-05-15T18:11:03.396177+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:11:03.396177+0000","last_undegraded":"2024-05-15T18:11:03.396177+0000","last_fullsized":"2024-05-15T18:11:03.396177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.052545+0000","last_change":"2024-05-15T18:12:20.052545+0000","last_active":"2024-05-15T18:12:20.052545+0000","last_peered":"2024-05-15T18:12:20.052545+0000","last_clean":"2024-05-15T18:12:20.052545+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:12:20.052545+0000","last_undegraded":"2024-05-15T18:12:20.052545+0000","last_fullsized":"2024-05-15T18:12:20.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.052417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:32.618399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.892641+0000","last_change":"2024-05-15T18:12:10.892676+0000","last_active":"2024-05-15T18:12:10.892641+0000","last_peered":"2024-05-15T18:12:10.892641+0000","last_clean":"2024-05-15T18:12:10.892641+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:12:10.892641+0000","last_undegraded":"2024-05-15T18:12:10.892641+0000","last_fullsized":"2024-05-15T18:12:10.892641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.892546+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:09.452875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.474146+0000","last_change":"2024-05-15T18:12:02.474184+0000","last_active":"2024-05-15T18:12:02.474146+0000","last_peered":"2024-05-15T18:12:02.474146+0000","last_clean":"2024-05-15T18:12:02.474146+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:12:02.474146+0000","last_undegraded":"2024-05-15T18:12:02.474146+0000","last_fullsized":"2024-05-15T18:12:02.474146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.474022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:25:37.061500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.960397+0000","last_change":"2024-05-15T18:12:53.960424+0000","last_active":"2024-05-15T18:12:53.960397+0000","last_peered":"2024-05-15T18:12:53.960397+0000","last_clean":"2024-05-15T18:12:53.960397+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:12:53.960397+0000","last_undegraded":"2024-05-15T18:12:53.960397+0000","last_fullsized":"2024-05-15T18:12:53.960397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:53.960302+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:53.960302+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.960302+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:15:21.988407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.088216+0000","last_change":"2024-05-15T18:12:42.088243+0000","last_active":"2024-05-15T18:12:42.088216+0000","last_peered":"2024-05-15T18:12:42.088216+0000","last_clean":"2024-05-15T18:12:42.088216+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:12:42.088216+0000","last_undegraded":"2024-05-15T18:12:42.088216+0000","last_fullsized":"2024-05-15T18:12:42.088216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:42.088128+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:42.088128+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.088128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:26:47.954467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.395526+0000","last_change":"2024-05-15T18:09:19.405624+0000","last_active":"2024-05-15T18:11:03.395526+0000","last_peered":"2024-05-15T18:11:03.395526+0000","last_clean":"2024-05-15T18:11:03.395526+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:11:03.395526+0000","last_undegraded":"2024-05-15T18:11:03.395526+0000","last_fullsized":"2024-05-15T18:11:03.395526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.537137+0000","last_change":"2024-05-15T18:12:15.537137+0000","last_active":"2024-05-15T18:12:15.537137+0000","last_peered":"2024-05-15T18:12:15.537137+0000","last_clean":"2024-05-15T18:12:15.537137+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:12:15.537137+0000","last_undegraded":"2024-05-15T18:12:15.537137+0000","last_fullsized":"2024-05-15T18:12:15.537137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.536986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:59.728892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.224399+0000","last_change":"2024-05-15T18:12:30.224462+0000","last_active":"2024-05-15T18:12:30.224399+0000","last_peered":"2024-05-15T18:12:30.224399+0000","last_clean":"2024-05-15T18:12:30.224399+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:12:30.224399+0000","last_undegraded":"2024-05-15T18:12:30.224399+0000","last_fullsized":"2024-05-15T18:12:30.224399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.224290+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:21.279383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.212353+0000","last_change":"2024-05-15T18:12:02.212375+0000","last_active":"2024-05-15T18:12:02.212353+0000","last_peered":"2024-05-15T18:12:02.212353+0000","last_clean":"2024-05-15T18:12:02.212353+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:12:02.212353+0000","last_undegraded":"2024-05-15T18:12:02.212353+0000","last_fullsized":"2024-05-15T18:12:02.212353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.212266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:31.297851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.193880+0000","last_change":"2024-05-15T18:12:41.193919+0000","last_active":"2024-05-15T18:12:41.193880+0000","last_peered":"2024-05-15T18:12:41.193880+0000","last_clean":"2024-05-15T18:12:41.193880+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:12:41.193880+0000","last_undegraded":"2024-05-15T18:12:41.193880+0000","last_fullsized":"2024-05-15T18:12:41.193880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:41.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:41.193780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.193780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:13:46.031668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.265264+0000","last_change":"2024-05-15T18:12:14.265289+0000","last_active":"2024-05-15T18:12:14.265264+0000","last_peered":"2024-05-15T18:12:14.265264+0000","last_clean":"2024-05-15T18:12:14.265264+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:12:14.265264+0000","last_undegraded":"2024-05-15T18:12:14.265264+0000","last_fullsized":"2024-05-15T18:12:14.265264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.265178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:00:30.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.953534+0000","last_change":"2024-05-15T18:12:46.953579+0000","last_active":"2024-05-15T18:12:46.953534+0000","last_peered":"2024-05-15T18:12:46.953534+0000","last_clean":"2024-05-15T18:12:46.953534+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:12:46.953534+0000","last_undegraded":"2024-05-15T18:12:46.953534+0000","last_fullsized":"2024-05-15T18:12:46.953534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:46.953407+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.953407+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.953407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:17:48.733387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.544729+0000","last_change":"2024-05-15T18:12:16.544771+0000","last_active":"2024-05-15T18:12:16.544729+0000","last_peered":"2024-05-15T18:12:16.544729+0000","last_clean":"2024-05-15T18:12:16.544729+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:12:16.544729+0000","last_undegraded":"2024-05-15T18:12:16.544729+0000","last_fullsized":"2024-05-15T18:12:16.544729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.544617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:26.563096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.854126+0000","last_change":"2024-05-15T18:12:04.854126+0000","last_active":"2024-05-15T18:12:04.854126+0000","last_peered":"2024-05-15T18:12:04.854126+0000","last_clean":"2024-05-15T18:12:04.854126+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:12:04.854126+0000","last_undegraded":"2024-05-15T18:12:04.854126+0000","last_fullsized":"2024-05-15T18:12:04.854126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.853980+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:12.123012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.875755+0000","last_change":"2024-05-15T18:12:03.875755+0000","last_active":"2024-05-15T18:12:03.875755+0000","last_peered":"2024-05-15T18:12:03.875755+0000","last_clean":"2024-05-15T18:12:03.875755+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:12:03.875755+0000","last_undegraded":"2024-05-15T18:12:03.875755+0000","last_fullsized":"2024-05-15T18:12:03.875755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.875637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:24.820098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396939+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:11:08.396939+0000","last_peered":"2024-05-15T18:11:08.396939+0000","last_clean":"2024-05-15T18:11:08.396939+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:11:08.396939+0000","last_undegraded":"2024-05-15T18:11:08.396939+0000","last_fullsized":"2024-05-15T18:11:08.396939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.142595+0000","last_change":"2024-05-15T18:12:40.142629+0000","last_active":"2024-05-15T18:12:40.142595+0000","last_peered":"2024-05-15T18:12:40.142595+0000","last_clean":"2024-05-15T18:12:40.142595+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:12:40.142595+0000","last_undegraded":"2024-05-15T18:12:40.142595+0000","last_fullsized":"2024-05-15T18:12:40.142595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:40.142500+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:40.142500+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.142500+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:44.800663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.116084+0000","last_change":"2024-05-15T18:12:53.116110+0000","last_active":"2024-05-15T18:12:53.116084+0000","last_peered":"2024-05-15T18:12:53.116084+0000","last_clean":"2024-05-15T18:12:53.116084+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:12:53.116084+0000","last_undegraded":"2024-05-15T18:12:53.116084+0000","last_fullsized":"2024-05-15T18:12:53.116084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:53.115966+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:53.115966+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.115966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:46:44.696807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.091544+0000","last_change":"2024-05-15T18:12:17.091569+0000","last_active":"2024-05-15T18:12:17.091544+0000","last_peered":"2024-05-15T18:12:17.091544+0000","last_clean":"2024-05-15T18:12:17.091544+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:12:17.091544+0000","last_undegraded":"2024-05-15T18:12:17.091544+0000","last_fullsized":"2024-05-15T18:12:17.091544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.091439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:24:24.593459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.281653+0000","last_change":"2024-05-15T18:12:26.281653+0000","last_active":"2024-05-15T18:12:26.281653+0000","last_peered":"2024-05-15T18:12:26.281653+0000","last_clean":"2024-05-15T18:12:26.281653+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:12:26.281653+0000","last_undegraded":"2024-05-15T18:12:26.281653+0000","last_fullsized":"2024-05-15T18:12:26.281653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.281513+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:35.878307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":382,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.505720+0000","last_change":"2024-05-15T18:12:06.505746+0000","last_active":"2024-05-15T18:12:06.505720+0000","last_peered":"2024-05-15T18:12:06.505720+0000","last_clean":"2024-05-15T18:12:06.505720+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:12:06.505720+0000","last_undegraded":"2024-05-15T18:12:06.505720+0000","last_fullsized":"2024-05-15T18:12:06.505720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.505630+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:15:15.678261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.170247+0000","last_change":"2024-05-15T18:12:45.170277+0000","last_active":"2024-05-15T18:12:45.170247+0000","last_peered":"2024-05-15T18:12:45.170247+0000","last_clean":"2024-05-15T18:12:45.170247+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:12:45.170247+0000","last_undegraded":"2024-05-15T18:12:45.170247+0000","last_fullsized":"2024-05-15T18:12:45.170247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:45.170157+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:45.170157+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.170157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:01.687704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.574715+0000","last_change":"2024-05-15T18:12:22.574766+0000","last_active":"2024-05-15T18:12:22.574715+0000","last_peered":"2024-05-15T18:12:22.574715+0000","last_clean":"2024-05-15T18:12:22.574715+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:12:22.574715+0000","last_undegraded":"2024-05-15T18:12:22.574715+0000","last_fullsized":"2024-05-15T18:12:22.574715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.574598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:34.319629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.875166+0000","last_change":"2024-05-15T18:12:50.875194+0000","last_active":"2024-05-15T18:12:50.875166+0000","last_peered":"2024-05-15T18:12:50.875166+0000","last_clean":"2024-05-15T18:12:50.875166+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:12:50.875166+0000","last_undegraded":"2024-05-15T18:12:50.875166+0000","last_fullsized":"2024-05-15T18:12:50.875166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.875069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.875069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.875069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:38.918843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.101386+0000","last_change":"2024-05-15T18:12:13.101422+0000","last_active":"2024-05-15T18:12:13.101386+0000","last_peered":"2024-05-15T18:12:13.101386+0000","last_clean":"2024-05-15T18:12:13.101386+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:12:13.101386+0000","last_undegraded":"2024-05-15T18:12:13.101386+0000","last_fullsized":"2024-05-15T18:12:13.101386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.101295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:02:45.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.136885+0000","last_change":"2024-05-15T18:12:08.136923+0000","last_active":"2024-05-15T18:12:08.136885+0000","last_peered":"2024-05-15T18:12:08.136885+0000","last_clean":"2024-05-15T18:12:08.136885+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:12:08.136885+0000","last_undegraded":"2024-05-15T18:12:08.136885+0000","last_fullsized":"2024-05-15T18:12:08.136885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.136791+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:18.155270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.879979+0000","last_change":"2024-05-15T18:12:01.880039+0000","last_active":"2024-05-15T18:12:01.879979+0000","last_peered":"2024-05-15T18:12:01.879979+0000","last_clean":"2024-05-15T18:12:01.879979+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:12:01.879979+0000","last_undegraded":"2024-05-15T18:12:01.879979+0000","last_fullsized":"2024-05-15T18:12:01.879979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.879852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:30.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.059723+0000","last_change":"2024-05-15T18:12:14.059771+0000","last_active":"2024-05-15T18:12:14.059723+0000","last_peered":"2024-05-15T18:12:14.059723+0000","last_clean":"2024-05-15T18:12:14.059723+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:12:14.059723+0000","last_undegraded":"2024-05-15T18:12:14.059723+0000","last_fullsized":"2024-05-15T18:12:14.059723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.059612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:52.613050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.579844+0000","last_change":"2024-05-15T18:12:20.579871+0000","last_active":"2024-05-15T18:12:20.579844+0000","last_peered":"2024-05-15T18:12:20.579844+0000","last_clean":"2024-05-15T18:12:20.579844+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:12:20.579844+0000","last_undegraded":"2024-05-15T18:12:20.579844+0000","last_fullsized":"2024-05-15T18:12:20.579844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.579756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:19.140085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397102+0000","last_change":"2024-05-15T18:08:37.185723+0000","last_active":"2024-05-15T18:11:08.397102+0000","last_peered":"2024-05-15T18:11:08.397102+0000","last_clean":"2024-05-15T18:11:08.397102+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:11:08.397102+0000","last_undegraded":"2024-05-15T18:11:08.397102+0000","last_fullsized":"2024-05-15T18:11:08.397102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.532585+0000","last_change":"2024-05-15T18:12:13.532610+0000","last_active":"2024-05-15T18:12:13.532585+0000","last_peered":"2024-05-15T18:12:13.532585+0000","last_clean":"2024-05-15T18:12:13.532585+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:12:13.532585+0000","last_undegraded":"2024-05-15T18:12:13.532585+0000","last_fullsized":"2024-05-15T18:12:13.532585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.532473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:34.476933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.850349+0000","last_change":"2024-05-15T18:12:07.850386+0000","last_active":"2024-05-15T18:12:07.850349+0000","last_peered":"2024-05-15T18:12:07.850349+0000","last_clean":"2024-05-15T18:12:07.850349+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:12:07.850349+0000","last_undegraded":"2024-05-15T18:12:07.850349+0000","last_fullsized":"2024-05-15T18:12:07.850349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.850240+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:45.111188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.202135+0000","last_change":"2024-05-15T18:12:19.202194+0000","last_active":"2024-05-15T18:12:19.202135+0000","last_peered":"2024-05-15T18:12:19.202135+0000","last_clean":"2024-05-15T18:12:19.202135+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:12:19.202135+0000","last_undegraded":"2024-05-15T18:12:19.202135+0000","last_fullsized":"2024-05-15T18:12:19.202135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.202036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:01.433105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397860+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:11:13.397860+0000","last_peered":"2024-05-15T18:11:13.397860+0000","last_clean":"2024-05-15T18:11:13.397860+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:11:13.397860+0000","last_undegraded":"2024-05-15T18:11:13.397860+0000","last_fullsized":"2024-05-15T18:11:13.397860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.219352+0000","last_change":"2024-05-15T18:12:43.219392+0000","last_active":"2024-05-15T18:12:43.219352+0000","last_peered":"2024-05-15T18:12:43.219352+0000","last_clean":"2024-05-15T18:12:43.219352+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:12:43.219352+0000","last_undegraded":"2024-05-15T18:12:43.219352+0000","last_fullsized":"2024-05-15T18:12:43.219352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:43.219263+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:43.219263+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.219263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:19:50.255782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.103086+0000","last_change":"2024-05-15T18:12:35.103086+0000","last_active":"2024-05-15T18:12:35.103086+0000","last_peered":"2024-05-15T18:12:35.103086+0000","last_clean":"2024-05-15T18:12:35.103086+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:12:35.103086+0000","last_undegraded":"2024-05-15T18:12:35.103086+0000","last_fullsized":"2024-05-15T18:12:35.103086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:35.102958+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:35.102958+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.102958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:18:29.354078+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.110609+0000","last_change":"2024-05-15T18:12:09.110633+0000","last_active":"2024-05-15T18:12:09.110609+0000","last_peered":"2024-05-15T18:12:09.110609+0000","last_clean":"2024-05-15T18:12:09.110609+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:12:09.110609+0000","last_undegraded":"2024-05-15T18:12:09.110609+0000","last_fullsized":"2024-05-15T18:12:09.110609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.110521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:26.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'31","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.230432+0000","last_change":"2024-05-15T18:12:24.230472+0000","last_active":"2024-05-15T18:12:24.230432+0000","last_peered":"2024-05-15T18:12:24.230432+0000","last_clean":"2024-05-15T18:12:24.230432+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:12:24.230432+0000","last_undegraded":"2024-05-15T18:12:24.230432+0000","last_fullsized":"2024-05-15T18:12:24.230432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.230338+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:28.672249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.200745+0000","last_change":"2024-05-15T18:12:20.200773+0000","last_active":"2024-05-15T18:12:20.200745+0000","last_peered":"2024-05-15T18:12:20.200745+0000","last_clean":"2024-05-15T18:12:20.200745+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:12:20.200745+0000","last_undegraded":"2024-05-15T18:12:20.200745+0000","last_fullsized":"2024-05-15T18:12:20.200745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.200646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:24.107584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397830+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:11:13.397830+0000","last_peered":"2024-05-15T18:11:13.397830+0000","last_clean":"2024-05-15T18:11:13.397830+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:11:13.397830+0000","last_undegraded":"2024-05-15T18:11:13.397830+0000","last_fullsized":"2024-05-15T18:11:13.397830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.561884+0000","last_change":"2024-05-15T18:12:24.561907+0000","last_active":"2024-05-15T18:12:24.561884+0000","last_peered":"2024-05-15T18:12:24.561884+0000","last_clean":"2024-05-15T18:12:24.561884+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:12:24.561884+0000","last_undegraded":"2024-05-15T18:12:24.561884+0000","last_fullsized":"2024-05-15T18:12:24.561884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.561798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:53.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.961011+0000","last_change":"2024-05-15T18:12:45.961011+0000","last_active":"2024-05-15T18:12:45.961011+0000","last_peered":"2024-05-15T18:12:45.961011+0000","last_clean":"2024-05-15T18:12:45.961011+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:12:45.961011+0000","last_undegraded":"2024-05-15T18:12:45.961011+0000","last_fullsized":"2024-05-15T18:12:45.961011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:45.960841+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:45.960841+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.960841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:48.335945+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.076973+0000","last_change":"2024-05-15T18:12:11.076997+0000","last_active":"2024-05-15T18:12:11.076973+0000","last_peered":"2024-05-15T18:12:11.076973+0000","last_clean":"2024-05-15T18:12:11.076973+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:12:11.076973+0000","last_undegraded":"2024-05-15T18:12:11.076973+0000","last_fullsized":"2024-05-15T18:12:11.076973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.076888+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:44.712782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.195779+0000","last_change":"2024-05-15T18:12:17.195819+0000","last_active":"2024-05-15T18:12:17.195779+0000","last_peered":"2024-05-15T18:12:17.195779+0000","last_clean":"2024-05-15T18:12:17.195779+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:12:17.195779+0000","last_undegraded":"2024-05-15T18:12:17.195779+0000","last_fullsized":"2024-05-15T18:12:17.195779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.195689+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:06.470822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.030201+0000","last_change":"2024-05-15T18:12:18.030230+0000","last_active":"2024-05-15T18:12:18.030201+0000","last_peered":"2024-05-15T18:12:18.030201+0000","last_clean":"2024-05-15T18:12:18.030201+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:12:18.030201+0000","last_undegraded":"2024-05-15T18:12:18.030201+0000","last_fullsized":"2024-05-15T18:12:18.030201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.030108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:36.616836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397061+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:11:08.397061+0000","last_peered":"2024-05-15T18:11:08.397061+0000","last_clean":"2024-05-15T18:11:08.397061+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:11:08.397061+0000","last_undegraded":"2024-05-15T18:11:08.397061+0000","last_fullsized":"2024-05-15T18:11:08.397061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.985766+0000","last_change":"2024-05-15T18:12:22.985820+0000","last_active":"2024-05-15T18:12:22.985766+0000","last_peered":"2024-05-15T18:12:22.985766+0000","last_clean":"2024-05-15T18:12:22.985766+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:12:22.985766+0000","last_undegraded":"2024-05-15T18:12:22.985766+0000","last_fullsized":"2024-05-15T18:12:22.985766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.985658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:45.191068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.546934+0000","last_change":"2024-05-15T18:12:41.546934+0000","last_active":"2024-05-15T18:12:41.546934+0000","last_peered":"2024-05-15T18:12:41.546934+0000","last_clean":"2024-05-15T18:12:41.546934+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:12:41.546934+0000","last_undegraded":"2024-05-15T18:12:41.546934+0000","last_fullsized":"2024-05-15T18:12:41.546934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:41.546819+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:41.546819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.546819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:57.515122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.175170+0000","last_change":"2024-05-15T18:12:30.175229+0000","last_active":"2024-05-15T18:12:30.175170+0000","last_peered":"2024-05-15T18:12:30.175170+0000","last_clean":"2024-05-15T18:12:30.175170+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:12:30.175170+0000","last_undegraded":"2024-05-15T18:12:30.175170+0000","last_fullsized":"2024-05-15T18:12:30.175170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.175060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:58.317953+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.058150+0000","last_change":"2024-05-15T18:12:49.058150+0000","last_active":"2024-05-15T18:12:49.058150+0000","last_peered":"2024-05-15T18:12:49.058150+0000","last_clean":"2024-05-15T18:12:49.058150+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:12:49.058150+0000","last_undegraded":"2024-05-15T18:12:49.058150+0000","last_fullsized":"2024-05-15T18:12:49.058150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:49.057973+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:49.057973+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.057973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:27.470127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":70,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.225501+0000","last_change":"2024-05-15T18:12:42.225545+0000","last_active":"2024-05-15T18:12:42.225501+0000","last_peered":"2024-05-15T18:12:42.225501+0000","last_clean":"2024-05-15T18:12:42.225501+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:12:42.225501+0000","last_undegraded":"2024-05-15T18:12:42.225501+0000","last_fullsized":"2024-05-15T18:12:42.225501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:42.225381+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:42.225381+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.225381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:49.913736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.085866+0000","last_change":"2024-05-15T18:08:37.180276+0000","last_active":"2024-05-15T18:11:58.085866+0000","last_peered":"2024-05-15T18:11:58.085866+0000","last_clean":"2024-05-15T18:11:58.085866+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:11:58.085866+0000","last_undegraded":"2024-05-15T18:11:58.085866+0000","last_fullsized":"2024-05-15T18:11:58.085866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.145477+0000","last_change":"2024-05-15T18:12:34.145506+0000","last_active":"2024-05-15T18:12:34.145477+0000","last_peered":"2024-05-15T18:12:34.145477+0000","last_clean":"2024-05-15T18:12:34.145477+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:12:34.145477+0000","last_undegraded":"2024-05-15T18:12:34.145477+0000","last_fullsized":"2024-05-15T18:12:34.145477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.145384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:22.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.134698+0000","last_change":"2024-05-15T18:12:43.134698+0000","last_active":"2024-05-15T18:12:43.134698+0000","last_peered":"2024-05-15T18:12:43.134698+0000","last_clean":"2024-05-15T18:12:43.134698+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:12:43.134698+0000","last_undegraded":"2024-05-15T18:12:43.134698+0000","last_fullsized":"2024-05-15T18:12:43.134698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:43.134559+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:43.134559+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.134559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:20:54.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.138916+0000","last_change":"2024-05-15T18:12:32.138916+0000","last_active":"2024-05-15T18:12:32.138916+0000","last_peered":"2024-05-15T18:12:32.138916+0000","last_clean":"2024-05-15T18:12:32.138916+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:12:32.138916+0000","last_undegraded":"2024-05-15T18:12:32.138916+0000","last_fullsized":"2024-05-15T18:12:32.138916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.138787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:48.107090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.134542+0000","last_change":"2024-05-15T18:12:47.134585+0000","last_active":"2024-05-15T18:12:47.134542+0000","last_peered":"2024-05-15T18:12:47.134542+0000","last_clean":"2024-05-15T18:12:47.134542+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:12:47.134542+0000","last_undegraded":"2024-05-15T18:12:47.134542+0000","last_fullsized":"2024-05-15T18:12:47.134542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:47.134445+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:47.134445+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.134445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:38.189538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.970784+0000","last_change":"2024-05-15T18:12:23.970784+0000","last_active":"2024-05-15T18:12:23.970784+0000","last_peered":"2024-05-15T18:12:23.970784+0000","last_clean":"2024-05-15T18:12:23.970784+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:12:23.970784+0000","last_undegraded":"2024-05-15T18:12:23.970784+0000","last_fullsized":"2024-05-15T18:12:23.970784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.970665+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:28:19.811968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.045114+0000","last_change":"2024-05-15T18:12:43.045170+0000","last_active":"2024-05-15T18:12:43.045114+0000","last_peered":"2024-05-15T18:12:43.045114+0000","last_clean":"2024-05-15T18:12:43.045114+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:12:43.045114+0000","last_undegraded":"2024-05-15T18:12:43.045114+0000","last_fullsized":"2024-05-15T18:12:43.045114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:43.045020+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:43.045020+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.045020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:27.966525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.121090+0000","last_change":"2024-05-15T18:12:25.121090+0000","last_active":"2024-05-15T18:12:25.121090+0000","last_peered":"2024-05-15T18:12:25.121090+0000","last_clean":"2024-05-15T18:12:25.121090+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:12:25.121090+0000","last_undegraded":"2024-05-15T18:12:25.121090+0000","last_fullsized":"2024-05-15T18:12:25.121090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.120969+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:19.624066+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.561005+0000","last_change":"2024-05-15T18:12:25.561063+0000","last_active":"2024-05-15T18:12:25.561005+0000","last_peered":"2024-05-15T18:12:25.561005+0000","last_clean":"2024-05-15T18:12:25.561005+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:12:25.561005+0000","last_undegraded":"2024-05-15T18:12:25.561005+0000","last_fullsized":"2024-05-15T18:12:25.561005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.560894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:37.100840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.044657+0000","last_change":"2024-05-15T18:12:30.044657+0000","last_active":"2024-05-15T18:12:30.044657+0000","last_peered":"2024-05-15T18:12:30.044657+0000","last_clean":"2024-05-15T18:12:30.044657+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:12:30.044657+0000","last_undegraded":"2024-05-15T18:12:30.044657+0000","last_fullsized":"2024-05-15T18:12:30.044657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.044530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:37.330279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.092312+0000","last_change":"2024-05-15T18:12:48.092336+0000","last_active":"2024-05-15T18:12:48.092312+0000","last_peered":"2024-05-15T18:12:48.092312+0000","last_clean":"2024-05-15T18:12:48.092312+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:12:48.092312+0000","last_undegraded":"2024-05-15T18:12:48.092312+0000","last_fullsized":"2024-05-15T18:12:48.092312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.092219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.092219+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.092219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:16.437531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.038957+0000","last_change":"2024-05-15T18:12:34.038981+0000","last_active":"2024-05-15T18:12:34.038957+0000","last_peered":"2024-05-15T18:12:34.038957+0000","last_clean":"2024-05-15T18:12:34.038957+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:12:34.038957+0000","last_undegraded":"2024-05-15T18:12:34.038957+0000","last_fullsized":"2024-05-15T18:12:34.038957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:34.038867+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:34.038867+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.038867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:23.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:53.721657+0000","last_change":"2024-05-15T18:08:37.174784+0000","last_active":"2024-05-15T18:11:53.721657+0000","last_peered":"2024-05-15T18:11:53.721657+0000","last_clean":"2024-05-15T18:11:53.721657+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:11:53.721657+0000","last_undegraded":"2024-05-15T18:11:53.721657+0000","last_fullsized":"2024-05-15T18:11:53.721657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.201489+0000","last_change":"2024-05-15T18:12:38.201522+0000","last_active":"2024-05-15T18:12:38.201489+0000","last_peered":"2024-05-15T18:12:38.201489+0000","last_clean":"2024-05-15T18:12:38.201489+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:12:38.201489+0000","last_undegraded":"2024-05-15T18:12:38.201489+0000","last_fullsized":"2024-05-15T18:12:38.201489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:38.201399+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:38.201399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.201399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:09:03.315937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.010136+0000","last_change":"2024-05-15T18:12:51.010162+0000","last_active":"2024-05-15T18:12:51.010136+0000","last_peered":"2024-05-15T18:12:51.010136+0000","last_clean":"2024-05-15T18:12:51.010136+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:12:51.010136+0000","last_undegraded":"2024-05-15T18:12:51.010136+0000","last_fullsized":"2024-05-15T18:12:51.010136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:51.010036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:51.010036+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.010036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:38:08.614485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.081145+0000","last_change":"2024-05-15T18:09:19.409291+0000","last_active":"2024-05-15T18:11:47.081145+0000","last_peered":"2024-05-15T18:11:47.081145+0000","last_clean":"2024-05-15T18:11:47.081145+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:11:47.081145+0000","last_undegraded":"2024-05-15T18:11:47.081145+0000","last_fullsized":"2024-05-15T18:11:47.081145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:38.159980+0000","last_clean_scrub_stamp":"2024-05-15T18:08:38.159980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.002208+0000","last_change":"2024-05-15T18:12:35.002246+0000","last_active":"2024-05-15T18:12:35.002208+0000","last_peered":"2024-05-15T18:12:35.002208+0000","last_clean":"2024-05-15T18:12:35.002208+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:12:35.002208+0000","last_undegraded":"2024-05-15T18:12:35.002208+0000","last_fullsized":"2024-05-15T18:12:35.002208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:35.002095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:35.002095+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.002095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:22.863528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.041100+0000","last_change":"2024-05-15T18:12:31.041130+0000","last_active":"2024-05-15T18:12:31.041100+0000","last_peered":"2024-05-15T18:12:31.041100+0000","last_clean":"2024-05-15T18:12:31.041100+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:12:31.041100+0000","last_undegraded":"2024-05-15T18:12:31.041100+0000","last_fullsized":"2024-05-15T18:12:31.041100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.041007+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:07.255869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.992340+0000","last_change":"2024-05-15T18:12:38.992367+0000","last_active":"2024-05-15T18:12:38.992340+0000","last_peered":"2024-05-15T18:12:38.992340+0000","last_clean":"2024-05-15T18:12:38.992340+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:12:38.992340+0000","last_undegraded":"2024-05-15T18:12:38.992340+0000","last_fullsized":"2024-05-15T18:12:38.992340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:38.992240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:38.992240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.992240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:39.302019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.988310+0000","last_change":"2024-05-15T18:12:20.988373+0000","last_active":"2024-05-15T18:12:20.988310+0000","last_peered":"2024-05-15T18:12:20.988310+0000","last_clean":"2024-05-15T18:12:20.988310+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:12:20.988310+0000","last_undegraded":"2024-05-15T18:12:20.988310+0000","last_fullsized":"2024-05-15T18:12:20.988310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.988215+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:54.295065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.123760+0000","last_change":"2024-05-15T18:12:51.123787+0000","last_active":"2024-05-15T18:12:51.123760+0000","last_peered":"2024-05-15T18:12:51.123760+0000","last_clean":"2024-05-15T18:12:51.123760+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:12:51.123760+0000","last_undegraded":"2024-05-15T18:12:51.123760+0000","last_fullsized":"2024-05-15T18:12:51.123760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:51.123675+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:51.123675+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.123675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:11.864114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":85,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.007457+0000","last_change":"2024-05-15T18:12:42.007541+0000","last_active":"2024-05-15T18:12:42.007457+0000","last_peered":"2024-05-15T18:12:42.007457+0000","last_clean":"2024-05-15T18:12:42.007457+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:12:42.007457+0000","last_undegraded":"2024-05-15T18:12:42.007457+0000","last_fullsized":"2024-05-15T18:12:42.007457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:42.007335+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:42.007335+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.007335+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:46.449247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:53.394668+0000","last_change":"2024-05-15T18:08:37.181882+0000","last_active":"2024-05-15T18:10:53.394668+0000","last_peered":"2024-05-15T18:10:53.394668+0000","last_clean":"2024-05-15T18:10:53.394668+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:10:53.394668+0000","last_undegraded":"2024-05-15T18:10:53.394668+0000","last_fullsized":"2024-05-15T18:10:53.394668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.228063+0000","last_change":"2024-05-15T18:12:32.228088+0000","last_active":"2024-05-15T18:12:32.228063+0000","last_peered":"2024-05-15T18:12:32.228063+0000","last_clean":"2024-05-15T18:12:32.228063+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:12:32.228063+0000","last_undegraded":"2024-05-15T18:12:32.228063+0000","last_fullsized":"2024-05-15T18:12:32.228063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.227938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:25.136580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.546310+0000","last_change":"2024-05-15T18:12:27.546336+0000","last_active":"2024-05-15T18:12:27.546310+0000","last_peered":"2024-05-15T18:12:27.546310+0000","last_clean":"2024-05-15T18:12:27.546310+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:12:27.546310+0000","last_undegraded":"2024-05-15T18:12:27.546310+0000","last_fullsized":"2024-05-15T18:12:27.546310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.546217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:46.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.088263+0000","last_change":"2024-05-15T18:12:33.088288+0000","last_active":"2024-05-15T18:12:33.088263+0000","last_peered":"2024-05-15T18:12:33.088263+0000","last_clean":"2024-05-15T18:12:33.088263+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:12:33.088263+0000","last_undegraded":"2024-05-15T18:12:33.088263+0000","last_fullsized":"2024-05-15T18:12:33.088263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.088145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:24.946373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:47.014991+0000","last_change":"2024-05-15T18:09:19.409578+0000","last_active":"2024-05-15T18:11:47.014991+0000","last_peered":"2024-05-15T18:11:47.014991+0000","last_clean":"2024-05-15T18:11:47.014991+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:11:47.014991+0000","last_undegraded":"2024-05-15T18:11:47.014991+0000","last_fullsized":"2024-05-15T18:11:47.014991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395301+0000","last_change":"2024-05-15T18:08:37.182059+0000","last_active":"2024-05-15T18:10:58.395301+0000","last_peered":"2024-05-15T18:10:58.395301+0000","last_clean":"2024-05-15T18:10:58.395301+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:10:58.395301+0000","last_undegraded":"2024-05-15T18:10:58.395301+0000","last_fullsized":"2024-05-15T18:10:58.395301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.124776+0000","last_change":"2024-05-15T18:12:24.124812+0000","last_active":"2024-05-15T18:12:24.124776+0000","last_peered":"2024-05-15T18:12:24.124776+0000","last_clean":"2024-05-15T18:12:24.124776+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:12:24.124776+0000","last_undegraded":"2024-05-15T18:12:24.124776+0000","last_fullsized":"2024-05-15T18:12:24.124776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.124681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:45.800550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.164306+0000","last_change":"2024-05-15T18:12:39.164327+0000","last_active":"2024-05-15T18:12:39.164306+0000","last_peered":"2024-05-15T18:12:39.164306+0000","last_clean":"2024-05-15T18:12:39.164306+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:12:39.164306+0000","last_undegraded":"2024-05-15T18:12:39.164306+0000","last_fullsized":"2024-05-15T18:12:39.164306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:39.164216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:39.164216+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.164216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:01.803010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.047409+0000","last_change":"2024-05-15T18:12:27.047454+0000","last_active":"2024-05-15T18:12:27.047409+0000","last_peered":"2024-05-15T18:12:27.047409+0000","last_clean":"2024-05-15T18:12:27.047409+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:12:27.047409+0000","last_undegraded":"2024-05-15T18:12:27.047409+0000","last_fullsized":"2024-05-15T18:12:27.047409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.047320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:59:33.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673020,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":132984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39932,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331908,"statfs":{"total":96636764160,"available":96595873792,"internally_reserved":0,"allocated":446464,"data_stored":133185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705722,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":720289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705722,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:12:59.596 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.597 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.597 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.597 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.598 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.598 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.598 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.598 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.599 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.600 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.600 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.600 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.600 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.600 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.601 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.601 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.601 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.602 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.602 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.602 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.602 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.603 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.603 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-15T18:08:30.137707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.603 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.603 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-15T18:08:40.167202+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=40, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.604 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.604 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.604 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.604 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.605 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.606 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.606 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.606 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.606 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.607 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.607 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.607 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-15T18:08:38.159980+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.608 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.608 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.608 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:12:59.608 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T18:13:19.609 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:13:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52d6c7b640 1 Processor -- start 2024-05-15T18:13:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52d6c7b640 1 -- start start 2024-05-15T18:13:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52d6c7b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52d012e460 0x7f52d0130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52d6c7b640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52d0071020 con 0x7f52d0127ea0 2024-05-15T18:13:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52d6c7b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f52d0071780 con 0x7f52d012e460 2024-05-15T18:13:19.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52cffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52d012e460 0x7f52d0130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52cffff640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f52d012e460 0x7f52d0130850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46486/0 (socket says 172.21.15.3:46486) 2024-05-15T18:13:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52cffff640 1 -- 172.21.15.3:0/4198164664 learned_addr learned my addr 172.21.15.3:0/4198164664 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:13:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.749+0000 7f52d4a17640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f52d0127ea0 0x7f52d0128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:51988/0 (socket says 172.21.15.3:51988) 2024-05-15T18:13:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.750+0000 7f52cffff640 1 -- 172.21.15.3:0/4198164664 >> v1:172.21.15.3:6789/0 conn(0x7f52d0127ea0 legacy=0x7f52d0128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:19.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.750+0000 7f52cffff640 1 -- 172.21.15.3:0/4198164664 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d006e6e0 con 0x7f52d012e460 2024-05-15T18:13:19.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.750+0000 7f52cffff640 1 --2- 172.21.15.3:0/4198164664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d012e460 0x7f52d0130850 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f52b800ba90 tx=0x7f52b802e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d55083fbdcde4b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:19.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52cf7fe640 1 -- 172.21.15.3:0/4198164664 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b803b070 con 0x7f52d012e460 2024-05-15T18:13:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52cf7fe640 1 -- 172.21.15.3:0/4198164664 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b802ee50 con 0x7f52d012e460 2024-05-15T18:13:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52cf7fe640 1 -- 172.21.15.3:0/4198164664 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b8036590 con 0x7f52d012e460 2024-05-15T18:13:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52d6c7b640 1 -- 172.21.15.3:0/4198164664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d012e460 msgr2=0x7f52d0130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52d6c7b640 1 --2- 172.21.15.3:0/4198164664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d012e460 0x7f52d0130850 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f52b800ba90 tx=0x7f52b802e170 comp rx=0 tx=0).stop 2024-05-15T18:13:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52d6c7b640 1 -- 172.21.15.3:0/4198164664 shutdown_connections 2024-05-15T18:13:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52d6c7b640 1 --2- 172.21.15.3:0/4198164664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d012e460 0x7f52d0130850 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52d6c7b640 1 -- 172.21.15.3:0/4198164664 >> 172.21.15.3:0/4198164664 conn(0x7f52d0099380 msgr2=0x7f52d0099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:13:19.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52d6c7b640 1 -- 172.21.15.3:0/4198164664 shutdown_connections 2024-05-15T18:13:19.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.751+0000 7f52d6c7b640 1 -- 172.21.15.3:0/4198164664 wait complete. 2024-05-15T18:13:19.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.752+0000 7f52d6c7b640 1 Processor -- start 2024-05-15T18:13:19.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.752+0000 7f52d6c7b640 1 -- start start 2024-05-15T18:13:19.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52d6c7b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d0127ea0 0x7f52d01bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:19.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52d6c7b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f52d00725d0 con 0x7f52d0127ea0 2024-05-15T18:13:19.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52d4a17640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d0127ea0 0x7f52d01bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:19.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52d4a17640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d0127ea0 0x7f52d01bfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46494/0 (socket says 172.21.15.3:46494) 2024-05-15T18:13:19.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52d4a17640 1 -- 172.21.15.3:0/3177928469 learned_addr learned my addr 172.21.15.3:0/3177928469 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:13:19.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52d4a17640 1 -- 172.21.15.3:0/3177928469 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d012b1e0 con 0x7f52d0127ea0 2024-05-15T18:13:19.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52d4a17640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d0127ea0 0x7f52d01bfbf0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c450 tx=0x7f52c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:19.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.753+0000 7f52cd7fa640 1 -- 172.21.15.3:0/3177928469 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52c0007410 con 0x7f52d0127ea0 2024-05-15T18:13:19.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.754+0000 7f52cd7fa640 1 -- 172.21.15.3:0/3177928469 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c00075b0 con 0x7f52d0127ea0 2024-05-15T18:13:19.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.754+0000 7f52cd7fa640 1 -- 172.21.15.3:0/3177928469 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52c0004910 con 0x7f52d0127ea0 2024-05-15T18:13:19.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.754+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d0123040 con 0x7f52d0127ea0 2024-05-15T18:13:19.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.754+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d01c0130 con 0x7f52d0127ea0 2024-05-15T18:13:19.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.754+0000 7f52cd7fa640 1 -- 172.21.15.3:0/3177928469 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f52c001a020 con 0x7f52d0127ea0 2024-05-15T18:13:19.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.755+0000 7f52cd7fa640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f52b0038060 0x7f52b003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:19.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.755+0000 7f52cd7fa640 1 -- 172.21.15.3:0/3177928469 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f52c004b100 con 0x7f52d0127ea0 2024-05-15T18:13:19.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.755+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d0062e90 con 0x7f52d0127ea0 2024-05-15T18:13:19.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.755+0000 7f52cffff640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f52b0038060 0x7f52b003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:19.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.756+0000 7f52cffff640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f52b0038060 0x7f52b003a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f52b8038000 tx=0x7f52b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:19.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.760+0000 7f52cd7fa640 1 -- 172.21.15.3:0/3177928469 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f52c001bc30 con 0x7f52d0127ea0 2024-05-15T18:13:19.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.944+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52d0122680 con 0x7f52b0038060 2024-05-15T18:13:19.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.960+0000 7f52cd7fa640 1 -- 172.21.15.3:0/3177928469 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665401 (secure 0 0 0) 0x7f52d0122680 con 0x7f52b0038060 2024-05-15T18:13:19.947 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:13:19.953 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:13:19.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f52b0038060 msgr2=0x7f52b003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:19.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f52b0038060 0x7f52b003a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f52b8038000 tx=0x7f52b8008040 comp rx=0 tx=0).stop 2024-05-15T18:13:19.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d0127ea0 msgr2=0x7f52d01bfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:19.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d0127ea0 0x7f52d01bfbf0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f52c000c450 tx=0x7f52c000c910 comp rx=0 tx=0).stop 2024-05-15T18:13:19.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 shutdown_connections 2024-05-15T18:13:19.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f52b0038060 0x7f52b003a520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:19.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 --2- 172.21.15.3:0/3177928469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f52d0127ea0 0x7f52d01bfbf0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:19.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 >> 172.21.15.3:0/3177928469 conn(0x7f52d0099380 msgr2=0x7f52d01b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:13:19.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 shutdown_connections 2024-05-15T18:13:19.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:19.965+0000 7f52d6c7b640 1 -- 172.21.15.3:0/3177928469 wait complete. 2024-05-15T18:13:19.956 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-05-15T18:13:18.404867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156600,"kb_used_data":2776,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330760,"statfs":{"total":386547056640,"available":386386698240,"internally_reserved":0,"allocated":2842624,"data_stored":1707986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":157476626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003897"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.568060+0000","last_change":"2024-05-15T18:12:23.568060+0000","last_active":"2024-05-15T18:12:23.568060+0000","last_peered":"2024-05-15T18:12:23.568060+0000","last_clean":"2024-05-15T18:12:23.568060+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:12:23.568060+0000","last_undegraded":"2024-05-15T18:12:23.568060+0000","last_fullsized":"2024-05-15T18:12:23.568060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.567934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:17.103555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.013697+0000","last_change":"2024-05-15T18:12:28.013727+0000","last_active":"2024-05-15T18:12:28.013697+0000","last_peered":"2024-05-15T18:12:28.013697+0000","last_clean":"2024-05-15T18:12:28.013697+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:12:28.013697+0000","last_undegraded":"2024-05-15T18:12:28.013697+0000","last_fullsized":"2024-05-15T18:12:28.013697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.013596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:49.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.121845+0000","last_change":"2024-05-15T18:12:33.121845+0000","last_active":"2024-05-15T18:12:33.121845+0000","last_peered":"2024-05-15T18:12:33.121845+0000","last_clean":"2024-05-15T18:12:33.121845+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:12:33.121845+0000","last_undegraded":"2024-05-15T18:12:33.121845+0000","last_fullsized":"2024-05-15T18:12:33.121845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.121644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:10.755036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.218618+0000","last_change":"2024-05-15T18:12:39.218647+0000","last_active":"2024-05-15T18:12:39.218618+0000","last_peered":"2024-05-15T18:12:39.218618+0000","last_clean":"2024-05-15T18:12:39.218618+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:12:39.218618+0000","last_undegraded":"2024-05-15T18:12:39.218618+0000","last_fullsized":"2024-05-15T18:12:39.218618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:39.218516+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:39.218516+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.218516+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:50:36.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.140484+0000","last_change":"2024-05-15T18:12:50.140541+0000","last_active":"2024-05-15T18:12:50.140484+0000","last_peered":"2024-05-15T18:12:50.140484+0000","last_clean":"2024-05-15T18:12:50.140484+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:12:50.140484+0000","last_undegraded":"2024-05-15T18:12:50.140484+0000","last_fullsized":"2024-05-15T18:12:50.140484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-15T18:12:50.140371+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-15T18:12:50.140371+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.140371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:42.852685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.178894+0000","last_change":"2024-05-15T18:12:36.178923+0000","last_active":"2024-05-15T18:12:36.178894+0000","last_peered":"2024-05-15T18:12:36.178894+0000","last_clean":"2024-05-15T18:12:36.178894+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:12:36.178894+0000","last_undegraded":"2024-05-15T18:12:36.178894+0000","last_fullsized":"2024-05-15T18:12:36.178894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:36.178803+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:36.178803+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.178803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:50.531119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.552979+0000","last_change":"2024-05-15T18:12:40.553006+0000","last_active":"2024-05-15T18:12:40.552979+0000","last_peered":"2024-05-15T18:12:40.552979+0000","last_clean":"2024-05-15T18:12:40.552979+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:12:40.552979+0000","last_undegraded":"2024-05-15T18:12:40.552979+0000","last_fullsized":"2024-05-15T18:12:40.552979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:40.552895+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:40.552895+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.552895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:16.767758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'12","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.209841+0000","last_change":"2024-05-15T18:12:44.209878+0000","last_active":"2024-05-15T18:12:44.209841+0000","last_peered":"2024-05-15T18:12:44.209841+0000","last_clean":"2024-05-15T18:12:44.209841+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:12:44.209841+0000","last_undegraded":"2024-05-15T18:12:44.209841+0000","last_fullsized":"2024-05-15T18:12:44.209841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:44.209754+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:44.209754+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.209754+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:06.347702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:06.114514+0000","last_change":"2024-05-15T18:13:06.114539+0000","last_active":"2024-05-15T18:13:06.114514+0000","last_peered":"2024-05-15T18:13:06.114514+0000","last_clean":"2024-05-15T18:13:06.114514+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:13:06.114514+0000","last_undegraded":"2024-05-15T18:13:06.114514+0000","last_fullsized":"2024-05-15T18:13:06.114514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:06.114414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:06.114414+0000","last_clean_scrub_stamp":"2024-05-15T18:13:06.114414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:14:00.932476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.026703+0000","last_change":"2024-05-15T18:12:36.026703+0000","last_active":"2024-05-15T18:12:36.026703+0000","last_peered":"2024-05-15T18:12:36.026703+0000","last_clean":"2024-05-15T18:12:36.026703+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:12:36.026703+0000","last_undegraded":"2024-05-15T18:12:36.026703+0000","last_fullsized":"2024-05-15T18:12:36.026703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:36.026558+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:36.026558+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.026558+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:18:30.277678+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.525739+0000","last_change":"2024-05-15T18:12:33.525782+0000","last_active":"2024-05-15T18:12:33.525739+0000","last_peered":"2024-05-15T18:12:33.525739+0000","last_clean":"2024-05-15T18:12:33.525739+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:12:33.525739+0000","last_undegraded":"2024-05-15T18:12:33.525739+0000","last_fullsized":"2024-05-15T18:12:33.525739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.525633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.525633+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.525633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:55.201502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.204112+0000","last_change":"2024-05-15T18:12:31.204112+0000","last_active":"2024-05-15T18:12:31.204112+0000","last_peered":"2024-05-15T18:12:31.204112+0000","last_clean":"2024-05-15T18:12:31.204112+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:12:31.204112+0000","last_undegraded":"2024-05-15T18:12:31.204112+0000","last_fullsized":"2024-05-15T18:12:31.204112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.203970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:59.549282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:13.152726+0000","last_change":"2024-05-15T18:13:13.152803+0000","last_active":"2024-05-15T18:13:13.152726+0000","last_peered":"2024-05-15T18:13:13.152726+0000","last_clean":"2024-05-15T18:13:13.152726+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:13:13.152726+0000","last_undegraded":"2024-05-15T18:13:13.152726+0000","last_fullsized":"2024-05-15T18:13:13.152726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:13.152602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:13.152602+0000","last_clean_scrub_stamp":"2024-05-15T18:13:13.152602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:41.866811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'6","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.549269+0000","last_change":"2024-05-15T18:12:19.549269+0000","last_active":"2024-05-15T18:12:19.549269+0000","last_peered":"2024-05-15T18:12:19.549269+0000","last_clean":"2024-05-15T18:12:19.549269+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:12:19.549269+0000","last_undegraded":"2024-05-15T18:12:19.549269+0000","last_fullsized":"2024-05-15T18:12:19.549269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.549105+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:39.405237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.174271+0000","last_change":"2024-05-15T18:12:31.174295+0000","last_active":"2024-05-15T18:12:31.174271+0000","last_peered":"2024-05-15T18:12:31.174271+0000","last_clean":"2024-05-15T18:12:31.174271+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:12:31.174271+0000","last_undegraded":"2024-05-15T18:12:31.174271+0000","last_fullsized":"2024-05-15T18:12:31.174271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.174181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:20.484887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.576366+0000","last_change":"2024-05-15T18:12:28.576366+0000","last_active":"2024-05-15T18:12:28.576366+0000","last_peered":"2024-05-15T18:12:28.576366+0000","last_clean":"2024-05-15T18:12:28.576366+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:12:28.576366+0000","last_undegraded":"2024-05-15T18:12:28.576366+0000","last_fullsized":"2024-05-15T18:12:28.576366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.576233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:31.123756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":66,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.185694+0000","last_change":"2024-05-15T18:12:34.185742+0000","last_active":"2024-05-15T18:12:34.185694+0000","last_peered":"2024-05-15T18:12:34.185694+0000","last_clean":"2024-05-15T18:12:34.185694+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:12:34.185694+0000","last_undegraded":"2024-05-15T18:12:34.185694+0000","last_fullsized":"2024-05-15T18:12:34.185694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:34.185583+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:34.185583+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.185583+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:37:51.790032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.969352+0000","last_change":"2024-05-15T18:12:40.969411+0000","last_active":"2024-05-15T18:12:40.969352+0000","last_peered":"2024-05-15T18:12:40.969352+0000","last_clean":"2024-05-15T18:12:40.969352+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:12:40.969352+0000","last_undegraded":"2024-05-15T18:12:40.969352+0000","last_fullsized":"2024-05-15T18:12:40.969352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:40.969246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:40.969246+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.969246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:45.627408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'6","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.089743+0000","last_change":"2024-05-15T18:12:32.089786+0000","last_active":"2024-05-15T18:12:32.089743+0000","last_peered":"2024-05-15T18:12:32.089743+0000","last_clean":"2024-05-15T18:12:32.089743+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:12:32.089743+0000","last_undegraded":"2024-05-15T18:12:32.089743+0000","last_fullsized":"2024-05-15T18:12:32.089743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.089658+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:06.944435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.585777+0000","last_change":"2024-05-15T18:12:29.585802+0000","last_active":"2024-05-15T18:12:29.585777+0000","last_peered":"2024-05-15T18:12:29.585777+0000","last_clean":"2024-05-15T18:12:29.585777+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:12:29.585777+0000","last_undegraded":"2024-05-15T18:12:29.585777+0000","last_fullsized":"2024-05-15T18:12:29.585777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.585687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:42.151668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.950384+0000","last_change":"2024-05-15T18:12:39.950416+0000","last_active":"2024-05-15T18:12:39.950384+0000","last_peered":"2024-05-15T18:12:39.950384+0000","last_clean":"2024-05-15T18:12:39.950384+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:12:39.950384+0000","last_undegraded":"2024-05-15T18:12:39.950384+0000","last_fullsized":"2024-05-15T18:12:39.950384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:39.950291+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:39.950291+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.950291+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:02.589085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.947787+0000","last_change":"2024-05-15T18:12:48.947819+0000","last_active":"2024-05-15T18:12:48.947787+0000","last_peered":"2024-05-15T18:12:48.947787+0000","last_clean":"2024-05-15T18:12:48.947787+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:12:48.947787+0000","last_undegraded":"2024-05-15T18:12:48.947787+0000","last_fullsized":"2024-05-15T18:12:48.947787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.947695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.947695+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.947695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:17.293007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.081466+0000","last_change":"2024-05-15T18:12:36.081492+0000","last_active":"2024-05-15T18:12:36.081466+0000","last_peered":"2024-05-15T18:12:36.081466+0000","last_clean":"2024-05-15T18:12:36.081466+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:12:36.081466+0000","last_undegraded":"2024-05-15T18:12:36.081466+0000","last_fullsized":"2024-05-15T18:12:36.081466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:36.081367+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:36.081367+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.081367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:18.312435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.004712+0000","last_change":"2024-05-15T18:12:45.004735+0000","last_active":"2024-05-15T18:12:45.004712+0000","last_peered":"2024-05-15T18:12:45.004712+0000","last_clean":"2024-05-15T18:12:45.004712+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:12:45.004712+0000","last_undegraded":"2024-05-15T18:12:45.004712+0000","last_fullsized":"2024-05-15T18:12:45.004712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:45.004620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:45.004620+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.004620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:13.000330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.545131+0000","last_change":"2024-05-15T18:12:26.545156+0000","last_active":"2024-05-15T18:12:26.545131+0000","last_peered":"2024-05-15T18:12:26.545131+0000","last_clean":"2024-05-15T18:12:26.545131+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:12:26.545131+0000","last_undegraded":"2024-05-15T18:12:26.545131+0000","last_fullsized":"2024-05-15T18:12:26.545131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.545026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:35.527326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.101747+0000","last_change":"2024-05-15T18:12:41.101813+0000","last_active":"2024-05-15T18:12:41.101747+0000","last_peered":"2024-05-15T18:12:41.101747+0000","last_clean":"2024-05-15T18:12:41.101747+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:12:41.101747+0000","last_undegraded":"2024-05-15T18:12:41.101747+0000","last_fullsized":"2024-05-15T18:12:41.101747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:41.101640+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:41.101640+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.101640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:28:35.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.063183+0000","last_change":"2024-05-15T18:12:29.063209+0000","last_active":"2024-05-15T18:12:29.063183+0000","last_peered":"2024-05-15T18:12:29.063183+0000","last_clean":"2024-05-15T18:12:29.063183+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:12:29.063183+0000","last_undegraded":"2024-05-15T18:12:29.063183+0000","last_fullsized":"2024-05-15T18:12:29.063183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.063096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:21.253645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:00.122209+0000","last_change":"2024-05-15T18:13:00.122233+0000","last_active":"2024-05-15T18:13:00.122209+0000","last_peered":"2024-05-15T18:13:00.122209+0000","last_clean":"2024-05-15T18:13:00.122209+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:13:00.122209+0000","last_undegraded":"2024-05-15T18:13:00.122209+0000","last_fullsized":"2024-05-15T18:13:00.122209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:00.122088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:00.122088+0000","last_clean_scrub_stamp":"2024-05-15T18:13:00.122088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:03:26.267482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.830009+0000","last_change":"2024-05-15T18:12:53.830067+0000","last_active":"2024-05-15T18:12:53.830009+0000","last_peered":"2024-05-15T18:12:53.830009+0000","last_clean":"2024-05-15T18:12:53.830009+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:12:53.830009+0000","last_undegraded":"2024-05-15T18:12:53.830009+0000","last_fullsized":"2024-05-15T18:12:53.830009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:53.829907+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:53.829907+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.829907+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:14.502533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.585841+0000","last_change":"2024-05-15T18:12:49.585867+0000","last_active":"2024-05-15T18:12:49.585841+0000","last_peered":"2024-05-15T18:12:49.585841+0000","last_clean":"2024-05-15T18:12:49.585841+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:12:49.585841+0000","last_undegraded":"2024-05-15T18:12:49.585841+0000","last_fullsized":"2024-05-15T18:12:49.585841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:49.585746+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:49.585746+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.585746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:54.027658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:10:58.395481+0000","last_change":"2024-05-15T18:08:37.186261+0000","last_active":"2024-05-15T18:10:58.395481+0000","last_peered":"2024-05-15T18:10:58.395481+0000","last_clean":"2024-05-15T18:10:58.395481+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:10:58.395481+0000","last_undegraded":"2024-05-15T18:10:58.395481+0000","last_fullsized":"2024-05-15T18:10:58.395481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'5","reported_seq":238,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.471375+0000","last_change":"2024-05-15T18:12:00.471407+0000","last_active":"2024-05-15T18:12:00.471375+0000","last_peered":"2024-05-15T18:12:00.471375+0000","last_clean":"2024-05-15T18:12:00.471375+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:12:00.471375+0000","last_undegraded":"2024-05-15T18:12:00.471375+0000","last_fullsized":"2024-05-15T18:12:00.471375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.471292+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:32.955699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.208450+0000","last_change":"2024-05-15T18:12:22.208523+0000","last_active":"2024-05-15T18:12:22.208450+0000","last_peered":"2024-05-15T18:12:22.208450+0000","last_clean":"2024-05-15T18:12:22.208450+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:12:22.208450+0000","last_undegraded":"2024-05-15T18:12:22.208450+0000","last_fullsized":"2024-05-15T18:12:22.208450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.208343+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:44.847137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.165954+0000","last_change":"2024-05-15T18:12:06.165990+0000","last_active":"2024-05-15T18:12:06.165954+0000","last_peered":"2024-05-15T18:12:06.165954+0000","last_clean":"2024-05-15T18:12:06.165954+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:12:06.165954+0000","last_undegraded":"2024-05-15T18:12:06.165954+0000","last_fullsized":"2024-05-15T18:12:06.165954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.165871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:13.434904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:54.838292+0000","last_change":"2024-05-15T18:12:54.838318+0000","last_active":"2024-05-15T18:12:54.838292+0000","last_peered":"2024-05-15T18:12:54.838292+0000","last_clean":"2024-05-15T18:12:54.838292+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:12:54.838292+0000","last_undegraded":"2024-05-15T18:12:54.838292+0000","last_fullsized":"2024-05-15T18:12:54.838292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-05-15T18:12:54.838201+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-05-15T18:12:54.838201+0000","last_clean_scrub_stamp":"2024-05-15T18:12:54.838201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:07.280383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.200972+0000","last_change":"2024-05-15T18:12:40.201023+0000","last_active":"2024-05-15T18:12:40.200972+0000","last_peered":"2024-05-15T18:12:40.200972+0000","last_clean":"2024-05-15T18:12:40.200972+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:12:40.200972+0000","last_undegraded":"2024-05-15T18:12:40.200972+0000","last_fullsized":"2024-05-15T18:12:40.200972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:40.200860+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:40.200860+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.200860+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:21:23.692098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.616194+0000","last_change":"2024-05-15T18:12:43.616233+0000","last_active":"2024-05-15T18:12:43.616194+0000","last_peered":"2024-05-15T18:12:43.616194+0000","last_clean":"2024-05-15T18:12:43.616194+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:12:43.616194+0000","last_undegraded":"2024-05-15T18:12:43.616194+0000","last_fullsized":"2024-05-15T18:12:43.616194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:43.616071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:43.616071+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.616071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:24.027421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.076827+0000","last_change":"2024-05-15T18:12:21.076858+0000","last_active":"2024-05-15T18:12:21.076827+0000","last_peered":"2024-05-15T18:12:21.076827+0000","last_clean":"2024-05-15T18:12:21.076827+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:12:21.076827+0000","last_undegraded":"2024-05-15T18:12:21.076827+0000","last_fullsized":"2024-05-15T18:12:21.076827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.076736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:12.212953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'10","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.191773+0000","last_change":"2024-05-15T18:12:04.191810+0000","last_active":"2024-05-15T18:12:04.191773+0000","last_peered":"2024-05-15T18:12:04.191773+0000","last_clean":"2024-05-15T18:12:04.191773+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:12:04.191773+0000","last_undegraded":"2024-05-15T18:12:04.191773+0000","last_fullsized":"2024-05-15T18:12:04.191773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.191688+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:12.868591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.280655+0000","last_change":"2024-05-15T18:11:59.280691+0000","last_active":"2024-05-15T18:11:59.280655+0000","last_peered":"2024-05-15T18:11:59.280655+0000","last_clean":"2024-05-15T18:11:59.280655+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:11:59.280655+0000","last_undegraded":"2024-05-15T18:11:59.280655+0000","last_fullsized":"2024-05-15T18:11:59.280655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.280542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:02.064253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:54.951074+0000","last_change":"2024-05-15T18:12:54.951103+0000","last_active":"2024-05-15T18:12:54.951074+0000","last_peered":"2024-05-15T18:12:54.951074+0000","last_clean":"2024-05-15T18:12:54.951074+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:12:54.951074+0000","last_undegraded":"2024-05-15T18:12:54.951074+0000","last_fullsized":"2024-05-15T18:12:54.951074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:54.950979+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:54.950979+0000","last_clean_scrub_stamp":"2024-05-15T18:12:54.950979+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:09:20.065517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":62,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.129734+0000","last_change":"2024-05-15T18:12:47.129758+0000","last_active":"2024-05-15T18:12:47.129734+0000","last_peered":"2024-05-15T18:12:47.129734+0000","last_clean":"2024-05-15T18:12:47.129734+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:12:47.129734+0000","last_undegraded":"2024-05-15T18:12:47.129734+0000","last_fullsized":"2024-05-15T18:12:47.129734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:47.129645+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:47.129645+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.129645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:46:33.776122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:59.160821+0000","last_change":"2024-05-15T18:12:59.160847+0000","last_active":"2024-05-15T18:12:59.160821+0000","last_peered":"2024-05-15T18:12:59.160821+0000","last_clean":"2024-05-15T18:12:59.160821+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:12:59.160821+0000","last_undegraded":"2024-05-15T18:12:59.160821+0000","last_fullsized":"2024-05-15T18:12:59.160821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:59.160732+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:59.160732+0000","last_clean_scrub_stamp":"2024-05-15T18:12:59.160732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:19.926939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.564300+0000","last_change":"2024-05-15T18:12:50.564324+0000","last_active":"2024-05-15T18:12:50.564300+0000","last_peered":"2024-05-15T18:12:50.564300+0000","last_clean":"2024-05-15T18:12:50.564300+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:12:50.564300+0000","last_undegraded":"2024-05-15T18:12:50.564300+0000","last_fullsized":"2024-05-15T18:12:50.564300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.564204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.564204+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.564204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:35.485709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.538861+0000","last_change":"2024-05-15T18:12:05.538899+0000","last_active":"2024-05-15T18:12:05.538861+0000","last_peered":"2024-05-15T18:12:05.538861+0000","last_clean":"2024-05-15T18:12:05.538861+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:12:05.538861+0000","last_undegraded":"2024-05-15T18:12:05.538861+0000","last_fullsized":"2024-05-15T18:12:05.538861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.538773+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:15:58.392906+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'286","reported_seq":417,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.258996+0000","last_change":"2024-05-15T18:12:29.259026+0000","last_active":"2024-05-15T18:12:29.258996+0000","last_peered":"2024-05-15T18:12:29.258996+0000","last_clean":"2024-05-15T18:12:29.258996+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:12:29.258996+0000","last_undegraded":"2024-05-15T18:12:29.258996+0000","last_fullsized":"2024-05-15T18:12:29.258996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.258908+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:17:31.038888+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.567559+0000","last_change":"2024-05-15T18:12:47.567623+0000","last_active":"2024-05-15T18:12:47.567559+0000","last_peered":"2024-05-15T18:12:47.567559+0000","last_clean":"2024-05-15T18:12:47.567559+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:12:47.567559+0000","last_undegraded":"2024-05-15T18:12:47.567559+0000","last_fullsized":"2024-05-15T18:12:47.567559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:47.567440+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:47.567440+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.567440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:10.206233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'24","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.163243+0000","last_change":"2024-05-15T18:12:27.163303+0000","last_active":"2024-05-15T18:12:27.163243+0000","last_peered":"2024-05-15T18:12:27.163243+0000","last_clean":"2024-05-15T18:12:27.163243+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:12:27.163243+0000","last_undegraded":"2024-05-15T18:12:27.163243+0000","last_fullsized":"2024-05-15T18:12:27.163243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.163125+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:48.445585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.905237+0000","last_change":"2024-05-15T18:12:49.905262+0000","last_active":"2024-05-15T18:12:49.905237+0000","last_peered":"2024-05-15T18:12:49.905237+0000","last_clean":"2024-05-15T18:12:49.905237+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:12:49.905237+0000","last_undegraded":"2024-05-15T18:12:49.905237+0000","last_fullsized":"2024-05-15T18:12:49.905237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:49.905153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:49.905153+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.905153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:42.813795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.344739+0000","last_change":"2024-05-15T18:12:04.344763+0000","last_active":"2024-05-15T18:12:04.344739+0000","last_peered":"2024-05-15T18:12:04.344739+0000","last_clean":"2024-05-15T18:12:04.344739+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:12:04.344739+0000","last_undegraded":"2024-05-15T18:12:04.344739+0000","last_fullsized":"2024-05-15T18:12:04.344739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.344646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:55.480863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.490821+0000","last_change":"2024-05-15T18:12:03.490856+0000","last_active":"2024-05-15T18:12:03.490821+0000","last_peered":"2024-05-15T18:12:03.490821+0000","last_clean":"2024-05-15T18:12:03.490821+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:12:03.490821+0000","last_undegraded":"2024-05-15T18:12:03.490821+0000","last_fullsized":"2024-05-15T18:12:03.490821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.490731+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:32.129481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":447,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.892996+0000","last_change":"2024-05-15T18:11:59.893055+0000","last_active":"2024-05-15T18:11:59.892996+0000","last_peered":"2024-05-15T18:11:59.892996+0000","last_clean":"2024-05-15T18:11:59.892996+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:59.892996+0000","last_undegraded":"2024-05-15T18:11:59.892996+0000","last_fullsized":"2024-05-15T18:11:59.892996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.892887+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:38.810690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.323325+0000","last_change":"2024-05-15T18:12:10.323325+0000","last_active":"2024-05-15T18:12:10.323325+0000","last_peered":"2024-05-15T18:12:10.323325+0000","last_clean":"2024-05-15T18:12:10.323325+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:12:10.323325+0000","last_undegraded":"2024-05-15T18:12:10.323325+0000","last_fullsized":"2024-05-15T18:12:10.323325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.323182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:01.360177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.576610+0000","last_change":"2024-05-15T18:12:38.576610+0000","last_active":"2024-05-15T18:12:38.576610+0000","last_peered":"2024-05-15T18:12:38.576610+0000","last_clean":"2024-05-15T18:12:38.576610+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:12:38.576610+0000","last_undegraded":"2024-05-15T18:12:38.576610+0000","last_fullsized":"2024-05-15T18:12:38.576610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:38.576449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:38.576449+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.576449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:45.862198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.051699+0000","last_change":"2024-05-15T18:12:12.051699+0000","last_active":"2024-05-15T18:12:12.051699+0000","last_peered":"2024-05-15T18:12:12.051699+0000","last_clean":"2024-05-15T18:12:12.051699+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:12:12.051699+0000","last_undegraded":"2024-05-15T18:12:12.051699+0000","last_fullsized":"2024-05-15T18:12:12.051699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.051591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:28:19.702252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'52","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.558253+0000","last_change":"2024-05-15T18:12:11.558253+0000","last_active":"2024-05-15T18:12:11.558253+0000","last_peered":"2024-05-15T18:12:11.558253+0000","last_clean":"2024-05-15T18:12:11.558253+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:12:11.558253+0000","last_undegraded":"2024-05-15T18:12:11.558253+0000","last_fullsized":"2024-05-15T18:12:11.558253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.558113+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:52.322479+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.845711+0000","last_change":"2024-05-15T18:12:00.845711+0000","last_active":"2024-05-15T18:12:00.845711+0000","last_peered":"2024-05-15T18:12:00.845711+0000","last_clean":"2024-05-15T18:12:00.845711+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:12:00.845711+0000","last_undegraded":"2024-05-15T18:12:00.845711+0000","last_fullsized":"2024-05-15T18:12:00.845711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.845599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:10.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.545505+0000","last_change":"2024-05-15T18:12:48.545505+0000","last_active":"2024-05-15T18:12:48.545505+0000","last_peered":"2024-05-15T18:12:48.545505+0000","last_clean":"2024-05-15T18:12:48.545505+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:12:48.545505+0000","last_undegraded":"2024-05-15T18:12:48.545505+0000","last_fullsized":"2024-05-15T18:12:48.545505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:48.545324+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:48.545324+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.545324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:53.203487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.948068+0000","last_change":"2024-05-15T18:12:37.948068+0000","last_active":"2024-05-15T18:12:37.948068+0000","last_peered":"2024-05-15T18:12:37.948068+0000","last_clean":"2024-05-15T18:12:37.948068+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:12:37.948068+0000","last_undegraded":"2024-05-15T18:12:37.948068+0000","last_fullsized":"2024-05-15T18:12:37.948068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:37.947944+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:37.947944+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.947944+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:41.854882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.535769+0000","last_change":"2024-05-15T18:12:31.535769+0000","last_active":"2024-05-15T18:12:31.535769+0000","last_peered":"2024-05-15T18:12:31.535769+0000","last_clean":"2024-05-15T18:12:31.535769+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:12:31.535769+0000","last_undegraded":"2024-05-15T18:12:31.535769+0000","last_fullsized":"2024-05-15T18:12:31.535769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.535653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.741063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"31'2","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.011129+0000","last_change":"2024-05-15T18:12:15.011129+0000","last_active":"2024-05-15T18:12:15.011129+0000","last_peered":"2024-05-15T18:12:15.011129+0000","last_clean":"2024-05-15T18:12:15.011129+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:12:15.011129+0000","last_undegraded":"2024-05-15T18:12:15.011129+0000","last_fullsized":"2024-05-15T18:12:15.011129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.010984+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:44.102759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.305526+0000","last_change":"2024-05-15T18:12:27.305526+0000","last_active":"2024-05-15T18:12:27.305526+0000","last_peered":"2024-05-15T18:12:27.305526+0000","last_clean":"2024-05-15T18:12:27.305526+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:12:27.305526+0000","last_undegraded":"2024-05-15T18:12:27.305526+0000","last_fullsized":"2024-05-15T18:12:27.305526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.305346+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:08:55.301055+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.922907+0000","last_change":"2024-05-15T18:12:09.922907+0000","last_active":"2024-05-15T18:12:09.922907+0000","last_peered":"2024-05-15T18:12:09.922907+0000","last_clean":"2024-05-15T18:12:09.922907+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:12:09.922907+0000","last_undegraded":"2024-05-15T18:12:09.922907+0000","last_fullsized":"2024-05-15T18:12:09.922907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.922780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:29.778911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.970242+0000","last_change":"2024-05-15T18:12:21.970242+0000","last_active":"2024-05-15T18:12:21.970242+0000","last_peered":"2024-05-15T18:12:21.970242+0000","last_clean":"2024-05-15T18:12:21.970242+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:12:21.970242+0000","last_undegraded":"2024-05-15T18:12:21.970242+0000","last_fullsized":"2024-05-15T18:12:21.970242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.970081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:32.198122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.533336+0000","last_change":"2024-05-15T18:12:34.533336+0000","last_active":"2024-05-15T18:12:34.533336+0000","last_peered":"2024-05-15T18:12:34.533336+0000","last_clean":"2024-05-15T18:12:34.533336+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:12:34.533336+0000","last_undegraded":"2024-05-15T18:12:34.533336+0000","last_fullsized":"2024-05-15T18:12:34.533336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:34.533218+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:34.533218+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.533218+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:29.036315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:58.116504+0000","last_change":"2024-05-15T18:12:58.116504+0000","last_active":"2024-05-15T18:12:58.116504+0000","last_peered":"2024-05-15T18:12:58.116504+0000","last_clean":"2024-05-15T18:12:58.116504+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:12:58.116504+0000","last_undegraded":"2024-05-15T18:12:58.116504+0000","last_fullsized":"2024-05-15T18:12:58.116504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:58.116376+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:58.116376+0000","last_clean_scrub_stamp":"2024-05-15T18:12:58.116376+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:51:58.766175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.068568+0000","last_change":"2024-05-15T18:12:19.068568+0000","last_active":"2024-05-15T18:12:19.068568+0000","last_peered":"2024-05-15T18:12:19.068568+0000","last_clean":"2024-05-15T18:12:19.068568+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:12:19.068568+0000","last_undegraded":"2024-05-15T18:12:19.068568+0000","last_fullsized":"2024-05-15T18:12:19.068568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.068452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:21.615975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'46","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.293167+0000","last_change":"2024-05-15T18:12:28.293167+0000","last_active":"2024-05-15T18:12:28.293167+0000","last_peered":"2024-05-15T18:12:28.293167+0000","last_clean":"2024-05-15T18:12:28.293167+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:12:28.293167+0000","last_undegraded":"2024-05-15T18:12:28.293167+0000","last_fullsized":"2024-05-15T18:12:28.293167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.293044+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:30.668147+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":410,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.833181+0000","last_change":"2024-05-15T18:12:05.833181+0000","last_active":"2024-05-15T18:12:05.833181+0000","last_peered":"2024-05-15T18:12:05.833181+0000","last_clean":"2024-05-15T18:12:05.833181+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:12:05.833181+0000","last_undegraded":"2024-05-15T18:12:05.833181+0000","last_fullsized":"2024-05-15T18:12:05.833181+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.833005+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:50.024912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:56.962570+0000","last_change":"2024-05-15T18:12:56.962570+0000","last_active":"2024-05-15T18:12:56.962570+0000","last_peered":"2024-05-15T18:12:56.962570+0000","last_clean":"2024-05-15T18:12:56.962570+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:12:56.962570+0000","last_undegraded":"2024-05-15T18:12:56.962570+0000","last_fullsized":"2024-05-15T18:12:56.962570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:56.962443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:56.962443+0000","last_clean_scrub_stamp":"2024-05-15T18:12:56.962443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:11:07.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.609722+0000","last_change":"2024-05-15T18:12:21.609722+0000","last_active":"2024-05-15T18:12:21.609722+0000","last_peered":"2024-05-15T18:12:21.609722+0000","last_clean":"2024-05-15T18:12:21.609722+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:12:21.609722+0000","last_undegraded":"2024-05-15T18:12:21.609722+0000","last_fullsized":"2024-05-15T18:12:21.609722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.609598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:32.043990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:04.098980+0000","last_change":"2024-05-15T18:13:04.098980+0000","last_active":"2024-05-15T18:13:04.098980+0000","last_peered":"2024-05-15T18:13:04.098980+0000","last_clean":"2024-05-15T18:13:04.098980+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:13:04.098980+0000","last_undegraded":"2024-05-15T18:13:04.098980+0000","last_fullsized":"2024-05-15T18:13:04.098980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:04.098791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:04.098791+0000","last_clean_scrub_stamp":"2024-05-15T18:13:04.098791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:01:47.962934+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.982070+0000","last_change":"2024-05-15T18:12:15.982070+0000","last_active":"2024-05-15T18:12:15.982070+0000","last_peered":"2024-05-15T18:12:15.982070+0000","last_clean":"2024-05-15T18:12:15.982070+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:12:15.982070+0000","last_undegraded":"2024-05-15T18:12:15.982070+0000","last_fullsized":"2024-05-15T18:12:15.982070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.981892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:27.521839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'63","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.357175+0000","last_change":"2024-05-15T18:12:03.357175+0000","last_active":"2024-05-15T18:12:03.357175+0000","last_peered":"2024-05-15T18:12:03.357175+0000","last_clean":"2024-05-15T18:12:03.357175+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:12:03.357175+0000","last_undegraded":"2024-05-15T18:12:03.357175+0000","last_fullsized":"2024-05-15T18:12:03.357175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.357042+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:36.663893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.920914+0000","last_change":"2024-05-15T18:11:58.920914+0000","last_active":"2024-05-15T18:11:58.920914+0000","last_peered":"2024-05-15T18:11:58.920914+0000","last_clean":"2024-05-15T18:11:58.920914+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:11:58.920914+0000","last_undegraded":"2024-05-15T18:11:58.920914+0000","last_fullsized":"2024-05-15T18:11:58.920914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.920801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:00:11.891898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'21","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:57.981315+0000","last_change":"2024-05-15T18:12:57.981315+0000","last_active":"2024-05-15T18:12:57.981315+0000","last_peered":"2024-05-15T18:12:57.981315+0000","last_clean":"2024-05-15T18:12:57.981315+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:12:57.981315+0000","last_undegraded":"2024-05-15T18:12:57.981315+0000","last_fullsized":"2024-05-15T18:12:57.981315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:57.981174+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:57.981174+0000","last_clean_scrub_stamp":"2024-05-15T18:12:57.981174+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:13:27.284069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.855619+0000","last_change":"2024-05-15T18:12:51.855619+0000","last_active":"2024-05-15T18:12:51.855619+0000","last_peered":"2024-05-15T18:12:51.855619+0000","last_clean":"2024-05-15T18:12:51.855619+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:12:51.855619+0000","last_undegraded":"2024-05-15T18:12:51.855619+0000","last_fullsized":"2024-05-15T18:12:51.855619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:51.855472+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:51.855472+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.855472+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:45:43.569013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.201631+0000","last_change":"2024-05-15T18:12:29.201631+0000","last_active":"2024-05-15T18:12:29.201631+0000","last_peered":"2024-05-15T18:12:29.201631+0000","last_clean":"2024-05-15T18:12:29.201631+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:12:29.201631+0000","last_undegraded":"2024-05-15T18:12:29.201631+0000","last_fullsized":"2024-05-15T18:12:29.201631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.201511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:36.487260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.549324+0000","last_change":"2024-05-15T18:12:17.549324+0000","last_active":"2024-05-15T18:12:17.549324+0000","last_peered":"2024-05-15T18:12:17.549324+0000","last_clean":"2024-05-15T18:12:17.549324+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:12:17.549324+0000","last_undegraded":"2024-05-15T18:12:17.549324+0000","last_fullsized":"2024-05-15T18:12:17.549324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.549183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:54.810132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.153393+0000","last_change":"2024-05-15T18:12:05.153393+0000","last_active":"2024-05-15T18:12:05.153393+0000","last_peered":"2024-05-15T18:12:05.153393+0000","last_clean":"2024-05-15T18:12:05.153393+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:12:05.153393+0000","last_undegraded":"2024-05-15T18:12:05.153393+0000","last_fullsized":"2024-05-15T18:12:05.153393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.153268+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:23:48.552424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.235621+0000","last_change":"2024-05-15T18:12:25.235658+0000","last_active":"2024-05-15T18:12:25.235621+0000","last_peered":"2024-05-15T18:12:25.235621+0000","last_clean":"2024-05-15T18:12:25.235621+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:12:25.235621+0000","last_undegraded":"2024-05-15T18:12:25.235621+0000","last_fullsized":"2024-05-15T18:12:25.235621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.235510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:10.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'3","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.086894+0000","last_change":"2024-05-15T18:08:47.219641+0000","last_active":"2024-05-15T18:11:58.086894+0000","last_peered":"2024-05-15T18:11:58.086894+0000","last_clean":"2024-05-15T18:11:58.086894+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:11:58.086894+0000","last_undegraded":"2024-05-15T18:11:58.086894+0000","last_fullsized":"2024-05-15T18:11:58.086894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.318664+0000","last_change":"2024-05-15T18:12:12.318664+0000","last_active":"2024-05-15T18:12:12.318664+0000","last_peered":"2024-05-15T18:12:12.318664+0000","last_clean":"2024-05-15T18:12:12.318664+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:12:12.318664+0000","last_undegraded":"2024-05-15T18:12:12.318664+0000","last_fullsized":"2024-05-15T18:12:12.318664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.318542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:02.692777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.150506+0000","last_change":"2024-05-15T18:12:52.150506+0000","last_active":"2024-05-15T18:12:52.150506+0000","last_peered":"2024-05-15T18:12:52.150506+0000","last_clean":"2024-05-15T18:12:52.150506+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:12:52.150506+0000","last_undegraded":"2024-05-15T18:12:52.150506+0000","last_fullsized":"2024-05-15T18:12:52.150506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:52.150383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:52.150383+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.150383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:43:18.858365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.119374+0000","last_change":"2024-05-15T18:12:23.119374+0000","last_active":"2024-05-15T18:12:23.119374+0000","last_peered":"2024-05-15T18:12:23.119374+0000","last_clean":"2024-05-15T18:12:23.119374+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:12:23.119374+0000","last_undegraded":"2024-05-15T18:12:23.119374+0000","last_fullsized":"2024-05-15T18:12:23.119374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.119253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:24.003247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'45","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.592703+0000","last_change":"2024-05-15T18:12:09.592703+0000","last_active":"2024-05-15T18:12:09.592703+0000","last_peered":"2024-05-15T18:12:09.592703+0000","last_clean":"2024-05-15T18:12:09.592703+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:12:09.592703+0000","last_undegraded":"2024-05-15T18:12:09.592703+0000","last_fullsized":"2024-05-15T18:12:09.592703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.592581+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:53:31.226178+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":415,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.470688+0000","last_change":"2024-05-15T18:12:00.470721+0000","last_active":"2024-05-15T18:12:00.470688+0000","last_peered":"2024-05-15T18:12:00.470688+0000","last_clean":"2024-05-15T18:12:00.470688+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:12:00.470688+0000","last_undegraded":"2024-05-15T18:12:00.470688+0000","last_fullsized":"2024-05-15T18:12:00.470688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.470590+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:35.192862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.974355+0000","last_change":"2024-05-15T18:12:52.974355+0000","last_active":"2024-05-15T18:12:52.974355+0000","last_peered":"2024-05-15T18:12:52.974355+0000","last_clean":"2024-05-15T18:12:52.974355+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:12:52.974355+0000","last_undegraded":"2024-05-15T18:12:52.974355+0000","last_fullsized":"2024-05-15T18:12:52.974355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-05-15T18:12:52.974233+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-05-15T18:12:52.974233+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.974233+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:07.326548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.656587+0000","last_change":"2024-05-15T18:12:44.656587+0000","last_active":"2024-05-15T18:12:44.656587+0000","last_peered":"2024-05-15T18:12:44.656587+0000","last_clean":"2024-05-15T18:12:44.656587+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:12:44.656587+0000","last_undegraded":"2024-05-15T18:12:44.656587+0000","last_fullsized":"2024-05-15T18:12:44.656587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:44.656449+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:44.656449+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.656449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:26.887517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:01.075398+0000","last_change":"2024-05-15T18:13:01.075430+0000","last_active":"2024-05-15T18:13:01.075398+0000","last_peered":"2024-05-15T18:13:01.075398+0000","last_clean":"2024-05-15T18:13:01.075398+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:13:01.075398+0000","last_undegraded":"2024-05-15T18:13:01.075398+0000","last_fullsized":"2024-05-15T18:13:01.075398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:13:01.075291+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:13:01.075291+0000","last_clean_scrub_stamp":"2024-05-15T18:13:01.075291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:37:13.867162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.095898+0000","last_change":"2024-05-15T18:12:16.095898+0000","last_active":"2024-05-15T18:12:16.095898+0000","last_peered":"2024-05-15T18:12:16.095898+0000","last_clean":"2024-05-15T18:12:16.095898+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:12:16.095898+0000","last_undegraded":"2024-05-15T18:12:16.095898+0000","last_fullsized":"2024-05-15T18:12:16.095898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.095781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:17.249315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.331845+0000","last_change":"2024-05-15T18:12:09.331845+0000","last_active":"2024-05-15T18:12:09.331845+0000","last_peered":"2024-05-15T18:12:09.331845+0000","last_clean":"2024-05-15T18:12:09.331845+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:12:09.331845+0000","last_undegraded":"2024-05-15T18:12:09.331845+0000","last_fullsized":"2024-05-15T18:12:09.331845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.331720+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:28.300746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":471,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.276017+0000","last_change":"2024-05-15T18:12:00.276044+0000","last_active":"2024-05-15T18:12:00.276017+0000","last_peered":"2024-05-15T18:12:00.276017+0000","last_clean":"2024-05-15T18:12:00.276017+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:12:00.276017+0000","last_undegraded":"2024-05-15T18:12:00.276017+0000","last_fullsized":"2024-05-15T18:12:00.276017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.275912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:39.193715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.629539+0000","last_change":"2024-05-15T18:12:45.629539+0000","last_active":"2024-05-15T18:12:45.629539+0000","last_peered":"2024-05-15T18:12:45.629539+0000","last_clean":"2024-05-15T18:12:45.629539+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:12:45.629539+0000","last_undegraded":"2024-05-15T18:12:45.629539+0000","last_fullsized":"2024-05-15T18:12:45.629539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:45.629416+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:45.629416+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.629416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:49.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.032552+0000","last_change":"2024-05-15T18:12:19.032552+0000","last_active":"2024-05-15T18:12:19.032552+0000","last_peered":"2024-05-15T18:12:19.032552+0000","last_clean":"2024-05-15T18:12:19.032552+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:12:19.032552+0000","last_undegraded":"2024-05-15T18:12:19.032552+0000","last_fullsized":"2024-05-15T18:12:19.032552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.032366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:37.619094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:55.176447+0000","last_change":"2024-05-15T18:12:55.176447+0000","last_active":"2024-05-15T18:12:55.176447+0000","last_peered":"2024-05-15T18:12:55.176447+0000","last_clean":"2024-05-15T18:12:55.176447+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:12:55.176447+0000","last_undegraded":"2024-05-15T18:12:55.176447+0000","last_fullsized":"2024-05-15T18:12:55.176447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:55.176293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:55.176293+0000","last_clean_scrub_stamp":"2024-05-15T18:12:55.176293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:03.564362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.354871+0000","last_change":"2024-05-15T18:12:08.354871+0000","last_active":"2024-05-15T18:12:08.354871+0000","last_peered":"2024-05-15T18:12:08.354871+0000","last_clean":"2024-05-15T18:12:08.354871+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:12:08.354871+0000","last_undegraded":"2024-05-15T18:12:08.354871+0000","last_fullsized":"2024-05-15T18:12:08.354871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.354757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:02.756370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.149858+0000","last_change":"2024-05-15T18:12:07.149858+0000","last_active":"2024-05-15T18:12:07.149858+0000","last_peered":"2024-05-15T18:12:07.149858+0000","last_clean":"2024-05-15T18:12:07.149858+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:12:07.149858+0000","last_undegraded":"2024-05-15T18:12:07.149858+0000","last_fullsized":"2024-05-15T18:12:07.149858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.149716+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:51.341623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.495674+0000","last_change":"2024-05-15T18:11:59.495696+0000","last_active":"2024-05-15T18:11:59.495674+0000","last_peered":"2024-05-15T18:11:59.495674+0000","last_clean":"2024-05-15T18:11:59.495674+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:11:59.495674+0000","last_undegraded":"2024-05-15T18:11:59.495674+0000","last_fullsized":"2024-05-15T18:11:59.495674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.495587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:27.408105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.086196+0000","last_change":"2024-05-15T18:12:10.086196+0000","last_active":"2024-05-15T18:12:10.086196+0000","last_peered":"2024-05-15T18:12:10.086196+0000","last_clean":"2024-05-15T18:12:10.086196+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:12:10.086196+0000","last_undegraded":"2024-05-15T18:12:10.086196+0000","last_fullsized":"2024-05-15T18:12:10.086196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.086069+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:14:22.063457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.274855+0000","last_change":"2024-05-15T18:12:15.274855+0000","last_active":"2024-05-15T18:12:15.274855+0000","last_peered":"2024-05-15T18:12:15.274855+0000","last_clean":"2024-05-15T18:12:15.274855+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:12:15.274855+0000","last_undegraded":"2024-05-15T18:12:15.274855+0000","last_fullsized":"2024-05-15T18:12:15.274855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.274744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:50.129521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.016283+0000","last_change":"2024-05-15T18:12:44.016319+0000","last_active":"2024-05-15T18:12:44.016283+0000","last_peered":"2024-05-15T18:12:44.016283+0000","last_clean":"2024-05-15T18:12:44.016283+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:12:44.016283+0000","last_undegraded":"2024-05-15T18:12:44.016283+0000","last_fullsized":"2024-05-15T18:12:44.016283+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-05-15T18:12:44.016193+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-05-15T18:12:44.016193+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.016193+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:53.612988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:07.121715+0000","last_change":"2024-05-15T18:13:07.121739+0000","last_active":"2024-05-15T18:13:07.121715+0000","last_peered":"2024-05-15T18:13:07.121715+0000","last_clean":"2024-05-15T18:13:07.121715+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:13:07.121715+0000","last_undegraded":"2024-05-15T18:13:07.121715+0000","last_fullsized":"2024-05-15T18:13:07.121715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:07.121602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:07.121602+0000","last_clean_scrub_stamp":"2024-05-15T18:13:07.121602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:53.520505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.161399+0000","last_change":"2024-05-15T18:12:48.161399+0000","last_active":"2024-05-15T18:12:48.161399+0000","last_peered":"2024-05-15T18:12:48.161399+0000","last_clean":"2024-05-15T18:12:48.161399+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:12:48.161399+0000","last_undegraded":"2024-05-15T18:12:48.161399+0000","last_fullsized":"2024-05-15T18:12:48.161399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.161262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.161262+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.161262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:54:13.067615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.108833+0000","last_change":"2024-05-15T18:12:15.108833+0000","last_active":"2024-05-15T18:12:15.108833+0000","last_peered":"2024-05-15T18:12:15.108833+0000","last_clean":"2024-05-15T18:12:15.108833+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:12:15.108833+0000","last_undegraded":"2024-05-15T18:12:15.108833+0000","last_fullsized":"2024-05-15T18:12:15.108833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.108718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:50:47.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.302463+0000","last_change":"2024-05-15T18:12:13.302463+0000","last_active":"2024-05-15T18:12:13.302463+0000","last_peered":"2024-05-15T18:12:13.302463+0000","last_clean":"2024-05-15T18:12:13.302463+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:12:13.302463+0000","last_undegraded":"2024-05-15T18:12:13.302463+0000","last_fullsized":"2024-05-15T18:12:13.302463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.302331+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:17.032807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.959264+0000","last_change":"2024-05-15T18:12:13.959264+0000","last_active":"2024-05-15T18:12:13.959264+0000","last_peered":"2024-05-15T18:12:13.959264+0000","last_clean":"2024-05-15T18:12:13.959264+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:12:13.959264+0000","last_undegraded":"2024-05-15T18:12:13.959264+0000","last_fullsized":"2024-05-15T18:12:13.959264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.959124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:07.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.529885+0000","last_change":"2024-05-15T18:12:18.529885+0000","last_active":"2024-05-15T18:12:18.529885+0000","last_peered":"2024-05-15T18:12:18.529885+0000","last_clean":"2024-05-15T18:12:18.529885+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:12:18.529885+0000","last_undegraded":"2024-05-15T18:12:18.529885+0000","last_fullsized":"2024-05-15T18:12:18.529885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'85","last_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_deep_scrub":"31'85","last_deep_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.529758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:29.586821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.150090+0000","last_change":"2024-05-15T18:12:46.150090+0000","last_active":"2024-05-15T18:12:46.150090+0000","last_peered":"2024-05-15T18:12:46.150090+0000","last_clean":"2024-05-15T18:12:46.150090+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:12:46.150090+0000","last_undegraded":"2024-05-15T18:12:46.150090+0000","last_fullsized":"2024-05-15T18:12:46.150090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:46.149947+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.149947+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.149947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:44.752649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:08.172026+0000","last_change":"2024-05-15T18:13:08.172050+0000","last_active":"2024-05-15T18:13:08.172026+0000","last_peered":"2024-05-15T18:13:08.172026+0000","last_clean":"2024-05-15T18:13:08.172026+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:13:08.172026+0000","last_undegraded":"2024-05-15T18:13:08.172026+0000","last_fullsized":"2024-05-15T18:13:08.172026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:08.171935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:08.171935+0000","last_clean_scrub_stamp":"2024-05-15T18:13:08.171935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:44:45.537479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.033076+0000","last_change":"2024-05-15T18:12:50.033123+0000","last_active":"2024-05-15T18:12:50.033076+0000","last_peered":"2024-05-15T18:12:50.033076+0000","last_clean":"2024-05-15T18:12:50.033076+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:12:50.033076+0000","last_undegraded":"2024-05-15T18:12:50.033076+0000","last_fullsized":"2024-05-15T18:12:50.033076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.032969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.032969+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.032969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:38.076744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.426564+0000","last_change":"2024-05-15T18:12:01.426564+0000","last_active":"2024-05-15T18:12:01.426564+0000","last_peered":"2024-05-15T18:12:01.426564+0000","last_clean":"2024-05-15T18:12:01.426564+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:12:01.426564+0000","last_undegraded":"2024-05-15T18:12:01.426564+0000","last_fullsized":"2024-05-15T18:12:01.426564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.426444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:20.013172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'293","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.240363+0000","last_change":"2024-05-15T18:12:03.240363+0000","last_active":"2024-05-15T18:12:03.240363+0000","last_peered":"2024-05-15T18:12:03.240363+0000","last_clean":"2024-05-15T18:12:03.240363+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:12:03.240363+0000","last_undegraded":"2024-05-15T18:12:03.240363+0000","last_fullsized":"2024-05-15T18:12:03.240363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'293","last_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_deep_scrub":"31'293","last_deep_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.240231+0000","objects_scrubbed":10,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:29:17.206611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.216735+0000","last_change":"2024-05-15T18:12:33.216735+0000","last_active":"2024-05-15T18:12:33.216735+0000","last_peered":"2024-05-15T18:12:33.216735+0000","last_clean":"2024-05-15T18:12:33.216735+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:12:33.216735+0000","last_undegraded":"2024-05-15T18:12:33.216735+0000","last_fullsized":"2024-05-15T18:12:33.216735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.216625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:46.914136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.079442+0000","last_change":"2024-05-15T18:12:18.079442+0000","last_active":"2024-05-15T18:12:18.079442+0000","last_peered":"2024-05-15T18:12:18.079442+0000","last_clean":"2024-05-15T18:12:18.079442+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:12:18.079442+0000","last_undegraded":"2024-05-15T18:12:18.079442+0000","last_fullsized":"2024-05-15T18:12:18.079442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.079282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:50.563689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.972287+0000","last_change":"2024-05-15T18:12:51.972287+0000","last_active":"2024-05-15T18:12:51.972287+0000","last_peered":"2024-05-15T18:12:51.972287+0000","last_clean":"2024-05-15T18:12:51.972287+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:12:51.972287+0000","last_undegraded":"2024-05-15T18:12:51.972287+0000","last_fullsized":"2024-05-15T18:12:51.972287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:51.972153+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:51.972153+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.972153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:36.602233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.590983+0000","last_change":"2024-05-15T18:12:36.590983+0000","last_active":"2024-05-15T18:12:36.590983+0000","last_peered":"2024-05-15T18:12:36.590983+0000","last_clean":"2024-05-15T18:12:36.590983+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:12:36.590983+0000","last_undegraded":"2024-05-15T18:12:36.590983+0000","last_fullsized":"2024-05-15T18:12:36.590983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:36.590813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:36.590813+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.590813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:57.873273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.125701+0000","last_change":"2024-05-15T18:12:46.125729+0000","last_active":"2024-05-15T18:12:46.125701+0000","last_peered":"2024-05-15T18:12:46.125701+0000","last_clean":"2024-05-15T18:12:46.125701+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:12:46.125701+0000","last_undegraded":"2024-05-15T18:12:46.125701+0000","last_fullsized":"2024-05-15T18:12:46.125701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:46.125590+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.125590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.125590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:16:40.358922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.560727+0000","last_change":"2024-05-15T18:12:51.560727+0000","last_active":"2024-05-15T18:12:51.560727+0000","last_peered":"2024-05-15T18:12:51.560727+0000","last_clean":"2024-05-15T18:12:51.560727+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:12:51.560727+0000","last_undegraded":"2024-05-15T18:12:51.560727+0000","last_fullsized":"2024-05-15T18:12:51.560727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:51.560605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:51.560605+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.560605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:01.157400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.543438+0000","last_change":"2024-05-15T18:12:07.543438+0000","last_active":"2024-05-15T18:12:07.543438+0000","last_peered":"2024-05-15T18:12:07.543438+0000","last_clean":"2024-05-15T18:12:07.543438+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:12:07.543438+0000","last_undegraded":"2024-05-15T18:12:07.543438+0000","last_fullsized":"2024-05-15T18:12:07.543438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.543314+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:32.467749+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.928898+0000","last_change":"2024-05-15T18:11:57.928898+0000","last_active":"2024-05-15T18:11:57.928898+0000","last_peered":"2024-05-15T18:11:57.928898+0000","last_clean":"2024-05-15T18:11:57.928898+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:11:57.928898+0000","last_undegraded":"2024-05-15T18:11:57.928898+0000","last_fullsized":"2024-05-15T18:11:57.928898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.928793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.522391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.124590+0000","last_change":"2024-05-15T18:12:49.124614+0000","last_active":"2024-05-15T18:12:49.124590+0000","last_peered":"2024-05-15T18:12:49.124590+0000","last_clean":"2024-05-15T18:12:49.124590+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:12:49.124590+0000","last_undegraded":"2024-05-15T18:12:49.124590+0000","last_fullsized":"2024-05-15T18:12:49.124590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:49.124505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:49.124505+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.124505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:44:13.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.125516+0000","last_change":"2024-05-15T18:12:38.125516+0000","last_active":"2024-05-15T18:12:38.125516+0000","last_peered":"2024-05-15T18:12:38.125516+0000","last_clean":"2024-05-15T18:12:38.125516+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:12:38.125516+0000","last_undegraded":"2024-05-15T18:12:38.125516+0000","last_fullsized":"2024-05-15T18:12:38.125516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-05-15T18:12:38.125335+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-05-15T18:12:38.125335+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.125335+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:38.435114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:10.147042+0000","last_change":"2024-05-15T18:13:10.147066+0000","last_active":"2024-05-15T18:13:10.147042+0000","last_peered":"2024-05-15T18:13:10.147042+0000","last_clean":"2024-05-15T18:13:10.147042+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:13:10.147042+0000","last_undegraded":"2024-05-15T18:13:10.147042+0000","last_fullsized":"2024-05-15T18:13:10.147042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:10.146942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:10.146942+0000","last_clean_scrub_stamp":"2024-05-15T18:13:10.146942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:13.846284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.545692+0000","last_change":"2024-05-15T18:12:37.545692+0000","last_active":"2024-05-15T18:12:37.545692+0000","last_peered":"2024-05-15T18:12:37.545692+0000","last_clean":"2024-05-15T18:12:37.545692+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:12:37.545692+0000","last_undegraded":"2024-05-15T18:12:37.545692+0000","last_fullsized":"2024-05-15T18:12:37.545692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.545580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.545580+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.545580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:29.736129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.016404+0000","last_change":"2024-05-15T18:12:17.016404+0000","last_active":"2024-05-15T18:12:17.016404+0000","last_peered":"2024-05-15T18:12:17.016404+0000","last_clean":"2024-05-15T18:12:17.016404+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:12:17.016404+0000","last_undegraded":"2024-05-15T18:12:17.016404+0000","last_fullsized":"2024-05-15T18:12:17.016404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.016284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:25.998584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.380243+0000","last_change":"2024-05-15T18:12:05.380243+0000","last_active":"2024-05-15T18:12:05.380243+0000","last_peered":"2024-05-15T18:12:05.380243+0000","last_clean":"2024-05-15T18:12:05.380243+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:12:05.380243+0000","last_undegraded":"2024-05-15T18:12:05.380243+0000","last_fullsized":"2024-05-15T18:12:05.380243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.380117+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:27.585526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.174237+0000","last_change":"2024-05-15T18:12:37.174237+0000","last_active":"2024-05-15T18:12:37.174237+0000","last_peered":"2024-05-15T18:12:37.174237+0000","last_clean":"2024-05-15T18:12:37.174237+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:12:37.174237+0000","last_undegraded":"2024-05-15T18:12:37.174237+0000","last_fullsized":"2024-05-15T18:12:37.174237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.174120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.174120+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.174120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:57.846747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.010324+0000","last_change":"2024-05-15T18:12:26.010324+0000","last_active":"2024-05-15T18:12:26.010324+0000","last_peered":"2024-05-15T18:12:26.010324+0000","last_clean":"2024-05-15T18:12:26.010324+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:12:26.010324+0000","last_undegraded":"2024-05-15T18:12:26.010324+0000","last_fullsized":"2024-05-15T18:12:26.010324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.010213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:44.979239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'8","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.995202+0000","last_change":"2024-05-15T18:12:19.995202+0000","last_active":"2024-05-15T18:12:19.995202+0000","last_peered":"2024-05-15T18:12:19.995202+0000","last_clean":"2024-05-15T18:12:19.995202+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:12:19.995202+0000","last_undegraded":"2024-05-15T18:12:19.995202+0000","last_fullsized":"2024-05-15T18:12:19.995202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.995046+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:22.542569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.601468+0000","last_change":"2024-05-15T18:12:39.601468+0000","last_active":"2024-05-15T18:12:39.601468+0000","last_peered":"2024-05-15T18:12:39.601468+0000","last_clean":"2024-05-15T18:12:39.601468+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:12:39.601468+0000","last_undegraded":"2024-05-15T18:12:39.601468+0000","last_fullsized":"2024-05-15T18:12:39.601468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-15T18:12:39.601344+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-15T18:12:39.601344+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.601344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:45:07.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.094140+0000","last_change":"2024-05-15T18:12:45.094166+0000","last_active":"2024-05-15T18:12:45.094140+0000","last_peered":"2024-05-15T18:12:45.094140+0000","last_clean":"2024-05-15T18:12:45.094140+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:12:45.094140+0000","last_undegraded":"2024-05-15T18:12:45.094140+0000","last_fullsized":"2024-05-15T18:12:45.094140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:45.094050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:45.094050+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.094050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:38:47.944537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.927216+0000","last_change":"2024-05-15T18:12:12.927216+0000","last_active":"2024-05-15T18:12:12.927216+0000","last_peered":"2024-05-15T18:12:12.927216+0000","last_clean":"2024-05-15T18:12:12.927216+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:12:12.927216+0000","last_undegraded":"2024-05-15T18:12:12.927216+0000","last_fullsized":"2024-05-15T18:12:12.927216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.927083+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:24.672114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.879840+0000","last_change":"2024-05-15T18:12:06.879840+0000","last_active":"2024-05-15T18:12:06.879840+0000","last_peered":"2024-05-15T18:12:06.879840+0000","last_clean":"2024-05-15T18:12:06.879840+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:12:06.879840+0000","last_undegraded":"2024-05-15T18:12:06.879840+0000","last_fullsized":"2024-05-15T18:12:06.879840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.879711+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:16.898190+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.431143+0000","last_change":"2024-05-15T18:12:01.431143+0000","last_active":"2024-05-15T18:12:01.431143+0000","last_peered":"2024-05-15T18:12:01.431143+0000","last_clean":"2024-05-15T18:12:01.431143+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:12:01.431143+0000","last_undegraded":"2024-05-15T18:12:01.431143+0000","last_fullsized":"2024-05-15T18:12:01.431143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.431023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:47.755595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.148347+0000","last_change":"2024-05-15T18:12:26.148381+0000","last_active":"2024-05-15T18:12:26.148347+0000","last_peered":"2024-05-15T18:12:26.148347+0000","last_clean":"2024-05-15T18:12:26.148347+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:12:26.148347+0000","last_undegraded":"2024-05-15T18:12:26.148347+0000","last_fullsized":"2024-05-15T18:12:26.148347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.148259+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:59.103311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:58.846721+0000","last_change":"2024-05-15T18:12:58.846748+0000","last_active":"2024-05-15T18:12:58.846721+0000","last_peered":"2024-05-15T18:12:58.846721+0000","last_clean":"2024-05-15T18:12:58.846721+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:12:58.846721+0000","last_undegraded":"2024-05-15T18:12:58.846721+0000","last_fullsized":"2024-05-15T18:12:58.846721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:58.846626+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:58.846626+0000","last_clean_scrub_stamp":"2024-05-15T18:12:58.846626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:16:11.649813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.120801+0000","last_change":"2024-05-15T18:12:37.120801+0000","last_active":"2024-05-15T18:12:37.120801+0000","last_peered":"2024-05-15T18:12:37.120801+0000","last_clean":"2024-05-15T18:12:37.120801+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:12:37.120801+0000","last_undegraded":"2024-05-15T18:12:37.120801+0000","last_fullsized":"2024-05-15T18:12:37.120801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.120650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.120650+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.120650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:09.173327+0000","last_change":"2024-05-15T18:13:09.173350+0000","last_active":"2024-05-15T18:13:09.173327+0000","last_peered":"2024-05-15T18:13:09.173327+0000","last_clean":"2024-05-15T18:13:09.173327+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:13:09.173327+0000","last_undegraded":"2024-05-15T18:13:09.173327+0000","last_fullsized":"2024-05-15T18:13:09.173327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:09.173216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:09.173216+0000","last_clean_scrub_stamp":"2024-05-15T18:13:09.173216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:56.796133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.391600+0000","last_change":"2024-05-15T18:12:02.391600+0000","last_active":"2024-05-15T18:12:02.391600+0000","last_peered":"2024-05-15T18:12:02.391600+0000","last_clean":"2024-05-15T18:12:02.391600+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:12:02.391600+0000","last_undegraded":"2024-05-15T18:12:02.391600+0000","last_fullsized":"2024-05-15T18:12:02.391600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.391444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:04.938967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.233258+0000","last_change":"2024-05-15T18:12:01.233258+0000","last_active":"2024-05-15T18:12:01.233258+0000","last_peered":"2024-05-15T18:12:01.233258+0000","last_clean":"2024-05-15T18:12:01.233258+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:12:01.233258+0000","last_undegraded":"2024-05-15T18:12:01.233258+0000","last_fullsized":"2024-05-15T18:12:01.233258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.233115+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:11.007085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":359,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.323821+0000","last_change":"2024-05-15T18:11:58.323821+0000","last_active":"2024-05-15T18:11:58.323821+0000","last_peered":"2024-05-15T18:11:58.323821+0000","last_clean":"2024-05-15T18:11:58.323821+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:58.323821+0000","last_undegraded":"2024-05-15T18:11:58.323821+0000","last_fullsized":"2024-05-15T18:11:58.323821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.323633+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.917231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396379+0000","last_change":"2024-05-15T18:08:47.221544+0000","last_active":"2024-05-15T18:11:03.396379+0000","last_peered":"2024-05-15T18:11:03.396379+0000","last_clean":"2024-05-15T18:11:03.396379+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:11:03.396379+0000","last_undegraded":"2024-05-15T18:11:03.396379+0000","last_fullsized":"2024-05-15T18:11:03.396379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.223814+0000","last_change":"2024-05-15T18:12:18.223814+0000","last_active":"2024-05-15T18:12:18.223814+0000","last_peered":"2024-05-15T18:12:18.223814+0000","last_clean":"2024-05-15T18:12:18.223814+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:12:18.223814+0000","last_undegraded":"2024-05-15T18:12:18.223814+0000","last_fullsized":"2024-05-15T18:12:18.223814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.223691+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:06.085124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:57.157882+0000","last_change":"2024-05-15T18:12:57.157882+0000","last_active":"2024-05-15T18:12:57.157882+0000","last_peered":"2024-05-15T18:12:57.157882+0000","last_clean":"2024-05-15T18:12:57.157882+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:12:57.157882+0000","last_undegraded":"2024-05-15T18:12:57.157882+0000","last_fullsized":"2024-05-15T18:12:57.157882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:57.157735+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:57.157735+0000","last_clean_scrub_stamp":"2024-05-15T18:12:57.157735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:55:19.006387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.127693+0000","last_change":"2024-05-15T18:12:44.127693+0000","last_active":"2024-05-15T18:12:44.127693+0000","last_peered":"2024-05-15T18:12:44.127693+0000","last_clean":"2024-05-15T18:12:44.127693+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:12:44.127693+0000","last_undegraded":"2024-05-15T18:12:44.127693+0000","last_fullsized":"2024-05-15T18:12:44.127693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:44.127568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:44.127568+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.127568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:12.123278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.358934+0000","last_change":"2024-05-15T18:12:06.358934+0000","last_active":"2024-05-15T18:12:06.358934+0000","last_peered":"2024-05-15T18:12:06.358934+0000","last_clean":"2024-05-15T18:12:06.358934+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:12:06.358934+0000","last_undegraded":"2024-05-15T18:12:06.358934+0000","last_fullsized":"2024-05-15T18:12:06.358934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.358819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:07.242813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.224031+0000","last_change":"2024-05-15T18:12:23.224031+0000","last_active":"2024-05-15T18:12:23.224031+0000","last_peered":"2024-05-15T18:12:23.224031+0000","last_clean":"2024-05-15T18:12:23.224031+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:12:23.224031+0000","last_undegraded":"2024-05-15T18:12:23.224031+0000","last_fullsized":"2024-05-15T18:12:23.224031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.223908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:27.882071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":402,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.886655+0000","last_change":"2024-05-15T18:12:02.886655+0000","last_active":"2024-05-15T18:12:02.886655+0000","last_peered":"2024-05-15T18:12:02.886655+0000","last_clean":"2024-05-15T18:12:02.886655+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:12:02.886655+0000","last_undegraded":"2024-05-15T18:12:02.886655+0000","last_fullsized":"2024-05-15T18:12:02.886655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.886536+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:13.272929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.857023+0000","last_change":"2024-05-15T18:12:52.857048+0000","last_active":"2024-05-15T18:12:52.857023+0000","last_peered":"2024-05-15T18:12:52.857023+0000","last_clean":"2024-05-15T18:12:52.857023+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:12:52.857023+0000","last_undegraded":"2024-05-15T18:12:52.857023+0000","last_fullsized":"2024-05-15T18:12:52.857023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-15T18:12:52.856931+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-15T18:12:52.856931+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.856931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:23:08.871415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.562885+0000","last_change":"2024-05-15T18:12:30.562885+0000","last_active":"2024-05-15T18:12:30.562885+0000","last_peered":"2024-05-15T18:12:30.562885+0000","last_clean":"2024-05-15T18:12:30.562885+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:12:30.562885+0000","last_undegraded":"2024-05-15T18:12:30.562885+0000","last_fullsized":"2024-05-15T18:12:30.562885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.562719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:21.698936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.977312+0000","last_change":"2024-05-15T18:12:36.977312+0000","last_active":"2024-05-15T18:12:36.977312+0000","last_peered":"2024-05-15T18:12:36.977312+0000","last_clean":"2024-05-15T18:12:36.977312+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:12:36.977312+0000","last_undegraded":"2024-05-15T18:12:36.977312+0000","last_fullsized":"2024-05-15T18:12:36.977312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:36.977151+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:36.977151+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.977151+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:32.112263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:11.104551+0000","last_change":"2024-05-15T18:13:11.104590+0000","last_active":"2024-05-15T18:13:11.104551+0000","last_peered":"2024-05-15T18:13:11.104551+0000","last_clean":"2024-05-15T18:13:11.104551+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:13:11.104551+0000","last_undegraded":"2024-05-15T18:13:11.104551+0000","last_fullsized":"2024-05-15T18:13:11.104551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:11.104445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:11.104445+0000","last_clean_scrub_stamp":"2024-05-15T18:13:11.104445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:37:36.173056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.448854+0000","last_change":"2024-05-15T18:11:59.448854+0000","last_active":"2024-05-15T18:11:59.448854+0000","last_peered":"2024-05-15T18:11:59.448854+0000","last_clean":"2024-05-15T18:11:59.448854+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:11:59.448854+0000","last_undegraded":"2024-05-15T18:11:59.448854+0000","last_fullsized":"2024-05-15T18:11:59.448854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.448742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:12:37.217420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.502595+0000","last_change":"2024-05-15T18:12:04.502595+0000","last_active":"2024-05-15T18:12:04.502595+0000","last_peered":"2024-05-15T18:12:04.502595+0000","last_clean":"2024-05-15T18:12:04.502595+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:12:04.502595+0000","last_undegraded":"2024-05-15T18:12:04.502595+0000","last_fullsized":"2024-05-15T18:12:04.502595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.502398+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:28.778374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:56.955872+0000","last_change":"2024-05-15T18:11:56.955872+0000","last_active":"2024-05-15T18:11:56.955872+0000","last_peered":"2024-05-15T18:11:56.955872+0000","last_clean":"2024-05-15T18:11:56.955872+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:11:56.955872+0000","last_undegraded":"2024-05-15T18:11:56.955872+0000","last_fullsized":"2024-05-15T18:11:56.955872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_clean_scrub_stamp":"2024-05-15T18:11:56.955763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:30.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.566752+0000","last_change":"2024-05-15T18:12:14.566798+0000","last_active":"2024-05-15T18:12:14.566752+0000","last_peered":"2024-05-15T18:12:14.566752+0000","last_clean":"2024-05-15T18:12:14.566752+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:12:14.566752+0000","last_undegraded":"2024-05-15T18:12:14.566752+0000","last_fullsized":"2024-05-15T18:12:14.566752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.566649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:21.835682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.588093+0000","last_change":"2024-05-15T18:12:46.588093+0000","last_active":"2024-05-15T18:12:46.588093+0000","last_peered":"2024-05-15T18:12:46.588093+0000","last_clean":"2024-05-15T18:12:46.588093+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:12:46.588093+0000","last_undegraded":"2024-05-15T18:12:46.588093+0000","last_fullsized":"2024-05-15T18:12:46.588093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:46.587943+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:46.587943+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.587943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:46.897722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.511624+0000","last_change":"2024-05-15T18:12:32.511652+0000","last_active":"2024-05-15T18:12:32.511624+0000","last_peered":"2024-05-15T18:12:32.511624+0000","last_clean":"2024-05-15T18:12:32.511624+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:12:32.511624+0000","last_undegraded":"2024-05-15T18:12:32.511624+0000","last_fullsized":"2024-05-15T18:12:32.511624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.511538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:33.395531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:05.080385+0000","last_change":"2024-05-15T18:13:05.080422+0000","last_active":"2024-05-15T18:13:05.080385+0000","last_peered":"2024-05-15T18:13:05.080385+0000","last_clean":"2024-05-15T18:13:05.080385+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:13:05.080385+0000","last_undegraded":"2024-05-15T18:13:05.080385+0000","last_fullsized":"2024-05-15T18:13:05.080385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:05.080234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:05.080234+0000","last_clean_scrub_stamp":"2024-05-15T18:13:05.080234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:40:14.056942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:55.876748+0000","last_change":"2024-05-15T18:12:55.876773+0000","last_active":"2024-05-15T18:12:55.876748+0000","last_peered":"2024-05-15T18:12:55.876748+0000","last_clean":"2024-05-15T18:12:55.876748+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:12:55.876748+0000","last_undegraded":"2024-05-15T18:12:55.876748+0000","last_fullsized":"2024-05-15T18:12:55.876748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:55.876645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:55.876645+0000","last_clean_scrub_stamp":"2024-05-15T18:12:55.876645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:29:29.771088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'40","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.350517+0000","last_change":"2024-05-15T18:12:11.350568+0000","last_active":"2024-05-15T18:12:11.350517+0000","last_peered":"2024-05-15T18:12:11.350517+0000","last_clean":"2024-05-15T18:12:11.350517+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:12:11.350517+0000","last_undegraded":"2024-05-15T18:12:11.350517+0000","last_fullsized":"2024-05-15T18:12:11.350517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.350399+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:11.134147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.232158+0000","last_change":"2024-05-15T18:12:21.232183+0000","last_active":"2024-05-15T18:12:21.232158+0000","last_peered":"2024-05-15T18:12:21.232158+0000","last_clean":"2024-05-15T18:12:21.232158+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:12:21.232158+0000","last_undegraded":"2024-05-15T18:12:21.232158+0000","last_fullsized":"2024-05-15T18:12:21.232158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.232063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:21.541842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:55.969064+0000","last_change":"2024-05-15T18:12:55.969092+0000","last_active":"2024-05-15T18:12:55.969064+0000","last_peered":"2024-05-15T18:12:55.969064+0000","last_clean":"2024-05-15T18:12:55.969064+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:12:55.969064+0000","last_undegraded":"2024-05-15T18:12:55.969064+0000","last_fullsized":"2024-05-15T18:12:55.969064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:55.968973+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:55.968973+0000","last_clean_scrub_stamp":"2024-05-15T18:12:55.968973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:32.811172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.980328+0000","last_change":"2024-05-15T18:12:24.980362+0000","last_active":"2024-05-15T18:12:24.980328+0000","last_peered":"2024-05-15T18:12:24.980328+0000","last_clean":"2024-05-15T18:12:24.980328+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:12:24.980328+0000","last_undegraded":"2024-05-15T18:12:24.980328+0000","last_fullsized":"2024-05-15T18:12:24.980328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.980229+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:19.381841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.546242+0000","last_change":"2024-05-15T18:12:35.546282+0000","last_active":"2024-05-15T18:12:35.546242+0000","last_peered":"2024-05-15T18:12:35.546242+0000","last_clean":"2024-05-15T18:12:35.546242+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:12:35.546242+0000","last_undegraded":"2024-05-15T18:12:35.546242+0000","last_fullsized":"2024-05-15T18:12:35.546242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:35.546148+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:35.546148+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.546148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:23:08.501199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.464665+0000","last_change":"2024-05-15T18:11:58.464695+0000","last_active":"2024-05-15T18:11:58.464665+0000","last_peered":"2024-05-15T18:11:58.464665+0000","last_clean":"2024-05-15T18:11:58.464665+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:11:58.464665+0000","last_undegraded":"2024-05-15T18:11:58.464665+0000","last_fullsized":"2024-05-15T18:11:58.464665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.464557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:27.556332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'8","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.875011+0000","last_change":"2024-05-15T18:12:08.875048+0000","last_active":"2024-05-15T18:12:08.875011+0000","last_peered":"2024-05-15T18:12:08.875011+0000","last_clean":"2024-05-15T18:12:08.875011+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:12:08.875011+0000","last_undegraded":"2024-05-15T18:12:08.875011+0000","last_fullsized":"2024-05-15T18:12:08.875011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.874911+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:19.931974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.544246+0000","last_change":"2024-05-15T18:12:10.544278+0000","last_active":"2024-05-15T18:12:10.544246+0000","last_peered":"2024-05-15T18:12:10.544246+0000","last_clean":"2024-05-15T18:12:10.544246+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:12:10.544246+0000","last_undegraded":"2024-05-15T18:12:10.544246+0000","last_fullsized":"2024-05-15T18:12:10.544246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.544159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:52.334749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.126720+0000","last_change":"2024-05-15T18:12:22.126750+0000","last_active":"2024-05-15T18:12:22.126720+0000","last_peered":"2024-05-15T18:12:22.126720+0000","last_clean":"2024-05-15T18:12:22.126720+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:12:22.126720+0000","last_undegraded":"2024-05-15T18:12:22.126720+0000","last_fullsized":"2024-05-15T18:12:22.126720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.126615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:44.332025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.156074+0000","last_change":"2024-05-15T18:12:28.156098+0000","last_active":"2024-05-15T18:12:28.156074+0000","last_peered":"2024-05-15T18:12:28.156074+0000","last_clean":"2024-05-15T18:12:28.156074+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:12:28.156074+0000","last_undegraded":"2024-05-15T18:12:28.156074+0000","last_fullsized":"2024-05-15T18:12:28.156074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.155985+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:20.346535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.574489+0000","last_change":"2024-05-15T18:12:42.574548+0000","last_active":"2024-05-15T18:12:42.574489+0000","last_peered":"2024-05-15T18:12:42.574489+0000","last_clean":"2024-05-15T18:12:42.574489+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:12:42.574489+0000","last_undegraded":"2024-05-15T18:12:42.574489+0000","last_fullsized":"2024-05-15T18:12:42.574489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:42.574370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:42.574370+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.574370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:31.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.579110+0000","last_change":"2024-05-15T18:12:12.579133+0000","last_active":"2024-05-15T18:12:12.579110+0000","last_peered":"2024-05-15T18:12:12.579110+0000","last_clean":"2024-05-15T18:12:12.579110+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:12:12.579110+0000","last_undegraded":"2024-05-15T18:12:12.579110+0000","last_fullsized":"2024-05-15T18:12:12.579110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.579011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:22.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'48","reported_seq":120,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.881810+0000","last_change":"2024-05-15T18:12:11.881882+0000","last_active":"2024-05-15T18:12:11.881810+0000","last_peered":"2024-05-15T18:12:11.881810+0000","last_clean":"2024-05-15T18:12:11.881810+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:12:11.881810+0000","last_undegraded":"2024-05-15T18:12:11.881810+0000","last_fullsized":"2024-05-15T18:12:11.881810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.881671+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:22.316063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.359537+0000","last_change":"2024-05-15T18:11:57.359562+0000","last_active":"2024-05-15T18:11:57.359537+0000","last_peered":"2024-05-15T18:11:57.359537+0000","last_clean":"2024-05-15T18:11:57.359537+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:11:57.359537+0000","last_undegraded":"2024-05-15T18:11:57.359537+0000","last_fullsized":"2024-05-15T18:11:57.359537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.359393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:31.155528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:18.398472+0000","last_change":"2024-05-15T18:08:47.222071+0000","last_active":"2024-05-15T18:11:18.398472+0000","last_peered":"2024-05-15T18:11:18.398472+0000","last_clean":"2024-05-15T18:11:18.398472+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:11:18.398472+0000","last_undegraded":"2024-05-15T18:11:18.398472+0000","last_fullsized":"2024-05-15T18:11:18.398472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.235644+0000","last_change":"2024-05-15T18:12:16.235673+0000","last_active":"2024-05-15T18:12:16.235644+0000","last_peered":"2024-05-15T18:12:16.235644+0000","last_clean":"2024-05-15T18:12:16.235644+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:12:16.235644+0000","last_undegraded":"2024-05-15T18:12:16.235644+0000","last_fullsized":"2024-05-15T18:12:16.235644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.235558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:08.093786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.918478+0000","last_change":"2024-05-15T18:12:47.918512+0000","last_active":"2024-05-15T18:12:47.918478+0000","last_peered":"2024-05-15T18:12:47.918478+0000","last_clean":"2024-05-15T18:12:47.918478+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:12:47.918478+0000","last_undegraded":"2024-05-15T18:12:47.918478+0000","last_fullsized":"2024-05-15T18:12:47.918478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:47.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:47.918385+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:38.973477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.315137+0000","last_change":"2024-05-15T18:12:07.315160+0000","last_active":"2024-05-15T18:12:07.315137+0000","last_peered":"2024-05-15T18:12:07.315137+0000","last_clean":"2024-05-15T18:12:07.315137+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:12:07.315137+0000","last_undegraded":"2024-05-15T18:12:07.315137+0000","last_fullsized":"2024-05-15T18:12:07.315137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.315047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:28.990916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.589070+0000","last_change":"2024-05-15T18:12:08.589118+0000","last_active":"2024-05-15T18:12:08.589070+0000","last_peered":"2024-05-15T18:12:08.589070+0000","last_clean":"2024-05-15T18:12:08.589070+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:12:08.589070+0000","last_undegraded":"2024-05-15T18:12:08.589070+0000","last_fullsized":"2024-05-15T18:12:08.589070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.588987+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:48.582117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.517728+0000","last_change":"2024-05-15T18:11:58.517779+0000","last_active":"2024-05-15T18:11:58.517728+0000","last_peered":"2024-05-15T18:11:58.517728+0000","last_clean":"2024-05-15T18:11:58.517728+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:11:58.517728+0000","last_undegraded":"2024-05-15T18:11:58.517728+0000","last_fullsized":"2024-05-15T18:11:58.517728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.517616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:10:30.693406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.201458+0000","last_change":"2024-05-15T18:12:35.201458+0000","last_active":"2024-05-15T18:12:35.201458+0000","last_peered":"2024-05-15T18:12:35.201458+0000","last_clean":"2024-05-15T18:12:35.201458+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:12:35.201458+0000","last_undegraded":"2024-05-15T18:12:35.201458+0000","last_fullsized":"2024-05-15T18:12:35.201458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:35.201346+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:35.201346+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.201346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:19.831426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:03.396177+0000","last_change":"2024-05-15T18:08:37.177574+0000","last_active":"2024-05-15T18:11:03.396177+0000","last_peered":"2024-05-15T18:11:03.396177+0000","last_clean":"2024-05-15T18:11:03.396177+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:11:03.396177+0000","last_undegraded":"2024-05-15T18:11:03.396177+0000","last_fullsized":"2024-05-15T18:11:03.396177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:36.152345+0000","last_clean_scrub_stamp":"2024-05-15T18:08:36.152345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.052545+0000","last_change":"2024-05-15T18:12:20.052545+0000","last_active":"2024-05-15T18:12:20.052545+0000","last_peered":"2024-05-15T18:12:20.052545+0000","last_clean":"2024-05-15T18:12:20.052545+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:12:20.052545+0000","last_undegraded":"2024-05-15T18:12:20.052545+0000","last_fullsized":"2024-05-15T18:12:20.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.052417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:32.618399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.892641+0000","last_change":"2024-05-15T18:12:10.892676+0000","last_active":"2024-05-15T18:12:10.892641+0000","last_peered":"2024-05-15T18:12:10.892641+0000","last_clean":"2024-05-15T18:12:10.892641+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:12:10.892641+0000","last_undegraded":"2024-05-15T18:12:10.892641+0000","last_fullsized":"2024-05-15T18:12:10.892641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.892546+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:09.452875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.474146+0000","last_change":"2024-05-15T18:12:02.474184+0000","last_active":"2024-05-15T18:12:02.474146+0000","last_peered":"2024-05-15T18:12:02.474146+0000","last_clean":"2024-05-15T18:12:02.474146+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:12:02.474146+0000","last_undegraded":"2024-05-15T18:12:02.474146+0000","last_fullsized":"2024-05-15T18:12:02.474146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.474022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:25:37.061500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.960397+0000","last_change":"2024-05-15T18:12:53.960424+0000","last_active":"2024-05-15T18:12:53.960397+0000","last_peered":"2024-05-15T18:12:53.960397+0000","last_clean":"2024-05-15T18:12:53.960397+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:12:53.960397+0000","last_undegraded":"2024-05-15T18:12:53.960397+0000","last_fullsized":"2024-05-15T18:12:53.960397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:53.960302+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:53.960302+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.960302+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:15:21.988407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.088216+0000","last_change":"2024-05-15T18:12:42.088243+0000","last_active":"2024-05-15T18:12:42.088216+0000","last_peered":"2024-05-15T18:12:42.088216+0000","last_clean":"2024-05-15T18:12:42.088216+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:12:42.088216+0000","last_undegraded":"2024-05-15T18:12:42.088216+0000","last_fullsized":"2024-05-15T18:12:42.088216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:42.088128+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:42.088128+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.088128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:26:47.954467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:56.832268+0000","last_change":"2024-05-15T18:12:56.832295+0000","last_active":"2024-05-15T18:12:56.832268+0000","last_peered":"2024-05-15T18:12:56.832268+0000","last_clean":"2024-05-15T18:12:56.832268+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:12:56.832268+0000","last_undegraded":"2024-05-15T18:12:56.832268+0000","last_fullsized":"2024-05-15T18:12:56.832268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:56.832182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:56.832182+0000","last_clean_scrub_stamp":"2024-05-15T18:12:56.832182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.674380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.537137+0000","last_change":"2024-05-15T18:12:15.537137+0000","last_active":"2024-05-15T18:12:15.537137+0000","last_peered":"2024-05-15T18:12:15.537137+0000","last_clean":"2024-05-15T18:12:15.537137+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:12:15.537137+0000","last_undegraded":"2024-05-15T18:12:15.537137+0000","last_fullsized":"2024-05-15T18:12:15.537137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.536986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:59.728892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.224399+0000","last_change":"2024-05-15T18:12:30.224462+0000","last_active":"2024-05-15T18:12:30.224399+0000","last_peered":"2024-05-15T18:12:30.224399+0000","last_clean":"2024-05-15T18:12:30.224399+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:12:30.224399+0000","last_undegraded":"2024-05-15T18:12:30.224399+0000","last_fullsized":"2024-05-15T18:12:30.224399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.224290+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:21.279383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.212353+0000","last_change":"2024-05-15T18:12:02.212375+0000","last_active":"2024-05-15T18:12:02.212353+0000","last_peered":"2024-05-15T18:12:02.212353+0000","last_clean":"2024-05-15T18:12:02.212353+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:12:02.212353+0000","last_undegraded":"2024-05-15T18:12:02.212353+0000","last_fullsized":"2024-05-15T18:12:02.212353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.212266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:31.297851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.193880+0000","last_change":"2024-05-15T18:12:41.193919+0000","last_active":"2024-05-15T18:12:41.193880+0000","last_peered":"2024-05-15T18:12:41.193880+0000","last_clean":"2024-05-15T18:12:41.193880+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:12:41.193880+0000","last_undegraded":"2024-05-15T18:12:41.193880+0000","last_fullsized":"2024-05-15T18:12:41.193880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:41.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:41.193780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.193780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:13:46.031668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.265264+0000","last_change":"2024-05-15T18:12:14.265289+0000","last_active":"2024-05-15T18:12:14.265264+0000","last_peered":"2024-05-15T18:12:14.265264+0000","last_clean":"2024-05-15T18:12:14.265264+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:12:14.265264+0000","last_undegraded":"2024-05-15T18:12:14.265264+0000","last_fullsized":"2024-05-15T18:12:14.265264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.265178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:00:30.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.953534+0000","last_change":"2024-05-15T18:12:46.953579+0000","last_active":"2024-05-15T18:12:46.953534+0000","last_peered":"2024-05-15T18:12:46.953534+0000","last_clean":"2024-05-15T18:12:46.953534+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:12:46.953534+0000","last_undegraded":"2024-05-15T18:12:46.953534+0000","last_fullsized":"2024-05-15T18:12:46.953534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:46.953407+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.953407+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.953407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:17:48.733387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.544729+0000","last_change":"2024-05-15T18:12:16.544771+0000","last_active":"2024-05-15T18:12:16.544729+0000","last_peered":"2024-05-15T18:12:16.544729+0000","last_clean":"2024-05-15T18:12:16.544729+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:12:16.544729+0000","last_undegraded":"2024-05-15T18:12:16.544729+0000","last_fullsized":"2024-05-15T18:12:16.544729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.544617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:26.563096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.854126+0000","last_change":"2024-05-15T18:12:04.854126+0000","last_active":"2024-05-15T18:12:04.854126+0000","last_peered":"2024-05-15T18:12:04.854126+0000","last_clean":"2024-05-15T18:12:04.854126+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:12:04.854126+0000","last_undegraded":"2024-05-15T18:12:04.854126+0000","last_fullsized":"2024-05-15T18:12:04.854126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.853980+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:12.123012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.875755+0000","last_change":"2024-05-15T18:12:03.875755+0000","last_active":"2024-05-15T18:12:03.875755+0000","last_peered":"2024-05-15T18:12:03.875755+0000","last_clean":"2024-05-15T18:12:03.875755+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:12:03.875755+0000","last_undegraded":"2024-05-15T18:12:03.875755+0000","last_fullsized":"2024-05-15T18:12:03.875755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.875637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:24.820098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.396939+0000","last_change":"2024-05-15T18:08:47.219517+0000","last_active":"2024-05-15T18:11:08.396939+0000","last_peered":"2024-05-15T18:11:08.396939+0000","last_clean":"2024-05-15T18:11:08.396939+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:11:08.396939+0000","last_undegraded":"2024-05-15T18:11:08.396939+0000","last_fullsized":"2024-05-15T18:11:08.396939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.142595+0000","last_change":"2024-05-15T18:12:40.142629+0000","last_active":"2024-05-15T18:12:40.142595+0000","last_peered":"2024-05-15T18:12:40.142595+0000","last_clean":"2024-05-15T18:12:40.142595+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:12:40.142595+0000","last_undegraded":"2024-05-15T18:12:40.142595+0000","last_fullsized":"2024-05-15T18:12:40.142595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:40.142500+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:40.142500+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.142500+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:44.800663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.116084+0000","last_change":"2024-05-15T18:12:53.116110+0000","last_active":"2024-05-15T18:12:53.116084+0000","last_peered":"2024-05-15T18:12:53.116084+0000","last_clean":"2024-05-15T18:12:53.116084+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:12:53.116084+0000","last_undegraded":"2024-05-15T18:12:53.116084+0000","last_fullsized":"2024-05-15T18:12:53.116084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:53.115966+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:53.115966+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.115966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:46:44.696807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.091544+0000","last_change":"2024-05-15T18:12:17.091569+0000","last_active":"2024-05-15T18:12:17.091544+0000","last_peered":"2024-05-15T18:12:17.091544+0000","last_clean":"2024-05-15T18:12:17.091544+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:12:17.091544+0000","last_undegraded":"2024-05-15T18:12:17.091544+0000","last_fullsized":"2024-05-15T18:12:17.091544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.091439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:24:24.593459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.281653+0000","last_change":"2024-05-15T18:12:26.281653+0000","last_active":"2024-05-15T18:12:26.281653+0000","last_peered":"2024-05-15T18:12:26.281653+0000","last_clean":"2024-05-15T18:12:26.281653+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:12:26.281653+0000","last_undegraded":"2024-05-15T18:12:26.281653+0000","last_fullsized":"2024-05-15T18:12:26.281653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.281513+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:35.878307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":383,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.505746+0000","last_change":"2024-05-15T18:12:06.505746+0000","last_active":"2024-05-15T18:12:06.505746+0000","last_peered":"2024-05-15T18:12:06.505746+0000","last_clean":"2024-05-15T18:12:06.505746+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:12:06.505746+0000","last_undegraded":"2024-05-15T18:12:06.505746+0000","last_fullsized":"2024-05-15T18:12:06.505746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.505630+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:15:15.678261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.170247+0000","last_change":"2024-05-15T18:12:45.170277+0000","last_active":"2024-05-15T18:12:45.170247+0000","last_peered":"2024-05-15T18:12:45.170247+0000","last_clean":"2024-05-15T18:12:45.170247+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:12:45.170247+0000","last_undegraded":"2024-05-15T18:12:45.170247+0000","last_fullsized":"2024-05-15T18:12:45.170247+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:45.170157+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:45.170157+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.170157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:01.687704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.574715+0000","last_change":"2024-05-15T18:12:22.574766+0000","last_active":"2024-05-15T18:12:22.574715+0000","last_peered":"2024-05-15T18:12:22.574715+0000","last_clean":"2024-05-15T18:12:22.574715+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:12:22.574715+0000","last_undegraded":"2024-05-15T18:12:22.574715+0000","last_fullsized":"2024-05-15T18:12:22.574715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.574598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:34.319629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.875166+0000","last_change":"2024-05-15T18:12:50.875194+0000","last_active":"2024-05-15T18:12:50.875166+0000","last_peered":"2024-05-15T18:12:50.875166+0000","last_clean":"2024-05-15T18:12:50.875166+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:12:50.875166+0000","last_undegraded":"2024-05-15T18:12:50.875166+0000","last_fullsized":"2024-05-15T18:12:50.875166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.875069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.875069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.875069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:38.918843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.101386+0000","last_change":"2024-05-15T18:12:13.101422+0000","last_active":"2024-05-15T18:12:13.101386+0000","last_peered":"2024-05-15T18:12:13.101386+0000","last_clean":"2024-05-15T18:12:13.101386+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:12:13.101386+0000","last_undegraded":"2024-05-15T18:12:13.101386+0000","last_fullsized":"2024-05-15T18:12:13.101386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.101295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:02:45.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'45","reported_seq":103,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.136885+0000","last_change":"2024-05-15T18:12:08.136923+0000","last_active":"2024-05-15T18:12:08.136885+0000","last_peered":"2024-05-15T18:12:08.136885+0000","last_clean":"2024-05-15T18:12:08.136885+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:12:08.136885+0000","last_undegraded":"2024-05-15T18:12:08.136885+0000","last_fullsized":"2024-05-15T18:12:08.136885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.136791+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:18.155270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.879979+0000","last_change":"2024-05-15T18:12:01.880039+0000","last_active":"2024-05-15T18:12:01.879979+0000","last_peered":"2024-05-15T18:12:01.879979+0000","last_clean":"2024-05-15T18:12:01.879979+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:12:01.879979+0000","last_undegraded":"2024-05-15T18:12:01.879979+0000","last_fullsized":"2024-05-15T18:12:01.879979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.879852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:30.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.059723+0000","last_change":"2024-05-15T18:12:14.059771+0000","last_active":"2024-05-15T18:12:14.059723+0000","last_peered":"2024-05-15T18:12:14.059723+0000","last_clean":"2024-05-15T18:12:14.059723+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:12:14.059723+0000","last_undegraded":"2024-05-15T18:12:14.059723+0000","last_fullsized":"2024-05-15T18:12:14.059723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.059612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:52.613050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.579844+0000","last_change":"2024-05-15T18:12:20.579871+0000","last_active":"2024-05-15T18:12:20.579844+0000","last_peered":"2024-05-15T18:12:20.579844+0000","last_clean":"2024-05-15T18:12:20.579844+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:12:20.579844+0000","last_undegraded":"2024-05-15T18:12:20.579844+0000","last_fullsized":"2024-05-15T18:12:20.579844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.579756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:19.140085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:03.102920+0000","last_change":"2024-05-15T18:13:03.102960+0000","last_active":"2024-05-15T18:13:03.102920+0000","last_peered":"2024-05-15T18:13:03.102920+0000","last_clean":"2024-05-15T18:13:03.102920+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:13:03.102920+0000","last_undegraded":"2024-05-15T18:13:03.102920+0000","last_fullsized":"2024-05-15T18:13:03.102920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:03.102817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:03.102817+0000","last_clean_scrub_stamp":"2024-05-15T18:13:03.102817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:21.928771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.532585+0000","last_change":"2024-05-15T18:12:13.532610+0000","last_active":"2024-05-15T18:12:13.532585+0000","last_peered":"2024-05-15T18:12:13.532585+0000","last_clean":"2024-05-15T18:12:13.532585+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:12:13.532585+0000","last_undegraded":"2024-05-15T18:12:13.532585+0000","last_fullsized":"2024-05-15T18:12:13.532585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.532473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:34.476933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":91,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.850349+0000","last_change":"2024-05-15T18:12:07.850386+0000","last_active":"2024-05-15T18:12:07.850349+0000","last_peered":"2024-05-15T18:12:07.850349+0000","last_clean":"2024-05-15T18:12:07.850349+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:12:07.850349+0000","last_undegraded":"2024-05-15T18:12:07.850349+0000","last_fullsized":"2024-05-15T18:12:07.850349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.850240+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:45.111188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.202135+0000","last_change":"2024-05-15T18:12:19.202194+0000","last_active":"2024-05-15T18:12:19.202135+0000","last_peered":"2024-05-15T18:12:19.202135+0000","last_clean":"2024-05-15T18:12:19.202135+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:12:19.202135+0000","last_undegraded":"2024-05-15T18:12:19.202135+0000","last_fullsized":"2024-05-15T18:12:19.202135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.202036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:01.433105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397860+0000","last_change":"2024-05-15T18:08:47.222465+0000","last_active":"2024-05-15T18:11:13.397860+0000","last_peered":"2024-05-15T18:11:13.397860+0000","last_clean":"2024-05-15T18:11:13.397860+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:11:13.397860+0000","last_undegraded":"2024-05-15T18:11:13.397860+0000","last_fullsized":"2024-05-15T18:11:13.397860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":78,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.219352+0000","last_change":"2024-05-15T18:12:43.219392+0000","last_active":"2024-05-15T18:12:43.219352+0000","last_peered":"2024-05-15T18:12:43.219352+0000","last_clean":"2024-05-15T18:12:43.219352+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:12:43.219352+0000","last_undegraded":"2024-05-15T18:12:43.219352+0000","last_fullsized":"2024-05-15T18:12:43.219352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:43.219263+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:43.219263+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.219263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:19:50.255782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.103086+0000","last_change":"2024-05-15T18:12:35.103086+0000","last_active":"2024-05-15T18:12:35.103086+0000","last_peered":"2024-05-15T18:12:35.103086+0000","last_clean":"2024-05-15T18:12:35.103086+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:12:35.103086+0000","last_undegraded":"2024-05-15T18:12:35.103086+0000","last_fullsized":"2024-05-15T18:12:35.103086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:35.102958+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:35.102958+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.102958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:18:29.354078+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.110609+0000","last_change":"2024-05-15T18:12:09.110633+0000","last_active":"2024-05-15T18:12:09.110609+0000","last_peered":"2024-05-15T18:12:09.110609+0000","last_clean":"2024-05-15T18:12:09.110609+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:12:09.110609+0000","last_undegraded":"2024-05-15T18:12:09.110609+0000","last_fullsized":"2024-05-15T18:12:09.110609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.110521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:26.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'31","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.230432+0000","last_change":"2024-05-15T18:12:24.230472+0000","last_active":"2024-05-15T18:12:24.230432+0000","last_peered":"2024-05-15T18:12:24.230432+0000","last_clean":"2024-05-15T18:12:24.230432+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:12:24.230432+0000","last_undegraded":"2024-05-15T18:12:24.230432+0000","last_fullsized":"2024-05-15T18:12:24.230432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.230338+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:28.672249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.200745+0000","last_change":"2024-05-15T18:12:20.200773+0000","last_active":"2024-05-15T18:12:20.200745+0000","last_peered":"2024-05-15T18:12:20.200745+0000","last_clean":"2024-05-15T18:12:20.200745+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:12:20.200745+0000","last_undegraded":"2024-05-15T18:12:20.200745+0000","last_fullsized":"2024-05-15T18:12:20.200745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.200646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:24.107584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:13.397830+0000","last_change":"2024-05-15T18:08:47.223799+0000","last_active":"2024-05-15T18:11:13.397830+0000","last_peered":"2024-05-15T18:11:13.397830+0000","last_clean":"2024-05-15T18:11:13.397830+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:11:13.397830+0000","last_undegraded":"2024-05-15T18:11:13.397830+0000","last_fullsized":"2024-05-15T18:11:13.397830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.561884+0000","last_change":"2024-05-15T18:12:24.561907+0000","last_active":"2024-05-15T18:12:24.561884+0000","last_peered":"2024-05-15T18:12:24.561884+0000","last_clean":"2024-05-15T18:12:24.561884+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:12:24.561884+0000","last_undegraded":"2024-05-15T18:12:24.561884+0000","last_fullsized":"2024-05-15T18:12:24.561884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.561798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:53.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.961011+0000","last_change":"2024-05-15T18:12:45.961011+0000","last_active":"2024-05-15T18:12:45.961011+0000","last_peered":"2024-05-15T18:12:45.961011+0000","last_clean":"2024-05-15T18:12:45.961011+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:12:45.961011+0000","last_undegraded":"2024-05-15T18:12:45.961011+0000","last_fullsized":"2024-05-15T18:12:45.961011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:45.960841+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:45.960841+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.960841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:48.335945+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.076973+0000","last_change":"2024-05-15T18:12:11.076997+0000","last_active":"2024-05-15T18:12:11.076973+0000","last_peered":"2024-05-15T18:12:11.076973+0000","last_clean":"2024-05-15T18:12:11.076973+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:12:11.076973+0000","last_undegraded":"2024-05-15T18:12:11.076973+0000","last_fullsized":"2024-05-15T18:12:11.076973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.076888+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:44.712782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.195779+0000","last_change":"2024-05-15T18:12:17.195819+0000","last_active":"2024-05-15T18:12:17.195779+0000","last_peered":"2024-05-15T18:12:17.195779+0000","last_clean":"2024-05-15T18:12:17.195779+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:12:17.195779+0000","last_undegraded":"2024-05-15T18:12:17.195779+0000","last_fullsized":"2024-05-15T18:12:17.195779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.195689+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:06.470822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.030201+0000","last_change":"2024-05-15T18:12:18.030230+0000","last_active":"2024-05-15T18:12:18.030201+0000","last_peered":"2024-05-15T18:12:18.030201+0000","last_clean":"2024-05-15T18:12:18.030201+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:12:18.030201+0000","last_undegraded":"2024-05-15T18:12:18.030201+0000","last_fullsized":"2024-05-15T18:12:18.030201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.030108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:36.616836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:08.397061+0000","last_change":"2024-05-15T18:08:47.222560+0000","last_active":"2024-05-15T18:11:08.397061+0000","last_peered":"2024-05-15T18:11:08.397061+0000","last_clean":"2024-05-15T18:11:08.397061+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:11:08.397061+0000","last_undegraded":"2024-05-15T18:11:08.397061+0000","last_fullsized":"2024-05-15T18:11:08.397061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:08:46.189356+0000","last_clean_scrub_stamp":"2024-05-15T18:08:46.189356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.985820+0000","last_change":"2024-05-15T18:12:22.985820+0000","last_active":"2024-05-15T18:12:22.985820+0000","last_peered":"2024-05-15T18:12:22.985820+0000","last_clean":"2024-05-15T18:12:22.985820+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:12:22.985820+0000","last_undegraded":"2024-05-15T18:12:22.985820+0000","last_fullsized":"2024-05-15T18:12:22.985820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.985658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:45.191068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.546934+0000","last_change":"2024-05-15T18:12:41.546934+0000","last_active":"2024-05-15T18:12:41.546934+0000","last_peered":"2024-05-15T18:12:41.546934+0000","last_clean":"2024-05-15T18:12:41.546934+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:12:41.546934+0000","last_undegraded":"2024-05-15T18:12:41.546934+0000","last_fullsized":"2024-05-15T18:12:41.546934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:41.546819+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:41.546819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.546819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:57.515122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.175229+0000","last_change":"2024-05-15T18:12:30.175229+0000","last_active":"2024-05-15T18:12:30.175229+0000","last_peered":"2024-05-15T18:12:30.175229+0000","last_clean":"2024-05-15T18:12:30.175229+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:12:30.175229+0000","last_undegraded":"2024-05-15T18:12:30.175229+0000","last_fullsized":"2024-05-15T18:12:30.175229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.175060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:58.317953+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.058150+0000","last_change":"2024-05-15T18:12:49.058150+0000","last_active":"2024-05-15T18:12:49.058150+0000","last_peered":"2024-05-15T18:12:49.058150+0000","last_clean":"2024-05-15T18:12:49.058150+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:12:49.058150+0000","last_undegraded":"2024-05-15T18:12:49.058150+0000","last_fullsized":"2024-05-15T18:12:49.058150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:49.057973+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:49.057973+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.057973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:27.470127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.225545+0000","last_change":"2024-05-15T18:12:42.225545+0000","last_active":"2024-05-15T18:12:42.225545+0000","last_peered":"2024-05-15T18:12:42.225545+0000","last_clean":"2024-05-15T18:12:42.225545+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:12:42.225545+0000","last_undegraded":"2024-05-15T18:12:42.225545+0000","last_fullsized":"2024-05-15T18:12:42.225545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:42.225381+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:42.225381+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.225381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:49.913736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:02.126085+0000","last_change":"2024-05-15T18:13:02.126111+0000","last_active":"2024-05-15T18:13:02.126085+0000","last_peered":"2024-05-15T18:13:02.126085+0000","last_clean":"2024-05-15T18:13:02.126085+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:13:02.126085+0000","last_undegraded":"2024-05-15T18:13:02.126085+0000","last_fullsized":"2024-05-15T18:13:02.126085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:02.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:02.125957+0000","last_clean_scrub_stamp":"2024-05-15T18:13:02.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:14:28.588404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.145506+0000","last_change":"2024-05-15T18:12:34.145506+0000","last_active":"2024-05-15T18:12:34.145506+0000","last_peered":"2024-05-15T18:12:34.145506+0000","last_clean":"2024-05-15T18:12:34.145506+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:12:34.145506+0000","last_undegraded":"2024-05-15T18:12:34.145506+0000","last_fullsized":"2024-05-15T18:12:34.145506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.145384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:22.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.134698+0000","last_change":"2024-05-15T18:12:43.134698+0000","last_active":"2024-05-15T18:12:43.134698+0000","last_peered":"2024-05-15T18:12:43.134698+0000","last_clean":"2024-05-15T18:12:43.134698+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:12:43.134698+0000","last_undegraded":"2024-05-15T18:12:43.134698+0000","last_fullsized":"2024-05-15T18:12:43.134698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:43.134559+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:43.134559+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.134559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:20:54.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.138916+0000","last_change":"2024-05-15T18:12:32.138916+0000","last_active":"2024-05-15T18:12:32.138916+0000","last_peered":"2024-05-15T18:12:32.138916+0000","last_clean":"2024-05-15T18:12:32.138916+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:12:32.138916+0000","last_undegraded":"2024-05-15T18:12:32.138916+0000","last_fullsized":"2024-05-15T18:12:32.138916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.138787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:48.107090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.134585+0000","last_change":"2024-05-15T18:12:47.134585+0000","last_active":"2024-05-15T18:12:47.134585+0000","last_peered":"2024-05-15T18:12:47.134585+0000","last_clean":"2024-05-15T18:12:47.134585+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:12:47.134585+0000","last_undegraded":"2024-05-15T18:12:47.134585+0000","last_fullsized":"2024-05-15T18:12:47.134585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:47.134445+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:47.134445+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.134445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:38.189538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.970784+0000","last_change":"2024-05-15T18:12:23.970784+0000","last_active":"2024-05-15T18:12:23.970784+0000","last_peered":"2024-05-15T18:12:23.970784+0000","last_clean":"2024-05-15T18:12:23.970784+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:12:23.970784+0000","last_undegraded":"2024-05-15T18:12:23.970784+0000","last_fullsized":"2024-05-15T18:12:23.970784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.970665+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:28:19.811968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.045170+0000","last_change":"2024-05-15T18:12:43.045170+0000","last_active":"2024-05-15T18:12:43.045170+0000","last_peered":"2024-05-15T18:12:43.045170+0000","last_clean":"2024-05-15T18:12:43.045170+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:12:43.045170+0000","last_undegraded":"2024-05-15T18:12:43.045170+0000","last_fullsized":"2024-05-15T18:12:43.045170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:43.045020+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:43.045020+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.045020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:27.966525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.121090+0000","last_change":"2024-05-15T18:12:25.121090+0000","last_active":"2024-05-15T18:12:25.121090+0000","last_peered":"2024-05-15T18:12:25.121090+0000","last_clean":"2024-05-15T18:12:25.121090+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:12:25.121090+0000","last_undegraded":"2024-05-15T18:12:25.121090+0000","last_fullsized":"2024-05-15T18:12:25.121090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.120969+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:19.624066+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.561063+0000","last_change":"2024-05-15T18:12:25.561063+0000","last_active":"2024-05-15T18:12:25.561063+0000","last_peered":"2024-05-15T18:12:25.561063+0000","last_clean":"2024-05-15T18:12:25.561063+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:12:25.561063+0000","last_undegraded":"2024-05-15T18:12:25.561063+0000","last_fullsized":"2024-05-15T18:12:25.561063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.560894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:37.100840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.044657+0000","last_change":"2024-05-15T18:12:30.044657+0000","last_active":"2024-05-15T18:12:30.044657+0000","last_peered":"2024-05-15T18:12:30.044657+0000","last_clean":"2024-05-15T18:12:30.044657+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:12:30.044657+0000","last_undegraded":"2024-05-15T18:12:30.044657+0000","last_fullsized":"2024-05-15T18:12:30.044657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.044530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:37.330279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.092336+0000","last_change":"2024-05-15T18:12:48.092336+0000","last_active":"2024-05-15T18:12:48.092336+0000","last_peered":"2024-05-15T18:12:48.092336+0000","last_clean":"2024-05-15T18:12:48.092336+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:12:48.092336+0000","last_undegraded":"2024-05-15T18:12:48.092336+0000","last_fullsized":"2024-05-15T18:12:48.092336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.092219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.092219+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.092219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:16.437531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":87,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.038957+0000","last_change":"2024-05-15T18:12:34.038981+0000","last_active":"2024-05-15T18:12:34.038957+0000","last_peered":"2024-05-15T18:12:34.038957+0000","last_clean":"2024-05-15T18:12:34.038957+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:12:34.038957+0000","last_undegraded":"2024-05-15T18:12:34.038957+0000","last_fullsized":"2024-05-15T18:12:34.038957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:34.038867+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:34.038867+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.038867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:23.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:12.121833+0000","last_change":"2024-05-15T18:13:12.121861+0000","last_active":"2024-05-15T18:13:12.121833+0000","last_peered":"2024-05-15T18:13:12.121833+0000","last_clean":"2024-05-15T18:13:12.121833+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:13:12.121833+0000","last_undegraded":"2024-05-15T18:13:12.121833+0000","last_fullsized":"2024-05-15T18:13:12.121833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:13:12.121742+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:13:12.121742+0000","last_clean_scrub_stamp":"2024-05-15T18:13:12.121742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:01:36.077893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.201489+0000","last_change":"2024-05-15T18:12:38.201522+0000","last_active":"2024-05-15T18:12:38.201489+0000","last_peered":"2024-05-15T18:12:38.201489+0000","last_clean":"2024-05-15T18:12:38.201489+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:12:38.201489+0000","last_undegraded":"2024-05-15T18:12:38.201489+0000","last_fullsized":"2024-05-15T18:12:38.201489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:38.201399+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:38.201399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.201399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:09:03.315937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.010162+0000","last_change":"2024-05-15T18:12:51.010162+0000","last_active":"2024-05-15T18:12:51.010162+0000","last_peered":"2024-05-15T18:12:51.010162+0000","last_clean":"2024-05-15T18:12:51.010162+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:12:51.010162+0000","last_undegraded":"2024-05-15T18:12:51.010162+0000","last_fullsized":"2024-05-15T18:12:51.010162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:51.010036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:51.010036+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.010036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:38:08.614485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:58.992221+0000","last_change":"2024-05-15T18:12:58.992221+0000","last_active":"2024-05-15T18:12:58.992221+0000","last_peered":"2024-05-15T18:12:58.992221+0000","last_clean":"2024-05-15T18:12:58.992221+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:12:58.992221+0000","last_undegraded":"2024-05-15T18:12:58.992221+0000","last_fullsized":"2024-05-15T18:12:58.992221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:58.992048+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:58.992048+0000","last_clean_scrub_stamp":"2024-05-15T18:12:58.992048+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:40:06.680403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.002246+0000","last_change":"2024-05-15T18:12:35.002246+0000","last_active":"2024-05-15T18:12:35.002246+0000","last_peered":"2024-05-15T18:12:35.002246+0000","last_clean":"2024-05-15T18:12:35.002246+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:12:35.002246+0000","last_undegraded":"2024-05-15T18:12:35.002246+0000","last_fullsized":"2024-05-15T18:12:35.002246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:35.002095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:35.002095+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.002095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:22.863528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.041130+0000","last_change":"2024-05-15T18:12:31.041130+0000","last_active":"2024-05-15T18:12:31.041130+0000","last_peered":"2024-05-15T18:12:31.041130+0000","last_clean":"2024-05-15T18:12:31.041130+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:12:31.041130+0000","last_undegraded":"2024-05-15T18:12:31.041130+0000","last_fullsized":"2024-05-15T18:12:31.041130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.041007+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:07.255869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.992367+0000","last_change":"2024-05-15T18:12:38.992367+0000","last_active":"2024-05-15T18:12:38.992367+0000","last_peered":"2024-05-15T18:12:38.992367+0000","last_clean":"2024-05-15T18:12:38.992367+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:12:38.992367+0000","last_undegraded":"2024-05-15T18:12:38.992367+0000","last_fullsized":"2024-05-15T18:12:38.992367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:38.992240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:38.992240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.992240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:39.302019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'8","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.988373+0000","last_change":"2024-05-15T18:12:20.988373+0000","last_active":"2024-05-15T18:12:20.988373+0000","last_peered":"2024-05-15T18:12:20.988373+0000","last_clean":"2024-05-15T18:12:20.988373+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:12:20.988373+0000","last_undegraded":"2024-05-15T18:12:20.988373+0000","last_fullsized":"2024-05-15T18:12:20.988373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.988215+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:54.295065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.123787+0000","last_change":"2024-05-15T18:12:51.123787+0000","last_active":"2024-05-15T18:12:51.123787+0000","last_peered":"2024-05-15T18:12:51.123787+0000","last_clean":"2024-05-15T18:12:51.123787+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:12:51.123787+0000","last_undegraded":"2024-05-15T18:12:51.123787+0000","last_fullsized":"2024-05-15T18:12:51.123787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:51.123675+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:51.123675+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.123675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:11.864114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.007541+0000","last_change":"2024-05-15T18:12:42.007541+0000","last_active":"2024-05-15T18:12:42.007541+0000","last_peered":"2024-05-15T18:12:42.007541+0000","last_clean":"2024-05-15T18:12:42.007541+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:12:42.007541+0000","last_undegraded":"2024-05-15T18:12:42.007541+0000","last_fullsized":"2024-05-15T18:12:42.007541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:42.007335+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:42.007335+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.007335+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:46.449247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:56.157154+0000","last_change":"2024-05-15T18:12:56.157154+0000","last_active":"2024-05-15T18:12:56.157154+0000","last_peered":"2024-05-15T18:12:56.157154+0000","last_clean":"2024-05-15T18:12:56.157154+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:12:56.157154+0000","last_undegraded":"2024-05-15T18:12:56.157154+0000","last_fullsized":"2024-05-15T18:12:56.157154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:56.157010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:56.157010+0000","last_clean_scrub_stamp":"2024-05-15T18:12:56.157010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:10.969142+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.228088+0000","last_change":"2024-05-15T18:12:32.228088+0000","last_active":"2024-05-15T18:12:32.228088+0000","last_peered":"2024-05-15T18:12:32.228088+0000","last_clean":"2024-05-15T18:12:32.228088+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:12:32.228088+0000","last_undegraded":"2024-05-15T18:12:32.228088+0000","last_fullsized":"2024-05-15T18:12:32.228088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.227938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:25.136580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.546310+0000","last_change":"2024-05-15T18:12:27.546336+0000","last_active":"2024-05-15T18:12:27.546310+0000","last_peered":"2024-05-15T18:12:27.546310+0000","last_clean":"2024-05-15T18:12:27.546310+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:12:27.546310+0000","last_undegraded":"2024-05-15T18:12:27.546310+0000","last_fullsized":"2024-05-15T18:12:27.546310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.546217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:46.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.088288+0000","last_change":"2024-05-15T18:12:33.088288+0000","last_active":"2024-05-15T18:12:33.088288+0000","last_peered":"2024-05-15T18:12:33.088288+0000","last_clean":"2024-05-15T18:12:33.088288+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:12:33.088288+0000","last_undegraded":"2024-05-15T18:12:33.088288+0000","last_fullsized":"2024-05-15T18:12:33.088288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.088145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:24.946373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:57.878475+0000","last_change":"2024-05-15T18:12:57.878508+0000","last_active":"2024-05-15T18:12:57.878475+0000","last_peered":"2024-05-15T18:12:57.878475+0000","last_clean":"2024-05-15T18:12:57.878475+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:12:57.878475+0000","last_undegraded":"2024-05-15T18:12:57.878475+0000","last_fullsized":"2024-05-15T18:12:57.878475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:57.878382+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:57.878382+0000","last_clean_scrub_stamp":"2024-05-15T18:12:57.878382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:14:02.716270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:54.157553+0000","last_change":"2024-05-15T18:12:54.157577+0000","last_active":"2024-05-15T18:12:54.157553+0000","last_peered":"2024-05-15T18:12:54.157553+0000","last_clean":"2024-05-15T18:12:54.157553+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:12:54.157553+0000","last_undegraded":"2024-05-15T18:12:54.157553+0000","last_fullsized":"2024-05-15T18:12:54.157553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:54.157440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:54.157440+0000","last_clean_scrub_stamp":"2024-05-15T18:12:54.157440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:32.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.124776+0000","last_change":"2024-05-15T18:12:24.124812+0000","last_active":"2024-05-15T18:12:24.124776+0000","last_peered":"2024-05-15T18:12:24.124776+0000","last_clean":"2024-05-15T18:12:24.124776+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:12:24.124776+0000","last_undegraded":"2024-05-15T18:12:24.124776+0000","last_fullsized":"2024-05-15T18:12:24.124776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.124681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:45.800550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.164306+0000","last_change":"2024-05-15T18:12:39.164327+0000","last_active":"2024-05-15T18:12:39.164306+0000","last_peered":"2024-05-15T18:12:39.164306+0000","last_clean":"2024-05-15T18:12:39.164306+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:12:39.164306+0000","last_undegraded":"2024-05-15T18:12:39.164306+0000","last_fullsized":"2024-05-15T18:12:39.164306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:39.164216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:39.164216+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.164216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:01.803010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.047409+0000","last_change":"2024-05-15T18:12:27.047454+0000","last_active":"2024-05-15T18:12:27.047409+0000","last_peered":"2024-05-15T18:12:27.047409+0000","last_clean":"2024-05-15T18:12:27.047409+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:12:27.047409+0000","last_undegraded":"2024-05-15T18:12:27.047409+0000","last_fullsized":"2024-05-15T18:12:27.047409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.047320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:59:33.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673024,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":132984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705727,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39932,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331908,"statfs":{"total":96636764160,"available":96595873792,"internally_reserved":0,"allocated":446464,"data_stored":133185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705726,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":720289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705726,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:13:19.968 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.969 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.970 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.970 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.970 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-15T18:08:36.152345+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=36, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.971 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.971 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.971 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.971 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-15T18:08:46.189356+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=136, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=15, tm_hour=18, tm_min=11, tm_sec=55, tm_wday=2, tm_yday=136, tm_isdst=0) 2024-05-15T18:13:19.972 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-15T18:13:39.972 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T18:13:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.112+0000 7f47b0180640 1 Processor -- start 2024-05-15T18:13:40.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.112+0000 7f47b0180640 1 -- start start 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47b0180640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f47a812ea60 0x7f47a812ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47b0180640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47a8072830 con 0x7f47a806de40 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47b0180640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7f47a80701c0 con 0x7f47a812ea60 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47adf1c640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7f47a812ea60 0x7f47a812ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47ad71b640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7f47a806de40 0x7f47a806e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40618/0 (socket says 172.21.15.3:40618) 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47ad71b640 1 -- 172.21.15.3:0/834334604 learned_addr learned my addr 172.21.15.3:0/834334604 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47adf1c640 1 -- 172.21.15.3:0/834334604 >> v1:172.21.15.3:6789/0 conn(0x7f47a806de40 legacy=0x7f47a806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47acf1a640 1 -- 172.21.15.3:0/834334604 <== mon.0 v1:172.21.15.3:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051670845 0 0) 0x7f47a8072830 con 0x7f47a806de40 2024-05-15T18:13:40.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.113+0000 7f47adf1c640 1 -- 172.21.15.3:0/834334604 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a812f380 con 0x7f47a812ea60 2024-05-15T18:13:40.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.114+0000 7f47adf1c640 1 --2- 172.21.15.3:0/834334604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a812ea60 0x7f47a812ee40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009720 tx=0x7f47a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ca211bef619f65 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.114+0000 7f47acf1a640 1 -- 172.21.15.3:0/834334604 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a40316d0 con 0x7f47a812ea60 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.114+0000 7f47acf1a640 1 -- 172.21.15.3:0/834334604 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a4037070 con 0x7f47a812ea60 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.114+0000 7f47acf1a640 1 -- 172.21.15.3:0/834334604 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a40319c0 con 0x7f47a812ea60 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.115+0000 7f47b0180640 1 -- 172.21.15.3:0/834334604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a812ea60 msgr2=0x7f47a812ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.115+0000 7f47b0180640 1 --2- 172.21.15.3:0/834334604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a812ea60 0x7f47a812ee40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009720 tx=0x7f47a402b840 comp rx=0 tx=0).stop 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.115+0000 7f47b0180640 1 -- 172.21.15.3:0/834334604 shutdown_connections 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.115+0000 7f47b0180640 1 --2- 172.21.15.3:0/834334604 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a812ea60 0x7f47a812ee40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.115+0000 7f47b0180640 1 -- 172.21.15.3:0/834334604 >> 172.21.15.3:0/834334604 conn(0x7f47a809cc80 msgr2=0x7f47a809d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.115+0000 7f47b0180640 1 -- 172.21.15.3:0/834334604 shutdown_connections 2024-05-15T18:13:40.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.115+0000 7f47b0180640 1 -- 172.21.15.3:0/834334604 wait complete. 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.116+0000 7f47b0180640 1 Processor -- start 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.116+0000 7f47b0180640 1 -- start start 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.116+0000 7f47b0180640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a806de40 0x7f47a811b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.116+0000 7f47b0180640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f47a806fa70 con 0x7f47a806de40 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f47adf1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a806de40 0x7f47a811b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f47adf1c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a806de40 0x7f47a811b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35018/0 (socket says 172.21.15.3:35018) 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f47adf1c640 1 -- 172.21.15.3:0/4261999565 learned_addr learned my addr 172.21.15.3:0/4261999565 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f47adf1c640 1 -- 172.21.15.3:0/4261999565 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a811d0c0 con 0x7f47a806de40 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f47adf1c640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a806de40 0x7f47a811b7f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009840 tx=0x7f47a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:40.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f479e7fc640 1 -- 172.21.15.3:0/4261999565 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a4032770 con 0x7f47a806de40 2024-05-15T18:13:40.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f479e7fc640 1 -- 172.21.15.3:0/4261999565 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a4032910 con 0x7f47a806de40 2024-05-15T18:13:40.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a811e960 con 0x7f47a806de40 2024-05-15T18:13:40.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f479e7fc640 1 -- 172.21.15.3:0/4261999565 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a4032c30 con 0x7f47a806de40 2024-05-15T18:13:40.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.117+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a811bd30 con 0x7f47a806de40 2024-05-15T18:13:40.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.118+0000 7f479e7fc640 1 -- 172.21.15.3:0/4261999565 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f47a404c060 con 0x7f47a806de40 2024-05-15T18:13:40.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.118+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a8062e90 con 0x7f47a806de40 2024-05-15T18:13:40.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.118+0000 7f479e7fc640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f478c038060 0x7f478c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:40.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.118+0000 7f479e7fc640 1 -- 172.21.15.3:0/4261999565 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7f47a402f050 con 0x7f47a806de40 2024-05-15T18:13:40.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.119+0000 7f47ad71b640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f478c038060 0x7f478c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:40.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.119+0000 7f47ad71b640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f478c038060 0x7f478c03a520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c00 tx=0x7f4798007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:40.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.123+0000 7f479e7fc640 1 -- 172.21.15.3:0/4261999565 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f47a4040070 con 0x7f47a806de40 2024-05-15T18:13:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.303+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 --> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47a812b800 con 0x7f478c038060 2024-05-15T18:13:40.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.319+0000 7f479e7fc640 1 -- 172.21.15.3:0/4261999565 <== mgr.4101 v2:172.21.15.173:6824/3800909313 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665746 (secure 0 0 0) 0x7f47a812b800 con 0x7f478c038060 2024-05-15T18:13:40.303 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-05-15T18:13:40.308 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f478c038060 msgr2=0x7f478c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f478c038060 0x7f478c03a520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4798000c00 tx=0x7f4798007910 comp rx=0 tx=0).stop 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a806de40 msgr2=0x7f47a811b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a806de40 0x7f47a811b7f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009840 tx=0x7f47a40046c0 comp rx=0 tx=0).stop 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 shutdown_connections 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7f478c038060 0x7f478c03a520 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 --2- 172.21.15.3:0/4261999565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f47a806de40 0x7f47a811b7f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.323+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 >> 172.21.15.3:0/4261999565 conn(0x7f47a809cc80 msgr2=0x7f47a81b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:13:40.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.324+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 shutdown_connections 2024-05-15T18:13:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.324+0000 7f47b0180640 1 -- 172.21.15.3:0/4261999565 wait complete. 2024-05-15T18:13:40.312 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-05-15T18:13:38.411386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5097,"num_read_kb":4682,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4784,"ondisk_log_size":4784,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156600,"kb_used_data":2776,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330760,"statfs":{"total":386547056640,"available":386386698240,"internally_reserved":0,"allocated":2842624,"data_stored":1707986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6382,"internal_metadata":157476626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003813"},"pg_stats":[{"pgid":"3.3f","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.568060+0000","last_change":"2024-05-15T18:12:23.568060+0000","last_active":"2024-05-15T18:12:23.568060+0000","last_peered":"2024-05-15T18:12:23.568060+0000","last_clean":"2024-05-15T18:12:23.568060+0000","last_became_active":"2024-05-15T18:08:37.184984+0000","last_became_peered":"2024-05-15T18:08:37.184984+0000","last_unstale":"2024-05-15T18:12:23.568060+0000","last_undegraded":"2024-05-15T18:12:23.568060+0000","last_fullsized":"2024-05-15T18:12:23.568060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:23.567934+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.567934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:17.103555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"31'6","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.013697+0000","last_change":"2024-05-15T18:12:28.013727+0000","last_active":"2024-05-15T18:12:28.013697+0000","last_peered":"2024-05-15T18:12:28.013697+0000","last_clean":"2024-05-15T18:12:28.013697+0000","last_became_active":"2024-05-15T18:08:39.181262+0000","last_became_peered":"2024-05-15T18:08:39.181262+0000","last_unstale":"2024-05-15T18:12:28.013697+0000","last_undegraded":"2024-05-15T18:12:28.013697+0000","last_fullsized":"2024-05-15T18:12:28.013697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:28.013596+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.013596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:49.296056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.121845+0000","last_change":"2024-05-15T18:12:33.121845+0000","last_active":"2024-05-15T18:12:33.121845+0000","last_peered":"2024-05-15T18:12:33.121845+0000","last_clean":"2024-05-15T18:12:33.121845+0000","last_became_active":"2024-05-15T18:08:37.180403+0000","last_became_peered":"2024-05-15T18:08:37.180403+0000","last_unstale":"2024-05-15T18:12:33.121845+0000","last_undegraded":"2024-05-15T18:12:33.121845+0000","last_fullsized":"2024-05-15T18:12:33.121845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.121644+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.121644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:24:10.755036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"31'14","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.218618+0000","last_change":"2024-05-15T18:12:39.218647+0000","last_active":"2024-05-15T18:12:39.218618+0000","last_peered":"2024-05-15T18:12:39.218618+0000","last_clean":"2024-05-15T18:12:39.218618+0000","last_became_active":"2024-05-15T18:08:39.183395+0000","last_became_peered":"2024-05-15T18:08:39.183395+0000","last_unstale":"2024-05-15T18:12:39.218618+0000","last_undegraded":"2024-05-15T18:12:39.218618+0000","last_fullsized":"2024-05-15T18:12:39.218618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:39.218516+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:39.218516+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.218516+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:50:36.582203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"29'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.140484+0000","last_change":"2024-05-15T18:12:50.140541+0000","last_active":"2024-05-15T18:12:50.140484+0000","last_peered":"2024-05-15T18:12:50.140484+0000","last_clean":"2024-05-15T18:12:50.140484+0000","last_became_active":"2024-05-15T18:08:37.185901+0000","last_became_peered":"2024-05-15T18:08:37.185901+0000","last_unstale":"2024-05-15T18:12:50.140484+0000","last_undegraded":"2024-05-15T18:12:50.140484+0000","last_fullsized":"2024-05-15T18:12:50.140484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-15T18:12:50.140371+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-15T18:12:50.140371+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.140371+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:42.852685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.178894+0000","last_change":"2024-05-15T18:12:36.178923+0000","last_active":"2024-05-15T18:12:36.178894+0000","last_peered":"2024-05-15T18:12:36.178894+0000","last_clean":"2024-05-15T18:12:36.178894+0000","last_became_active":"2024-05-15T18:08:39.182965+0000","last_became_peered":"2024-05-15T18:08:39.182965+0000","last_unstale":"2024-05-15T18:12:36.178894+0000","last_undegraded":"2024-05-15T18:12:36.178894+0000","last_fullsized":"2024-05-15T18:12:36.178894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:36.178803+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:36.178803+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.178803+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:50.531119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.552979+0000","last_change":"2024-05-15T18:12:40.553006+0000","last_active":"2024-05-15T18:12:40.552979+0000","last_peered":"2024-05-15T18:12:40.552979+0000","last_clean":"2024-05-15T18:12:40.552979+0000","last_became_active":"2024-05-15T18:08:37.173769+0000","last_became_peered":"2024-05-15T18:08:37.173769+0000","last_unstale":"2024-05-15T18:12:40.552979+0000","last_undegraded":"2024-05-15T18:12:40.552979+0000","last_fullsized":"2024-05-15T18:12:40.552979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:40.552895+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:40.552895+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.552895+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:16.767758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"31'12","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.209841+0000","last_change":"2024-05-15T18:12:44.209878+0000","last_active":"2024-05-15T18:12:44.209841+0000","last_peered":"2024-05-15T18:12:44.209841+0000","last_clean":"2024-05-15T18:12:44.209841+0000","last_became_active":"2024-05-15T18:08:39.180680+0000","last_became_peered":"2024-05-15T18:08:39.180680+0000","last_unstale":"2024-05-15T18:12:44.209841+0000","last_undegraded":"2024-05-15T18:12:44.209841+0000","last_fullsized":"2024-05-15T18:12:44.209841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:44.209754+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:44.209754+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.209754+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:00:06.347702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:06.114514+0000","last_change":"2024-05-15T18:13:06.114539+0000","last_active":"2024-05-15T18:13:06.114514+0000","last_peered":"2024-05-15T18:13:06.114514+0000","last_clean":"2024-05-15T18:13:06.114514+0000","last_became_active":"2024-05-15T18:08:37.179632+0000","last_became_peered":"2024-05-15T18:08:37.179632+0000","last_unstale":"2024-05-15T18:13:06.114514+0000","last_undegraded":"2024-05-15T18:13:06.114514+0000","last_fullsized":"2024-05-15T18:13:06.114514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:06.114414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:06.114414+0000","last_clean_scrub_stamp":"2024-05-15T18:13:06.114414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:14:00.932476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.026703+0000","last_change":"2024-05-15T18:12:36.026703+0000","last_active":"2024-05-15T18:12:36.026703+0000","last_peered":"2024-05-15T18:12:36.026703+0000","last_clean":"2024-05-15T18:12:36.026703+0000","last_became_active":"2024-05-15T18:08:39.184200+0000","last_became_peered":"2024-05-15T18:08:39.184200+0000","last_unstale":"2024-05-15T18:12:36.026703+0000","last_undegraded":"2024-05-15T18:12:36.026703+0000","last_fullsized":"2024-05-15T18:12:36.026703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:36.026558+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:36.026558+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.026558+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:18:30.277678+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.525739+0000","last_change":"2024-05-15T18:12:33.525782+0000","last_active":"2024-05-15T18:12:33.525739+0000","last_peered":"2024-05-15T18:12:33.525739+0000","last_clean":"2024-05-15T18:12:33.525739+0000","last_became_active":"2024-05-15T18:08:37.178598+0000","last_became_peered":"2024-05-15T18:08:37.178598+0000","last_unstale":"2024-05-15T18:12:33.525739+0000","last_undegraded":"2024-05-15T18:12:33.525739+0000","last_fullsized":"2024-05-15T18:12:33.525739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.525633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.525633+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.525633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:55.201502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.204112+0000","last_change":"2024-05-15T18:12:31.204112+0000","last_active":"2024-05-15T18:12:31.204112+0000","last_peered":"2024-05-15T18:12:31.204112+0000","last_clean":"2024-05-15T18:12:31.204112+0000","last_became_active":"2024-05-15T18:08:39.188351+0000","last_became_peered":"2024-05-15T18:08:39.188351+0000","last_unstale":"2024-05-15T18:12:31.204112+0000","last_undegraded":"2024-05-15T18:12:31.204112+0000","last_fullsized":"2024-05-15T18:12:31.204112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:31.203970+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.203970+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:59.549282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:13.152726+0000","last_change":"2024-05-15T18:13:13.152803+0000","last_active":"2024-05-15T18:13:13.152726+0000","last_peered":"2024-05-15T18:13:13.152726+0000","last_clean":"2024-05-15T18:13:13.152726+0000","last_became_active":"2024-05-15T18:08:37.176701+0000","last_became_peered":"2024-05-15T18:08:37.176701+0000","last_unstale":"2024-05-15T18:13:13.152726+0000","last_undegraded":"2024-05-15T18:13:13.152726+0000","last_fullsized":"2024-05-15T18:13:13.152726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:13.152602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:13.152602+0000","last_clean_scrub_stamp":"2024-05-15T18:13:13.152602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:09:41.866811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"31'6","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.549269+0000","last_change":"2024-05-15T18:12:19.549269+0000","last_active":"2024-05-15T18:12:19.549269+0000","last_peered":"2024-05-15T18:12:19.549269+0000","last_clean":"2024-05-15T18:12:19.549269+0000","last_became_active":"2024-05-15T18:08:39.186830+0000","last_became_peered":"2024-05-15T18:08:39.186830+0000","last_unstale":"2024-05-15T18:12:19.549269+0000","last_undegraded":"2024-05-15T18:12:19.549269+0000","last_fullsized":"2024-05-15T18:12:19.549269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:19.549105+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.549105+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:39.405237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.174271+0000","last_change":"2024-05-15T18:12:31.174295+0000","last_active":"2024-05-15T18:12:31.174271+0000","last_peered":"2024-05-15T18:12:31.174271+0000","last_clean":"2024-05-15T18:12:31.174271+0000","last_became_active":"2024-05-15T18:08:37.180641+0000","last_became_peered":"2024-05-15T18:08:37.180641+0000","last_unstale":"2024-05-15T18:12:31.174271+0000","last_undegraded":"2024-05-15T18:12:31.174271+0000","last_fullsized":"2024-05-15T18:12:31.174271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.174181+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.174181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:20.484887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"31'4","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.576366+0000","last_change":"2024-05-15T18:12:28.576366+0000","last_active":"2024-05-15T18:12:28.576366+0000","last_peered":"2024-05-15T18:12:28.576366+0000","last_clean":"2024-05-15T18:12:28.576366+0000","last_became_active":"2024-05-15T18:08:39.183428+0000","last_became_peered":"2024-05-15T18:08:39.183428+0000","last_unstale":"2024-05-15T18:12:28.576366+0000","last_undegraded":"2024-05-15T18:12:28.576366+0000","last_fullsized":"2024-05-15T18:12:28.576366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:28.576233+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.576233+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:31.123756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"31'12","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.185742+0000","last_change":"2024-05-15T18:12:34.185742+0000","last_active":"2024-05-15T18:12:34.185742+0000","last_peered":"2024-05-15T18:12:34.185742+0000","last_clean":"2024-05-15T18:12:34.185742+0000","last_became_active":"2024-05-15T18:08:39.183358+0000","last_became_peered":"2024-05-15T18:08:39.183358+0000","last_unstale":"2024-05-15T18:12:34.185742+0000","last_undegraded":"2024-05-15T18:12:34.185742+0000","last_fullsized":"2024-05-15T18:12:34.185742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:34.185583+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:34.185583+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.185583+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:37:51.790032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.969411+0000","last_change":"2024-05-15T18:12:40.969411+0000","last_active":"2024-05-15T18:12:40.969411+0000","last_peered":"2024-05-15T18:12:40.969411+0000","last_clean":"2024-05-15T18:12:40.969411+0000","last_became_active":"2024-05-15T18:08:37.177070+0000","last_became_peered":"2024-05-15T18:08:37.177070+0000","last_unstale":"2024-05-15T18:12:40.969411+0000","last_undegraded":"2024-05-15T18:12:40.969411+0000","last_fullsized":"2024-05-15T18:12:40.969411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:40.969246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:40.969246+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.969246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:45.627408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"31'6","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.089786+0000","last_change":"2024-05-15T18:12:32.089786+0000","last_active":"2024-05-15T18:12:32.089786+0000","last_peered":"2024-05-15T18:12:32.089786+0000","last_clean":"2024-05-15T18:12:32.089786+0000","last_became_active":"2024-05-15T18:08:39.184703+0000","last_became_peered":"2024-05-15T18:08:39.184703+0000","last_unstale":"2024-05-15T18:12:32.089786+0000","last_undegraded":"2024-05-15T18:12:32.089786+0000","last_fullsized":"2024-05-15T18:12:32.089786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:32.089658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.089658+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:06.944435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.585802+0000","last_change":"2024-05-15T18:12:29.585802+0000","last_active":"2024-05-15T18:12:29.585802+0000","last_peered":"2024-05-15T18:12:29.585802+0000","last_clean":"2024-05-15T18:12:29.585802+0000","last_became_active":"2024-05-15T18:08:37.178027+0000","last_became_peered":"2024-05-15T18:08:37.178027+0000","last_unstale":"2024-05-15T18:12:29.585802+0000","last_undegraded":"2024-05-15T18:12:29.585802+0000","last_fullsized":"2024-05-15T18:12:29.585802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:29.585687+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.585687+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:42.151668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"31'14","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.950416+0000","last_change":"2024-05-15T18:12:39.950416+0000","last_active":"2024-05-15T18:12:39.950416+0000","last_peered":"2024-05-15T18:12:39.950416+0000","last_clean":"2024-05-15T18:12:39.950416+0000","last_became_active":"2024-05-15T18:08:39.186138+0000","last_became_peered":"2024-05-15T18:08:39.186138+0000","last_unstale":"2024-05-15T18:12:39.950416+0000","last_undegraded":"2024-05-15T18:12:39.950416+0000","last_fullsized":"2024-05-15T18:12:39.950416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:39.950291+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:39.950291+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.950291+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:02.589085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.947819+0000","last_change":"2024-05-15T18:12:48.947819+0000","last_active":"2024-05-15T18:12:48.947819+0000","last_peered":"2024-05-15T18:12:48.947819+0000","last_clean":"2024-05-15T18:12:48.947819+0000","last_became_active":"2024-05-15T18:08:37.176428+0000","last_became_peered":"2024-05-15T18:08:37.176428+0000","last_unstale":"2024-05-15T18:12:48.947819+0000","last_undegraded":"2024-05-15T18:12:48.947819+0000","last_fullsized":"2024-05-15T18:12:48.947819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.947695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.947695+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.947695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:17.293007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"31'6","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.081492+0000","last_change":"2024-05-15T18:12:36.081492+0000","last_active":"2024-05-15T18:12:36.081492+0000","last_peered":"2024-05-15T18:12:36.081492+0000","last_clean":"2024-05-15T18:12:36.081492+0000","last_became_active":"2024-05-15T18:08:39.182302+0000","last_became_peered":"2024-05-15T18:08:39.182302+0000","last_unstale":"2024-05-15T18:12:36.081492+0000","last_undegraded":"2024-05-15T18:12:36.081492+0000","last_fullsized":"2024-05-15T18:12:36.081492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:36.081367+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:36.081367+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.081367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:18.312435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.004735+0000","last_change":"2024-05-15T18:12:45.004735+0000","last_active":"2024-05-15T18:12:45.004735+0000","last_peered":"2024-05-15T18:12:45.004735+0000","last_clean":"2024-05-15T18:12:45.004735+0000","last_became_active":"2024-05-15T18:08:37.171449+0000","last_became_peered":"2024-05-15T18:08:37.171449+0000","last_unstale":"2024-05-15T18:12:45.004735+0000","last_undegraded":"2024-05-15T18:12:45.004735+0000","last_fullsized":"2024-05-15T18:12:45.004735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:45.004620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:45.004620+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.004620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:13.000330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'10","reported_seq":81,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.545156+0000","last_change":"2024-05-15T18:12:26.545156+0000","last_active":"2024-05-15T18:12:26.545156+0000","last_peered":"2024-05-15T18:12:26.545156+0000","last_clean":"2024-05-15T18:12:26.545156+0000","last_became_active":"2024-05-15T18:08:39.182991+0000","last_became_peered":"2024-05-15T18:08:39.182991+0000","last_unstale":"2024-05-15T18:12:26.545156+0000","last_undegraded":"2024-05-15T18:12:26.545156+0000","last_fullsized":"2024-05-15T18:12:26.545156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:26.545026+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.545026+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:35.527326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.101813+0000","last_change":"2024-05-15T18:12:41.101813+0000","last_active":"2024-05-15T18:12:41.101813+0000","last_peered":"2024-05-15T18:12:41.101813+0000","last_clean":"2024-05-15T18:12:41.101813+0000","last_became_active":"2024-05-15T18:08:37.179435+0000","last_became_peered":"2024-05-15T18:08:37.179435+0000","last_unstale":"2024-05-15T18:12:41.101813+0000","last_undegraded":"2024-05-15T18:12:41.101813+0000","last_fullsized":"2024-05-15T18:12:41.101813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:41.101640+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:41.101640+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.101640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:28:35.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"31'4","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.063209+0000","last_change":"2024-05-15T18:12:29.063209+0000","last_active":"2024-05-15T18:12:29.063209+0000","last_peered":"2024-05-15T18:12:29.063209+0000","last_clean":"2024-05-15T18:12:29.063209+0000","last_became_active":"2024-05-15T18:08:39.179898+0000","last_became_peered":"2024-05-15T18:08:39.179898+0000","last_unstale":"2024-05-15T18:12:29.063209+0000","last_undegraded":"2024-05-15T18:12:29.063209+0000","last_fullsized":"2024-05-15T18:12:29.063209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:29.063096+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.063096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:21.253645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:00.122233+0000","last_change":"2024-05-15T18:13:00.122233+0000","last_active":"2024-05-15T18:13:00.122233+0000","last_peered":"2024-05-15T18:13:00.122233+0000","last_clean":"2024-05-15T18:13:00.122233+0000","last_became_active":"2024-05-15T18:08:37.180376+0000","last_became_peered":"2024-05-15T18:08:37.180376+0000","last_unstale":"2024-05-15T18:13:00.122233+0000","last_undegraded":"2024-05-15T18:13:00.122233+0000","last_fullsized":"2024-05-15T18:13:00.122233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:00.122088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:00.122088+0000","last_clean_scrub_stamp":"2024-05-15T18:13:00.122088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:03:26.267482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"31'36","reported_seq":109,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.830009+0000","last_change":"2024-05-15T18:12:53.830067+0000","last_active":"2024-05-15T18:12:53.830009+0000","last_peered":"2024-05-15T18:12:53.830009+0000","last_clean":"2024-05-15T18:12:53.830009+0000","last_became_active":"2024-05-15T18:08:47.222763+0000","last_became_peered":"2024-05-15T18:08:47.222763+0000","last_unstale":"2024-05-15T18:12:53.830009+0000","last_undegraded":"2024-05-15T18:12:53.830009+0000","last_fullsized":"2024-05-15T18:12:53.830009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:53.829907+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:53.829907+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.829907+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:14.502533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.585841+0000","last_change":"2024-05-15T18:12:49.585867+0000","last_active":"2024-05-15T18:12:49.585841+0000","last_peered":"2024-05-15T18:12:49.585841+0000","last_clean":"2024-05-15T18:12:49.585841+0000","last_became_active":"2024-05-15T18:09:19.408030+0000","last_became_peered":"2024-05-15T18:09:19.408030+0000","last_unstale":"2024-05-15T18:12:49.585841+0000","last_undegraded":"2024-05-15T18:12:49.585841+0000","last_fullsized":"2024-05-15T18:12:49.585841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:49.585746+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:49.585746+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.585746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:54.027658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:15.147882+0000","last_change":"2024-05-15T18:13:15.147882+0000","last_active":"2024-05-15T18:13:15.147882+0000","last_peered":"2024-05-15T18:13:15.147882+0000","last_clean":"2024-05-15T18:13:15.147882+0000","last_became_active":"2024-05-15T18:08:37.185865+0000","last_became_peered":"2024-05-15T18:08:37.185865+0000","last_unstale":"2024-05-15T18:13:15.147882+0000","last_undegraded":"2024-05-15T18:13:15.147882+0000","last_fullsized":"2024-05-15T18:13:15.147882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:15.147758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:15.147758+0000","last_clean_scrub_stamp":"2024-05-15T18:13:15.147758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:37:46.696306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"31'5","reported_seq":239,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.471407+0000","last_change":"2024-05-15T18:12:00.471407+0000","last_active":"2024-05-15T18:12:00.471407+0000","last_peered":"2024-05-15T18:12:00.471407+0000","last_clean":"2024-05-15T18:12:00.471407+0000","last_became_active":"2024-05-15T18:08:41.191379+0000","last_became_peered":"2024-05-15T18:08:41.191379+0000","last_unstale":"2024-05-15T18:12:00.471407+0000","last_undegraded":"2024-05-15T18:12:00.471407+0000","last_fullsized":"2024-05-15T18:12:00.471407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:00.471292+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.471292+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:32.955699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"31'36","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.208523+0000","last_change":"2024-05-15T18:12:22.208523+0000","last_active":"2024-05-15T18:12:22.208523+0000","last_peered":"2024-05-15T18:12:22.208523+0000","last_clean":"2024-05-15T18:12:22.208523+0000","last_became_active":"2024-05-15T18:08:43.204592+0000","last_became_peered":"2024-05-15T18:08:43.204592+0000","last_unstale":"2024-05-15T18:12:22.208523+0000","last_undegraded":"2024-05-15T18:12:22.208523+0000","last_fullsized":"2024-05-15T18:12:22.208523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:22.208343+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.208343+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:44.847137+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.165954+0000","last_change":"2024-05-15T18:12:06.165990+0000","last_active":"2024-05-15T18:12:06.165954+0000","last_peered":"2024-05-15T18:12:06.165954+0000","last_clean":"2024-05-15T18:12:06.165954+0000","last_became_active":"2024-05-15T18:08:45.208962+0000","last_became_peered":"2024-05-15T18:08:45.208962+0000","last_unstale":"2024-05-15T18:12:06.165954+0000","last_undegraded":"2024-05-15T18:12:06.165954+0000","last_fullsized":"2024-05-15T18:12:06.165954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.165871+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.165871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:13.434904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"31'9","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:54.838292+0000","last_change":"2024-05-15T18:12:54.838318+0000","last_active":"2024-05-15T18:12:54.838292+0000","last_peered":"2024-05-15T18:12:54.838292+0000","last_clean":"2024-05-15T18:12:54.838292+0000","last_became_active":"2024-05-15T18:08:47.222798+0000","last_became_peered":"2024-05-15T18:08:47.222798+0000","last_unstale":"2024-05-15T18:12:54.838292+0000","last_undegraded":"2024-05-15T18:12:54.838292+0000","last_fullsized":"2024-05-15T18:12:54.838292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-05-15T18:12:54.838201+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-05-15T18:12:54.838201+0000","last_clean_scrub_stamp":"2024-05-15T18:12:54.838201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:07.280383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'24","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.201023+0000","last_change":"2024-05-15T18:12:40.201023+0000","last_active":"2024-05-15T18:12:40.201023+0000","last_peered":"2024-05-15T18:12:40.201023+0000","last_clean":"2024-05-15T18:12:40.201023+0000","last_became_active":"2024-05-15T18:08:39.181717+0000","last_became_peered":"2024-05-15T18:08:39.181717+0000","last_unstale":"2024-05-15T18:12:40.201023+0000","last_undegraded":"2024-05-15T18:12:40.201023+0000","last_fullsized":"2024-05-15T18:12:40.201023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:40.200860+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:40.200860+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.200860+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:21:23.692098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":55,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.616233+0000","last_change":"2024-05-15T18:12:43.616233+0000","last_active":"2024-05-15T18:12:43.616233+0000","last_peered":"2024-05-15T18:12:43.616233+0000","last_clean":"2024-05-15T18:12:43.616233+0000","last_became_active":"2024-05-15T18:08:37.176352+0000","last_became_peered":"2024-05-15T18:08:37.176352+0000","last_unstale":"2024-05-15T18:12:43.616233+0000","last_undegraded":"2024-05-15T18:12:43.616233+0000","last_fullsized":"2024-05-15T18:12:43.616233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:43.616071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:43.616071+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.616071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:24.027421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.076858+0000","last_change":"2024-05-15T18:12:21.076858+0000","last_active":"2024-05-15T18:12:21.076858+0000","last_peered":"2024-05-15T18:12:21.076858+0000","last_clean":"2024-05-15T18:12:21.076858+0000","last_became_active":"2024-05-15T18:08:41.190086+0000","last_became_peered":"2024-05-15T18:08:41.190086+0000","last_unstale":"2024-05-15T18:12:21.076858+0000","last_undegraded":"2024-05-15T18:12:21.076858+0000","last_fullsized":"2024-05-15T18:12:21.076858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.076736+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.076736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:12.212953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'10","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.191810+0000","last_change":"2024-05-15T18:12:04.191810+0000","last_active":"2024-05-15T18:12:04.191810+0000","last_peered":"2024-05-15T18:12:04.191810+0000","last_clean":"2024-05-15T18:12:04.191810+0000","last_became_active":"2024-05-15T18:08:43.192752+0000","last_became_peered":"2024-05-15T18:08:43.192752+0000","last_unstale":"2024-05-15T18:12:04.191810+0000","last_undegraded":"2024-05-15T18:12:04.191810+0000","last_fullsized":"2024-05-15T18:12:04.191810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:04.191688+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.191688+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:16:12.868591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.280655+0000","last_change":"2024-05-15T18:11:59.280691+0000","last_active":"2024-05-15T18:11:59.280655+0000","last_peered":"2024-05-15T18:11:59.280655+0000","last_clean":"2024-05-15T18:11:59.280655+0000","last_became_active":"2024-05-15T18:08:45.200245+0000","last_became_peered":"2024-05-15T18:08:45.200245+0000","last_unstale":"2024-05-15T18:11:59.280655+0000","last_undegraded":"2024-05-15T18:11:59.280655+0000","last_fullsized":"2024-05-15T18:11:59.280655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.280542+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.280542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:02.064253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'10","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:54.951074+0000","last_change":"2024-05-15T18:12:54.951103+0000","last_active":"2024-05-15T18:12:54.951074+0000","last_peered":"2024-05-15T18:12:54.951074+0000","last_clean":"2024-05-15T18:12:54.951074+0000","last_became_active":"2024-05-15T18:08:47.215135+0000","last_became_peered":"2024-05-15T18:08:47.215135+0000","last_unstale":"2024-05-15T18:12:54.951074+0000","last_undegraded":"2024-05-15T18:12:54.951074+0000","last_fullsized":"2024-05-15T18:12:54.951074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:54.950979+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:54.950979+0000","last_clean_scrub_stamp":"2024-05-15T18:12:54.950979+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:09:20.065517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":59,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"31'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.129758+0000","last_change":"2024-05-15T18:12:47.129758+0000","last_active":"2024-05-15T18:12:47.129758+0000","last_peered":"2024-05-15T18:12:47.129758+0000","last_clean":"2024-05-15T18:12:47.129758+0000","last_became_active":"2024-05-15T18:08:39.180080+0000","last_became_peered":"2024-05-15T18:08:39.180080+0000","last_unstale":"2024-05-15T18:12:47.129758+0000","last_undegraded":"2024-05-15T18:12:47.129758+0000","last_fullsized":"2024-05-15T18:12:47.129758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:47.129645+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:47.129645+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.129645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:46:33.776122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:59.160847+0000","last_change":"2024-05-15T18:12:59.160847+0000","last_active":"2024-05-15T18:12:59.160847+0000","last_peered":"2024-05-15T18:12:59.160847+0000","last_clean":"2024-05-15T18:12:59.160847+0000","last_became_active":"2024-05-15T18:08:37.184897+0000","last_became_peered":"2024-05-15T18:08:37.184897+0000","last_unstale":"2024-05-15T18:12:59.160847+0000","last_undegraded":"2024-05-15T18:12:59.160847+0000","last_fullsized":"2024-05-15T18:12:59.160847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:59.160732+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:59.160732+0000","last_clean_scrub_stamp":"2024-05-15T18:12:59.160732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:19.926939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.564300+0000","last_change":"2024-05-15T18:12:50.564324+0000","last_active":"2024-05-15T18:12:50.564300+0000","last_peered":"2024-05-15T18:12:50.564300+0000","last_clean":"2024-05-15T18:12:50.564300+0000","last_became_active":"2024-05-15T18:09:19.409724+0000","last_became_peered":"2024-05-15T18:09:19.409724+0000","last_unstale":"2024-05-15T18:12:50.564300+0000","last_undegraded":"2024-05-15T18:12:50.564300+0000","last_fullsized":"2024-05-15T18:12:50.564300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.564204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.564204+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.564204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:35.485709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.538899+0000","last_change":"2024-05-15T18:12:05.538899+0000","last_active":"2024-05-15T18:12:05.538899+0000","last_peered":"2024-05-15T18:12:05.538899+0000","last_clean":"2024-05-15T18:12:05.538899+0000","last_became_active":"2024-05-15T18:08:43.198694+0000","last_became_peered":"2024-05-15T18:08:43.198694+0000","last_unstale":"2024-05-15T18:12:05.538899+0000","last_undegraded":"2024-05-15T18:12:05.538899+0000","last_fullsized":"2024-05-15T18:12:05.538899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:05.538773+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.538773+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:15:58.392906+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'286","reported_seq":417,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.258996+0000","last_change":"2024-05-15T18:12:29.259026+0000","last_active":"2024-05-15T18:12:29.258996+0000","last_peered":"2024-05-15T18:12:29.258996+0000","last_clean":"2024-05-15T18:12:29.258996+0000","last_became_active":"2024-05-15T18:08:45.210543+0000","last_became_peered":"2024-05-15T18:08:45.210543+0000","last_unstale":"2024-05-15T18:12:29.258996+0000","last_undegraded":"2024-05-15T18:12:29.258996+0000","last_fullsized":"2024-05-15T18:12:29.258996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'286","last_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_deep_scrub":"31'286","last_deep_scrub_stamp":"2024-05-15T18:12:29.258908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.258908+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:17:31.038888+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"31'8","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.567559+0000","last_change":"2024-05-15T18:12:47.567623+0000","last_active":"2024-05-15T18:12:47.567559+0000","last_peered":"2024-05-15T18:12:47.567559+0000","last_clean":"2024-05-15T18:12:47.567559+0000","last_became_active":"2024-05-15T18:08:47.220184+0000","last_became_peered":"2024-05-15T18:08:47.220184+0000","last_unstale":"2024-05-15T18:12:47.567559+0000","last_undegraded":"2024-05-15T18:12:47.567559+0000","last_fullsized":"2024-05-15T18:12:47.567559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:47.567440+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:47.567440+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.567440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:10.206233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"31'24","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.163303+0000","last_change":"2024-05-15T18:12:27.163303+0000","last_active":"2024-05-15T18:12:27.163303+0000","last_peered":"2024-05-15T18:12:27.163303+0000","last_clean":"2024-05-15T18:12:27.163303+0000","last_became_active":"2024-05-15T18:08:39.186767+0000","last_became_peered":"2024-05-15T18:08:39.186767+0000","last_unstale":"2024-05-15T18:12:27.163303+0000","last_undegraded":"2024-05-15T18:12:27.163303+0000","last_fullsized":"2024-05-15T18:12:27.163303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:27.163125+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.163125+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:48.445585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.905262+0000","last_change":"2024-05-15T18:12:49.905262+0000","last_active":"2024-05-15T18:12:49.905262+0000","last_peered":"2024-05-15T18:12:49.905262+0000","last_clean":"2024-05-15T18:12:49.905262+0000","last_became_active":"2024-05-15T18:08:37.175747+0000","last_became_peered":"2024-05-15T18:08:37.175747+0000","last_unstale":"2024-05-15T18:12:49.905262+0000","last_undegraded":"2024-05-15T18:12:49.905262+0000","last_fullsized":"2024-05-15T18:12:49.905262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:49.905153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:49.905153+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.905153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:42.813795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.344763+0000","last_change":"2024-05-15T18:12:04.344763+0000","last_active":"2024-05-15T18:12:04.344763+0000","last_peered":"2024-05-15T18:12:04.344763+0000","last_clean":"2024-05-15T18:12:04.344763+0000","last_became_active":"2024-05-15T18:08:41.190740+0000","last_became_peered":"2024-05-15T18:08:41.190740+0000","last_unstale":"2024-05-15T18:12:04.344763+0000","last_undegraded":"2024-05-15T18:12:04.344763+0000","last_fullsized":"2024-05-15T18:12:04.344763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:04.344646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.344646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:30:55.480863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"31'36","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.490856+0000","last_change":"2024-05-15T18:12:03.490856+0000","last_active":"2024-05-15T18:12:03.490856+0000","last_peered":"2024-05-15T18:12:03.490856+0000","last_clean":"2024-05-15T18:12:03.490856+0000","last_became_active":"2024-05-15T18:08:43.199295+0000","last_became_peered":"2024-05-15T18:08:43.199295+0000","last_unstale":"2024-05-15T18:12:03.490856+0000","last_undegraded":"2024-05-15T18:12:03.490856+0000","last_fullsized":"2024-05-15T18:12:03.490856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:03.490731+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.490731+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:32.129481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"31'285","reported_seq":448,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.893055+0000","last_change":"2024-05-15T18:11:59.893055+0000","last_active":"2024-05-15T18:11:59.893055+0000","last_peered":"2024-05-15T18:11:59.893055+0000","last_clean":"2024-05-15T18:11:59.893055+0000","last_became_active":"2024-05-15T18:08:45.198508+0000","last_became_peered":"2024-05-15T18:08:45.198508+0000","last_unstale":"2024-05-15T18:11:59.893055+0000","last_undegraded":"2024-05-15T18:11:59.893055+0000","last_fullsized":"2024-05-15T18:11:59.893055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:59.892887+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.892887+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:38.810690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"31'10","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.323325+0000","last_change":"2024-05-15T18:12:10.323325+0000","last_active":"2024-05-15T18:12:10.323325+0000","last_peered":"2024-05-15T18:12:10.323325+0000","last_clean":"2024-05-15T18:12:10.323325+0000","last_became_active":"2024-05-15T18:08:39.193751+0000","last_became_peered":"2024-05-15T18:08:39.193751+0000","last_unstale":"2024-05-15T18:12:10.323325+0000","last_undegraded":"2024-05-15T18:12:10.323325+0000","last_fullsized":"2024-05-15T18:12:10.323325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:10.323182+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.323182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:01.360177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.576610+0000","last_change":"2024-05-15T18:12:38.576610+0000","last_active":"2024-05-15T18:12:38.576610+0000","last_peered":"2024-05-15T18:12:38.576610+0000","last_clean":"2024-05-15T18:12:38.576610+0000","last_became_active":"2024-05-15T18:08:37.173153+0000","last_became_peered":"2024-05-15T18:08:37.173153+0000","last_unstale":"2024-05-15T18:12:38.576610+0000","last_undegraded":"2024-05-15T18:12:38.576610+0000","last_fullsized":"2024-05-15T18:12:38.576610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:38.576449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:38.576449+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.576449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:45.862198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.051699+0000","last_change":"2024-05-15T18:12:12.051699+0000","last_active":"2024-05-15T18:12:12.051699+0000","last_peered":"2024-05-15T18:12:12.051699+0000","last_clean":"2024-05-15T18:12:12.051699+0000","last_became_active":"2024-05-15T18:08:41.193312+0000","last_became_peered":"2024-05-15T18:08:41.193312+0000","last_unstale":"2024-05-15T18:12:12.051699+0000","last_undegraded":"2024-05-15T18:12:12.051699+0000","last_fullsized":"2024-05-15T18:12:12.051699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.051591+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.051591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:28:19.702252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"31'52","reported_seq":113,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.558253+0000","last_change":"2024-05-15T18:12:11.558253+0000","last_active":"2024-05-15T18:12:11.558253+0000","last_peered":"2024-05-15T18:12:11.558253+0000","last_clean":"2024-05-15T18:12:11.558253+0000","last_became_active":"2024-05-15T18:08:43.190054+0000","last_became_peered":"2024-05-15T18:08:43.190054+0000","last_unstale":"2024-05-15T18:12:11.558253+0000","last_undegraded":"2024-05-15T18:12:11.558253+0000","last_fullsized":"2024-05-15T18:12:11.558253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'52","last_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_deep_scrub":"31'52","last_deep_scrub_stamp":"2024-05-15T18:12:11.558113+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.558113+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:43:52.322479+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.845711+0000","last_change":"2024-05-15T18:12:00.845711+0000","last_active":"2024-05-15T18:12:00.845711+0000","last_peered":"2024-05-15T18:12:00.845711+0000","last_clean":"2024-05-15T18:12:00.845711+0000","last_became_active":"2024-05-15T18:08:45.198107+0000","last_became_peered":"2024-05-15T18:08:45.198107+0000","last_unstale":"2024-05-15T18:12:00.845711+0000","last_undegraded":"2024-05-15T18:12:00.845711+0000","last_fullsized":"2024-05-15T18:12:00.845711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:00.845599+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.845599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:10.619569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"31'5","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.545505+0000","last_change":"2024-05-15T18:12:48.545505+0000","last_active":"2024-05-15T18:12:48.545505+0000","last_peered":"2024-05-15T18:12:48.545505+0000","last_clean":"2024-05-15T18:12:48.545505+0000","last_became_active":"2024-05-15T18:08:47.221544+0000","last_became_peered":"2024-05-15T18:08:47.221544+0000","last_unstale":"2024-05-15T18:12:48.545505+0000","last_undegraded":"2024-05-15T18:12:48.545505+0000","last_fullsized":"2024-05-15T18:12:48.545505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:48.545324+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:48.545324+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.545324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:53.203487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.948068+0000","last_change":"2024-05-15T18:12:37.948068+0000","last_active":"2024-05-15T18:12:37.948068+0000","last_peered":"2024-05-15T18:12:37.948068+0000","last_clean":"2024-05-15T18:12:37.948068+0000","last_became_active":"2024-05-15T18:08:39.184108+0000","last_became_peered":"2024-05-15T18:08:39.184108+0000","last_unstale":"2024-05-15T18:12:37.948068+0000","last_undegraded":"2024-05-15T18:12:37.948068+0000","last_fullsized":"2024-05-15T18:12:37.948068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:37.947944+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:37.947944+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.947944+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:41.854882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.535769+0000","last_change":"2024-05-15T18:12:31.535769+0000","last_active":"2024-05-15T18:12:31.535769+0000","last_peered":"2024-05-15T18:12:31.535769+0000","last_clean":"2024-05-15T18:12:31.535769+0000","last_became_active":"2024-05-15T18:08:37.178372+0000","last_became_peered":"2024-05-15T18:08:37.178372+0000","last_unstale":"2024-05-15T18:12:31.535769+0000","last_undegraded":"2024-05-15T18:12:31.535769+0000","last_fullsized":"2024-05-15T18:12:31.535769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:31.535653+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.535653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:53.741063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"31'2","reported_seq":231,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.011129+0000","last_change":"2024-05-15T18:12:15.011129+0000","last_active":"2024-05-15T18:12:15.011129+0000","last_peered":"2024-05-15T18:12:15.011129+0000","last_clean":"2024-05-15T18:12:15.011129+0000","last_became_active":"2024-05-15T18:08:41.193518+0000","last_became_peered":"2024-05-15T18:08:41.193518+0000","last_unstale":"2024-05-15T18:12:15.011129+0000","last_undegraded":"2024-05-15T18:12:15.011129+0000","last_fullsized":"2024-05-15T18:12:15.011129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:15.010984+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.010984+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:44.102759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.305526+0000","last_change":"2024-05-15T18:12:27.305526+0000","last_active":"2024-05-15T18:12:27.305526+0000","last_peered":"2024-05-15T18:12:27.305526+0000","last_clean":"2024-05-15T18:12:27.305526+0000","last_became_active":"2024-05-15T18:08:43.204109+0000","last_became_peered":"2024-05-15T18:08:43.204109+0000","last_unstale":"2024-05-15T18:12:27.305526+0000","last_undegraded":"2024-05-15T18:12:27.305526+0000","last_fullsized":"2024-05-15T18:12:27.305526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:27.305346+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.305346+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:08:55.301055+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.922907+0000","last_change":"2024-05-15T18:12:09.922907+0000","last_active":"2024-05-15T18:12:09.922907+0000","last_peered":"2024-05-15T18:12:09.922907+0000","last_clean":"2024-05-15T18:12:09.922907+0000","last_became_active":"2024-05-15T18:08:45.207691+0000","last_became_peered":"2024-05-15T18:08:45.207691+0000","last_unstale":"2024-05-15T18:12:09.922907+0000","last_undegraded":"2024-05-15T18:12:09.922907+0000","last_fullsized":"2024-05-15T18:12:09.922907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.922780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.922780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:29.778911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"31'4","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.970242+0000","last_change":"2024-05-15T18:12:21.970242+0000","last_active":"2024-05-15T18:12:21.970242+0000","last_peered":"2024-05-15T18:12:21.970242+0000","last_clean":"2024-05-15T18:12:21.970242+0000","last_became_active":"2024-05-15T18:08:47.216956+0000","last_became_peered":"2024-05-15T18:08:47.216956+0000","last_unstale":"2024-05-15T18:12:21.970242+0000","last_undegraded":"2024-05-15T18:12:21.970242+0000","last_fullsized":"2024-05-15T18:12:21.970242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:21.970081+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.970081+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:46:32.198122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"31'10","reported_seq":80,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.533336+0000","last_change":"2024-05-15T18:12:34.533336+0000","last_active":"2024-05-15T18:12:34.533336+0000","last_peered":"2024-05-15T18:12:34.533336+0000","last_clean":"2024-05-15T18:12:34.533336+0000","last_became_active":"2024-05-15T18:08:39.184662+0000","last_became_peered":"2024-05-15T18:08:39.184662+0000","last_unstale":"2024-05-15T18:12:34.533336+0000","last_undegraded":"2024-05-15T18:12:34.533336+0000","last_fullsized":"2024-05-15T18:12:34.533336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:34.533218+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:34.533218+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.533218+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:29.036315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:58.116504+0000","last_change":"2024-05-15T18:12:58.116504+0000","last_active":"2024-05-15T18:12:58.116504+0000","last_peered":"2024-05-15T18:12:58.116504+0000","last_clean":"2024-05-15T18:12:58.116504+0000","last_became_active":"2024-05-15T18:08:37.180348+0000","last_became_peered":"2024-05-15T18:08:37.180348+0000","last_unstale":"2024-05-15T18:12:58.116504+0000","last_undegraded":"2024-05-15T18:12:58.116504+0000","last_fullsized":"2024-05-15T18:12:58.116504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:58.116376+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:58.116376+0000","last_clean_scrub_stamp":"2024-05-15T18:12:58.116376+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:51:58.766175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.068568+0000","last_change":"2024-05-15T18:12:19.068568+0000","last_active":"2024-05-15T18:12:19.068568+0000","last_peered":"2024-05-15T18:12:19.068568+0000","last_clean":"2024-05-15T18:12:19.068568+0000","last_became_active":"2024-05-15T18:08:41.190706+0000","last_became_peered":"2024-05-15T18:08:41.190706+0000","last_unstale":"2024-05-15T18:12:19.068568+0000","last_undegraded":"2024-05-15T18:12:19.068568+0000","last_fullsized":"2024-05-15T18:12:19.068568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.068452+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.068452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:21.615975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"31'46","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.293167+0000","last_change":"2024-05-15T18:12:28.293167+0000","last_active":"2024-05-15T18:12:28.293167+0000","last_peered":"2024-05-15T18:12:28.293167+0000","last_clean":"2024-05-15T18:12:28.293167+0000","last_became_active":"2024-05-15T18:08:43.204696+0000","last_became_peered":"2024-05-15T18:08:43.204696+0000","last_unstale":"2024-05-15T18:12:28.293167+0000","last_undegraded":"2024-05-15T18:12:28.293167+0000","last_fullsized":"2024-05-15T18:12:28.293167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'46","last_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_deep_scrub":"31'46","last_deep_scrub_stamp":"2024-05-15T18:12:28.293044+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.293044+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:30.668147+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"31'285","reported_seq":410,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.833181+0000","last_change":"2024-05-15T18:12:05.833181+0000","last_active":"2024-05-15T18:12:05.833181+0000","last_peered":"2024-05-15T18:12:05.833181+0000","last_clean":"2024-05-15T18:12:05.833181+0000","last_became_active":"2024-05-15T18:08:45.205042+0000","last_became_peered":"2024-05-15T18:08:45.205042+0000","last_unstale":"2024-05-15T18:12:05.833181+0000","last_undegraded":"2024-05-15T18:12:05.833181+0000","last_fullsized":"2024-05-15T18:12:05.833181+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:05.833005+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.833005+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:50.024912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:56.962570+0000","last_change":"2024-05-15T18:12:56.962570+0000","last_active":"2024-05-15T18:12:56.962570+0000","last_peered":"2024-05-15T18:12:56.962570+0000","last_clean":"2024-05-15T18:12:56.962570+0000","last_became_active":"2024-05-15T18:08:47.218086+0000","last_became_peered":"2024-05-15T18:08:47.218086+0000","last_unstale":"2024-05-15T18:12:56.962570+0000","last_undegraded":"2024-05-15T18:12:56.962570+0000","last_fullsized":"2024-05-15T18:12:56.962570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:56.962443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:56.962443+0000","last_clean_scrub_stamp":"2024-05-15T18:12:56.962443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:11:07.390547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.609722+0000","last_change":"2024-05-15T18:12:21.609722+0000","last_active":"2024-05-15T18:12:21.609722+0000","last_peered":"2024-05-15T18:12:21.609722+0000","last_clean":"2024-05-15T18:12:21.609722+0000","last_became_active":"2024-05-15T18:08:39.179943+0000","last_became_peered":"2024-05-15T18:08:39.179943+0000","last_unstale":"2024-05-15T18:12:21.609722+0000","last_undegraded":"2024-05-15T18:12:21.609722+0000","last_fullsized":"2024-05-15T18:12:21.609722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:21.609598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.609598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:32.043990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:04.098980+0000","last_change":"2024-05-15T18:13:04.098980+0000","last_active":"2024-05-15T18:13:04.098980+0000","last_peered":"2024-05-15T18:13:04.098980+0000","last_clean":"2024-05-15T18:13:04.098980+0000","last_became_active":"2024-05-15T18:08:37.179697+0000","last_became_peered":"2024-05-15T18:08:37.179697+0000","last_unstale":"2024-05-15T18:13:04.098980+0000","last_undegraded":"2024-05-15T18:13:04.098980+0000","last_fullsized":"2024-05-15T18:13:04.098980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:04.098791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:04.098791+0000","last_clean_scrub_stamp":"2024-05-15T18:13:04.098791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:01:47.962934+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.982070+0000","last_change":"2024-05-15T18:12:15.982070+0000","last_active":"2024-05-15T18:12:15.982070+0000","last_peered":"2024-05-15T18:12:15.982070+0000","last_clean":"2024-05-15T18:12:15.982070+0000","last_became_active":"2024-05-15T18:08:41.193467+0000","last_became_peered":"2024-05-15T18:08:41.193467+0000","last_unstale":"2024-05-15T18:12:15.982070+0000","last_undegraded":"2024-05-15T18:12:15.982070+0000","last_fullsized":"2024-05-15T18:12:15.982070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.981892+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.981892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:27.521839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"31'63","reported_seq":137,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.357175+0000","last_change":"2024-05-15T18:12:03.357175+0000","last_active":"2024-05-15T18:12:03.357175+0000","last_peered":"2024-05-15T18:12:03.357175+0000","last_clean":"2024-05-15T18:12:03.357175+0000","last_became_active":"2024-05-15T18:08:43.201198+0000","last_became_peered":"2024-05-15T18:08:43.201198+0000","last_unstale":"2024-05-15T18:12:03.357175+0000","last_undegraded":"2024-05-15T18:12:03.357175+0000","last_fullsized":"2024-05-15T18:12:03.357175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:03.357042+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.357042+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:36.663893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.920914+0000","last_change":"2024-05-15T18:11:58.920914+0000","last_active":"2024-05-15T18:11:58.920914+0000","last_peered":"2024-05-15T18:11:58.920914+0000","last_clean":"2024-05-15T18:11:58.920914+0000","last_became_active":"2024-05-15T18:08:45.200341+0000","last_became_peered":"2024-05-15T18:08:45.200341+0000","last_unstale":"2024-05-15T18:11:58.920914+0000","last_undegraded":"2024-05-15T18:11:58.920914+0000","last_fullsized":"2024-05-15T18:11:58.920914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.920801+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.920801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:00:11.891898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"31'21","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:57.981315+0000","last_change":"2024-05-15T18:12:57.981315+0000","last_active":"2024-05-15T18:12:57.981315+0000","last_peered":"2024-05-15T18:12:57.981315+0000","last_clean":"2024-05-15T18:12:57.981315+0000","last_became_active":"2024-05-15T18:08:47.219180+0000","last_became_peered":"2024-05-15T18:08:47.219180+0000","last_unstale":"2024-05-15T18:12:57.981315+0000","last_undegraded":"2024-05-15T18:12:57.981315+0000","last_fullsized":"2024-05-15T18:12:57.981315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:57.981174+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:57.981174+0000","last_clean_scrub_stamp":"2024-05-15T18:12:57.981174+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:13:27.284069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"31'14","reported_seq":90,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.855619+0000","last_change":"2024-05-15T18:12:51.855619+0000","last_active":"2024-05-15T18:12:51.855619+0000","last_peered":"2024-05-15T18:12:51.855619+0000","last_clean":"2024-05-15T18:12:51.855619+0000","last_became_active":"2024-05-15T18:08:39.191096+0000","last_became_peered":"2024-05-15T18:08:39.191096+0000","last_unstale":"2024-05-15T18:12:51.855619+0000","last_undegraded":"2024-05-15T18:12:51.855619+0000","last_fullsized":"2024-05-15T18:12:51.855619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:51.855472+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:51.855472+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.855472+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:45:43.569013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:29.201631+0000","last_change":"2024-05-15T18:12:29.201631+0000","last_active":"2024-05-15T18:12:29.201631+0000","last_peered":"2024-05-15T18:12:29.201631+0000","last_clean":"2024-05-15T18:12:29.201631+0000","last_became_active":"2024-05-15T18:08:37.180706+0000","last_became_peered":"2024-05-15T18:08:37.180706+0000","last_unstale":"2024-05-15T18:12:29.201631+0000","last_undegraded":"2024-05-15T18:12:29.201631+0000","last_fullsized":"2024-05-15T18:12:29.201631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:29.201511+0000","last_clean_scrub_stamp":"2024-05-15T18:12:29.201511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:36.487260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.549324+0000","last_change":"2024-05-15T18:12:17.549324+0000","last_active":"2024-05-15T18:12:17.549324+0000","last_peered":"2024-05-15T18:12:17.549324+0000","last_clean":"2024-05-15T18:12:17.549324+0000","last_became_active":"2024-05-15T18:08:41.189050+0000","last_became_peered":"2024-05-15T18:08:41.189050+0000","last_unstale":"2024-05-15T18:12:17.549324+0000","last_undegraded":"2024-05-15T18:12:17.549324+0000","last_fullsized":"2024-05-15T18:12:17.549324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.549183+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.549183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:54.810132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.153393+0000","last_change":"2024-05-15T18:12:05.153393+0000","last_active":"2024-05-15T18:12:05.153393+0000","last_peered":"2024-05-15T18:12:05.153393+0000","last_clean":"2024-05-15T18:12:05.153393+0000","last_became_active":"2024-05-15T18:08:43.192162+0000","last_became_peered":"2024-05-15T18:08:43.192162+0000","last_unstale":"2024-05-15T18:12:05.153393+0000","last_undegraded":"2024-05-15T18:12:05.153393+0000","last_fullsized":"2024-05-15T18:12:05.153393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:05.153268+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.153268+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:23:48.552424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.235658+0000","last_change":"2024-05-15T18:12:25.235658+0000","last_active":"2024-05-15T18:12:25.235658+0000","last_peered":"2024-05-15T18:12:25.235658+0000","last_clean":"2024-05-15T18:12:25.235658+0000","last_became_active":"2024-05-15T18:08:45.210292+0000","last_became_peered":"2024-05-15T18:08:45.210292+0000","last_unstale":"2024-05-15T18:12:25.235658+0000","last_undegraded":"2024-05-15T18:12:25.235658+0000","last_fullsized":"2024-05-15T18:12:25.235658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.235510+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.235510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:10.157015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:17.144759+0000","last_change":"2024-05-15T18:13:17.144788+0000","last_active":"2024-05-15T18:13:17.144759+0000","last_peered":"2024-05-15T18:13:17.144759+0000","last_clean":"2024-05-15T18:13:17.144759+0000","last_became_active":"2024-05-15T18:08:47.219353+0000","last_became_peered":"2024-05-15T18:08:47.219353+0000","last_unstale":"2024-05-15T18:13:17.144759+0000","last_undegraded":"2024-05-15T18:13:17.144759+0000","last_fullsized":"2024-05-15T18:13:17.144759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:13:17.144662+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:13:17.144662+0000","last_clean_scrub_stamp":"2024-05-15T18:13:17.144662+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:27:15.326605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.318664+0000","last_change":"2024-05-15T18:12:12.318664+0000","last_active":"2024-05-15T18:12:12.318664+0000","last_peered":"2024-05-15T18:12:12.318664+0000","last_clean":"2024-05-15T18:12:12.318664+0000","last_became_active":"2024-05-15T18:08:39.191492+0000","last_became_peered":"2024-05-15T18:08:39.191492+0000","last_unstale":"2024-05-15T18:12:12.318664+0000","last_undegraded":"2024-05-15T18:12:12.318664+0000","last_fullsized":"2024-05-15T18:12:12.318664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:12.318542+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.318542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:44:02.692777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.150506+0000","last_change":"2024-05-15T18:12:52.150506+0000","last_active":"2024-05-15T18:12:52.150506+0000","last_peered":"2024-05-15T18:12:52.150506+0000","last_clean":"2024-05-15T18:12:52.150506+0000","last_became_active":"2024-05-15T18:08:37.181931+0000","last_became_peered":"2024-05-15T18:08:37.181931+0000","last_unstale":"2024-05-15T18:12:52.150506+0000","last_undegraded":"2024-05-15T18:12:52.150506+0000","last_fullsized":"2024-05-15T18:12:52.150506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:52.150383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:52.150383+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.150383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:43:18.858365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.119374+0000","last_change":"2024-05-15T18:12:23.119374+0000","last_active":"2024-05-15T18:12:23.119374+0000","last_peered":"2024-05-15T18:12:23.119374+0000","last_clean":"2024-05-15T18:12:23.119374+0000","last_became_active":"2024-05-15T18:08:41.188427+0000","last_became_peered":"2024-05-15T18:08:41.188427+0000","last_unstale":"2024-05-15T18:12:23.119374+0000","last_undegraded":"2024-05-15T18:12:23.119374+0000","last_fullsized":"2024-05-15T18:12:23.119374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:23.119253+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.119253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:24.003247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"31'45","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.592703+0000","last_change":"2024-05-15T18:12:09.592703+0000","last_active":"2024-05-15T18:12:09.592703+0000","last_peered":"2024-05-15T18:12:09.592703+0000","last_clean":"2024-05-15T18:12:09.592703+0000","last_became_active":"2024-05-15T18:08:43.193858+0000","last_became_peered":"2024-05-15T18:08:43.193858+0000","last_unstale":"2024-05-15T18:12:09.592703+0000","last_undegraded":"2024-05-15T18:12:09.592703+0000","last_fullsized":"2024-05-15T18:12:09.592703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:09.592581+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.592581+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:53:31.226178+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'285","reported_seq":416,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.470721+0000","last_change":"2024-05-15T18:12:00.470721+0000","last_active":"2024-05-15T18:12:00.470721+0000","last_peered":"2024-05-15T18:12:00.470721+0000","last_clean":"2024-05-15T18:12:00.470721+0000","last_became_active":"2024-05-15T18:08:45.200346+0000","last_became_peered":"2024-05-15T18:08:45.200346+0000","last_unstale":"2024-05-15T18:12:00.470721+0000","last_undegraded":"2024-05-15T18:12:00.470721+0000","last_fullsized":"2024-05-15T18:12:00.470721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.470590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.470590+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:19:35.192862+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.974355+0000","last_change":"2024-05-15T18:12:52.974355+0000","last_active":"2024-05-15T18:12:52.974355+0000","last_peered":"2024-05-15T18:12:52.974355+0000","last_clean":"2024-05-15T18:12:52.974355+0000","last_became_active":"2024-05-15T18:08:47.214955+0000","last_became_peered":"2024-05-15T18:08:47.214955+0000","last_unstale":"2024-05-15T18:12:52.974355+0000","last_undegraded":"2024-05-15T18:12:52.974355+0000","last_fullsized":"2024-05-15T18:12:52.974355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'13","last_scrub_stamp":"2024-05-15T18:12:52.974233+0000","last_deep_scrub":"31'13","last_deep_scrub_stamp":"2024-05-15T18:12:52.974233+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.974233+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:24:07.326548+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.656587+0000","last_change":"2024-05-15T18:12:44.656587+0000","last_active":"2024-05-15T18:12:44.656587+0000","last_peered":"2024-05-15T18:12:44.656587+0000","last_clean":"2024-05-15T18:12:44.656587+0000","last_became_active":"2024-05-15T18:08:39.185009+0000","last_became_peered":"2024-05-15T18:08:39.185009+0000","last_unstale":"2024-05-15T18:12:44.656587+0000","last_undegraded":"2024-05-15T18:12:44.656587+0000","last_fullsized":"2024-05-15T18:12:44.656587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:44.656449+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:44.656449+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.656449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:26.887517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:01.075398+0000","last_change":"2024-05-15T18:13:01.075430+0000","last_active":"2024-05-15T18:13:01.075398+0000","last_peered":"2024-05-15T18:13:01.075398+0000","last_clean":"2024-05-15T18:13:01.075398+0000","last_became_active":"2024-05-15T18:08:37.184943+0000","last_became_peered":"2024-05-15T18:08:37.184943+0000","last_unstale":"2024-05-15T18:13:01.075398+0000","last_undegraded":"2024-05-15T18:13:01.075398+0000","last_fullsized":"2024-05-15T18:13:01.075398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:13:01.075291+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:13:01.075291+0000","last_clean_scrub_stamp":"2024-05-15T18:13:01.075291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:37:13.867162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'5","reported_seq":429,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.095898+0000","last_change":"2024-05-15T18:12:16.095898+0000","last_active":"2024-05-15T18:12:16.095898+0000","last_peered":"2024-05-15T18:12:16.095898+0000","last_clean":"2024-05-15T18:12:16.095898+0000","last_became_active":"2024-05-15T18:08:41.190645+0000","last_became_peered":"2024-05-15T18:08:41.190645+0000","last_unstale":"2024-05-15T18:12:16.095898+0000","last_undegraded":"2024-05-15T18:12:16.095898+0000","last_fullsized":"2024-05-15T18:12:16.095898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:16.095781+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.095781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:17.249315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'15","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.331845+0000","last_change":"2024-05-15T18:12:09.331845+0000","last_active":"2024-05-15T18:12:09.331845+0000","last_peered":"2024-05-15T18:12:09.331845+0000","last_clean":"2024-05-15T18:12:09.331845+0000","last_became_active":"2024-05-15T18:08:43.204311+0000","last_became_peered":"2024-05-15T18:08:43.204311+0000","last_unstale":"2024-05-15T18:12:09.331845+0000","last_undegraded":"2024-05-15T18:12:09.331845+0000","last_fullsized":"2024-05-15T18:12:09.331845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'15","last_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_deep_scrub":"31'15","last_deep_scrub_stamp":"2024-05-15T18:12:09.331720+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.331720+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:28.300746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'285","reported_seq":472,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:00.276044+0000","last_change":"2024-05-15T18:12:00.276044+0000","last_active":"2024-05-15T18:12:00.276044+0000","last_peered":"2024-05-15T18:12:00.276044+0000","last_clean":"2024-05-15T18:12:00.276044+0000","last_became_active":"2024-05-15T18:08:45.199037+0000","last_became_peered":"2024-05-15T18:08:45.199037+0000","last_unstale":"2024-05-15T18:12:00.276044+0000","last_undegraded":"2024-05-15T18:12:00.276044+0000","last_fullsized":"2024-05-15T18:12:00.276044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:00.275912+0000","last_clean_scrub_stamp":"2024-05-15T18:12:00.275912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:57:39.193715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.629539+0000","last_change":"2024-05-15T18:12:45.629539+0000","last_active":"2024-05-15T18:12:45.629539+0000","last_peered":"2024-05-15T18:12:45.629539+0000","last_clean":"2024-05-15T18:12:45.629539+0000","last_became_active":"2024-05-15T18:08:47.214779+0000","last_became_peered":"2024-05-15T18:08:47.214779+0000","last_unstale":"2024-05-15T18:12:45.629539+0000","last_undegraded":"2024-05-15T18:12:45.629539+0000","last_fullsized":"2024-05-15T18:12:45.629539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:45.629416+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:45.629416+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.629416+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:49.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.032552+0000","last_change":"2024-05-15T18:12:19.032552+0000","last_active":"2024-05-15T18:12:19.032552+0000","last_peered":"2024-05-15T18:12:19.032552+0000","last_clean":"2024-05-15T18:12:19.032552+0000","last_became_active":"2024-05-15T18:08:39.193343+0000","last_became_peered":"2024-05-15T18:08:39.193343+0000","last_unstale":"2024-05-15T18:12:19.032552+0000","last_undegraded":"2024-05-15T18:12:19.032552+0000","last_fullsized":"2024-05-15T18:12:19.032552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:19.032366+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.032366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:37.619094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:55.176447+0000","last_change":"2024-05-15T18:12:55.176447+0000","last_active":"2024-05-15T18:12:55.176447+0000","last_peered":"2024-05-15T18:12:55.176447+0000","last_clean":"2024-05-15T18:12:55.176447+0000","last_became_active":"2024-05-15T18:08:37.182688+0000","last_became_peered":"2024-05-15T18:08:37.182688+0000","last_unstale":"2024-05-15T18:12:55.176447+0000","last_undegraded":"2024-05-15T18:12:55.176447+0000","last_fullsized":"2024-05-15T18:12:55.176447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:55.176293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:55.176293+0000","last_clean_scrub_stamp":"2024-05-15T18:12:55.176293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:03.564362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.354871+0000","last_change":"2024-05-15T18:12:08.354871+0000","last_active":"2024-05-15T18:12:08.354871+0000","last_peered":"2024-05-15T18:12:08.354871+0000","last_clean":"2024-05-15T18:12:08.354871+0000","last_became_active":"2024-05-15T18:08:41.189340+0000","last_became_peered":"2024-05-15T18:08:41.189340+0000","last_unstale":"2024-05-15T18:12:08.354871+0000","last_undegraded":"2024-05-15T18:12:08.354871+0000","last_fullsized":"2024-05-15T18:12:08.354871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:08.354757+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.354757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:02.756370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"31'48","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.149858+0000","last_change":"2024-05-15T18:12:07.149858+0000","last_active":"2024-05-15T18:12:07.149858+0000","last_peered":"2024-05-15T18:12:07.149858+0000","last_clean":"2024-05-15T18:12:07.149858+0000","last_became_active":"2024-05-15T18:08:43.191921+0000","last_became_peered":"2024-05-15T18:08:43.191921+0000","last_unstale":"2024-05-15T18:12:07.149858+0000","last_undegraded":"2024-05-15T18:12:07.149858+0000","last_fullsized":"2024-05-15T18:12:07.149858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:07.149716+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.149716+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:51.341623+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.495696+0000","last_change":"2024-05-15T18:11:59.495696+0000","last_active":"2024-05-15T18:11:59.495696+0000","last_peered":"2024-05-15T18:11:59.495696+0000","last_clean":"2024-05-15T18:11:59.495696+0000","last_became_active":"2024-05-15T18:08:45.203741+0000","last_became_peered":"2024-05-15T18:08:45.203741+0000","last_unstale":"2024-05-15T18:11:59.495696+0000","last_undegraded":"2024-05-15T18:11:59.495696+0000","last_fullsized":"2024-05-15T18:11:59.495696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.495587+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.495587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:27.408105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"31'8","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.086196+0000","last_change":"2024-05-15T18:12:10.086196+0000","last_active":"2024-05-15T18:12:10.086196+0000","last_peered":"2024-05-15T18:12:10.086196+0000","last_clean":"2024-05-15T18:12:10.086196+0000","last_became_active":"2024-05-15T18:08:47.213779+0000","last_became_peered":"2024-05-15T18:08:47.213779+0000","last_unstale":"2024-05-15T18:12:10.086196+0000","last_undegraded":"2024-05-15T18:12:10.086196+0000","last_fullsized":"2024-05-15T18:12:10.086196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:10.086069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.086069+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:14:22.063457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":431,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.274855+0000","last_change":"2024-05-15T18:12:15.274855+0000","last_active":"2024-05-15T18:12:15.274855+0000","last_peered":"2024-05-15T18:12:15.274855+0000","last_clean":"2024-05-15T18:12:15.274855+0000","last_became_active":"2024-05-15T18:08:39.189272+0000","last_became_peered":"2024-05-15T18:08:39.189272+0000","last_unstale":"2024-05-15T18:12:15.274855+0000","last_undegraded":"2024-05-15T18:12:15.274855+0000","last_fullsized":"2024-05-15T18:12:15.274855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.274744+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.274744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:41:50.129521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":211,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.016283+0000","last_change":"2024-05-15T18:12:44.016319+0000","last_active":"2024-05-15T18:12:44.016283+0000","last_peered":"2024-05-15T18:12:44.016283+0000","last_clean":"2024-05-15T18:12:44.016283+0000","last_became_active":"2024-05-15T18:08:26.215235+0000","last_became_peered":"2024-05-15T18:08:26.215235+0000","last_unstale":"2024-05-15T18:12:44.016283+0000","last_undegraded":"2024-05-15T18:12:44.016283+0000","last_fullsized":"2024-05-15T18:12:44.016283+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-05-15T18:12:44.016193+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-05-15T18:12:44.016193+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.016193+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:53.612988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:07.121715+0000","last_change":"2024-05-15T18:13:07.121739+0000","last_active":"2024-05-15T18:13:07.121715+0000","last_peered":"2024-05-15T18:13:07.121715+0000","last_clean":"2024-05-15T18:13:07.121715+0000","last_became_active":"2024-05-15T18:08:31.149935+0000","last_became_peered":"2024-05-15T18:08:31.149935+0000","last_unstale":"2024-05-15T18:13:07.121715+0000","last_undegraded":"2024-05-15T18:13:07.121715+0000","last_fullsized":"2024-05-15T18:13:07.121715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:07.121602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:07.121602+0000","last_clean_scrub_stamp":"2024-05-15T18:13:07.121602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:53.520505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.161399+0000","last_change":"2024-05-15T18:12:48.161399+0000","last_active":"2024-05-15T18:12:48.161399+0000","last_peered":"2024-05-15T18:12:48.161399+0000","last_clean":"2024-05-15T18:12:48.161399+0000","last_became_active":"2024-05-15T18:08:37.186087+0000","last_became_peered":"2024-05-15T18:08:37.186087+0000","last_unstale":"2024-05-15T18:12:48.161399+0000","last_undegraded":"2024-05-15T18:12:48.161399+0000","last_fullsized":"2024-05-15T18:12:48.161399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.161262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.161262+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.161262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:54:13.067615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.108833+0000","last_change":"2024-05-15T18:12:15.108833+0000","last_active":"2024-05-15T18:12:15.108833+0000","last_peered":"2024-05-15T18:12:15.108833+0000","last_clean":"2024-05-15T18:12:15.108833+0000","last_became_active":"2024-05-15T18:08:41.190839+0000","last_became_peered":"2024-05-15T18:08:41.190839+0000","last_unstale":"2024-05-15T18:12:15.108833+0000","last_undegraded":"2024-05-15T18:12:15.108833+0000","last_fullsized":"2024-05-15T18:12:15.108833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.108718+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.108718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:50:47.176686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"31'87","reported_seq":178,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.302463+0000","last_change":"2024-05-15T18:12:13.302463+0000","last_active":"2024-05-15T18:12:13.302463+0000","last_peered":"2024-05-15T18:12:13.302463+0000","last_clean":"2024-05-15T18:12:13.302463+0000","last_became_active":"2024-05-15T18:08:43.204351+0000","last_became_peered":"2024-05-15T18:08:43.204351+0000","last_unstale":"2024-05-15T18:12:13.302463+0000","last_undegraded":"2024-05-15T18:12:13.302463+0000","last_fullsized":"2024-05-15T18:12:13.302463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'87","last_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_deep_scrub":"31'87","last_deep_scrub_stamp":"2024-05-15T18:12:13.302331+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.302331+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:50:17.032807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.959264+0000","last_change":"2024-05-15T18:12:13.959264+0000","last_active":"2024-05-15T18:12:13.959264+0000","last_peered":"2024-05-15T18:12:13.959264+0000","last_clean":"2024-05-15T18:12:13.959264+0000","last_became_active":"2024-05-15T18:08:45.207833+0000","last_became_peered":"2024-05-15T18:08:45.207833+0000","last_unstale":"2024-05-15T18:12:13.959264+0000","last_undegraded":"2024-05-15T18:12:13.959264+0000","last_fullsized":"2024-05-15T18:12:13.959264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.959124+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.959124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:07.494745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"31'85","reported_seq":177,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.529885+0000","last_change":"2024-05-15T18:12:18.529885+0000","last_active":"2024-05-15T18:12:18.529885+0000","last_peered":"2024-05-15T18:12:18.529885+0000","last_clean":"2024-05-15T18:12:18.529885+0000","last_became_active":"2024-05-15T18:08:47.212118+0000","last_became_peered":"2024-05-15T18:08:47.212118+0000","last_unstale":"2024-05-15T18:12:18.529885+0000","last_undegraded":"2024-05-15T18:12:18.529885+0000","last_fullsized":"2024-05-15T18:12:18.529885+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'85","last_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_deep_scrub":"31'85","last_deep_scrub_stamp":"2024-05-15T18:12:18.529758+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.529758+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:29.586821+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":218,"num_write":165,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.150090+0000","last_change":"2024-05-15T18:12:46.150090+0000","last_active":"2024-05-15T18:12:46.150090+0000","last_peered":"2024-05-15T18:12:46.150090+0000","last_clean":"2024-05-15T18:12:46.150090+0000","last_became_active":"2024-05-15T18:08:39.180479+0000","last_became_peered":"2024-05-15T18:08:39.180479+0000","last_unstale":"2024-05-15T18:12:46.150090+0000","last_undegraded":"2024-05-15T18:12:46.150090+0000","last_fullsized":"2024-05-15T18:12:46.150090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:46.149947+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.149947+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.149947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:17:44.752649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:08.172026+0000","last_change":"2024-05-15T18:13:08.172050+0000","last_active":"2024-05-15T18:13:08.172026+0000","last_peered":"2024-05-15T18:13:08.172026+0000","last_clean":"2024-05-15T18:13:08.172026+0000","last_became_active":"2024-05-15T18:08:31.152404+0000","last_became_peered":"2024-05-15T18:08:31.152404+0000","last_unstale":"2024-05-15T18:13:08.172026+0000","last_undegraded":"2024-05-15T18:13:08.172026+0000","last_fullsized":"2024-05-15T18:13:08.172026+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:08.171935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:08.171935+0000","last_clean_scrub_stamp":"2024-05-15T18:13:08.171935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:44:45.537479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.033076+0000","last_change":"2024-05-15T18:12:50.033123+0000","last_active":"2024-05-15T18:12:50.033076+0000","last_peered":"2024-05-15T18:12:50.033076+0000","last_clean":"2024-05-15T18:12:50.033076+0000","last_became_active":"2024-05-15T18:08:37.179257+0000","last_became_peered":"2024-05-15T18:08:37.179257+0000","last_unstale":"2024-05-15T18:12:50.033076+0000","last_undegraded":"2024-05-15T18:12:50.033076+0000","last_fullsized":"2024-05-15T18:12:50.033076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.032969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.032969+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.032969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:38.076744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.426564+0000","last_change":"2024-05-15T18:12:01.426564+0000","last_active":"2024-05-15T18:12:01.426564+0000","last_peered":"2024-05-15T18:12:01.426564+0000","last_clean":"2024-05-15T18:12:01.426564+0000","last_became_active":"2024-05-15T18:08:41.190456+0000","last_became_peered":"2024-05-15T18:08:41.190456+0000","last_unstale":"2024-05-15T18:12:01.426564+0000","last_undegraded":"2024-05-15T18:12:01.426564+0000","last_fullsized":"2024-05-15T18:12:01.426564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.426444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.426444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:20.013172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"31'293","reported_seq":519,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.240363+0000","last_change":"2024-05-15T18:12:03.240363+0000","last_active":"2024-05-15T18:12:03.240363+0000","last_peered":"2024-05-15T18:12:03.240363+0000","last_clean":"2024-05-15T18:12:03.240363+0000","last_became_active":"2024-05-15T18:08:43.197148+0000","last_became_peered":"2024-05-15T18:08:43.197148+0000","last_unstale":"2024-05-15T18:12:03.240363+0000","last_undegraded":"2024-05-15T18:12:03.240363+0000","last_fullsized":"2024-05-15T18:12:03.240363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'293","last_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_deep_scrub":"31'293","last_deep_scrub_stamp":"2024-05-15T18:12:03.240231+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.240231+0000","objects_scrubbed":10,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:29:17.206611+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":384,"num_read_kb":387,"num_write":42,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.216735+0000","last_change":"2024-05-15T18:12:33.216735+0000","last_active":"2024-05-15T18:12:33.216735+0000","last_peered":"2024-05-15T18:12:33.216735+0000","last_clean":"2024-05-15T18:12:33.216735+0000","last_became_active":"2024-05-15T18:08:45.210487+0000","last_became_peered":"2024-05-15T18:08:45.210487+0000","last_unstale":"2024-05-15T18:12:33.216735+0000","last_undegraded":"2024-05-15T18:12:33.216735+0000","last_fullsized":"2024-05-15T18:12:33.216735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:33.216625+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.216625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:03:46.914136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"31'5","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.079442+0000","last_change":"2024-05-15T18:12:18.079442+0000","last_active":"2024-05-15T18:12:18.079442+0000","last_peered":"2024-05-15T18:12:18.079442+0000","last_clean":"2024-05-15T18:12:18.079442+0000","last_became_active":"2024-05-15T18:08:47.216930+0000","last_became_peered":"2024-05-15T18:08:47.216930+0000","last_unstale":"2024-05-15T18:12:18.079442+0000","last_undegraded":"2024-05-15T18:12:18.079442+0000","last_fullsized":"2024-05-15T18:12:18.079442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:18.079282+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.079282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:50.563689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"31'4","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.972287+0000","last_change":"2024-05-15T18:12:51.972287+0000","last_active":"2024-05-15T18:12:51.972287+0000","last_peered":"2024-05-15T18:12:51.972287+0000","last_clean":"2024-05-15T18:12:51.972287+0000","last_became_active":"2024-05-15T18:08:39.186531+0000","last_became_peered":"2024-05-15T18:08:39.186531+0000","last_unstale":"2024-05-15T18:12:51.972287+0000","last_undegraded":"2024-05-15T18:12:51.972287+0000","last_fullsized":"2024-05-15T18:12:51.972287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:51.972153+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:51.972153+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.972153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:36.602233+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.590983+0000","last_change":"2024-05-15T18:12:36.590983+0000","last_active":"2024-05-15T18:12:36.590983+0000","last_peered":"2024-05-15T18:12:36.590983+0000","last_clean":"2024-05-15T18:12:36.590983+0000","last_became_active":"2024-05-15T18:08:31.152960+0000","last_became_peered":"2024-05-15T18:08:31.152960+0000","last_unstale":"2024-05-15T18:12:36.590983+0000","last_undegraded":"2024-05-15T18:12:36.590983+0000","last_fullsized":"2024-05-15T18:12:36.590983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:36.590813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:36.590813+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.590813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:57.873273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.125701+0000","last_change":"2024-05-15T18:12:46.125729+0000","last_active":"2024-05-15T18:12:46.125701+0000","last_peered":"2024-05-15T18:12:46.125701+0000","last_clean":"2024-05-15T18:12:46.125701+0000","last_became_active":"2024-05-15T18:08:37.172584+0000","last_became_peered":"2024-05-15T18:08:37.172584+0000","last_unstale":"2024-05-15T18:12:46.125701+0000","last_undegraded":"2024-05-15T18:12:46.125701+0000","last_fullsized":"2024-05-15T18:12:46.125701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:46.125590+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.125590+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.125590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:16:40.358922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.560727+0000","last_change":"2024-05-15T18:12:51.560727+0000","last_active":"2024-05-15T18:12:51.560727+0000","last_peered":"2024-05-15T18:12:51.560727+0000","last_clean":"2024-05-15T18:12:51.560727+0000","last_became_active":"2024-05-15T18:09:19.410941+0000","last_became_peered":"2024-05-15T18:09:19.410941+0000","last_unstale":"2024-05-15T18:12:51.560727+0000","last_undegraded":"2024-05-15T18:12:51.560727+0000","last_fullsized":"2024-05-15T18:12:51.560727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:51.560605+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:51.560605+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.560605+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:05:01.157400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"31'24","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.543438+0000","last_change":"2024-05-15T18:12:07.543438+0000","last_active":"2024-05-15T18:12:07.543438+0000","last_peered":"2024-05-15T18:12:07.543438+0000","last_clean":"2024-05-15T18:12:07.543438+0000","last_became_active":"2024-05-15T18:08:43.195257+0000","last_became_peered":"2024-05-15T18:08:43.195257+0000","last_unstale":"2024-05-15T18:12:07.543438+0000","last_undegraded":"2024-05-15T18:12:07.543438+0000","last_fullsized":"2024-05-15T18:12:07.543438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:07.543314+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.543314+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:08:32.467749+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.928898+0000","last_change":"2024-05-15T18:11:57.928898+0000","last_active":"2024-05-15T18:11:57.928898+0000","last_peered":"2024-05-15T18:11:57.928898+0000","last_clean":"2024-05-15T18:11:57.928898+0000","last_became_active":"2024-05-15T18:08:45.203876+0000","last_became_peered":"2024-05-15T18:08:45.203876+0000","last_unstale":"2024-05-15T18:11:57.928898+0000","last_undegraded":"2024-05-15T18:11:57.928898+0000","last_fullsized":"2024-05-15T18:11:57.928898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.928793+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.928793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.522391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.124614+0000","last_change":"2024-05-15T18:12:49.124614+0000","last_active":"2024-05-15T18:12:49.124614+0000","last_peered":"2024-05-15T18:12:49.124614+0000","last_clean":"2024-05-15T18:12:49.124614+0000","last_became_active":"2024-05-15T18:08:47.219119+0000","last_became_peered":"2024-05-15T18:08:47.219119+0000","last_unstale":"2024-05-15T18:12:49.124614+0000","last_undegraded":"2024-05-15T18:12:49.124614+0000","last_fullsized":"2024-05-15T18:12:49.124614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:49.124505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:49.124505+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.124505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:44:13.004567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"31'22","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.125516+0000","last_change":"2024-05-15T18:12:38.125516+0000","last_active":"2024-05-15T18:12:38.125516+0000","last_peered":"2024-05-15T18:12:38.125516+0000","last_clean":"2024-05-15T18:12:38.125516+0000","last_became_active":"2024-05-15T18:08:39.182587+0000","last_became_peered":"2024-05-15T18:08:39.182587+0000","last_unstale":"2024-05-15T18:12:38.125516+0000","last_undegraded":"2024-05-15T18:12:38.125516+0000","last_fullsized":"2024-05-15T18:12:38.125516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'22","last_scrub_stamp":"2024-05-15T18:12:38.125335+0000","last_deep_scrub":"31'22","last_deep_scrub_stamp":"2024-05-15T18:12:38.125335+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.125335+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:38.435114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":62,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:10.147042+0000","last_change":"2024-05-15T18:13:10.147066+0000","last_active":"2024-05-15T18:13:10.147042+0000","last_peered":"2024-05-15T18:13:10.147042+0000","last_clean":"2024-05-15T18:13:10.147042+0000","last_became_active":"2024-05-15T18:08:31.153209+0000","last_became_peered":"2024-05-15T18:08:31.153209+0000","last_unstale":"2024-05-15T18:13:10.147042+0000","last_undegraded":"2024-05-15T18:13:10.147042+0000","last_fullsized":"2024-05-15T18:13:10.147042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:10.146942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:10.146942+0000","last_clean_scrub_stamp":"2024-05-15T18:13:10.146942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:25:13.846284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.545692+0000","last_change":"2024-05-15T18:12:37.545692+0000","last_active":"2024-05-15T18:12:37.545692+0000","last_peered":"2024-05-15T18:12:37.545692+0000","last_clean":"2024-05-15T18:12:37.545692+0000","last_became_active":"2024-05-15T18:08:37.172781+0000","last_became_peered":"2024-05-15T18:08:37.172781+0000","last_unstale":"2024-05-15T18:12:37.545692+0000","last_undegraded":"2024-05-15T18:12:37.545692+0000","last_fullsized":"2024-05-15T18:12:37.545692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.545580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.545580+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.545580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:29.736129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.016404+0000","last_change":"2024-05-15T18:12:17.016404+0000","last_active":"2024-05-15T18:12:17.016404+0000","last_peered":"2024-05-15T18:12:17.016404+0000","last_clean":"2024-05-15T18:12:17.016404+0000","last_became_active":"2024-05-15T18:08:41.191107+0000","last_became_peered":"2024-05-15T18:08:41.191107+0000","last_unstale":"2024-05-15T18:12:17.016404+0000","last_undegraded":"2024-05-15T18:12:17.016404+0000","last_fullsized":"2024-05-15T18:12:17.016404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.016284+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.016284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:25.998584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"31'21","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:05.380243+0000","last_change":"2024-05-15T18:12:05.380243+0000","last_active":"2024-05-15T18:12:05.380243+0000","last_peered":"2024-05-15T18:12:05.380243+0000","last_clean":"2024-05-15T18:12:05.380243+0000","last_became_active":"2024-05-15T18:08:43.201964+0000","last_became_peered":"2024-05-15T18:08:43.201964+0000","last_unstale":"2024-05-15T18:12:05.380243+0000","last_undegraded":"2024-05-15T18:12:05.380243+0000","last_fullsized":"2024-05-15T18:12:05.380243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:05.380117+0000","last_clean_scrub_stamp":"2024-05-15T18:12:05.380117+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:27.585526+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.174237+0000","last_change":"2024-05-15T18:12:37.174237+0000","last_active":"2024-05-15T18:12:37.174237+0000","last_peered":"2024-05-15T18:12:37.174237+0000","last_clean":"2024-05-15T18:12:37.174237+0000","last_became_active":"2024-05-15T18:08:45.210624+0000","last_became_peered":"2024-05-15T18:08:45.210624+0000","last_unstale":"2024-05-15T18:12:37.174237+0000","last_undegraded":"2024-05-15T18:12:37.174237+0000","last_fullsized":"2024-05-15T18:12:37.174237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.174120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.174120+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.174120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:57.846747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.010324+0000","last_change":"2024-05-15T18:12:26.010324+0000","last_active":"2024-05-15T18:12:26.010324+0000","last_peered":"2024-05-15T18:12:26.010324+0000","last_clean":"2024-05-15T18:12:26.010324+0000","last_became_active":"2024-05-15T18:08:47.221575+0000","last_became_peered":"2024-05-15T18:08:47.221575+0000","last_unstale":"2024-05-15T18:12:26.010324+0000","last_undegraded":"2024-05-15T18:12:26.010324+0000","last_fullsized":"2024-05-15T18:12:26.010324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:26.010213+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.010213+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:46:44.979239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"31'8","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.995202+0000","last_change":"2024-05-15T18:12:19.995202+0000","last_active":"2024-05-15T18:12:19.995202+0000","last_peered":"2024-05-15T18:12:19.995202+0000","last_clean":"2024-05-15T18:12:19.995202+0000","last_became_active":"2024-05-15T18:08:39.193828+0000","last_became_peered":"2024-05-15T18:08:39.193828+0000","last_unstale":"2024-05-15T18:12:19.995202+0000","last_undegraded":"2024-05-15T18:12:19.995202+0000","last_fullsized":"2024-05-15T18:12:19.995202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:19.995046+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.995046+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:22.542569+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.601468+0000","last_change":"2024-05-15T18:12:39.601468+0000","last_active":"2024-05-15T18:12:39.601468+0000","last_peered":"2024-05-15T18:12:39.601468+0000","last_clean":"2024-05-15T18:12:39.601468+0000","last_became_active":"2024-05-15T18:08:37.173673+0000","last_became_peered":"2024-05-15T18:08:37.173673+0000","last_unstale":"2024-05-15T18:12:39.601468+0000","last_undegraded":"2024-05-15T18:12:39.601468+0000","last_fullsized":"2024-05-15T18:12:39.601468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-15T18:12:39.601344+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-15T18:12:39.601344+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.601344+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:45:07.744236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.094140+0000","last_change":"2024-05-15T18:12:45.094166+0000","last_active":"2024-05-15T18:12:45.094140+0000","last_peered":"2024-05-15T18:12:45.094140+0000","last_clean":"2024-05-15T18:12:45.094140+0000","last_became_active":"2024-05-15T18:08:31.152006+0000","last_became_peered":"2024-05-15T18:08:31.152006+0000","last_unstale":"2024-05-15T18:12:45.094140+0000","last_undegraded":"2024-05-15T18:12:45.094140+0000","last_fullsized":"2024-05-15T18:12:45.094140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:45.094050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:45.094050+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.094050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:38:47.944537+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"31'1","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.927216+0000","last_change":"2024-05-15T18:12:12.927216+0000","last_active":"2024-05-15T18:12:12.927216+0000","last_peered":"2024-05-15T18:12:12.927216+0000","last_clean":"2024-05-15T18:12:12.927216+0000","last_became_active":"2024-05-15T18:08:41.195422+0000","last_became_peered":"2024-05-15T18:08:41.195422+0000","last_unstale":"2024-05-15T18:12:12.927216+0000","last_undegraded":"2024-05-15T18:12:12.927216+0000","last_fullsized":"2024-05-15T18:12:12.927216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2024-05-15T18:12:12.927083+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.927083+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:24.672114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"31'73","reported_seq":150,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.879840+0000","last_change":"2024-05-15T18:12:06.879840+0000","last_active":"2024-05-15T18:12:06.879840+0000","last_peered":"2024-05-15T18:12:06.879840+0000","last_clean":"2024-05-15T18:12:06.879840+0000","last_became_active":"2024-05-15T18:08:43.200453+0000","last_became_peered":"2024-05-15T18:08:43.200453+0000","last_unstale":"2024-05-15T18:12:06.879840+0000","last_undegraded":"2024-05-15T18:12:06.879840+0000","last_fullsized":"2024-05-15T18:12:06.879840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'73","last_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_deep_scrub":"31'73","last_deep_scrub_stamp":"2024-05-15T18:12:06.879711+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.879711+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:16.898190+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.431143+0000","last_change":"2024-05-15T18:12:01.431143+0000","last_active":"2024-05-15T18:12:01.431143+0000","last_peered":"2024-05-15T18:12:01.431143+0000","last_clean":"2024-05-15T18:12:01.431143+0000","last_became_active":"2024-05-15T18:08:45.198073+0000","last_became_peered":"2024-05-15T18:08:45.198073+0000","last_unstale":"2024-05-15T18:12:01.431143+0000","last_undegraded":"2024-05-15T18:12:01.431143+0000","last_fullsized":"2024-05-15T18:12:01.431143+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.431023+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.431023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:57:47.755595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"31'9","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.148381+0000","last_change":"2024-05-15T18:12:26.148381+0000","last_active":"2024-05-15T18:12:26.148381+0000","last_peered":"2024-05-15T18:12:26.148381+0000","last_clean":"2024-05-15T18:12:26.148381+0000","last_became_active":"2024-05-15T18:08:47.214677+0000","last_became_peered":"2024-05-15T18:08:47.214677+0000","last_unstale":"2024-05-15T18:12:26.148381+0000","last_undegraded":"2024-05-15T18:12:26.148381+0000","last_fullsized":"2024-05-15T18:12:26.148381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'9","last_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_deep_scrub":"31'9","last_deep_scrub_stamp":"2024-05-15T18:12:26.148259+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.148259+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:22:59.103311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"31'4","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:58.846721+0000","last_change":"2024-05-15T18:12:58.846748+0000","last_active":"2024-05-15T18:12:58.846721+0000","last_peered":"2024-05-15T18:12:58.846721+0000","last_clean":"2024-05-15T18:12:58.846721+0000","last_became_active":"2024-05-15T18:09:19.408632+0000","last_became_peered":"2024-05-15T18:09:19.408632+0000","last_unstale":"2024-05-15T18:12:58.846721+0000","last_undegraded":"2024-05-15T18:12:58.846721+0000","last_fullsized":"2024-05-15T18:12:58.846721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:58.846626+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:58.846626+0000","last_clean_scrub_stamp":"2024-05-15T18:12:58.846626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:16:11.649813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:37.120801+0000","last_change":"2024-05-15T18:12:37.120801+0000","last_active":"2024-05-15T18:12:37.120801+0000","last_peered":"2024-05-15T18:12:37.120801+0000","last_clean":"2024-05-15T18:12:37.120801+0000","last_became_active":"2024-05-15T18:08:37.179638+0000","last_became_peered":"2024-05-15T18:08:37.179638+0000","last_unstale":"2024-05-15T18:12:37.120801+0000","last_undegraded":"2024-05-15T18:12:37.120801+0000","last_fullsized":"2024-05-15T18:12:37.120801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:37.120650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:37.120650+0000","last_clean_scrub_stamp":"2024-05-15T18:12:37.120650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:50:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:09.173327+0000","last_change":"2024-05-15T18:13:09.173350+0000","last_active":"2024-05-15T18:13:09.173327+0000","last_peered":"2024-05-15T18:13:09.173327+0000","last_clean":"2024-05-15T18:13:09.173327+0000","last_became_active":"2024-05-15T18:08:31.153094+0000","last_became_peered":"2024-05-15T18:08:31.153094+0000","last_unstale":"2024-05-15T18:13:09.173327+0000","last_undegraded":"2024-05-15T18:13:09.173327+0000","last_fullsized":"2024-05-15T18:13:09.173327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:09.173216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:09.173216+0000","last_clean_scrub_stamp":"2024-05-15T18:13:09.173216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:21:56.796133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.391600+0000","last_change":"2024-05-15T18:12:02.391600+0000","last_active":"2024-05-15T18:12:02.391600+0000","last_peered":"2024-05-15T18:12:02.391600+0000","last_clean":"2024-05-15T18:12:02.391600+0000","last_became_active":"2024-05-15T18:08:41.191368+0000","last_became_peered":"2024-05-15T18:08:41.191368+0000","last_unstale":"2024-05-15T18:12:02.391600+0000","last_undegraded":"2024-05-15T18:12:02.391600+0000","last_fullsized":"2024-05-15T18:12:02.391600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.391444+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.391444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:26:04.938967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'21","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.233258+0000","last_change":"2024-05-15T18:12:01.233258+0000","last_active":"2024-05-15T18:12:01.233258+0000","last_peered":"2024-05-15T18:12:01.233258+0000","last_clean":"2024-05-15T18:12:01.233258+0000","last_became_active":"2024-05-15T18:08:43.197417+0000","last_became_peered":"2024-05-15T18:08:43.197417+0000","last_unstale":"2024-05-15T18:12:01.233258+0000","last_undegraded":"2024-05-15T18:12:01.233258+0000","last_fullsized":"2024-05-15T18:12:01.233258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'21","last_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_deep_scrub":"31'21","last_deep_scrub_stamp":"2024-05-15T18:12:01.233115+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.233115+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:18:11.007085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'285","reported_seq":359,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.323821+0000","last_change":"2024-05-15T18:11:58.323821+0000","last_active":"2024-05-15T18:11:58.323821+0000","last_peered":"2024-05-15T18:11:58.323821+0000","last_clean":"2024-05-15T18:11:58.323821+0000","last_became_active":"2024-05-15T18:08:45.203802+0000","last_became_peered":"2024-05-15T18:08:45.203802+0000","last_unstale":"2024-05-15T18:11:58.323821+0000","last_undegraded":"2024-05-15T18:11:58.323821+0000","last_fullsized":"2024-05-15T18:11:58.323821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:11:58.323633+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.323633+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:20:54.917231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"31'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:18.167794+0000","last_change":"2024-05-15T18:13:18.167794+0000","last_active":"2024-05-15T18:13:18.167794+0000","last_peered":"2024-05-15T18:13:18.167794+0000","last_clean":"2024-05-15T18:13:18.167794+0000","last_became_active":"2024-05-15T18:08:47.221232+0000","last_became_peered":"2024-05-15T18:08:47.221232+0000","last_unstale":"2024-05-15T18:13:18.167794+0000","last_undegraded":"2024-05-15T18:13:18.167794+0000","last_fullsized":"2024-05-15T18:13:18.167794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:13:18.167675+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:13:18.167675+0000","last_clean_scrub_stamp":"2024-05-15T18:13:18.167675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:57:24.732195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.223814+0000","last_change":"2024-05-15T18:12:18.223814+0000","last_active":"2024-05-15T18:12:18.223814+0000","last_peered":"2024-05-15T18:12:18.223814+0000","last_clean":"2024-05-15T18:12:18.223814+0000","last_became_active":"2024-05-15T18:08:39.188591+0000","last_became_peered":"2024-05-15T18:08:39.188591+0000","last_unstale":"2024-05-15T18:12:18.223814+0000","last_undegraded":"2024-05-15T18:12:18.223814+0000","last_fullsized":"2024-05-15T18:12:18.223814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:18.223691+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.223691+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:06.085124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"31'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:57.157882+0000","last_change":"2024-05-15T18:12:57.157882+0000","last_active":"2024-05-15T18:12:57.157882+0000","last_peered":"2024-05-15T18:12:57.157882+0000","last_clean":"2024-05-15T18:12:57.157882+0000","last_became_active":"2024-05-15T18:08:37.183920+0000","last_became_peered":"2024-05-15T18:08:37.183920+0000","last_unstale":"2024-05-15T18:12:57.157882+0000","last_undegraded":"2024-05-15T18:12:57.157882+0000","last_fullsized":"2024-05-15T18:12:57.157882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:57.157735+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:57.157735+0000","last_clean_scrub_stamp":"2024-05-15T18:12:57.157735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:55:19.006387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:44.127693+0000","last_change":"2024-05-15T18:12:44.127693+0000","last_active":"2024-05-15T18:12:44.127693+0000","last_peered":"2024-05-15T18:12:44.127693+0000","last_clean":"2024-05-15T18:12:44.127693+0000","last_became_active":"2024-05-15T18:08:31.150865+0000","last_became_peered":"2024-05-15T18:08:31.150865+0000","last_unstale":"2024-05-15T18:12:44.127693+0000","last_undegraded":"2024-05-15T18:12:44.127693+0000","last_fullsized":"2024-05-15T18:12:44.127693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:44.127568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:44.127568+0000","last_clean_scrub_stamp":"2024-05-15T18:12:44.127568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:09:12.123278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.358934+0000","last_change":"2024-05-15T18:12:06.358934+0000","last_active":"2024-05-15T18:12:06.358934+0000","last_peered":"2024-05-15T18:12:06.358934+0000","last_clean":"2024-05-15T18:12:06.358934+0000","last_became_active":"2024-05-15T18:08:41.191082+0000","last_became_peered":"2024-05-15T18:08:41.191082+0000","last_unstale":"2024-05-15T18:12:06.358934+0000","last_undegraded":"2024-05-15T18:12:06.358934+0000","last_fullsized":"2024-05-15T18:12:06.358934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:06.358819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.358819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:07.242813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.224031+0000","last_change":"2024-05-15T18:12:23.224031+0000","last_active":"2024-05-15T18:12:23.224031+0000","last_peered":"2024-05-15T18:12:23.224031+0000","last_clean":"2024-05-15T18:12:23.224031+0000","last_became_active":"2024-05-15T18:08:43.204755+0000","last_became_peered":"2024-05-15T18:08:43.204755+0000","last_unstale":"2024-05-15T18:12:23.224031+0000","last_undegraded":"2024-05-15T18:12:23.224031+0000","last_fullsized":"2024-05-15T18:12:23.224031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:23.223908+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.223908+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:27.882071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"31'285","reported_seq":402,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.886655+0000","last_change":"2024-05-15T18:12:02.886655+0000","last_active":"2024-05-15T18:12:02.886655+0000","last_peered":"2024-05-15T18:12:02.886655+0000","last_clean":"2024-05-15T18:12:02.886655+0000","last_became_active":"2024-05-15T18:08:45.198032+0000","last_became_peered":"2024-05-15T18:08:45.198032+0000","last_unstale":"2024-05-15T18:12:02.886655+0000","last_undegraded":"2024-05-15T18:12:02.886655+0000","last_fullsized":"2024-05-15T18:12:02.886655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:02.886536+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.886536+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:13.272929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'3","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:52.857048+0000","last_change":"2024-05-15T18:12:52.857048+0000","last_active":"2024-05-15T18:12:52.857048+0000","last_peered":"2024-05-15T18:12:52.857048+0000","last_clean":"2024-05-15T18:12:52.857048+0000","last_became_active":"2024-05-15T18:08:47.222258+0000","last_became_peered":"2024-05-15T18:08:47.222258+0000","last_unstale":"2024-05-15T18:12:52.857048+0000","last_undegraded":"2024-05-15T18:12:52.857048+0000","last_fullsized":"2024-05-15T18:12:52.857048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-15T18:12:52.856931+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-15T18:12:52.856931+0000","last_clean_scrub_stamp":"2024-05-15T18:12:52.856931+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:23:08.871415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"31'10","reported_seq":75,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.562885+0000","last_change":"2024-05-15T18:12:30.562885+0000","last_active":"2024-05-15T18:12:30.562885+0000","last_peered":"2024-05-15T18:12:30.562885+0000","last_clean":"2024-05-15T18:12:30.562885+0000","last_became_active":"2024-05-15T18:08:39.183406+0000","last_became_peered":"2024-05-15T18:08:39.183406+0000","last_unstale":"2024-05-15T18:12:30.562885+0000","last_undegraded":"2024-05-15T18:12:30.562885+0000","last_fullsized":"2024-05-15T18:12:30.562885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'10","last_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_deep_scrub":"31'10","last_deep_scrub_stamp":"2024-05-15T18:12:30.562719+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.562719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:31:21.698936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"31'3","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:36.977312+0000","last_change":"2024-05-15T18:12:36.977312+0000","last_active":"2024-05-15T18:12:36.977312+0000","last_peered":"2024-05-15T18:12:36.977312+0000","last_clean":"2024-05-15T18:12:36.977312+0000","last_became_active":"2024-05-15T18:08:37.178904+0000","last_became_peered":"2024-05-15T18:08:37.178904+0000","last_unstale":"2024-05-15T18:12:36.977312+0000","last_undegraded":"2024-05-15T18:12:36.977312+0000","last_fullsized":"2024-05-15T18:12:36.977312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:36.977151+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:36.977151+0000","last_clean_scrub_stamp":"2024-05-15T18:12:36.977151+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:39:32.112263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:11.104551+0000","last_change":"2024-05-15T18:13:11.104590+0000","last_active":"2024-05-15T18:13:11.104551+0000","last_peered":"2024-05-15T18:13:11.104551+0000","last_clean":"2024-05-15T18:13:11.104551+0000","last_became_active":"2024-05-15T18:08:31.286130+0000","last_became_peered":"2024-05-15T18:08:31.286130+0000","last_unstale":"2024-05-15T18:13:11.104551+0000","last_undegraded":"2024-05-15T18:13:11.104551+0000","last_fullsized":"2024-05-15T18:13:11.104551+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:11.104445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:11.104445+0000","last_clean_scrub_stamp":"2024-05-15T18:13:11.104445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:37:36.173056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:59.448854+0000","last_change":"2024-05-15T18:11:59.448854+0000","last_active":"2024-05-15T18:11:59.448854+0000","last_peered":"2024-05-15T18:11:59.448854+0000","last_clean":"2024-05-15T18:11:59.448854+0000","last_became_active":"2024-05-15T18:08:41.190823+0000","last_became_peered":"2024-05-15T18:08:41.190823+0000","last_unstale":"2024-05-15T18:11:59.448854+0000","last_undegraded":"2024-05-15T18:11:59.448854+0000","last_fullsized":"2024-05-15T18:11:59.448854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:59.448742+0000","last_clean_scrub_stamp":"2024-05-15T18:11:59.448742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:12:37.217420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"31'98","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.502595+0000","last_change":"2024-05-15T18:12:04.502595+0000","last_active":"2024-05-15T18:12:04.502595+0000","last_peered":"2024-05-15T18:12:04.502595+0000","last_clean":"2024-05-15T18:12:04.502595+0000","last_became_active":"2024-05-15T18:08:43.199162+0000","last_became_peered":"2024-05-15T18:08:43.199162+0000","last_unstale":"2024-05-15T18:12:04.502595+0000","last_undegraded":"2024-05-15T18:12:04.502595+0000","last_fullsized":"2024-05-15T18:12:04.502595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'98","last_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_deep_scrub":"31'98","last_deep_scrub_stamp":"2024-05-15T18:12:04.502398+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.502398+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:57:28.778374+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":98,"num_read_kb":92,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:56.955872+0000","last_change":"2024-05-15T18:11:56.955872+0000","last_active":"2024-05-15T18:11:56.955872+0000","last_peered":"2024-05-15T18:11:56.955872+0000","last_clean":"2024-05-15T18:11:56.955872+0000","last_became_active":"2024-05-15T18:08:45.200917+0000","last_became_peered":"2024-05-15T18:08:45.200917+0000","last_unstale":"2024-05-15T18:11:56.955872+0000","last_undegraded":"2024-05-15T18:11:56.955872+0000","last_fullsized":"2024-05-15T18:11:56.955872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:56.955763+0000","last_clean_scrub_stamp":"2024-05-15T18:11:56.955763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:30.751898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.566798+0000","last_change":"2024-05-15T18:12:14.566798+0000","last_active":"2024-05-15T18:12:14.566798+0000","last_peered":"2024-05-15T18:12:14.566798+0000","last_clean":"2024-05-15T18:12:14.566798+0000","last_became_active":"2024-05-15T18:08:47.209711+0000","last_became_peered":"2024-05-15T18:08:47.209711+0000","last_unstale":"2024-05-15T18:12:14.566798+0000","last_undegraded":"2024-05-15T18:12:14.566798+0000","last_fullsized":"2024-05-15T18:12:14.566798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:14.566649+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.566649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:21.835682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"31'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.588093+0000","last_change":"2024-05-15T18:12:46.588093+0000","last_active":"2024-05-15T18:12:46.588093+0000","last_peered":"2024-05-15T18:12:46.588093+0000","last_clean":"2024-05-15T18:12:46.588093+0000","last_became_active":"2024-05-15T18:08:47.219158+0000","last_became_peered":"2024-05-15T18:08:47.219158+0000","last_unstale":"2024-05-15T18:12:46.588093+0000","last_undegraded":"2024-05-15T18:12:46.588093+0000","last_fullsized":"2024-05-15T18:12:46.588093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:46.587943+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:46.587943+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.587943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:46.897722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":45,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.511652+0000","last_change":"2024-05-15T18:12:32.511652+0000","last_active":"2024-05-15T18:12:32.511652+0000","last_peered":"2024-05-15T18:12:32.511652+0000","last_clean":"2024-05-15T18:12:32.511652+0000","last_became_active":"2024-05-15T18:08:39.183400+0000","last_became_peered":"2024-05-15T18:08:39.183400+0000","last_unstale":"2024-05-15T18:12:32.511652+0000","last_undegraded":"2024-05-15T18:12:32.511652+0000","last_fullsized":"2024-05-15T18:12:32.511652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:32.511538+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.511538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:33:33.395531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:05.080422+0000","last_change":"2024-05-15T18:13:05.080422+0000","last_active":"2024-05-15T18:13:05.080422+0000","last_peered":"2024-05-15T18:13:05.080422+0000","last_clean":"2024-05-15T18:13:05.080422+0000","last_became_active":"2024-05-15T18:08:37.185234+0000","last_became_peered":"2024-05-15T18:08:37.185234+0000","last_unstale":"2024-05-15T18:13:05.080422+0000","last_undegraded":"2024-05-15T18:13:05.080422+0000","last_fullsized":"2024-05-15T18:13:05.080422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:05.080234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:05.080234+0000","last_clean_scrub_stamp":"2024-05-15T18:13:05.080234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:40:14.056942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:55.876773+0000","last_change":"2024-05-15T18:12:55.876773+0000","last_active":"2024-05-15T18:12:55.876773+0000","last_peered":"2024-05-15T18:12:55.876773+0000","last_clean":"2024-05-15T18:12:55.876773+0000","last_became_active":"2024-05-15T18:09:19.404166+0000","last_became_peered":"2024-05-15T18:09:19.404166+0000","last_unstale":"2024-05-15T18:12:55.876773+0000","last_undegraded":"2024-05-15T18:12:55.876773+0000","last_fullsized":"2024-05-15T18:12:55.876773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:55.876645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:55.876645+0000","last_clean_scrub_stamp":"2024-05-15T18:12:55.876645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:29:29.771088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.350568+0000","last_change":"2024-05-15T18:12:11.350568+0000","last_active":"2024-05-15T18:12:11.350568+0000","last_peered":"2024-05-15T18:12:11.350568+0000","last_clean":"2024-05-15T18:12:11.350568+0000","last_became_active":"2024-05-15T18:08:43.204251+0000","last_became_peered":"2024-05-15T18:08:43.204251+0000","last_unstale":"2024-05-15T18:12:11.350568+0000","last_undegraded":"2024-05-15T18:12:11.350568+0000","last_fullsized":"2024-05-15T18:12:11.350568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:11.350399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.350399+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:54:11.134147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:21.232183+0000","last_change":"2024-05-15T18:12:21.232183+0000","last_active":"2024-05-15T18:12:21.232183+0000","last_peered":"2024-05-15T18:12:21.232183+0000","last_clean":"2024-05-15T18:12:21.232183+0000","last_became_active":"2024-05-15T18:08:45.208412+0000","last_became_peered":"2024-05-15T18:08:45.208412+0000","last_unstale":"2024-05-15T18:12:21.232183+0000","last_undegraded":"2024-05-15T18:12:21.232183+0000","last_fullsized":"2024-05-15T18:12:21.232183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:21.232063+0000","last_clean_scrub_stamp":"2024-05-15T18:12:21.232063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:21.541842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"31'5","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:55.969064+0000","last_change":"2024-05-15T18:12:55.969092+0000","last_active":"2024-05-15T18:12:55.969064+0000","last_peered":"2024-05-15T18:12:55.969064+0000","last_clean":"2024-05-15T18:12:55.969064+0000","last_became_active":"2024-05-15T18:08:47.216224+0000","last_became_peered":"2024-05-15T18:08:47.216224+0000","last_unstale":"2024-05-15T18:12:55.969064+0000","last_undegraded":"2024-05-15T18:12:55.969064+0000","last_fullsized":"2024-05-15T18:12:55.969064+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'5","last_scrub_stamp":"2024-05-15T18:12:55.968973+0000","last_deep_scrub":"31'5","last_deep_scrub_stamp":"2024-05-15T18:12:55.968973+0000","last_clean_scrub_stamp":"2024-05-15T18:12:55.968973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:32.811172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.980362+0000","last_change":"2024-05-15T18:12:24.980362+0000","last_active":"2024-05-15T18:12:24.980362+0000","last_peered":"2024-05-15T18:12:24.980362+0000","last_clean":"2024-05-15T18:12:24.980362+0000","last_became_active":"2024-05-15T18:08:39.191898+0000","last_became_peered":"2024-05-15T18:08:39.191898+0000","last_unstale":"2024-05-15T18:12:24.980362+0000","last_undegraded":"2024-05-15T18:12:24.980362+0000","last_fullsized":"2024-05-15T18:12:24.980362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:24.980229+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.980229+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:04:19.381841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"31'6","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.546282+0000","last_change":"2024-05-15T18:12:35.546282+0000","last_active":"2024-05-15T18:12:35.546282+0000","last_peered":"2024-05-15T18:12:35.546282+0000","last_clean":"2024-05-15T18:12:35.546282+0000","last_became_active":"2024-05-15T18:08:37.177914+0000","last_became_peered":"2024-05-15T18:08:37.177914+0000","last_unstale":"2024-05-15T18:12:35.546282+0000","last_undegraded":"2024-05-15T18:12:35.546282+0000","last_fullsized":"2024-05-15T18:12:35.546282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:35.546148+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:35.546148+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.546148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:23:08.501199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.464695+0000","last_change":"2024-05-15T18:11:58.464695+0000","last_active":"2024-05-15T18:11:58.464695+0000","last_peered":"2024-05-15T18:11:58.464695+0000","last_clean":"2024-05-15T18:11:58.464695+0000","last_became_active":"2024-05-15T18:08:41.191440+0000","last_became_peered":"2024-05-15T18:08:41.191440+0000","last_unstale":"2024-05-15T18:11:58.464695+0000","last_undegraded":"2024-05-15T18:11:58.464695+0000","last_fullsized":"2024-05-15T18:11:58.464695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.464557+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.464557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:27.556332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"31'8","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.875048+0000","last_change":"2024-05-15T18:12:08.875048+0000","last_active":"2024-05-15T18:12:08.875048+0000","last_peered":"2024-05-15T18:12:08.875048+0000","last_clean":"2024-05-15T18:12:08.875048+0000","last_became_active":"2024-05-15T18:08:43.194853+0000","last_became_peered":"2024-05-15T18:08:43.194853+0000","last_unstale":"2024-05-15T18:12:08.875048+0000","last_undegraded":"2024-05-15T18:12:08.875048+0000","last_fullsized":"2024-05-15T18:12:08.875048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:08.874911+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.874911+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:19:19.931974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.544278+0000","last_change":"2024-05-15T18:12:10.544278+0000","last_active":"2024-05-15T18:12:10.544278+0000","last_peered":"2024-05-15T18:12:10.544278+0000","last_clean":"2024-05-15T18:12:10.544278+0000","last_became_active":"2024-05-15T18:08:45.208152+0000","last_became_peered":"2024-05-15T18:08:45.208152+0000","last_unstale":"2024-05-15T18:12:10.544278+0000","last_undegraded":"2024-05-15T18:12:10.544278+0000","last_fullsized":"2024-05-15T18:12:10.544278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:10.544159+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.544159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:30:52.334749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"31'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.126720+0000","last_change":"2024-05-15T18:12:22.126750+0000","last_active":"2024-05-15T18:12:22.126720+0000","last_peered":"2024-05-15T18:12:22.126720+0000","last_clean":"2024-05-15T18:12:22.126720+0000","last_became_active":"2024-05-15T18:08:47.209443+0000","last_became_peered":"2024-05-15T18:08:47.209443+0000","last_unstale":"2024-05-15T18:12:22.126720+0000","last_undegraded":"2024-05-15T18:12:22.126720+0000","last_fullsized":"2024-05-15T18:12:22.126720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:22.126615+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.126615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:44.332025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"31'24","reported_seq":98,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:28.156098+0000","last_change":"2024-05-15T18:12:28.156098+0000","last_active":"2024-05-15T18:12:28.156098+0000","last_peered":"2024-05-15T18:12:28.156098+0000","last_clean":"2024-05-15T18:12:28.156098+0000","last_became_active":"2024-05-15T18:08:39.182041+0000","last_became_peered":"2024-05-15T18:08:39.182041+0000","last_unstale":"2024-05-15T18:12:28.156098+0000","last_undegraded":"2024-05-15T18:12:28.156098+0000","last_fullsized":"2024-05-15T18:12:28.156098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'24","last_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_deep_scrub":"31'24","last_deep_scrub_stamp":"2024-05-15T18:12:28.155985+0000","last_clean_scrub_stamp":"2024-05-15T18:12:28.155985+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:35:20.346535+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":75,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.574548+0000","last_change":"2024-05-15T18:12:42.574548+0000","last_active":"2024-05-15T18:12:42.574548+0000","last_peered":"2024-05-15T18:12:42.574548+0000","last_clean":"2024-05-15T18:12:42.574548+0000","last_became_active":"2024-05-15T18:08:37.175865+0000","last_became_peered":"2024-05-15T18:08:37.175865+0000","last_unstale":"2024-05-15T18:12:42.574548+0000","last_undegraded":"2024-05-15T18:12:42.574548+0000","last_fullsized":"2024-05-15T18:12:42.574548+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:42.574370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:42.574370+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.574370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:31.849503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:12.579133+0000","last_change":"2024-05-15T18:12:12.579133+0000","last_active":"2024-05-15T18:12:12.579133+0000","last_peered":"2024-05-15T18:12:12.579133+0000","last_clean":"2024-05-15T18:12:12.579133+0000","last_became_active":"2024-05-15T18:08:41.196238+0000","last_became_peered":"2024-05-15T18:08:41.196238+0000","last_unstale":"2024-05-15T18:12:12.579133+0000","last_undegraded":"2024-05-15T18:12:12.579133+0000","last_fullsized":"2024-05-15T18:12:12.579133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:12.579011+0000","last_clean_scrub_stamp":"2024-05-15T18:12:12.579011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:17:22.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"31'48","reported_seq":121,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.881882+0000","last_change":"2024-05-15T18:12:11.881882+0000","last_active":"2024-05-15T18:12:11.881882+0000","last_peered":"2024-05-15T18:12:11.881882+0000","last_clean":"2024-05-15T18:12:11.881882+0000","last_became_active":"2024-05-15T18:08:43.192077+0000","last_became_peered":"2024-05-15T18:08:43.192077+0000","last_unstale":"2024-05-15T18:12:11.881882+0000","last_undegraded":"2024-05-15T18:12:11.881882+0000","last_fullsized":"2024-05-15T18:12:11.881882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'48","last_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_deep_scrub":"31'48","last_deep_scrub_stamp":"2024-05-15T18:12:11.881671+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.881671+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:09:22.316063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:57.359562+0000","last_change":"2024-05-15T18:11:57.359562+0000","last_active":"2024-05-15T18:11:57.359562+0000","last_peered":"2024-05-15T18:11:57.359562+0000","last_clean":"2024-05-15T18:11:57.359562+0000","last_became_active":"2024-05-15T18:08:45.200590+0000","last_became_peered":"2024-05-15T18:08:45.200590+0000","last_unstale":"2024-05-15T18:11:57.359562+0000","last_undegraded":"2024-05-15T18:11:57.359562+0000","last_fullsized":"2024-05-15T18:11:57.359562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:57.359393+0000","last_clean_scrub_stamp":"2024-05-15T18:11:57.359393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:58:31.155528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:19.207478+0000","last_change":"2024-05-15T18:13:19.207526+0000","last_active":"2024-05-15T18:13:19.207478+0000","last_peered":"2024-05-15T18:13:19.207478+0000","last_clean":"2024-05-15T18:13:19.207478+0000","last_became_active":"2024-05-15T18:08:47.221722+0000","last_became_peered":"2024-05-15T18:08:47.221722+0000","last_unstale":"2024-05-15T18:13:19.207478+0000","last_undegraded":"2024-05-15T18:13:19.207478+0000","last_fullsized":"2024-05-15T18:13:19.207478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:19.207357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:19.207357+0000","last_clean_scrub_stamp":"2024-05-15T18:13:19.207357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:30.376459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.235673+0000","last_change":"2024-05-15T18:12:16.235673+0000","last_active":"2024-05-15T18:12:16.235673+0000","last_peered":"2024-05-15T18:12:16.235673+0000","last_clean":"2024-05-15T18:12:16.235673+0000","last_became_active":"2024-05-15T18:08:39.188616+0000","last_became_peered":"2024-05-15T18:08:39.188616+0000","last_unstale":"2024-05-15T18:12:16.235673+0000","last_undegraded":"2024-05-15T18:12:16.235673+0000","last_fullsized":"2024-05-15T18:12:16.235673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:16.235558+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.235558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:08.093786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.918512+0000","last_change":"2024-05-15T18:12:47.918512+0000","last_active":"2024-05-15T18:12:47.918512+0000","last_peered":"2024-05-15T18:12:47.918512+0000","last_clean":"2024-05-15T18:12:47.918512+0000","last_became_active":"2024-05-15T18:08:37.176115+0000","last_became_peered":"2024-05-15T18:08:37.176115+0000","last_unstale":"2024-05-15T18:12:47.918512+0000","last_undegraded":"2024-05-15T18:12:47.918512+0000","last_fullsized":"2024-05-15T18:12:47.918512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:47.918385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:47.918385+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.918385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:38.973477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.315160+0000","last_change":"2024-05-15T18:12:07.315160+0000","last_active":"2024-05-15T18:12:07.315160+0000","last_peered":"2024-05-15T18:12:07.315160+0000","last_clean":"2024-05-15T18:12:07.315160+0000","last_became_active":"2024-05-15T18:08:41.190329+0000","last_became_peered":"2024-05-15T18:08:41.190329+0000","last_unstale":"2024-05-15T18:12:07.315160+0000","last_undegraded":"2024-05-15T18:12:07.315160+0000","last_fullsized":"2024-05-15T18:12:07.315160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:07.315047+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.315047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:28.990916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"31'37","reported_seq":93,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.589118+0000","last_change":"2024-05-15T18:12:08.589118+0000","last_active":"2024-05-15T18:12:08.589118+0000","last_peered":"2024-05-15T18:12:08.589118+0000","last_clean":"2024-05-15T18:12:08.589118+0000","last_became_active":"2024-05-15T18:08:43.194080+0000","last_became_peered":"2024-05-15T18:08:43.194080+0000","last_unstale":"2024-05-15T18:12:08.589118+0000","last_undegraded":"2024-05-15T18:12:08.589118+0000","last_fullsized":"2024-05-15T18:12:08.589118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'37","last_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_deep_scrub":"31'37","last_deep_scrub_stamp":"2024-05-15T18:12:08.588987+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.588987+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:48.582117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:11:58.517779+0000","last_change":"2024-05-15T18:11:58.517779+0000","last_active":"2024-05-15T18:11:58.517779+0000","last_peered":"2024-05-15T18:11:58.517779+0000","last_clean":"2024-05-15T18:11:58.517779+0000","last_became_active":"2024-05-15T18:08:45.203770+0000","last_became_peered":"2024-05-15T18:08:45.203770+0000","last_unstale":"2024-05-15T18:11:58.517779+0000","last_undegraded":"2024-05-15T18:11:58.517779+0000","last_fullsized":"2024-05-15T18:11:58.517779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:11:58.517616+0000","last_clean_scrub_stamp":"2024-05-15T18:11:58.517616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:10:30.693406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.201458+0000","last_change":"2024-05-15T18:12:35.201458+0000","last_active":"2024-05-15T18:12:35.201458+0000","last_peered":"2024-05-15T18:12:35.201458+0000","last_clean":"2024-05-15T18:12:35.201458+0000","last_became_active":"2024-05-15T18:08:39.181281+0000","last_became_peered":"2024-05-15T18:08:39.181281+0000","last_unstale":"2024-05-15T18:12:35.201458+0000","last_undegraded":"2024-05-15T18:12:35.201458+0000","last_fullsized":"2024-05-15T18:12:35.201458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:35.201346+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:35.201346+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.201346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:06:19.831426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:14.172040+0000","last_change":"2024-05-15T18:13:14.172040+0000","last_active":"2024-05-15T18:13:14.172040+0000","last_peered":"2024-05-15T18:13:14.172040+0000","last_clean":"2024-05-15T18:13:14.172040+0000","last_became_active":"2024-05-15T18:08:37.177126+0000","last_became_peered":"2024-05-15T18:08:37.177126+0000","last_unstale":"2024-05-15T18:13:14.172040+0000","last_undegraded":"2024-05-15T18:13:14.172040+0000","last_fullsized":"2024-05-15T18:13:14.172040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:14.171889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:14.171889+0000","last_clean_scrub_stamp":"2024-05-15T18:13:14.171889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:59:58.581966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.052545+0000","last_change":"2024-05-15T18:12:20.052545+0000","last_active":"2024-05-15T18:12:20.052545+0000","last_peered":"2024-05-15T18:12:20.052545+0000","last_clean":"2024-05-15T18:12:20.052545+0000","last_became_active":"2024-05-15T18:08:41.190817+0000","last_became_peered":"2024-05-15T18:08:41.190817+0000","last_unstale":"2024-05-15T18:12:20.052545+0000","last_undegraded":"2024-05-15T18:12:20.052545+0000","last_fullsized":"2024-05-15T18:12:20.052545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.052417+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.052417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:05:32.618399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"31'63","reported_seq":136,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:10.892641+0000","last_change":"2024-05-15T18:12:10.892676+0000","last_active":"2024-05-15T18:12:10.892641+0000","last_peered":"2024-05-15T18:12:10.892641+0000","last_clean":"2024-05-15T18:12:10.892641+0000","last_became_active":"2024-05-15T18:08:43.194273+0000","last_became_peered":"2024-05-15T18:08:43.194273+0000","last_unstale":"2024-05-15T18:12:10.892641+0000","last_undegraded":"2024-05-15T18:12:10.892641+0000","last_fullsized":"2024-05-15T18:12:10.892641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'63","last_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_deep_scrub":"31'63","last_deep_scrub_stamp":"2024-05-15T18:12:10.892546+0000","last_clean_scrub_stamp":"2024-05-15T18:12:10.892546+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:09.452875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.474146+0000","last_change":"2024-05-15T18:12:02.474184+0000","last_active":"2024-05-15T18:12:02.474146+0000","last_peered":"2024-05-15T18:12:02.474146+0000","last_clean":"2024-05-15T18:12:02.474146+0000","last_became_active":"2024-05-15T18:08:45.205055+0000","last_became_peered":"2024-05-15T18:08:45.205055+0000","last_unstale":"2024-05-15T18:12:02.474146+0000","last_undegraded":"2024-05-15T18:12:02.474146+0000","last_fullsized":"2024-05-15T18:12:02.474146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.474022+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.474022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:25:37.061500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"31'14","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.960424+0000","last_change":"2024-05-15T18:12:53.960424+0000","last_active":"2024-05-15T18:12:53.960424+0000","last_peered":"2024-05-15T18:12:53.960424+0000","last_clean":"2024-05-15T18:12:53.960424+0000","last_became_active":"2024-05-15T18:08:47.215028+0000","last_became_peered":"2024-05-15T18:08:47.215028+0000","last_unstale":"2024-05-15T18:12:53.960424+0000","last_undegraded":"2024-05-15T18:12:53.960424+0000","last_fullsized":"2024-05-15T18:12:53.960424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:53.960302+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:53.960302+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.960302+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:15:21.988407+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"31'2","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.088216+0000","last_change":"2024-05-15T18:12:42.088243+0000","last_active":"2024-05-15T18:12:42.088216+0000","last_peered":"2024-05-15T18:12:42.088216+0000","last_clean":"2024-05-15T18:12:42.088216+0000","last_became_active":"2024-05-15T18:08:39.186436+0000","last_became_peered":"2024-05-15T18:08:39.186436+0000","last_unstale":"2024-05-15T18:12:42.088216+0000","last_undegraded":"2024-05-15T18:12:42.088216+0000","last_fullsized":"2024-05-15T18:12:42.088216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:42.088128+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:42.088128+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.088128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:26:47.954467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:56.832295+0000","last_change":"2024-05-15T18:12:56.832295+0000","last_active":"2024-05-15T18:12:56.832295+0000","last_peered":"2024-05-15T18:12:56.832295+0000","last_clean":"2024-05-15T18:12:56.832295+0000","last_became_active":"2024-05-15T18:09:19.405110+0000","last_became_peered":"2024-05-15T18:09:19.405110+0000","last_unstale":"2024-05-15T18:12:56.832295+0000","last_undegraded":"2024-05-15T18:12:56.832295+0000","last_fullsized":"2024-05-15T18:12:56.832295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:56.832182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:56.832182+0000","last_clean_scrub_stamp":"2024-05-15T18:12:56.832182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:17:33.674380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:15.537137+0000","last_change":"2024-05-15T18:12:15.537137+0000","last_active":"2024-05-15T18:12:15.537137+0000","last_peered":"2024-05-15T18:12:15.537137+0000","last_clean":"2024-05-15T18:12:15.537137+0000","last_became_active":"2024-05-15T18:08:41.191524+0000","last_became_peered":"2024-05-15T18:08:41.191524+0000","last_unstale":"2024-05-15T18:12:15.537137+0000","last_undegraded":"2024-05-15T18:12:15.537137+0000","last_fullsized":"2024-05-15T18:12:15.537137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:15.536986+0000","last_clean_scrub_stamp":"2024-05-15T18:12:15.536986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:12:59.728892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"31'47","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.224399+0000","last_change":"2024-05-15T18:12:30.224462+0000","last_active":"2024-05-15T18:12:30.224399+0000","last_peered":"2024-05-15T18:12:30.224399+0000","last_clean":"2024-05-15T18:12:30.224399+0000","last_became_active":"2024-05-15T18:08:43.204391+0000","last_became_peered":"2024-05-15T18:08:43.204391+0000","last_unstale":"2024-05-15T18:12:30.224399+0000","last_undegraded":"2024-05-15T18:12:30.224399+0000","last_fullsized":"2024-05-15T18:12:30.224399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'47","last_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_deep_scrub":"31'47","last_deep_scrub_stamp":"2024-05-15T18:12:30.224290+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.224290+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:21.279383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:02.212353+0000","last_change":"2024-05-15T18:12:02.212375+0000","last_active":"2024-05-15T18:12:02.212353+0000","last_peered":"2024-05-15T18:12:02.212353+0000","last_clean":"2024-05-15T18:12:02.212353+0000","last_became_active":"2024-05-15T18:08:45.208256+0000","last_became_peered":"2024-05-15T18:08:45.208256+0000","last_unstale":"2024-05-15T18:12:02.212353+0000","last_undegraded":"2024-05-15T18:12:02.212353+0000","last_fullsized":"2024-05-15T18:12:02.212353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:02.212266+0000","last_clean_scrub_stamp":"2024-05-15T18:12:02.212266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:31.297851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.193919+0000","last_change":"2024-05-15T18:12:41.193919+0000","last_active":"2024-05-15T18:12:41.193919+0000","last_peered":"2024-05-15T18:12:41.193919+0000","last_clean":"2024-05-15T18:12:41.193919+0000","last_became_active":"2024-05-15T18:08:47.218301+0000","last_became_peered":"2024-05-15T18:08:47.218301+0000","last_unstale":"2024-05-15T18:12:41.193919+0000","last_undegraded":"2024-05-15T18:12:41.193919+0000","last_fullsized":"2024-05-15T18:12:41.193919+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:41.193780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:41.193780+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.193780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:13:46.031668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.265264+0000","last_change":"2024-05-15T18:12:14.265289+0000","last_active":"2024-05-15T18:12:14.265264+0000","last_peered":"2024-05-15T18:12:14.265264+0000","last_clean":"2024-05-15T18:12:14.265264+0000","last_became_active":"2024-05-15T18:08:39.191373+0000","last_became_peered":"2024-05-15T18:08:39.191373+0000","last_unstale":"2024-05-15T18:12:14.265264+0000","last_undegraded":"2024-05-15T18:12:14.265264+0000","last_fullsized":"2024-05-15T18:12:14.265264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:14.265178+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.265178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T06:00:30.533247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:46.953534+0000","last_change":"2024-05-15T18:12:46.953579+0000","last_active":"2024-05-15T18:12:46.953534+0000","last_peered":"2024-05-15T18:12:46.953534+0000","last_clean":"2024-05-15T18:12:46.953534+0000","last_became_active":"2024-05-15T18:08:37.175236+0000","last_became_peered":"2024-05-15T18:08:37.175236+0000","last_unstale":"2024-05-15T18:12:46.953534+0000","last_undegraded":"2024-05-15T18:12:46.953534+0000","last_fullsized":"2024-05-15T18:12:46.953534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:46.953407+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:46.953407+0000","last_clean_scrub_stamp":"2024-05-15T18:12:46.953407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:17:48.733387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:16.544729+0000","last_change":"2024-05-15T18:12:16.544771+0000","last_active":"2024-05-15T18:12:16.544729+0000","last_peered":"2024-05-15T18:12:16.544729+0000","last_clean":"2024-05-15T18:12:16.544729+0000","last_became_active":"2024-05-15T18:08:41.190776+0000","last_became_peered":"2024-05-15T18:08:41.190776+0000","last_unstale":"2024-05-15T18:12:16.544729+0000","last_undegraded":"2024-05-15T18:12:16.544729+0000","last_fullsized":"2024-05-15T18:12:16.544729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:16.544617+0000","last_clean_scrub_stamp":"2024-05-15T18:12:16.544617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:26.563096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"31'40","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:04.854126+0000","last_change":"2024-05-15T18:12:04.854126+0000","last_active":"2024-05-15T18:12:04.854126+0000","last_peered":"2024-05-15T18:12:04.854126+0000","last_clean":"2024-05-15T18:12:04.854126+0000","last_became_active":"2024-05-15T18:08:43.200891+0000","last_became_peered":"2024-05-15T18:08:43.200891+0000","last_unstale":"2024-05-15T18:12:04.854126+0000","last_undegraded":"2024-05-15T18:12:04.854126+0000","last_fullsized":"2024-05-15T18:12:04.854126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'40","last_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_deep_scrub":"31'40","last_deep_scrub_stamp":"2024-05-15T18:12:04.853980+0000","last_clean_scrub_stamp":"2024-05-15T18:12:04.853980+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:04:12.123012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:03.875755+0000","last_change":"2024-05-15T18:12:03.875755+0000","last_active":"2024-05-15T18:12:03.875755+0000","last_peered":"2024-05-15T18:12:03.875755+0000","last_clean":"2024-05-15T18:12:03.875755+0000","last_became_active":"2024-05-15T18:08:45.197707+0000","last_became_peered":"2024-05-15T18:08:45.197707+0000","last_unstale":"2024-05-15T18:12:03.875755+0000","last_undegraded":"2024-05-15T18:12:03.875755+0000","last_fullsized":"2024-05-15T18:12:03.875755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:03.875637+0000","last_clean_scrub_stamp":"2024-05-15T18:12:03.875637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:24.820098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"31'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:16.184829+0000","last_change":"2024-05-15T18:13:16.184829+0000","last_active":"2024-05-15T18:13:16.184829+0000","last_peered":"2024-05-15T18:13:16.184829+0000","last_clean":"2024-05-15T18:13:16.184829+0000","last_became_active":"2024-05-15T18:08:47.219203+0000","last_became_peered":"2024-05-15T18:08:47.219203+0000","last_unstale":"2024-05-15T18:13:16.184829+0000","last_undegraded":"2024-05-15T18:13:16.184829+0000","last_fullsized":"2024-05-15T18:13:16.184829+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:13:16.184649+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:13:16.184649+0000","last_clean_scrub_stamp":"2024-05-15T18:13:16.184649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:27:02.413492+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"31'6","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:40.142595+0000","last_change":"2024-05-15T18:12:40.142629+0000","last_active":"2024-05-15T18:12:40.142595+0000","last_peered":"2024-05-15T18:12:40.142595+0000","last_clean":"2024-05-15T18:12:40.142595+0000","last_became_active":"2024-05-15T18:08:39.182766+0000","last_became_peered":"2024-05-15T18:08:39.182766+0000","last_unstale":"2024-05-15T18:12:40.142595+0000","last_undegraded":"2024-05-15T18:12:40.142595+0000","last_fullsized":"2024-05-15T18:12:40.142595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:40.142500+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:40.142500+0000","last_clean_scrub_stamp":"2024-05-15T18:12:40.142500+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:44:44.800663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"31'12","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:53.116084+0000","last_change":"2024-05-15T18:12:53.116110+0000","last_active":"2024-05-15T18:12:53.116084+0000","last_peered":"2024-05-15T18:12:53.116084+0000","last_clean":"2024-05-15T18:12:53.116084+0000","last_became_active":"2024-05-15T18:08:37.182547+0000","last_became_peered":"2024-05-15T18:08:37.182547+0000","last_unstale":"2024-05-15T18:12:53.116084+0000","last_undegraded":"2024-05-15T18:12:53.116084+0000","last_fullsized":"2024-05-15T18:12:53.116084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:53.115966+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:53.115966+0000","last_clean_scrub_stamp":"2024-05-15T18:12:53.115966+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:46:44.696807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":21,"num_write":68,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.091544+0000","last_change":"2024-05-15T18:12:17.091569+0000","last_active":"2024-05-15T18:12:17.091544+0000","last_peered":"2024-05-15T18:12:17.091544+0000","last_clean":"2024-05-15T18:12:17.091544+0000","last_became_active":"2024-05-15T18:08:41.189792+0000","last_became_peered":"2024-05-15T18:08:41.189792+0000","last_unstale":"2024-05-15T18:12:17.091544+0000","last_undegraded":"2024-05-15T18:12:17.091544+0000","last_fullsized":"2024-05-15T18:12:17.091544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:17.091439+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.091439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:24:24.593459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'16","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:26.281653+0000","last_change":"2024-05-15T18:12:26.281653+0000","last_active":"2024-05-15T18:12:26.281653+0000","last_peered":"2024-05-15T18:12:26.281653+0000","last_clean":"2024-05-15T18:12:26.281653+0000","last_became_active":"2024-05-15T18:08:43.204789+0000","last_became_peered":"2024-05-15T18:08:43.204789+0000","last_unstale":"2024-05-15T18:12:26.281653+0000","last_undegraded":"2024-05-15T18:12:26.281653+0000","last_fullsized":"2024-05-15T18:12:26.281653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'16","last_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_deep_scrub":"31'16","last_deep_scrub_stamp":"2024-05-15T18:12:26.281513+0000","last_clean_scrub_stamp":"2024-05-15T18:12:26.281513+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:35.878307+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"31'285","reported_seq":383,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:06.505746+0000","last_change":"2024-05-15T18:12:06.505746+0000","last_active":"2024-05-15T18:12:06.505746+0000","last_peered":"2024-05-15T18:12:06.505746+0000","last_clean":"2024-05-15T18:12:06.505746+0000","last_became_active":"2024-05-15T18:08:45.206354+0000","last_became_peered":"2024-05-15T18:08:45.206354+0000","last_unstale":"2024-05-15T18:12:06.505746+0000","last_undegraded":"2024-05-15T18:12:06.505746+0000","last_fullsized":"2024-05-15T18:12:06.505746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'285","last_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_deep_scrub":"31'285","last_deep_scrub_stamp":"2024-05-15T18:12:06.505630+0000","last_clean_scrub_stamp":"2024-05-15T18:12:06.505630+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:15:15.678261+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"29'2","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.170277+0000","last_change":"2024-05-15T18:12:45.170277+0000","last_active":"2024-05-15T18:12:45.170277+0000","last_peered":"2024-05-15T18:12:45.170277+0000","last_clean":"2024-05-15T18:12:45.170277+0000","last_became_active":"2024-05-15T18:08:47.218902+0000","last_became_peered":"2024-05-15T18:08:47.218902+0000","last_unstale":"2024-05-15T18:12:45.170277+0000","last_undegraded":"2024-05-15T18:12:45.170277+0000","last_fullsized":"2024-05-15T18:12:45.170277+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:45.170157+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:45.170157+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.170157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:41:01.687704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.574715+0000","last_change":"2024-05-15T18:12:22.574766+0000","last_active":"2024-05-15T18:12:22.574715+0000","last_peered":"2024-05-15T18:12:22.574715+0000","last_clean":"2024-05-15T18:12:22.574715+0000","last_became_active":"2024-05-15T18:08:39.180257+0000","last_became_peered":"2024-05-15T18:08:39.180257+0000","last_unstale":"2024-05-15T18:12:22.574715+0000","last_undegraded":"2024-05-15T18:12:22.574715+0000","last_fullsized":"2024-05-15T18:12:22.574715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:22.574598+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.574598+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:48:34.319629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:50.875166+0000","last_change":"2024-05-15T18:12:50.875194+0000","last_active":"2024-05-15T18:12:50.875166+0000","last_peered":"2024-05-15T18:12:50.875166+0000","last_clean":"2024-05-15T18:12:50.875166+0000","last_became_active":"2024-05-15T18:08:37.176570+0000","last_became_peered":"2024-05-15T18:08:37.176570+0000","last_unstale":"2024-05-15T18:12:50.875166+0000","last_undegraded":"2024-05-15T18:12:50.875166+0000","last_fullsized":"2024-05-15T18:12:50.875166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:50.875069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:50.875069+0000","last_clean_scrub_stamp":"2024-05-15T18:12:50.875069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:41:38.918843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.101386+0000","last_change":"2024-05-15T18:12:13.101422+0000","last_active":"2024-05-15T18:12:13.101386+0000","last_peered":"2024-05-15T18:12:13.101386+0000","last_clean":"2024-05-15T18:12:13.101386+0000","last_became_active":"2024-05-15T18:08:41.192404+0000","last_became_peered":"2024-05-15T18:08:41.192404+0000","last_unstale":"2024-05-15T18:12:13.101386+0000","last_undegraded":"2024-05-15T18:12:13.101386+0000","last_fullsized":"2024-05-15T18:12:13.101386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.101295+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.101295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:02:45.928543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"31'45","reported_seq":104,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:08.136923+0000","last_change":"2024-05-15T18:12:08.136923+0000","last_active":"2024-05-15T18:12:08.136923+0000","last_peered":"2024-05-15T18:12:08.136923+0000","last_clean":"2024-05-15T18:12:08.136923+0000","last_became_active":"2024-05-15T18:08:43.191162+0000","last_became_peered":"2024-05-15T18:08:43.191162+0000","last_unstale":"2024-05-15T18:12:08.136923+0000","last_undegraded":"2024-05-15T18:12:08.136923+0000","last_fullsized":"2024-05-15T18:12:08.136923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'45","last_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_deep_scrub":"31'45","last_deep_scrub_stamp":"2024-05-15T18:12:08.136791+0000","last_clean_scrub_stamp":"2024-05-15T18:12:08.136791+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:51:18.155270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:01.880039+0000","last_change":"2024-05-15T18:12:01.880039+0000","last_active":"2024-05-15T18:12:01.880039+0000","last_peered":"2024-05-15T18:12:01.880039+0000","last_clean":"2024-05-15T18:12:01.880039+0000","last_became_active":"2024-05-15T18:08:45.203975+0000","last_became_peered":"2024-05-15T18:08:45.203975+0000","last_unstale":"2024-05-15T18:12:01.880039+0000","last_undegraded":"2024-05-15T18:12:01.880039+0000","last_fullsized":"2024-05-15T18:12:01.880039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:01.879852+0000","last_clean_scrub_stamp":"2024-05-15T18:12:01.879852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:43:30.965437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"31'6","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:14.059723+0000","last_change":"2024-05-15T18:12:14.059771+0000","last_active":"2024-05-15T18:12:14.059723+0000","last_peered":"2024-05-15T18:12:14.059723+0000","last_clean":"2024-05-15T18:12:14.059723+0000","last_became_active":"2024-05-15T18:08:47.216882+0000","last_became_peered":"2024-05-15T18:08:47.216882+0000","last_unstale":"2024-05-15T18:12:14.059723+0000","last_undegraded":"2024-05-15T18:12:14.059723+0000","last_fullsized":"2024-05-15T18:12:14.059723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:14.059612+0000","last_clean_scrub_stamp":"2024-05-15T18:12:14.059612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:30:52.613050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.579844+0000","last_change":"2024-05-15T18:12:20.579871+0000","last_active":"2024-05-15T18:12:20.579844+0000","last_peered":"2024-05-15T18:12:20.579844+0000","last_clean":"2024-05-15T18:12:20.579844+0000","last_became_active":"2024-05-15T18:08:39.180342+0000","last_became_peered":"2024-05-15T18:08:39.180342+0000","last_unstale":"2024-05-15T18:12:20.579844+0000","last_undegraded":"2024-05-15T18:12:20.579844+0000","last_fullsized":"2024-05-15T18:12:20.579844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:20.579756+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.579756+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:48:19.140085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:03.102920+0000","last_change":"2024-05-15T18:13:03.102960+0000","last_active":"2024-05-15T18:13:03.102920+0000","last_peered":"2024-05-15T18:13:03.102920+0000","last_clean":"2024-05-15T18:13:03.102920+0000","last_became_active":"2024-05-15T18:08:37.185140+0000","last_became_peered":"2024-05-15T18:08:37.185140+0000","last_unstale":"2024-05-15T18:13:03.102920+0000","last_undegraded":"2024-05-15T18:13:03.102920+0000","last_fullsized":"2024-05-15T18:13:03.102920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:03.102817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:03.102817+0000","last_clean_scrub_stamp":"2024-05-15T18:13:03.102817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:12:21.928771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:13.532585+0000","last_change":"2024-05-15T18:12:13.532610+0000","last_active":"2024-05-15T18:12:13.532585+0000","last_peered":"2024-05-15T18:12:13.532585+0000","last_clean":"2024-05-15T18:12:13.532585+0000","last_became_active":"2024-05-15T18:08:41.194705+0000","last_became_peered":"2024-05-15T18:08:41.194705+0000","last_unstale":"2024-05-15T18:12:13.532585+0000","last_undegraded":"2024-05-15T18:12:13.532585+0000","last_fullsized":"2024-05-15T18:12:13.532585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:13.532473+0000","last_clean_scrub_stamp":"2024-05-15T18:12:13.532473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:18:34.476933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"31'36","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:07.850386+0000","last_change":"2024-05-15T18:12:07.850386+0000","last_active":"2024-05-15T18:12:07.850386+0000","last_peered":"2024-05-15T18:12:07.850386+0000","last_clean":"2024-05-15T18:12:07.850386+0000","last_became_active":"2024-05-15T18:08:43.200337+0000","last_became_peered":"2024-05-15T18:08:43.200337+0000","last_unstale":"2024-05-15T18:12:07.850386+0000","last_undegraded":"2024-05-15T18:12:07.850386+0000","last_fullsized":"2024-05-15T18:12:07.850386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'36","last_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_deep_scrub":"31'36","last_deep_scrub_stamp":"2024-05-15T18:12:07.850240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:07.850240+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:32:45.111188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:19.202135+0000","last_change":"2024-05-15T18:12:19.202194+0000","last_active":"2024-05-15T18:12:19.202135+0000","last_peered":"2024-05-15T18:12:19.202135+0000","last_clean":"2024-05-15T18:12:19.202135+0000","last_became_active":"2024-05-15T18:08:45.208261+0000","last_became_peered":"2024-05-15T18:08:45.208261+0000","last_unstale":"2024-05-15T18:12:19.202135+0000","last_undegraded":"2024-05-15T18:12:19.202135+0000","last_fullsized":"2024-05-15T18:12:19.202135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:19.202036+0000","last_clean_scrub_stamp":"2024-05-15T18:12:19.202036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:01.433105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"29'2","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:20.185718+0000","last_change":"2024-05-15T18:13:20.185746+0000","last_active":"2024-05-15T18:13:20.185718+0000","last_peered":"2024-05-15T18:13:20.185718+0000","last_clean":"2024-05-15T18:13:20.185718+0000","last_became_active":"2024-05-15T18:08:47.222171+0000","last_became_peered":"2024-05-15T18:08:47.222171+0000","last_unstale":"2024-05-15T18:13:20.185718+0000","last_undegraded":"2024-05-15T18:13:20.185718+0000","last_fullsized":"2024-05-15T18:13:20.185718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:13:20.185614+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:13:20.185614+0000","last_clean_scrub_stamp":"2024-05-15T18:13:20.185614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:44:58.459100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"31'12","reported_seq":79,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.219392+0000","last_change":"2024-05-15T18:12:43.219392+0000","last_active":"2024-05-15T18:12:43.219392+0000","last_peered":"2024-05-15T18:12:43.219392+0000","last_clean":"2024-05-15T18:12:43.219392+0000","last_became_active":"2024-05-15T18:08:39.181511+0000","last_became_peered":"2024-05-15T18:08:39.181511+0000","last_unstale":"2024-05-15T18:12:43.219392+0000","last_undegraded":"2024-05-15T18:12:43.219392+0000","last_fullsized":"2024-05-15T18:12:43.219392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:43.219263+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:43.219263+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.219263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:19:50.255782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"29'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.103086+0000","last_change":"2024-05-15T18:12:35.103086+0000","last_active":"2024-05-15T18:12:35.103086+0000","last_peered":"2024-05-15T18:12:35.103086+0000","last_clean":"2024-05-15T18:12:35.103086+0000","last_became_active":"2024-05-15T18:08:37.180324+0000","last_became_peered":"2024-05-15T18:08:37.180324+0000","last_unstale":"2024-05-15T18:12:35.103086+0000","last_undegraded":"2024-05-15T18:12:35.103086+0000","last_fullsized":"2024-05-15T18:12:35.103086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:35.102958+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:35.102958+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.102958+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:18:29.354078+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:09.110633+0000","last_change":"2024-05-15T18:12:09.110633+0000","last_active":"2024-05-15T18:12:09.110633+0000","last_peered":"2024-05-15T18:12:09.110633+0000","last_clean":"2024-05-15T18:12:09.110633+0000","last_became_active":"2024-05-15T18:08:41.195343+0000","last_became_peered":"2024-05-15T18:08:41.195343+0000","last_unstale":"2024-05-15T18:12:09.110633+0000","last_undegraded":"2024-05-15T18:12:09.110633+0000","last_fullsized":"2024-05-15T18:12:09.110633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:09.110521+0000","last_clean_scrub_stamp":"2024-05-15T18:12:09.110521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:07:26.939908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"31'31","reported_seq":84,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.230432+0000","last_change":"2024-05-15T18:12:24.230472+0000","last_active":"2024-05-15T18:12:24.230432+0000","last_peered":"2024-05-15T18:12:24.230432+0000","last_clean":"2024-05-15T18:12:24.230432+0000","last_became_active":"2024-05-15T18:08:43.205156+0000","last_became_peered":"2024-05-15T18:08:43.205156+0000","last_unstale":"2024-05-15T18:12:24.230432+0000","last_undegraded":"2024-05-15T18:12:24.230432+0000","last_fullsized":"2024-05-15T18:12:24.230432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'31","last_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_deep_scrub":"31'31","last_deep_scrub_stamp":"2024-05-15T18:12:24.230338+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.230338+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:28.672249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.200745+0000","last_change":"2024-05-15T18:12:20.200773+0000","last_active":"2024-05-15T18:12:20.200745+0000","last_peered":"2024-05-15T18:12:20.200745+0000","last_clean":"2024-05-15T18:12:20.200745+0000","last_became_active":"2024-05-15T18:08:45.207819+0000","last_became_peered":"2024-05-15T18:08:45.207819+0000","last_unstale":"2024-05-15T18:12:20.200745+0000","last_undegraded":"2024-05-15T18:12:20.200745+0000","last_fullsized":"2024-05-15T18:12:20.200745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:20.200646+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.200646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:46:24.107584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"31'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:22.212756+0000","last_change":"2024-05-15T18:13:22.212785+0000","last_active":"2024-05-15T18:13:22.212756+0000","last_peered":"2024-05-15T18:13:22.212756+0000","last_clean":"2024-05-15T18:13:22.212756+0000","last_became_active":"2024-05-15T18:08:47.223488+0000","last_became_peered":"2024-05-15T18:08:47.223488+0000","last_unstale":"2024-05-15T18:13:22.212756+0000","last_undegraded":"2024-05-15T18:13:22.212756+0000","last_fullsized":"2024-05-15T18:13:22.212756+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:13:22.212634+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:13:22.212634+0000","last_clean_scrub_stamp":"2024-05-15T18:13:22.212634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:24:09.986704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"31'4","reported_seq":56,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.561907+0000","last_change":"2024-05-15T18:12:24.561907+0000","last_active":"2024-05-15T18:12:24.561907+0000","last_peered":"2024-05-15T18:12:24.561907+0000","last_clean":"2024-05-15T18:12:24.561907+0000","last_became_active":"2024-05-15T18:08:39.182638+0000","last_became_peered":"2024-05-15T18:08:39.182638+0000","last_unstale":"2024-05-15T18:12:24.561907+0000","last_undegraded":"2024-05-15T18:12:24.561907+0000","last_fullsized":"2024-05-15T18:12:24.561907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:24.561798+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.561798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:53.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"31'4","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:45.961011+0000","last_change":"2024-05-15T18:12:45.961011+0000","last_active":"2024-05-15T18:12:45.961011+0000","last_peered":"2024-05-15T18:12:45.961011+0000","last_clean":"2024-05-15T18:12:45.961011+0000","last_became_active":"2024-05-15T18:08:37.171152+0000","last_became_peered":"2024-05-15T18:08:37.171152+0000","last_unstale":"2024-05-15T18:12:45.961011+0000","last_undegraded":"2024-05-15T18:12:45.961011+0000","last_fullsized":"2024-05-15T18:12:45.961011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:45.960841+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:45.960841+0000","last_clean_scrub_stamp":"2024-05-15T18:12:45.960841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:17:48.335945+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"31'3","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:11.076997+0000","last_change":"2024-05-15T18:12:11.076997+0000","last_active":"2024-05-15T18:12:11.076997+0000","last_peered":"2024-05-15T18:12:11.076997+0000","last_clean":"2024-05-15T18:12:11.076997+0000","last_became_active":"2024-05-15T18:08:41.194516+0000","last_became_peered":"2024-05-15T18:08:41.194516+0000","last_unstale":"2024-05-15T18:12:11.076997+0000","last_undegraded":"2024-05-15T18:12:11.076997+0000","last_fullsized":"2024-05-15T18:12:11.076997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-05-15T18:12:11.076888+0000","last_clean_scrub_stamp":"2024-05-15T18:12:11.076888+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:44.712782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"31'39","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:17.195779+0000","last_change":"2024-05-15T18:12:17.195819+0000","last_active":"2024-05-15T18:12:17.195779+0000","last_peered":"2024-05-15T18:12:17.195779+0000","last_clean":"2024-05-15T18:12:17.195779+0000","last_became_active":"2024-05-15T18:08:43.204524+0000","last_became_peered":"2024-05-15T18:08:43.204524+0000","last_unstale":"2024-05-15T18:12:17.195779+0000","last_undegraded":"2024-05-15T18:12:17.195779+0000","last_fullsized":"2024-05-15T18:12:17.195779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'39","last_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_deep_scrub":"31'39","last_deep_scrub_stamp":"2024-05-15T18:12:17.195689+0000","last_clean_scrub_stamp":"2024-05-15T18:12:17.195689+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:06.470822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:18.030201+0000","last_change":"2024-05-15T18:12:18.030230+0000","last_active":"2024-05-15T18:12:18.030201+0000","last_peered":"2024-05-15T18:12:18.030201+0000","last_clean":"2024-05-15T18:12:18.030201+0000","last_became_active":"2024-05-15T18:08:45.209375+0000","last_became_peered":"2024-05-15T18:08:45.209375+0000","last_unstale":"2024-05-15T18:12:18.030201+0000","last_undegraded":"2024-05-15T18:12:18.030201+0000","last_fullsized":"2024-05-15T18:12:18.030201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:18.030108+0000","last_clean_scrub_stamp":"2024-05-15T18:12:18.030108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:36.616836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"31'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:21.169774+0000","last_change":"2024-05-15T18:13:21.169774+0000","last_active":"2024-05-15T18:13:21.169774+0000","last_peered":"2024-05-15T18:13:21.169774+0000","last_clean":"2024-05-15T18:13:21.169774+0000","last_became_active":"2024-05-15T18:08:47.222271+0000","last_became_peered":"2024-05-15T18:08:47.222271+0000","last_unstale":"2024-05-15T18:13:21.169774+0000","last_undegraded":"2024-05-15T18:13:21.169774+0000","last_fullsized":"2024-05-15T18:13:21.169774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:13:21.169616+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:13:21.169616+0000","last_clean_scrub_stamp":"2024-05-15T18:13:21.169616+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:08:01.169452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:22.985820+0000","last_change":"2024-05-15T18:12:22.985820+0000","last_active":"2024-05-15T18:12:22.985820+0000","last_peered":"2024-05-15T18:12:22.985820+0000","last_clean":"2024-05-15T18:12:22.985820+0000","last_became_active":"2024-05-15T18:08:39.192896+0000","last_became_peered":"2024-05-15T18:08:39.192896+0000","last_unstale":"2024-05-15T18:12:22.985820+0000","last_undegraded":"2024-05-15T18:12:22.985820+0000","last_fullsized":"2024-05-15T18:12:22.985820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:22.985658+0000","last_clean_scrub_stamp":"2024-05-15T18:12:22.985658+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:45.191068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"31'6","reported_seq":54,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:41.546934+0000","last_change":"2024-05-15T18:12:41.546934+0000","last_active":"2024-05-15T18:12:41.546934+0000","last_peered":"2024-05-15T18:12:41.546934+0000","last_clean":"2024-05-15T18:12:41.546934+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:12:41.546934+0000","last_undegraded":"2024-05-15T18:12:41.546934+0000","last_fullsized":"2024-05-15T18:12:41.546934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:41.546819+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:41.546819+0000","last_clean_scrub_stamp":"2024-05-15T18:12:41.546819+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:57.515122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"31'8","reported_seq":69,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.175229+0000","last_change":"2024-05-15T18:12:30.175229+0000","last_active":"2024-05-15T18:12:30.175229+0000","last_peered":"2024-05-15T18:12:30.175229+0000","last_clean":"2024-05-15T18:12:30.175229+0000","last_became_active":"2024-05-15T18:08:39.182008+0000","last_became_peered":"2024-05-15T18:08:39.182008+0000","last_unstale":"2024-05-15T18:12:30.175229+0000","last_undegraded":"2024-05-15T18:12:30.175229+0000","last_fullsized":"2024-05-15T18:12:30.175229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:30.175060+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.175060+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:44:58.317953+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'6","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:49.058150+0000","last_change":"2024-05-15T18:12:49.058150+0000","last_active":"2024-05-15T18:12:49.058150+0000","last_peered":"2024-05-15T18:12:49.058150+0000","last_clean":"2024-05-15T18:12:49.058150+0000","last_became_active":"2024-05-15T18:08:37.174232+0000","last_became_peered":"2024-05-15T18:08:37.174232+0000","last_unstale":"2024-05-15T18:12:49.058150+0000","last_undegraded":"2024-05-15T18:12:49.058150+0000","last_fullsized":"2024-05-15T18:12:49.058150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:49.057973+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:49.057973+0000","last_clean_scrub_stamp":"2024-05-15T18:12:49.057973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:58:27.470127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"31'8","reported_seq":71,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.225545+0000","last_change":"2024-05-15T18:12:42.225545+0000","last_active":"2024-05-15T18:12:42.225545+0000","last_peered":"2024-05-15T18:12:42.225545+0000","last_clean":"2024-05-15T18:12:42.225545+0000","last_became_active":"2024-05-15T18:08:39.181586+0000","last_became_peered":"2024-05-15T18:08:39.181586+0000","last_unstale":"2024-05-15T18:12:42.225545+0000","last_undegraded":"2024-05-15T18:12:42.225545+0000","last_fullsized":"2024-05-15T18:12:42.225545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:42.225381+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:42.225381+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.225381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:39:49.913736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:02.126085+0000","last_change":"2024-05-15T18:13:02.126111+0000","last_active":"2024-05-15T18:13:02.126085+0000","last_peered":"2024-05-15T18:13:02.126085+0000","last_clean":"2024-05-15T18:13:02.126085+0000","last_became_active":"2024-05-15T18:08:37.179960+0000","last_became_peered":"2024-05-15T18:08:37.179960+0000","last_unstale":"2024-05-15T18:13:02.126085+0000","last_undegraded":"2024-05-15T18:13:02.126085+0000","last_fullsized":"2024-05-15T18:13:02.126085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:13:02.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:13:02.125957+0000","last_clean_scrub_stamp":"2024-05-15T18:13:02.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:14:28.588404+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'6","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.145506+0000","last_change":"2024-05-15T18:12:34.145506+0000","last_active":"2024-05-15T18:12:34.145506+0000","last_peered":"2024-05-15T18:12:34.145506+0000","last_clean":"2024-05-15T18:12:34.145506+0000","last_became_active":"2024-05-15T18:08:39.181327+0000","last_became_peered":"2024-05-15T18:08:39.181327+0000","last_unstale":"2024-05-15T18:12:34.145506+0000","last_undegraded":"2024-05-15T18:12:34.145506+0000","last_fullsized":"2024-05-15T18:12:34.145506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:34.145384+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.145384+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:22.006817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.134698+0000","last_change":"2024-05-15T18:12:43.134698+0000","last_active":"2024-05-15T18:12:43.134698+0000","last_peered":"2024-05-15T18:12:43.134698+0000","last_clean":"2024-05-15T18:12:43.134698+0000","last_became_active":"2024-05-15T18:08:37.179348+0000","last_became_peered":"2024-05-15T18:08:37.179348+0000","last_unstale":"2024-05-15T18:12:43.134698+0000","last_undegraded":"2024-05-15T18:12:43.134698+0000","last_fullsized":"2024-05-15T18:12:43.134698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:43.134559+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:43.134559+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.134559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:20:54.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'8","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.138916+0000","last_change":"2024-05-15T18:12:32.138916+0000","last_active":"2024-05-15T18:12:32.138916+0000","last_peered":"2024-05-15T18:12:32.138916+0000","last_clean":"2024-05-15T18:12:32.138916+0000","last_became_active":"2024-05-15T18:08:39.182012+0000","last_became_peered":"2024-05-15T18:08:39.182012+0000","last_unstale":"2024-05-15T18:12:32.138916+0000","last_undegraded":"2024-05-15T18:12:32.138916+0000","last_fullsized":"2024-05-15T18:12:32.138916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:32.138787+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.138787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:25:48.107090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:47.134585+0000","last_change":"2024-05-15T18:12:47.134585+0000","last_active":"2024-05-15T18:12:47.134585+0000","last_peered":"2024-05-15T18:12:47.134585+0000","last_clean":"2024-05-15T18:12:47.134585+0000","last_became_active":"2024-05-15T18:08:37.172895+0000","last_became_peered":"2024-05-15T18:08:37.172895+0000","last_unstale":"2024-05-15T18:12:47.134585+0000","last_undegraded":"2024-05-15T18:12:47.134585+0000","last_fullsized":"2024-05-15T18:12:47.134585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:47.134445+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:47.134445+0000","last_clean_scrub_stamp":"2024-05-15T18:12:47.134445+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:54:38.189538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"31'8","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:23.970784+0000","last_change":"2024-05-15T18:12:23.970784+0000","last_active":"2024-05-15T18:12:23.970784+0000","last_peered":"2024-05-15T18:12:23.970784+0000","last_clean":"2024-05-15T18:12:23.970784+0000","last_became_active":"2024-05-15T18:08:39.191947+0000","last_became_peered":"2024-05-15T18:08:39.191947+0000","last_unstale":"2024-05-15T18:12:23.970784+0000","last_undegraded":"2024-05-15T18:12:23.970784+0000","last_fullsized":"2024-05-15T18:12:23.970784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:23.970665+0000","last_clean_scrub_stamp":"2024-05-15T18:12:23.970665+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:28:19.811968+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:43.045170+0000","last_change":"2024-05-15T18:12:43.045170+0000","last_active":"2024-05-15T18:12:43.045170+0000","last_peered":"2024-05-15T18:12:43.045170+0000","last_clean":"2024-05-15T18:12:43.045170+0000","last_became_active":"2024-05-15T18:08:37.176208+0000","last_became_peered":"2024-05-15T18:08:37.176208+0000","last_unstale":"2024-05-15T18:12:43.045170+0000","last_undegraded":"2024-05-15T18:12:43.045170+0000","last_fullsized":"2024-05-15T18:12:43.045170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:43.045020+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:43.045020+0000","last_clean_scrub_stamp":"2024-05-15T18:12:43.045020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:00:27.966525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"31'8","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.121090+0000","last_change":"2024-05-15T18:12:25.121090+0000","last_active":"2024-05-15T18:12:25.121090+0000","last_peered":"2024-05-15T18:12:25.121090+0000","last_clean":"2024-05-15T18:12:25.121090+0000","last_became_active":"2024-05-15T18:08:39.186828+0000","last_became_peered":"2024-05-15T18:08:39.186828+0000","last_unstale":"2024-05-15T18:12:25.121090+0000","last_undegraded":"2024-05-15T18:12:25.121090+0000","last_fullsized":"2024-05-15T18:12:25.121090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:25.120969+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.120969+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:23:19.624066+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:25.561063+0000","last_change":"2024-05-15T18:12:25.561063+0000","last_active":"2024-05-15T18:12:25.561063+0000","last_peered":"2024-05-15T18:12:25.561063+0000","last_clean":"2024-05-15T18:12:25.561063+0000","last_became_active":"2024-05-15T18:08:37.184945+0000","last_became_peered":"2024-05-15T18:08:37.184945+0000","last_unstale":"2024-05-15T18:12:25.561063+0000","last_undegraded":"2024-05-15T18:12:25.561063+0000","last_fullsized":"2024-05-15T18:12:25.561063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:25.560894+0000","last_clean_scrub_stamp":"2024-05-15T18:12:25.560894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:27:37.100840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"31'6","reported_seq":67,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:30.044657+0000","last_change":"2024-05-15T18:12:30.044657+0000","last_active":"2024-05-15T18:12:30.044657+0000","last_peered":"2024-05-15T18:12:30.044657+0000","last_clean":"2024-05-15T18:12:30.044657+0000","last_became_active":"2024-05-15T18:08:39.181667+0000","last_became_peered":"2024-05-15T18:08:39.181667+0000","last_unstale":"2024-05-15T18:12:30.044657+0000","last_undegraded":"2024-05-15T18:12:30.044657+0000","last_fullsized":"2024-05-15T18:12:30.044657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:30.044530+0000","last_clean_scrub_stamp":"2024-05-15T18:12:30.044530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:37.330279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:48.092336+0000","last_change":"2024-05-15T18:12:48.092336+0000","last_active":"2024-05-15T18:12:48.092336+0000","last_peered":"2024-05-15T18:12:48.092336+0000","last_clean":"2024-05-15T18:12:48.092336+0000","last_became_active":"2024-05-15T18:08:37.172932+0000","last_became_peered":"2024-05-15T18:08:37.172932+0000","last_unstale":"2024-05-15T18:12:48.092336+0000","last_undegraded":"2024-05-15T18:12:48.092336+0000","last_fullsized":"2024-05-15T18:12:48.092336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:48.092219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:48.092219+0000","last_clean_scrub_stamp":"2024-05-15T18:12:48.092219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:36:16.437531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'12","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:34.038981+0000","last_change":"2024-05-15T18:12:34.038981+0000","last_active":"2024-05-15T18:12:34.038981+0000","last_peered":"2024-05-15T18:12:34.038981+0000","last_clean":"2024-05-15T18:12:34.038981+0000","last_became_active":"2024-05-15T18:08:39.185345+0000","last_became_peered":"2024-05-15T18:08:39.185345+0000","last_unstale":"2024-05-15T18:12:34.038981+0000","last_undegraded":"2024-05-15T18:12:34.038981+0000","last_fullsized":"2024-05-15T18:12:34.038981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:34.038867+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:34.038867+0000","last_clean_scrub_stamp":"2024-05-15T18:12:34.038867+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:49:23.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"31'2","reported_seq":49,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:13:12.121833+0000","last_change":"2024-05-15T18:13:12.121861+0000","last_active":"2024-05-15T18:13:12.121833+0000","last_peered":"2024-05-15T18:13:12.121833+0000","last_clean":"2024-05-15T18:13:12.121833+0000","last_became_active":"2024-05-15T18:08:37.174368+0000","last_became_peered":"2024-05-15T18:08:37.174368+0000","last_unstale":"2024-05-15T18:13:12.121833+0000","last_undegraded":"2024-05-15T18:13:12.121833+0000","last_fullsized":"2024-05-15T18:13:12.121833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:13:12.121742+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:13:12.121742+0000","last_clean_scrub_stamp":"2024-05-15T18:13:12.121742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:01:36.077893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"31'4","reported_seq":53,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.201522+0000","last_change":"2024-05-15T18:12:38.201522+0000","last_active":"2024-05-15T18:12:38.201522+0000","last_peered":"2024-05-15T18:12:38.201522+0000","last_clean":"2024-05-15T18:12:38.201522+0000","last_became_active":"2024-05-15T18:08:39.182582+0000","last_became_peered":"2024-05-15T18:08:39.182582+0000","last_unstale":"2024-05-15T18:12:38.201522+0000","last_undegraded":"2024-05-15T18:12:38.201522+0000","last_fullsized":"2024-05-15T18:12:38.201522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:38.201399+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:38.201399+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.201399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T03:09:03.315937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.010162+0000","last_change":"2024-05-15T18:12:51.010162+0000","last_active":"2024-05-15T18:12:51.010162+0000","last_peered":"2024-05-15T18:12:51.010162+0000","last_clean":"2024-05-15T18:12:51.010162+0000","last_became_active":"2024-05-15T18:08:37.179277+0000","last_became_peered":"2024-05-15T18:08:37.179277+0000","last_unstale":"2024-05-15T18:12:51.010162+0000","last_undegraded":"2024-05-15T18:12:51.010162+0000","last_fullsized":"2024-05-15T18:12:51.010162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:51.010036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:51.010036+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.010036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:38:08.614485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"31'14","reported_seq":77,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:58.992221+0000","last_change":"2024-05-15T18:12:58.992221+0000","last_active":"2024-05-15T18:12:58.992221+0000","last_peered":"2024-05-15T18:12:58.992221+0000","last_clean":"2024-05-15T18:12:58.992221+0000","last_became_active":"2024-05-15T18:09:19.409049+0000","last_became_peered":"2024-05-15T18:09:19.409049+0000","last_unstale":"2024-05-15T18:12:58.992221+0000","last_undegraded":"2024-05-15T18:12:58.992221+0000","last_fullsized":"2024-05-15T18:12:58.992221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'14","last_scrub_stamp":"2024-05-15T18:12:58.992048+0000","last_deep_scrub":"31'14","last_deep_scrub_stamp":"2024-05-15T18:12:58.992048+0000","last_clean_scrub_stamp":"2024-05-15T18:12:58.992048+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:40:06.680403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":42,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:35.002246+0000","last_change":"2024-05-15T18:12:35.002246+0000","last_active":"2024-05-15T18:12:35.002246+0000","last_peered":"2024-05-15T18:12:35.002246+0000","last_clean":"2024-05-15T18:12:35.002246+0000","last_became_active":"2024-05-15T18:08:37.179804+0000","last_became_peered":"2024-05-15T18:08:37.179804+0000","last_unstale":"2024-05-15T18:12:35.002246+0000","last_undegraded":"2024-05-15T18:12:35.002246+0000","last_fullsized":"2024-05-15T18:12:35.002246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:35.002095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:35.002095+0000","last_clean_scrub_stamp":"2024-05-15T18:12:35.002095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:22.863528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"31'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:31.041130+0000","last_change":"2024-05-15T18:12:31.041130+0000","last_active":"2024-05-15T18:12:31.041130+0000","last_peered":"2024-05-15T18:12:31.041130+0000","last_clean":"2024-05-15T18:12:31.041130+0000","last_became_active":"2024-05-15T18:08:39.179852+0000","last_became_peered":"2024-05-15T18:08:39.179852+0000","last_unstale":"2024-05-15T18:12:31.041130+0000","last_undegraded":"2024-05-15T18:12:31.041130+0000","last_fullsized":"2024-05-15T18:12:31.041130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:31.041007+0000","last_clean_scrub_stamp":"2024-05-15T18:12:31.041007+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:12:07.255869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:38.992367+0000","last_change":"2024-05-15T18:12:38.992367+0000","last_active":"2024-05-15T18:12:38.992367+0000","last_peered":"2024-05-15T18:12:38.992367+0000","last_clean":"2024-05-15T18:12:38.992367+0000","last_became_active":"2024-05-15T18:08:37.173378+0000","last_became_peered":"2024-05-15T18:08:37.173378+0000","last_unstale":"2024-05-15T18:12:38.992367+0000","last_undegraded":"2024-05-15T18:12:38.992367+0000","last_fullsized":"2024-05-15T18:12:38.992367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:38.992240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:38.992240+0000","last_clean_scrub_stamp":"2024-05-15T18:12:38.992240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:42:39.302019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"31'8","reported_seq":55,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:20.988373+0000","last_change":"2024-05-15T18:12:20.988373+0000","last_active":"2024-05-15T18:12:20.988373+0000","last_peered":"2024-05-15T18:12:20.988373+0000","last_clean":"2024-05-15T18:12:20.988373+0000","last_became_active":"2024-05-15T18:08:39.193002+0000","last_became_peered":"2024-05-15T18:08:39.193002+0000","last_unstale":"2024-05-15T18:12:20.988373+0000","last_undegraded":"2024-05-15T18:12:20.988373+0000","last_fullsized":"2024-05-15T18:12:20.988373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2024-05-15T18:12:20.988215+0000","last_clean_scrub_stamp":"2024-05-15T18:12:20.988215+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T05:35:54.295065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'2","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:51.123787+0000","last_change":"2024-05-15T18:12:51.123787+0000","last_active":"2024-05-15T18:12:51.123787+0000","last_peered":"2024-05-15T18:12:51.123787+0000","last_clean":"2024-05-15T18:12:51.123787+0000","last_became_active":"2024-05-15T18:08:37.182516+0000","last_became_peered":"2024-05-15T18:08:37.182516+0000","last_unstale":"2024-05-15T18:12:51.123787+0000","last_undegraded":"2024-05-15T18:12:51.123787+0000","last_fullsized":"2024-05-15T18:12:51.123787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:51.123675+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:51.123675+0000","last_clean_scrub_stamp":"2024-05-15T18:12:51.123675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T02:33:11.864114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"31'12","reported_seq":86,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:42.007541+0000","last_change":"2024-05-15T18:12:42.007541+0000","last_active":"2024-05-15T18:12:42.007541+0000","last_peered":"2024-05-15T18:12:42.007541+0000","last_clean":"2024-05-15T18:12:42.007541+0000","last_became_active":"2024-05-15T18:08:39.187636+0000","last_became_peered":"2024-05-15T18:08:39.187636+0000","last_unstale":"2024-05-15T18:12:42.007541+0000","last_undegraded":"2024-05-15T18:12:42.007541+0000","last_fullsized":"2024-05-15T18:12:42.007541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'12","last_scrub_stamp":"2024-05-15T18:12:42.007335+0000","last_deep_scrub":"31'12","last_deep_scrub_stamp":"2024-05-15T18:12:42.007335+0000","last_clean_scrub_stamp":"2024-05-15T18:12:42.007335+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:26:46.449247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:56.157154+0000","last_change":"2024-05-15T18:12:56.157154+0000","last_active":"2024-05-15T18:12:56.157154+0000","last_peered":"2024-05-15T18:12:56.157154+0000","last_clean":"2024-05-15T18:12:56.157154+0000","last_became_active":"2024-05-15T18:08:37.181062+0000","last_became_peered":"2024-05-15T18:08:37.181062+0000","last_unstale":"2024-05-15T18:12:56.157154+0000","last_undegraded":"2024-05-15T18:12:56.157154+0000","last_fullsized":"2024-05-15T18:12:56.157154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:56.157010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:56.157010+0000","last_clean_scrub_stamp":"2024-05-15T18:12:56.157010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:48:10.969142+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:32.228088+0000","last_change":"2024-05-15T18:12:32.228088+0000","last_active":"2024-05-15T18:12:32.228088+0000","last_peered":"2024-05-15T18:12:32.228088+0000","last_clean":"2024-05-15T18:12:32.228088+0000","last_became_active":"2024-05-15T18:08:39.187249+0000","last_became_peered":"2024-05-15T18:08:39.187249+0000","last_unstale":"2024-05-15T18:12:32.228088+0000","last_undegraded":"2024-05-15T18:12:32.228088+0000","last_fullsized":"2024-05-15T18:12:32.228088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:32.227938+0000","last_clean_scrub_stamp":"2024-05-15T18:12:32.227938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:14:25.136580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.546336+0000","last_change":"2024-05-15T18:12:27.546336+0000","last_active":"2024-05-15T18:12:27.546336+0000","last_peered":"2024-05-15T18:12:27.546336+0000","last_clean":"2024-05-15T18:12:27.546336+0000","last_became_active":"2024-05-15T18:08:37.178790+0000","last_became_peered":"2024-05-15T18:08:37.178790+0000","last_unstale":"2024-05-15T18:12:27.546336+0000","last_undegraded":"2024-05-15T18:12:27.546336+0000","last_fullsized":"2024-05-15T18:12:27.546336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:27.546217+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.546217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:53:46.132945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"31'4","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:33.088288+0000","last_change":"2024-05-15T18:12:33.088288+0000","last_active":"2024-05-15T18:12:33.088288+0000","last_peered":"2024-05-15T18:12:33.088288+0000","last_clean":"2024-05-15T18:12:33.088288+0000","last_became_active":"2024-05-15T18:08:39.178265+0000","last_became_peered":"2024-05-15T18:08:39.178265+0000","last_unstale":"2024-05-15T18:12:33.088288+0000","last_undegraded":"2024-05-15T18:12:33.088288+0000","last_fullsized":"2024-05-15T18:12:33.088288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2024-05-15T18:12:33.088145+0000","last_clean_scrub_stamp":"2024-05-15T18:12:33.088145+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T04:11:24.946373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"31'2","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:57.878475+0000","last_change":"2024-05-15T18:12:57.878508+0000","last_active":"2024-05-15T18:12:57.878475+0000","last_peered":"2024-05-15T18:12:57.878475+0000","last_clean":"2024-05-15T18:12:57.878475+0000","last_became_active":"2024-05-15T18:09:19.409229+0000","last_became_peered":"2024-05-15T18:09:19.409229+0000","last_unstale":"2024-05-15T18:12:57.878475+0000","last_undegraded":"2024-05-15T18:12:57.878475+0000","last_fullsized":"2024-05-15T18:12:57.878475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-05-15T18:12:57.878382+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-05-15T18:12:57.878382+0000","last_clean_scrub_stamp":"2024-05-15T18:12:57.878382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T01:14:02.716270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:54.157577+0000","last_change":"2024-05-15T18:12:54.157577+0000","last_active":"2024-05-15T18:12:54.157577+0000","last_peered":"2024-05-15T18:12:54.157577+0000","last_clean":"2024-05-15T18:12:54.157577+0000","last_became_active":"2024-05-15T18:08:37.181752+0000","last_became_peered":"2024-05-15T18:08:37.181752+0000","last_unstale":"2024-05-15T18:12:54.157577+0000","last_undegraded":"2024-05-15T18:12:54.157577+0000","last_fullsized":"2024-05-15T18:12:54.157577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:54.157440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:54.157440+0000","last_clean_scrub_stamp":"2024-05-15T18:12:54.157440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:58:32.283540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"29'2","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:24.124812+0000","last_change":"2024-05-15T18:12:24.124812+0000","last_active":"2024-05-15T18:12:24.124812+0000","last_peered":"2024-05-15T18:12:24.124812+0000","last_clean":"2024-05-15T18:12:24.124812+0000","last_became_active":"2024-05-15T18:08:39.189942+0000","last_became_peered":"2024-05-15T18:08:39.189942+0000","last_unstale":"2024-05-15T18:12:24.124812+0000","last_undegraded":"2024-05-15T18:12:24.124812+0000","last_fullsized":"2024-05-15T18:12:24.124812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-15T18:12:24.124681+0000","last_clean_scrub_stamp":"2024-05-15T18:12:24.124681+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:32:45.800550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:39.164327+0000","last_change":"2024-05-15T18:12:39.164327+0000","last_active":"2024-05-15T18:12:39.164327+0000","last_peered":"2024-05-15T18:12:39.164327+0000","last_clean":"2024-05-15T18:12:39.164327+0000","last_became_active":"2024-05-15T18:08:37.179726+0000","last_became_peered":"2024-05-15T18:08:37.179726+0000","last_unstale":"2024-05-15T18:12:39.164327+0000","last_undegraded":"2024-05-15T18:12:39.164327+0000","last_fullsized":"2024-05-15T18:12:39.164327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T18:12:39.164216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T18:12:39.164216+0000","last_clean_scrub_stamp":"2024-05-15T18:12:39.164216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:01.803010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"31'6","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T18:12:27.047454+0000","last_change":"2024-05-15T18:12:27.047454+0000","last_active":"2024-05-15T18:12:27.047454+0000","last_peered":"2024-05-15T18:12:27.047454+0000","last_clean":"2024-05-15T18:12:27.047454+0000","last_became_active":"2024-05-15T18:08:39.191859+0000","last_became_peered":"2024-05-15T18:08:39.191859+0000","last_unstale":"2024-05-15T18:12:27.047454+0000","last_undegraded":"2024-05-15T18:12:27.047454+0000","last_fullsized":"2024-05-15T18:12:27.047454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-05-15T18:12:27.047320+0000","last_clean_scrub_stamp":"2024-05-15T18:12:27.047320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:59:33.295448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1617,"num_read_kb":1507,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":10,"seq":42949673028,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":132984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":40434113},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705731,"num_pgs":152,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39932,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331908,"statfs":{"total":96636764160,"available":96595873792,"internally_reserved":0,"allocated":446464,"data_stored":133185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705730,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40444,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331396,"statfs":{"total":96636764160,"available":96595349504,"internally_reserved":0,"allocated":970752,"data_stored":720289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705730,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":1007616,"data_stored":721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T18:13:40.328 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-15T18:13:40.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.477+0000 7fb34987b640 1 Processor -- start 2024-05-15T18:13:40.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.477+0000 7fb34987b640 1 -- start start 2024-05-15T18:13:40.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb34987b640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb34406dfe0 0x7fb3441337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb34987b640 1 -- --> v1:172.21.15.3:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3440720b0 con 0x7fb34406d4f0 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb34987b640 1 -- --> v2:172.21.15.3:3300/0 -- mon_getmap magic: 0 -- 0x7fb34406f6b0 con 0x7fb34406dfe0 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb3427fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb34406dfe0 0x7fb3441337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb342ffd640 1 --1- >> v1:172.21.15.3:6789/0 conn(0x7fb34406d4f0 0x7fb34406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.3:6789/0 says I am v1:172.21.15.3:40622/0 (socket says 172.21.15.3:40622) 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb342ffd640 1 -- 172.21.15.3:0/1090638810 learned_addr learned my addr 172.21.15.3:0/1090638810 (peer_addr_for_me v1:172.21.15.3:0/0) 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb3427fc640 1 --2- >> v2:172.21.15.3:3300/0 conn(0x7fb34406dfe0 0x7fb3441337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35022/0 (socket says 172.21.15.3:35022) 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb3427fc640 1 -- 172.21.15.3:0/1090638810 >> v1:172.21.15.3:6789/0 conn(0x7fb34406d4f0 legacy=0x7fb34406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.478+0000 7fb3427fc640 1 -- 172.21.15.3:0/1090638810 --> v2:172.21.15.3:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34406e710 con 0x7fb34406dfe0 2024-05-15T18:13:40.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb3427fc640 1 --2- 172.21.15.3:0/1090638810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406dfe0 0x7fb3441337c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb338009720 tx=0x7fb33802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80341098b38d24a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb341ffb640 1 -- 172.21.15.3:0/1090638810 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3380316d0 con 0x7fb34406dfe0 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb341ffb640 1 -- 172.21.15.3:0/1090638810 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338037070 con 0x7fb34406dfe0 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb341ffb640 1 -- 172.21.15.3:0/1090638810 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3380319c0 con 0x7fb34406dfe0 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb34987b640 1 -- 172.21.15.3:0/1090638810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406dfe0 msgr2=0x7fb3441337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb34987b640 1 --2- 172.21.15.3:0/1090638810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406dfe0 0x7fb3441337c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb338009720 tx=0x7fb33802b840 comp rx=0 tx=0).stop 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb34987b640 1 -- 172.21.15.3:0/1090638810 shutdown_connections 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb34987b640 1 --2- 172.21.15.3:0/1090638810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406dfe0 0x7fb3441337c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.479+0000 7fb34987b640 1 -- 172.21.15.3:0/1090638810 >> 172.21.15.3:0/1090638810 conn(0x7fb34409d750 msgr2=0x7fb34409db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.480+0000 7fb34987b640 1 -- 172.21.15.3:0/1090638810 shutdown_connections 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.480+0000 7fb34987b640 1 -- 172.21.15.3:0/1090638810 wait complete. 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.480+0000 7fb34987b640 1 Processor -- start 2024-05-15T18:13:40.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.481+0000 7fb34987b640 1 -- start start 2024-05-15T18:13:40.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.481+0000 7fb34987b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406d4f0 0x7fb344127ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:40.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.481+0000 7fb34987b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb34409fe30 con 0x7fb34406d4f0 2024-05-15T18:13:40.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.481+0000 7fb342ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406d4f0 0x7fb344127ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:40.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.481+0000 7fb342ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406d4f0 0x7fb344127ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35038/0 (socket says 172.21.15.3:35038) 2024-05-15T18:13:40.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.481+0000 7fb342ffd640 1 -- 172.21.15.3:0/4020957856 learned_addr learned my addr 172.21.15.3:0/4020957856 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.481+0000 7fb342ffd640 1 -- 172.21.15.3:0/4020957856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34412a1d0 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.482+0000 7fb342ffd640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406d4f0 0x7fb344127ad0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c4a0 tx=0x7fb33400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.482+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb334017070 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.482+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334005c10 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.482+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb334007070 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.482+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34412a690 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.482+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3441281f0 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.483+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb33401a070 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.483+0000 7fb32bfff640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb330038060 0x7fb33003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.483+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5938+0+0 (secure 0 0 0) 0x7fb33404aba0 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.483+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb344129560 con 0x7fb34406d4f0 2024-05-15T18:13:40.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.483+0000 7fb3427fc640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb330038060 0x7fb33003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T18:13:40.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.484+0000 7fb3427fc640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb330038060 0x7fb33003a520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb338036000 tx=0x7fb338008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T18:13:40.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.488+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb33401b3b0 con 0x7fb34406d4f0 2024-05-15T18:13:40.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.670+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb344062e90 con 0x7fb34406d4f0 2024-05-15T18:13:40.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.672+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb334010c00 con 0x7fb34406d4f0 2024-05-15T18:13:40.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.672+0000 7fb32bfff640 1 -- 172.21.15.3:0/4020957856 <== mon.0 v2:172.21.15.3:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb334019680 con 0x7fb34406d4f0 2024-05-15T18:13:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb330038060 msgr2=0x7fb33003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb330038060 0x7fb33003a520 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb338036000 tx=0x7fb338008030 comp rx=0 tx=0).stop 2024-05-15T18:13:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406d4f0 msgr2=0x7fb344127ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T18:13:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406d4f0 0x7fb344127ad0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c4a0 tx=0x7fb33400c960 comp rx=0 tx=0).stop 2024-05-15T18:13:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 shutdown_connections 2024-05-15T18:13:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.173:6824/3800909313,v1:172.21.15.173:6825/3800909313] conn(0x7fb330038060 0x7fb33003a520 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:40.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 --2- 172.21.15.3:0/4020957856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb34406d4f0 0x7fb344127ad0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T18:13:40.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 >> 172.21.15.3:0/4020957856 conn(0x7fb34409d750 msgr2=0x7fb344070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T18:13:40.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 shutdown_connections 2024-05-15T18:13:40.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-05-15T18:13:40.674+0000 7fb34987b640 1 -- 172.21.15.3:0/4020957856 wait complete. 2024-05-15T18:13:40.661 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-15T18:13:40.661 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-15T18:13:40.661 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-15T18:13:40.661 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T18:13:40.701 INFO:tasks.ceph.osd.0:Stopped 2024-05-15T18:13:40.702 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-15T18:13:40.702 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T18:13:40.738 INFO:tasks.ceph.osd.1:Stopped 2024-05-15T18:13:40.738 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-15T18:13:40.738 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T18:13:40.821 INFO:tasks.ceph.osd.2:Stopped 2024-05-15T18:13:40.821 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-15T18:13:40.821 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T18:13:40.860 INFO:tasks.ceph.osd.3:Stopped 2024-05-15T18:13:40.860 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-15T18:13:40.860 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-15T18:13:40.860 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T18:13:40.930 INFO:tasks.ceph.mgr.x:Stopped 2024-05-15T18:13:40.930 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-15T18:13:40.930 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-15T18:13:40.930 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T18:13:40.941 INFO:tasks.ceph.mon.a:Stopped 2024-05-15T18:13:40.942 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-15T18:13:40.942 DEBUG:teuthology.orchestra.run.smithi003:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-15T18:13:41.011 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi003.front.sepia.ceph.com 2024-05-15T18:13:41.011 DEBUG:teuthology.orchestra.run.smithi003:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-15T18:13:41.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:13:41.173 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-15T18:13:41.270 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:13:41.270 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-15T18:13:41.326 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:13:41.326 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-15T18:13:41.376 INFO:tasks.ceph:Archiving mon data... 2024-05-15T18:13:41.378 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/data/mon.a.tgz 2024-05-15T18:13:41.378 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2024-05-15T18:13:41.394 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.yxgxY2fSh4 2024-05-15T18:13:41.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yxgxY2fSh4 2024-05-15T18:13:41.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.yxgxY2fSh4 2024-05-15T18:13:41.618 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.yxgxY2fSh4 is 264KB 2024-05-15T18:13:41.685 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.yxgxY2fSh4 2024-05-15T18:13:41.701 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-15T18:13:41.702 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T18:13:41.744 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T18:13:41.823 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T18:13:41.839 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T18:13:41.839 INFO:tasks.ceph:Archiving crash dumps... 2024-05-15T18:13:41.841 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/remote/smithi003/crash 2024-05-15T18:13:41.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T18:13:41.888 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/remote/smithi173/crash 2024-05-15T18:13:41.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T18:13:41.930 INFO:tasks.ceph:Compressing logs... 2024-05-15T18:13:41.930 DEBUG:teuthology.orchestra.run.smithi003:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T18:13:41.933 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T18:13:41.973 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-05-15T18:13:41.973 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31812.log 2024-05-15T18:13:41.973 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32526.log 2024-05-15T18:13:41.973 INFO:teuthology.orchestra.run.smithi003.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-05-15T18:13:41.973 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32568.log 2024-05-15T18:13:41.973 INFO:teuthology.orchestra.run.smithi003.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31812.log.gz 2024-05-15T18:13:41.973 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31938.log 2024-05-15T18:13:41.974 INFO:teuthology.orchestra.run.smithi003.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32526.log.gz 2024-05-15T18:13:41.974 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32568.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-15T18:13:41.974 INFO:teuthology.orchestra.run.smithi003.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32568.log.gz 2024-05-15T18:13:41.974 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29880.log 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31938.log.gz 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28059.log 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33392.log 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.29880.log.gz 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.tmp-client.admin.28059.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph.tmp-client.admin.28059.log.gz 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr: /var/log/ceph/ceph.audit.log 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.33392.log.gz 2024-05-15T18:13:41.975 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32637.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32335.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32637.log.gz 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32335.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32208.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32335.log.gz 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31290.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31290.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.32208.log.gz 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32037.log 2024-05-15T18:13:41.976 INFO:teuthology.orchestra.run.smithi003.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31290.log.gz 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31854.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32037.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32037.log.gz 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33057.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31854.log.gz 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32376.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33057.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.33057.log.gz 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32721.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32376.log.gz 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33015.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31896.log 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32721.log.gz 2024-05-15T18:13:41.977 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33310.log 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33015.log.gz 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32039.log 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.31896.log: /var/log/ceph/ceph-client.admin.33310.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31896.log.gz 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32931.log 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33310.log.gz 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29762.log 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32039.log: /var/log/ceph/ceph-client.admin.32931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32205.log 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32039.log.gz 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32931.log.gz 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.29762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33268.log 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32205.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29762.log.gz 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32847.log 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32205.log.gz 2024-05-15T18:13:41.978 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32206.log 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33268.log: /var/log/ceph/ceph-client.admin.32847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33099.log 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33268.log.gz 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32847.log.gz 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32207.log 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32206.log.gz 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32375.log 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33099.log: /var/log/ceph/ceph-client.admin.32207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.33099.log.gz 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32207.log.gz 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29923.log 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32375.log.gz 2024-05-15T18:13:41.979 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32484.log 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33352.log: /var/log/ceph/ceph-client.admin.29923.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32763.log 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.29923.log.gz 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32040.log 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32484.log: /var/log/ceph/ceph-client.admin.32763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32973.log 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32484.log.gz 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32763.log.gz 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32336.log 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32040.log.gz 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32889.log 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32679.log 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32973.log.gz 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32336.log.gz 2024-05-15T18:13:41.980 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33226.log 2024-05-15T18:13:41.981 INFO:teuthology.orchestra.run.smithi003.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32889.log.gz 2024-05-15T18:13:41.981 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.32679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31770.log 2024-05-15T18:13:41.981 INFO:teuthology.orchestra.run.smithi003.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.32679.log.gz 2024-05-15T18:13:41.981 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.admin.33226.log: /var/log/ceph/ceph-client.admin.31770.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.33226.log.gz 2024-05-15T18:13:41.981 INFO:teuthology.orchestra.run.smithi003.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31770.log.gz 2024-05-15T18:13:42.006 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83982.log 2024-05-15T18:13:42.006 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65212.log 2024-05-15T18:13:42.006 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.83982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91212.log 2024-05-15T18:13:42.007 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.65212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57347.log 2024-05-15T18:13:42.007 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.91212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70052.log 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93027.log 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.57347.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83982.log.gz 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.70052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31975.log 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.65212.log.gz 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.93027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69447.log 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91212.log.gz 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.31975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37993.log 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.31975.log.gz 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.69447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94842.log 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57347.log.gz 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.37993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82154.log 2024-05-15T18:13:42.034 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.94842.log: gzip -5 91.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.93027.log.gz /var/log/ceph/ceph-client.0.60977.log 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54927.log 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.82154.log: /var/log/ceph/ceph-client.0.60977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50087.log 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr: 93.3% 91.4% -- replaced with /var/log/ceph/ceph-client.0.37993.log.gz 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.54927.log: -- replaced with /var/log/ceph/ceph-client.0.70052.log.gz 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:gzip 91.0% -- replaced with /var/log/ceph/ceph-client.0.94842.log.gz -5 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr: --verbose -- /var/log/ceph/ceph-client.0.67027.log 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.50087.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.69447.log.gz 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72472.log 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.67027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41012.log 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60977.log.gz 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54927.log.gz 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.72472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68237.log 2024-05-15T18:13:42.035 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50087.log.gz 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.41012.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82154.log.gz 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:gzip/var/log/ceph/ceph-client.0.68237.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32055.log 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.2.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.67027.log.gz 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.0.72472.log.gz -5 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr: --verbose -- /var/log/ceph/ceph-client.0.42827.log 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.32055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44642.log 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.32055.log.gz 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.42827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77919.log 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.41012.log.gz 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.44642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53717.log 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68237.log.gz 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.77919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79734.log 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.53717.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42827.log.gz 2024-05-15T18:13:42.036 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87594.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36554.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.79734.log: /var/log/ceph/ceph-client.0.87594.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44642.log.gz 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68842.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77919.log.gz 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36554.log: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74287.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.0.87594.log.gz 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53717.log.gz 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36554.log.gz 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.68842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85797.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79734.log.gz 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59767.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.74287.log: /var/log/ceph/ceph-client.0.85797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80944.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.59767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58557.log 2024-05-15T18:13:42.037 INFO:teuthology.orchestra.run.smithi173.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.85797.log.gz 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.80944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49482.log 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68842.log.gz 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.58557.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.74287.log.gz 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.49482.log: gzip -5 91.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.59767.log.gz /var/log/ceph/ceph-client.0.80339.log 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47062.log 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80944.log.gz 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.80339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62792.log 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58557.log.gz 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.47062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60372.log 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49482.log.gz 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.62792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48877.log 2024-05-15T18:13:42.038 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.60372.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51297.log 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.0.47062.log.gz 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.48877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62187.log 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.80339.log.gz 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.51297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78524.log 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3%/var/log/ceph/ceph-client.0.62187.log: -- replaced with /var/log/ceph/ceph-client.0.62792.log.gz 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57952.log 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60372.log.gz 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48877.log.gz 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.78524.log: /var/log/ceph/ceph-client.0.57952.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.51297.log.gz 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62187.log.gz 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67632.log 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59162.log 2024-05-15T18:13:42.039 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78524.log.gz 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57952.log.gz 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.67632.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46457.log 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.59162.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.46457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97314.log 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.0.67632.log.gz 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56137.log 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.59162.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.97314.log: /var/log/ceph/ceph-client.0.56137.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46457.log.gz 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56137.log.gz 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53112.log 2024-05-15T18:13:42.040 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90607.log 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz/var/log/ceph/ceph-client.0.53112.log: 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79129.log 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.90607.log: gzip -5 93.3% -- replaced with /var/log/ceph/ceph-client.0.97314.log.gz 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr: --verbose -- /var/log/ceph/ceph-client.0.73077.log 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.73077.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.53112.log.gz 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.79129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66422.log 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mgr.x.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90607.log.gz 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79129.log.gz 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75499.log 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42222.log 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.75499.log: /var/log/ceph/ceph-client.0.66422.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.73077.log.gz 2024-05-15T18:13:42.041 INFO:teuthology.orchestra.run.smithi173.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75499.log.gz 2024-05-15T18:13:42.042 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.66422.log.gz 2024-05-15T18:13:42.042 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90002.log 2024-05-15T18:13:42.042 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61582.log 2024-05-15T18:13:42.042 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.42222.log: /var/log/ceph/ceph-client.0.90002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41617.log 2024-05-15T18:13:42.049 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.61582.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.90002.log.gz 2024-05-15T18:13:42.049 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42222.log.gz 2024-05-15T18:13:42.049 INFO:teuthology.orchestra.run.smithi173.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.61582.log.gz 2024-05-15T18:13:42.049 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64002.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94237.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.64002.log: /var/log/ceph/ceph-client.0.41617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93632.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.94237.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41617.log.gz 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.0.64002.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.54322.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94237.log.gz 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.93632.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93632.log.gz 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70657.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51902.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.54322.log: /var/log/ceph/ceph-client.0.70657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43432.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.51902.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54322.log.gz 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44037.log 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51902.log.gz 2024-05-15T18:13:42.050 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.43432.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.70657.log.gz 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43432.log.gz 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77314.log 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48272.log 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.44037.log: /var/log/ceph/ceph-client.0.77314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31935.log 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.48272.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77314.log.gz 91.1% 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.0.44037.log.gz 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55532.log 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48272.log.gz 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88193.log 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.31935.log: /var/log/ceph/ceph-client.0.55532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92422.log 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.31935.log.gz 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.88193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96052.log 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.88193.log.gz 2024-05-15T18:13:42.051 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.92422.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.55532.log.gz 2024-05-15T18:13:42.053 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92422.log.gz 2024-05-15T18:13:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74892.log 2024-05-15T18:13:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50692.log 2024-05-15T18:13:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.96052.log: /var/log/ceph/ceph-client.0.74892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52507.log 2024-05-15T18:13:42.054 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.50692.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.96052.log.gz 2024-05-15T18:13:42.054 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86995.log 2024-05-15T18:13:42.054 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.0.74892.log.gz 2024-05-15T18:13:42.054 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50692.log.gz 2024-05-15T18:13:42.055 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.52507.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52507.log.gz 2024-05-15T18:13:42.055 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85192.log 2024-05-15T18:13:42.055 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36474.log 2024-05-15T18:13:42.055 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.86995.log: /var/log/ceph/ceph-client.0.85192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37388.log 2024-05-15T18:13:42.057 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.36474.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86995.log.gz 2024-05-15T18:13:42.057 INFO:teuthology.orchestra.run.smithi173.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36474.log.gz 2024-05-15T18:13:42.057 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91817.log 2024-05-15T18:13:42.057 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65817.log 2024-05-15T18:13:42.057 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85192.log.gz 2024-05-15T18:13:42.058 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.37388.log: /var/log/ceph/ceph-client.0.91817.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.37388.log.gz 2024-05-15T18:13:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39808.log 2024-05-15T18:13:42.059 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.91817.log.gz 2024-05-15T18:13:42.060 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.65817.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65817.log.gz 2024-05-15T18:13:42.061 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71262.log 2024-05-15T18:13:42.061 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76104.log 2024-05-15T18:13:42.062 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.39808.log: /var/log/ceph/ceph-client.0.71262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84587.log 2024-05-15T18:13:42.064 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.76104.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39808.log.gz 2024-05-15T18:13:42.064 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71262.log.gz 2024-05-15T18:13:42.064 INFO:teuthology.orchestra.run.smithi173.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76104.log.gzgzip 2024-05-15T18:13:42.064 INFO:teuthology.orchestra.run.smithi173.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.40413.log 2024-05-15T18:13:42.064 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95447.log 2024-05-15T18:13:42.065 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.84587.log: /var/log/ceph/ceph-client.0.40413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83377.log 2024-05-15T18:13:42.065 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.95447.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.40413.log.gz 2024-05-15T18:13:42.066 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95447.log.gz 2024-05-15T18:13:42.066 INFO:teuthology.orchestra.run.smithi173.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.84587.log.gz 2024-05-15T18:13:42.067 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82759.log 2024-05-15T18:13:42.067 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88792.log 2024-05-15T18:13:42.068 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.83377.log: /var/log/ceph/ceph-client.0.82759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32015.log 2024-05-15T18:13:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.88792.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.83377.log.gz 2024-05-15T18:13:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89397.log 2024-05-15T18:13:42.070 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88792.log.gz 2024-05-15T18:13:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.32015.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.32015.log.gz 2024-05-15T18:13:42.070 INFO:teuthology.orchestra.run.smithi173.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82759.log.gz 2024-05-15T18:13:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64607.log 2024-05-15T18:13:42.071 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47667.log 2024-05-15T18:13:42.071 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.89397.log: /var/log/ceph/ceph-client.0.64607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71867.log 2024-05-15T18:13:42.072 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.47667.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.89397.log.gz 2024-05-15T18:13:42.072 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64607.log.gz 2024-05-15T18:13:42.073 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36514.log 2024-05-15T18:13:42.074 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47667.log.gz 2024-05-15T18:13:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76709.log 2024-05-15T18:13:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.71867.log: /var/log/ceph/ceph-client.admin.36514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56742.log 2024-05-15T18:13:42.074 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.76709.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36514.log.gz 2024-05-15T18:13:42.074 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71867.log.gz 2024-05-15T18:13:42.075 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76709.log.gz 2024-05-15T18:13:42.075 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45852.log 2024-05-15T18:13:42.076 INFO:teuthology.orchestra.run.smithi173.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-15T18:13:42.076 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63397.log 2024-05-15T18:13:42.076 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.56742.log: /var/log/ceph/ceph-client.0.45852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96657.log 2024-05-15T18:13:42.076 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.63397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39203.log 2024-05-15T18:13:42.077 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.96657.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45852.log.gz 2024-05-15T18:13:42.077 INFO:teuthology.orchestra.run.smithi173.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63397.log.gz 2024-05-15T18:13:42.077 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56742.log.gz 2024-05-15T18:13:42.079 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45247.log 2024-05-15T18:13:42.079 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.96657.log.gz 2024-05-15T18:13:42.079 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86396.log 2024-05-15T18:13:42.079 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.39203.log: /var/log/ceph/ceph-client.0.45247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73682.log 2024-05-15T18:13:42.079 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.86396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81549.log 2024-05-15T18:13:42.081 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.73682.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.86396.log.gz 2024-05-15T18:13:42.081 INFO:teuthology.orchestra.run.smithi173.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45247.log.gz 2024-05-15T18:13:42.081 INFO:teuthology.orchestra.run.smithi173.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39203.log.gz 2024-05-15T18:13:42.081 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73682.log.gz 2024-05-15T18:13:42.081 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38598.log 2024-05-15T18:13:42.082 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.0.81549.log: /var/log/ceph/ceph-client.0.38598.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81549.log.gz 2024-05-15T18:13:42.083 INFO:teuthology.orchestra.run.smithi173.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38598.log.gz 2024-05-15T18:13:42.087 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-15T18:13:42.141 INFO:teuthology.orchestra.run.smithi003.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-15T18:13:42.800 INFO:teuthology.orchestra.run.smithi173.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-15T18:13:42.925 INFO:teuthology.orchestra.run.smithi003.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-15T18:13:42.926 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-05-15T18:13:42.927 INFO:teuthology.orchestra.run.smithi003.stderr:real 0m0.981s 2024-05-15T18:13:42.927 INFO:teuthology.orchestra.run.smithi003.stderr:user 0m1.133s 2024-05-15T18:13:42.927 INFO:teuthology.orchestra.run.smithi003.stderr:sys 0m0.074s 2024-05-15T18:13:42.952 INFO:teuthology.orchestra.run.smithi173.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-15T18:13:42.955 INFO:teuthology.orchestra.run.smithi173.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-15T18:13:42.957 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-05-15T18:13:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m0.961s 2024-05-15T18:13:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m2.801s 2024-05-15T18:13:42.957 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.211s 2024-05-15T18:13:42.957 INFO:tasks.ceph:Archiving logs... 2024-05-15T18:13:42.957 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/remote/smithi003/log 2024-05-15T18:13:42.959 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T18:13:43.190 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/remote/smithi173/log 2024-05-15T18:13:43.190 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T18:13:43.717 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-15T18:13:43.728 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-15T18:13:43.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T18:13:43.731 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T18:13:43.804 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-15T18:13:43.813 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-15T18:13:43.813 DEBUG:teuthology.orchestra.run.smithi003:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T18:13:43.816 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T18:13:43.829 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-05-15T18:13:43.830 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-05-15T18:13:43.834 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T18:13:43.834 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-05-15T18:13:43.834 INFO:teuthology.orchestra.run.smithi003.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +497us[ +495us] +/- 57ms 2024-05-15T18:13:43.834 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 -1291us[-1291us] +/- 59ms 2024-05-15T18:13:43.834 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +1119us[+1119us] +/- 85ms 2024-05-15T18:13:43.834 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:13:43.836 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T18:13:43.836 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-05-15T18:13:43.836 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +498us[ +501us] +/- 57ms 2024-05-15T18:13:43.836 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -1288us[-1285us] +/- 59ms 2024-05-15T18:13:43.836 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +1129us[+1132us] +/- 85ms 2024-05-15T18:13:43.836 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T18:13:43.836 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-15T18:13:43.847 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-15T18:13:43.848 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-15T18:13:43.856 DEBUG:teuthology.orchestra.run.smithi003:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T18:13:43.939 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T18:13:43.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T18:13:44.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T18:13:44.029 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T18:13:44.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T18:13:44.057 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-15T18:13:44.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-15T18:13:44.076 INFO:teuthology.task.internal:Duration was 1173.659008 seconds 2024-05-15T18:13:44.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-15T18:13:44.122 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-15T18:13:44.122 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T18:13:44.125 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T18:13:44.163 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T18:13:44.163 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T18:13:44.457 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-15T18:13:44.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi003.front.sepia.ceph.com 2024-05-15T18:13:44.457 DEBUG:teuthology.orchestra.run.smithi003:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T18:13:44.478 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-05-15T18:13:44.479 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T18:13:44.519 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-15T18:13:44.520 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T18:13:44.522 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T18:13:44.586 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-15T18:13:44.586 DEBUG:teuthology.orchestra.run.smithi003:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T18:13:44.589 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T18:13:44.720 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-15T18:13:44.731 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-15T18:13:44.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T18:13:44.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T18:13:44.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-15T18:13:44.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T18:13:44.799 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T18:13:44.821 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = core 2024-05-15T18:13:44.845 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-05-15T18:13:44.873 DEBUG:teuthology.orchestra.run.smithi003:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T18:13:44.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T18:13:44.898 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T18:13:44.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T18:13:44.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-15T18:13:44.939 INFO:teuthology.task.internal:Transferring archived files... 2024-05-15T18:13:44.940 DEBUG:teuthology.misc:Transferring archived files from smithi003:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/remote/smithi003 2024-05-15T18:13:44.940 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T18:13:44.975 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-15_17:01:13-rgw-wip-65996-squid-distro-default-smithi/7707331/remote/smithi173 2024-05-15T18:13:44.975 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T18:13:45.008 INFO:teuthology.task.internal:Removing archive directory... 2024-05-15T18:13:45.008 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T18:13:45.012 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T18:13:45.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-15T18:13:45.074 INFO:teuthology.task.internal:Not uploading archives. 2024-05-15T18:13:45.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-15T18:13:45.085 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-15T18:13:45.086 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T18:13:45.088 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T18:13:45.101 INFO:teuthology.orchestra.run.smithi003.stdout: 265746 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 18:13 /home/ubuntu/cephtest 2024-05-15T18:13:45.113 INFO:teuthology.orchestra.run.smithi173.stdout: 265701 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 18:13 /home/ubuntu/cephtest 2024-05-15T18:13:45.115 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-15T18:13:45.125 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-15T18:13:45.149 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 1173.6590082645416 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-05-15T18:13:45.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T18:13:45.231 INFO:teuthology.run:pass